Senior Data Engineer
Epam • Revolutionizing the delivery of the digital products
About the Role
We are hiring a Data Engineer, who will support a critical digital transformation project for one of EPAM’s top clients.
This is a high-impact role, with the opportunity to advance your skills and grow within a global organization. If you'd like to learn more about this position and project, apply now! Connect with a recruiter today!
Req.#739031841
#LI-DNI
Responsibilities
- Design and implement data pipelines to support data-driven decision-making.
- Manage and secure data, ensuring reliable and accurate access for stakeholders.
- Develop and maintain Spark/PySpark and SQL-based data solutions.
- Utilize Azure SQL Server, Synapse, and other cloud-based data platforms for data storage and processing.
- Work collaboratively with cross-functional teams to build scalable, efficient data solutions.
- Ensure fault tolerance and data availability across regions and availability zones.
- Develop and optimize SQL queries, with expertise in clustered column store tables.
- Analyze unstructured data to extract valuable insights and relationships.
- Implement and manage real-time data streams using Kafka, Event Hubs, and Stream Analytics.
- Develop and support serverless computing solutions using Azure Functions or similar technologies.
Requirements
- Bachelor’s degree in a related field (e.g., Computer Science, Engineering).
- 6-8 years of relevant work experience in data engineering.
- Proven experience working with cloud-based data engineering tools and platforms.
- Strong familiarity with Spark, PySpark, and SQL technologies (Databricks, Azure Synapse, SQL Server).
- Experience with streaming technologies such as Kafka and Event Hubs.
- Solid understanding of fault-tolerant infrastructure and data availability.
- Expertise in Python and PySpark programming languages.
- Proficient in SQL and database performance optimization.
- Knowledge of data extraction techniques for unstructured data.
- Strong communication, analytical, and problem-solving skills.
We Offer
- Extended Healthcare with Prescription Drugs, Dental and Vision, and Healthcare Spending Account (Company Paid).
- Life and AD&D Insurance (Company Paid).
- Employee Assistance Program (Company Paid).
- Telehealth (Company Paid).
- Short-term Disability (Company Paid).
- Long-Term Disability.
- Paid Time Off (including vacation and sick days).
- Registered Retirement Savings Plan (RRSP) with Company match.
- Maternity/Parental/Adoption Leave Top-up.
- Employee Stock Purchase Program.
- Critical Illness Insurance.
- Employee Discounts.
- Unlimited access to LinkedIn learning solutions.
About Us
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here, you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.