Senior AI Engineer with Databricks

About the role

EPAM is looking for a Senior AI Engineer with strong expertise in Databricks to design, deploy, and operate production‑grade machine learning systems. The role focuses on building robust feature engineering pipelines, model training, and real‑time inference solutions.

Key responsibilities

• Design and optimise feature engineering pipelines for batch and real‑time workloads.
• Build, deploy and maintain scalable model training and inference pipelines.
• Process structured and unstructured data at scale using Spark and Databricks.
• Develop streaming solutions with Spark Streaming to enable real‑time feature generation and model serving.
• Ensure reliability, scalability and performance of ML solutions in production.
• Support batch pipelines for model training and retraining, and operate production ML systems.

Required profile

• 5+ years of experience building, deploying and operating offline and online feature engineering pipelines.
• Strong experience with model training and real‑time inferencing pipelines.
• Hands‑on expertise in Databricks, Spark/PySpark, Python and SQL.
• Experience processing large‑scale unstructured data and using Spark Streaming.
• Proven track record of running production‑grade ML systems.
• English proficiency at B2 level or higher.

Required skills

• Databricks
• Apache Spark / PySpark
• Python
• SQL
• Spark Streaming
• AWS (nice to have)
• MLflow
• MLOps practices

What we offer

• Continuous upskilling, learning & development programs.
• Diverse tasks and projects with assessment centre reviews.
• Personal development plan, mentoring and leadership development.
• Certification support and access to 2,500+ internal courses.
• Competitive USD compensation, regular salary and performance reviews.
• Private health insurance and well‑being events.
• Recreation areas, kitchens, sports equipment and IT equipment.