About the Role
<h3>About the role</h3><p>We are looking for a Senior Data Engineer with strong Databricks experience to build and optimize modern data platforms. You will develop scalable ETL/ELT pipelines, process large datasets and contribute to the evolution of cloud-native Data Engineering solutions.</p><h3>Responsibilities:</h3><ul><li><p>Design, develop and maintain scalable ETL/ELT pipelines</p></li><li><p>Build reliable batch and streaming data processing solutions</p></li><li><p>Develop data pipelines using Databricks and Apache Spark</p></li><li><p>Optimize Spark jobs and improve platform performance</p></li><li><p>Work with Delta Lake and Medallion Architecture</p></li><li><p>Build and maintain data models for analytics and reporting</p></li><li><p>Ensure data quality, monitoring and observability</p></li><li><p>Collaborate with Architects, Data Scientists and Analytics teams</p></li><li><p>Participate in code reviews and technical improvements</p></li><li><p>Contribute to CI/CD processes and engineering best practices</p></li></ul><h3>Requirements:</h3><ul><li><p>5+ years of experience in Data Engineering</p></li><li><p>2+ years of commercial experience with Databricks</p></li><li><p>Strong knowledge of PySpark and Spark SQL</p></li><li><p>Excellent SQL skills</p></li><li><p>Strong Python programming skills</p></li><li><p>Experience building ETL/ELT pipelines</p></li><li><p>Experience working with Delta Lake</p></li><li><p>Good understanding of Medallion Architecture</p></li><li><p>Experience with cloud environments (Azure, AWS or GCP)</p></li><li><p>Experience with Git and CI/CD</p></li><li><p>Understanding of data modelling principles</p></li><li><p>Good communication skills</p></li><li><p>Fluent English - C1 </p></li></ul><h3>Nice to have:</h3><ul><li><p>Unity Catalog experience</p></li><li><p>dbt</p></li><li><p>Kafka or Structured Streaming</p></li><li><p>Airflow or Databricks Workflows</p></li><li><p>Databricks certification</p></li><li><p>Experience with performance tuning and cost optimization</p></li></ul>