About the Role
Unleash the power of cloud innovation — lead Data Modernization in Azure!Warszawa-based opportunity with a hybrid work model (3 remote days per week)As a Senior Azure Data Engineer, you will be working for our client, a global financial technology leader providing infrastructure and services for capital markets, payments, and financial information management. You will be instrumental in a high-impact cloud modernization initiative focused on migrating legacy Cloudera and Hadoop data environments to a state-of-the-art Azure ecosystem. This project aims to redesign data architectures that support scalable BI analytics, regulatory reporting, and metadata-driven automation across multiple geographies, all while upholding strict data governance and performance standards.Your main responsibilities:Lead the migration of on-premises Cloudera and Hadoop data platforms to Azure DatabricksDesign and implement scalable ETL/ELT frameworks based on medallion architecture principlesDevelop metadata-driven data ingestion, transformation, and quality validation pipelinesAutomate deployment and orchestration using CI/CD pipelines and DevOps toolsCollaborate with business and IT stakeholders to translate data requirements into robust technical solutionsOptimize and refactor Spark and PySpark code to improve performance and cost efficiencyEnsure data security, compliance, and governance across all data layersMentor and guide data engineers in best practices for data lakehouse developmentSupport end-to-end data delivery from ingestion to BI and API publicationDrive innovation by identifying automation opportunities and platform improvementsYou're ideal for this role if you have:Proven experience in large-scale data platform migration and modernization projectsDeep expertise in Azure Databricks, Delta Lake, and Azure Data FactoryStrong programming skills in Python, PySpark, and SQLHands-on experience with CI/CD pipelines using Azure DevOps, GitHub, or JenkinsSolid understanding of medallion architecture and metadata-driven data engineeringFamiliarity with orchestration tools such as Airflow or Azure Data FactoryStrong knowledge of data governance, lineage, and regulatory compliance frameworksExcellent analytical and problem-solving abilities in complex data environmentsAbility to collaborate effectively with cross-functional and business teamsA degree in Computer Science, Engineering, or a related technical disciplineIt is a strong plus if you have:Experience with Hadoop, Cloudera, or Prometheus (hosting on local servers is acceptable)Certifications in Azure or Data EngineeringLanguage Required for the role:Polish (fluent / communicative)English (fluent / communicative)Eligibility for the role:Only candidates with an existing legal right to work in the European Union will be considered for this role.#MAKEYourCareerBETTERInterested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.We offer you: ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in the financial industry in Europe. We offer an environment for professional, ambitious, and driven people. The offer includes: Stable and long-term cooperation with very good conditions Enhance your skills and develop your expertise in the financial industry Work on the most strategic projects available in the market Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years Participate in Social Events, training, and work in an international environment Access to attractive Medical Package Access to Multisport Program Access to Pluralsight Flexible hours & remote work Internal number #8446You can report violations in accordance with ITDS’s Whistleblower Procedure available here.