/Databricks Data Engineer/Architect

Databricks Data Engineer/Architect

Wrocław, PLplvia direct
// Job Type
Full Time
// Salary
Not disclosed
// Posted
5 months ago

About the Role

<h3><strong>Tech stack:</strong></h3><ul><li><p>Databricks (Unity Catalog, Delta Live Tables)</p></li><li><p>Python (PySpark), SQL</p></li><li><p>Azure, AWS, or GCP</p></li><li><p>Data Lakehouse, Data Mesh, Data Marts</p></li><li><p>DevOps, CI/CD Pipelines</p></li><li><p>Agile (Scrum/Kanban)</p></li></ul><h3><strong>Requirements:</strong></h3><ul><li><p>At least <strong>8 years</strong> in Data Engineering, with a minimum of <strong>2 years</strong> specifically in Big Data environments.</p></li><li><p><strong>4+ years</strong> of hands-on experience with Databricks services, including data pipelines and Unity Catalog.</p></li><li><p>Expert-level skills in <strong>Python</strong> and <strong>SQL</strong>.</p></li><li><p>Strong background in Data Warehousing, ETL, and distributed data processing.</p></li><li><p>Deep understanding of Data Lakes, Data Warehouses, and <strong>Data Mesh</strong> concepts.</p></li><li><p>Experience with at least one public cloud (Azure, AWS, or GCP) and strong design skills for both relational and non-relational storage.</p></li><li><p>Analytical mindset capable of troubleshooting complex issues in a big data landscape.</p></li><li><p>Very good verbal and written <strong>English</strong> B2/C1</p></li><li><p>Experience working in Agile (Scrum/Kanban) environments.</p></li></ul><h3><strong>Project description:</strong></h3><p>Join our data engineering team as we develop and scale our enterprise data platform. We are building a high-performance ecosystem designed to manage large-scale datasets, ranging from structured to unstructured formats. In this role, you will help modernize our data infrastructure by implementing cutting-edge storage and processing solutions. You will play a key part in designing how we ingest, process, and govern data to provide reliable insights across the organization.</p><h3><strong>Main responsibilities:</strong></h3><ul><li><p>Design and maintain robust data pipelines and distributed data processing systems using Databricks.</p></li><li><p>Implement and manage data governance and security frameworks via <strong>Unity Catalog</strong>.</p></li><li><p>Develop sophisticated data models (Relational and Non-Relational) to support complex analytical requirements.</p></li><li><p>Improve the performance and reliability of Big Data workflows and ETL processes.</p></li><li><p>Work within an Agile environment, integrating DevOps and CI/CD principles into the data lifecycle.</p></li><li><p>Act as a subject matter expert, guiding the team through complex big data challenges and architectural decisions.</p></li></ul>

Interested in this job?

Login to Apply

Use our AI to tailor your resume for this Databricks Data Engineer/Architect position at Spyrosoft.