Senior Data Consultant (Python, GCP, Airflow)
Senior Data Consultant (Python, GCP, Airflow)
Kraków, PL, 30-302
Contract type: B2B
Salary range: 125-163 PLN/h
What will you do?
You will join a modern data platform initiative focused on building scalable data solutions in Google Cloud Platform. The project involves designing robust data pipelines, developing data models, and ensuring reliable and high-quality data for business decision-making. You will collaborate with cross-functional teams to deliver efficient and maintainable data architecture.
Your tasks:
- Design, develop, and maintain scalable data pipelines and ETL processes
- Build and manage Apache Airflow DAGs for workflow orchestration
- Develop data processing logic using Python and frameworks like DBT or Spark
- Work with BigQuery and Cloud SQL to store and transform data
- Implement and maintain data architecture and data models
- Ensure data quality, integrity, and reliability
- Collaborate with business stakeholders to translate requirements into data solutions
- Maintain technical documentation and contribute to data standards
- Support deployment and monitoring of pipelines in GCP environments
- Participate in code reviews and improve engineering best practices
Requirements:
- Strong proficiency in Python for backend or data processing
- Hands-on experience with Google Cloud Platform including BigQuery, Cloud Storage, Compute Engine or GKE
- Experience with Apache Airflow for workflow orchestration
- Strong experience with ETL and data integration pipelines
- Experience with Spark
- Knowledge of NoSQL databases
- Strong knowledge of relational databases
- Strong understanding of data architecture
- Good understanding of data quality
- Strong understanding of data integration
- Openness to work 4 days a month from our client's office (Kraków)
Nice to have skills:
- Familiarity with Apache Beam