Senior Data Engineer – Big Data & Cloud Technologies

Senior Data Engineer – Big Data & Cloud Technologies Krakow Hybrid English Senior Banking, Corporate Banking Data Engineer Unleash the Power of Data — Shape the Future of Big Data & Cloud Innovation! Krakow-based opportunity with hybrid work model, allowing up to 3 days remote per week. As a Senior Data Engineer, you will be working for our client, a leading player in the data and analytics industry. You will contribute to designing and building scalable, high-performance data pipelines that drive business insights and innovation. This role offers a unique chance to be at the forefront of big data and cloud technologies, shaping meaningful solutions for global clients. Your main responsibilities: Develop and optimize data pipelines using PySpark, Scala, and Hadoop components to support scalable analytics solutions. Work with Apache Spark, Hive, YARN, and ETL frameworks to process large datasets efficiently. Collaborate with Business Analysts to interpret requirements and translate them into technical solutions. Implement and maintain automated testing, deployment, and monitoring tools to ensure system reliability. Provide production support, troubleshoot issues, and improve performance and scalability. Participate actively in Agile rituals, including sprint planning, reviews, and retrospectives. Contribute to system architecture and design discussions, ensuring best practices and standards. You're ideal for this role if you have: 4+ years of experience in data engineering or similar roles. Strong proficiency in PySpark or Scala development and design. Hands-on experience with scheduling tools such as Airflow. Knowledge of Hadoop ecosystem components (Hive, Spark, Spark SQL, YARN). Experience with SQL, RESTful services, and Unix/Linux environments. Familiarity with version control (Git, GitHub), CI/CD tools (Jenkins, Ansible), and requirement management systems (JIRA). It is a strong plus if you have: (optional) Experience with Elasticsearch. Development experience with Java APIs. Knowledge of data ingestion techniques. Understanding of cloud design patterns. Exposure to DevOps methodologies and Agile practices like Scrum and Kanban. Language Required for the role: Fluent in English. Eligibility for the role: Only candidates with an existing legal right to work in Europe will be considered for this role. #MAKEYourCareerBETTER Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.