Java/Spark Big Data Developer

<p>Correct Context is looking for a <strong>Java/Spark Big Data&nbsp;Developer</strong> for Comscore in Poland and around.</p><p>Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.</p><p>Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.</p><p><strong>We offer:</strong></p><ul><li><p>Real big data projects, petabytes scale 🚀</p></li><li><p>An international team 🌎</p></li><li><p>A small, independent team working environment 🧑‍💻</p></li><li><p>Flexible work time ⏰</p></li><li><p>Fully remote or in-office work in Wroclaw, Poland 🏢</p></li><li><p>18,000 - 25,000 PLN net/month B2B 💰</p></li><li><p>Multikafeteria 🍽️</p></li><li><p>Private healthcare 🏥</p></li><li><p>Free parking 🚗</p></li></ul><p><strong>As a Java Developer, you will:</strong></p><ul><li><p>Taking care of our high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines</p></li><li><p>Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance</p></li><li><p>Work with distributed systems, contributing to the design and implementation of backend solutions</p></li><li><p>Collaborate with cross-functional teams to integrate different platforms and ensure smooth data flow</p></li><li><p>Troubleshoot and debug issues to improve overall system stability</p></li><li><p>Participate in code reviews and offer guidance on best practices</p></li><li><p>Debug java/aws/airflow pipelines</p></li><li><p>Help team to produce better solutions (teaching/code reviews/showing directions)</p></li><li><p>Design high efficient processing pipelines</p></li></ul><p><strong>The candidate must have:</strong></p><ul><li><p>Linux as a daily driver of operations</p></li><li><p>Good understanding of Spark internals and mechanics</p></li><li><p>Experience with Apache Iceberg (or similar)</p></li><li><p>Proven ability to debug JVM/Java (hopefully in Spark ecosystem)</p></li><li><p>Hands-on, proactive approach</p></li></ul><p><strong>The recruitment process for the Java Developer position has following steps</strong>:</p><ol><li><p>Technical survey ~ 10min</p></li><li><p>Technical screening - 30 min</p></li><li><p>Technical interview - 1h-2h</p></li></ol><p>If you think you’re a good fit, but don’t meet all the qualifications, let’s talk!</p><p></p>