Sr Software Engineer

Post Sr Software Engineer Job Category: Data Engineering Requisition Number: SRSOF017933 Apply now Posting Details Posted: February 24, 2026 Full-Time Locations Showing 1 location Bangalore, KA 560066, IND Job Details Description Sr Software Engineer Let’s be unstoppable together! Circana is a leading provider of technology, AI, and data solutions for consumer packaged goods companies, manufacturers, and retailers. Our predictive analytics and Liquid Data® platform help clients measure market share, uncover consumer behavior, and drive growth—powered by six decades of expertise and an expansive, high-quality data set. At Circana, we are fueled by our passion for continuous learning and growth, we seek and share feedback freely, and we celebrate victories both big and small in an environment that is flexible and accommodating to our work and personal lives.  We’re a global company dedicated to fostering inclusivity and belonging. We value and celebrate the unique experiences, cultures, and viewpoints that each individual brings. By embracing a wide range of backgrounds, skills, expertise, and beyond, we create a stronger, more innovative environment for our employees, clients, and communities. With us, you can always bring your full self to work.  Join our inclusive, committed team to be a challenger, own outcomes, and stay curious together. Circana is proud to be Certified™ by Great Place To Work®. This prestigious award is based entirely on what current employees say about their experience working at Circana. Learn more at www.circana.com. Job Summary:  We are seeking a skilled and motivated Data Engineer to join our growing team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and infrastructure on the On-Premises and cloud platform. You will leverage your expertise in PySpark, Spark, Python and Apache Airflow to process and orchestrate large-scale data workloads, ensuring data quality, efficiency, and scalability. If you have a passion for data engineering and a desire to make a significant impact, we encourage you to apply!   Key Responsibilities: Data Engineering & Data Pipeline Development  Design, develop, and optimize scalable DATA workflows using Python, PySpark, and Airflow Implement real-time and batch data processing using Spark Enforce best practices for data quality, governance, and security throughout the data lifecycle Ensure data availability, reliability and performance through monitoring and automation. Cloud Data Engineering : Manage cloud infrastructure and cost optimization for data processing workloads Implement CI/CD pipelines for data workflows to ensure smooth and reliable deployments. Big Data & Analytics:  Build and optimize large-scale data processing pipelines using Apache Spark and PySpark  Implement data partitioning, caching, and performance tuning for Spark-based workloads. Work with diverse data formats (structured and unstructured) to support advanced analytics and machine learning initiatives. .Workflow Orchestration (Airflow)  Design and maintain DAGs (Directed Acyclic Graphs) in Airflow to automate complex data workflows Monitor, troubleshoot, and optimize job execution and dependencies Required Skills & Experience:  4+ years of experience in data engineering with expertise in PySpark, Spark. Strong programming skills in Python, SQL with the ability to write efficient and maintainable code Deep understanding of Spark internals (RDDs, DataFrames, DAG execution, partitioning, etc.) Experience with Airflow DAGs, scheduling, and dependency management Knowledge of Git, Docker, Kubernetes, and apply best practices of DevOps for CI/CD workflows Experience in cloud platform like Azure/AWS is favourable. Excellent problem-solving skills and ability to optimize large-scale data processing.  Experience in Agile/Scrum environments Strong communication and collaboration skills, with the ability to effectively work with remote teams Bonus Points: Experience with data modeling and data warehousing concepts Familiarity with data visualization tools and techniques Knowledge of machine learning algorithms and frameworks