Senior Data Engineer

Illumina · India - Bengaluru - Manyata

India - Bengaluru - Manyata6+ yearsPosted 16 Nov 2026Last checked 22 Nov 2026

Free account: apply link, HR contact and an AI-written cold email

About the role

What if the work you did every day could impact the lives of people you know? Or all of humanity? At Illumina, we are expanding access to genomic technology to realize health equity for billions of people around the world. Our efforts enable life-changing discoveries that are transforming human health through the early detection and diagnosis of diseases and new treatment options for patients. Working at Illumina means being part of something bigger than yourself. Every person, in every role, has the opportunity to make a difference. Surrounded by extraordinary people, inspiring leaders, and world changing projects, you will do more and become more than you ever thought possible. Position Summary: The Senior Data Engineer will be part of the Data Engineering and Analytics team, designing, building, validating, and supporting enterprise data pipelines that integrate SAP S/4HANA data into the Databricks Lakehouse through SAP Datasphere and Amazon S3. The engineer owns assigned SAP datasets end to end, from source analysis and ingestion through reconciliation, testing, release, and production support, within approved architecture, security, and change-control standards. The role partners with SAP, platform, architecture, governance, and business teams, leads complex troubleshooting and continuous improvement, and provides technical guidance to other engineers. Responsibilities: Own end-to-end onboarding of assigned SAP objects following the standard onboarding runbook, including source analysis, CDS wrapper view creation, Datasphere replication flow setup, Bronze ingestion configuration, validation, and sign-off. Design, build, and maintain Bronze ingestion pipelines in Databricks (Auto Loader, Lakeflow Declarative Pipelines, PySpark, Delta Lake) for full, delta, CDC, and watermark loads, handling restartability, deletes, and schema changes within approved design patterns. Operate and monitor Datasphere replication flows into Amazon S3, recover failed runs, and work with the platform administration team to resolve connectivity and capacity issues. Run source-to-Bronze reconciliation as a continuous control; review PASS/FAIL results, investigate aggregate and record-level discrepancies, and document corrective actions. Plan and execute SIT/UAT scenarios covering full loads, deltas, deletes, and field additions or removals; reconcile SAP validation output against Bronze data and compile acceptance evidence. Monitor pipeline observability dashboards and alerts; resolve ingestion failures and schema drift, lead root cause analysis (RCA) for complex issues, and implement preventive actions. Promote all changes through Git and CI/CD, review peer code and configurations, and apply approved Unity Catalog access controls for assigned datasets. Develop automation and reusable components that improve onboarding, reconciliation, monitoring, and recovery.

Skills mentioned

  • Python
  • SQL
  • CI/CD
  • Spark
  • SAP
  • Git

Want to reach Illumina's HR directly?

NextKnock finds the hiring contact and writes a personal cold email from your resume. You send it from your own Gmail.

Similar jobs

More jobs at Illumina

All Illumina jobs and company facts →

Browse more