Development Expert - PySpark Data Engineering (Analytics) Bangalore North

Job Description

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

Job Title: Development Expert – Data Engineering (Analytics)

Work Location: Bangalore North – Devanahalli Innovation Campus

What you’ll build

In this role, you’ll design and deliver scalable data architectures that power advanced analytics and intelligent automation across enterprise HR platforms. Your work will directly enable reliable, high‑performance data pipelines and AI‑driven capabilities that improve workforce insights and business decision‑making.

• Design, build, and optimize enterprise‑scale ETL/ELT pipelines that ensure reliable and scalable data delivery across environments
• Develop semantic data models including data flows, SQL‑based views, physical tables, and governed access controls
• Create AI‑driven and agent‑based solutions to automate metadata generation, intelligent validation, data product creation, and impact analysis
• Integrate data from multiple enterprise platforms and design transformation frameworks to produce high‑quality, governed data assets
• Improve performance of batch and real‑time pipelines to enable low‑latency, high‑throughput distributed data processing
• Manage and process large datasets using SQL and modern big data technologies such as Hive, HBase, and Parquet
• Establish best practices for data validation, observability, schema evolution, and pipeline monitoring
• Drive engineering excellence through CI/CD automation, infrastructure‑as‑code, and reliable deployment practices
• Collaborate with data scientists, analysts, architects, and platform engineers to deliver production‑grade software products
• Mentor engineers and promote best practices in modern data engineering, AI integration, and DevOps methodologies

What you bring

• You bring strong technical expertise in modern data engineering along with a collaborative mindset and passion for building reliable, scalable systems.
• Proficiency in Python or Scala with hands‑on experience building scalable ETL/ELT pipelines or data services
• Strong knowledge of Apache Spark, Kafka, Airflow, and advanced SQL for workflow orchestration and data processing
• Experience working with distributed systems, data lake architectures, and large‑scale storage formats such as Hive or Parquet
• Familiarity with integrating AI/ML workflows into enterprise data pipelines and building LLM‑powered applications
• Experience with CI/CD tools such as Git, Jenkins, Docker, or Kubernetes and infrastructure automation practices
• Strong problem‑solving skills with the ability to optimize system performance, reliability, and throughput
• Ability to collaborate across cross‑functional teams to resolve complex integration challenges

Education & Experience

• Bachelor’s or Master’s degree in Computer Science or a related field
• 12+ years of professional experience in software or data engineering
• Strong written and verbal communication skills

Where you belong

You’ll be part of a collaborative engineering team focused on building scalable, user‑friendly analytics solutions that help organizations better understand workforce dynamics and align people strategies with business goals. In this team, you will: Work closely with cross‑functional experts across analytics, platform engineering, and product teams Contribute to scalable, cloud‑based analytics solutions used by organizations globally Help shape best practices for data engineering, AI adoption, and DevOps excellence Mentor team members and support a culture of continuous learning and innovation Build software products that enable organizations to make informed, strategic workforce decisions

#LI-RA2 #DevT4 #LifeAtSAP #DataEngineeringCareers #CloudEngineering #AIEngineering #AnalyticsEngineering

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 447483 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid