Senior Data Engineer (Automation)

Job Description

We help the world run better

At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the foundation for tomorrow and creating a workplace that embraces differences, values flexibility, and is aligned to our purpose-driven and future-focused work. We offer a highly collaborative, caring team environment with a strong focus on learning and development, recognition for your individual contributions, and a variety of benefit options for you to choose from.

ABOUT SAP SUCCESSFACTORS

SAP SuccessFactors is a leading cloud-based Human Capital Management (HCM) software suite that provides comprehensive solutions for HR processes, including talent management, workforce analytics, and employee experience. With over 12,000 customers across diverse industries and 191 million users in more than 200 countries, SuccessFactors is trusted by organizations of all sizes. Its flexibility allows it to cater to both large enterprises and mid-market companies, offering scalable solutions that can be tailored to meet specific business needs.

The platform supports various HR functions, such as recruitment, performance management, learning and development, and compensation, all in a global, user-friendly environment. SAP SuccessFactors is designed to be scalable and adaptable, helping organizations improve HR processes while ensuring compliance with international regulations. Its widespread adoption and industry-specific capabilities make it a critical tool for companies looking to optimize their workforce management strategies.

ABOUT HCM ANALYTICS TEAM

The SAP SuccessFactors HCM Analytics team is responsible for delivering powerful, data-driven insights to help organizations optimize their HR processes. This team focuses on developing and enhancing advanced analytics tools within the SuccessFactors suite, enabling businesses to leverage workforce data for better decision-making. By providing actionable insights into talent management, employee performance, workforce trends, and organizational health, the HCM Analytics team plays a key role in driving HR transformation and improving operational efficiency. Their work supports HR leaders in aligning people strategies with business objectives, fostering a data-centric culture within the organization.

The team collaborates with various departments to ensure the development of user-friendly, scalable analytics solutions that meet the unique needs of businesses globally. Their expertise in HR data analysis, predictive modeling, and reporting allows organizations to gain a deeper understanding of their workforce dynamics and make more informed, strategic HR decisions. The SuccessFactors HCM Analytics team is committed to continuously enhancing the platform's capabilities to provide customers with the tools they need to stay ahead in today’s competitive and rapidly evolving business environment.

POSITION OVERVIEW

As a Lead QA Engineer for the Data Engineering team responsible for building analytical solutions for SAP SuccessFactors, you will be expected to ensure the highest quality of data pipelines and analytics systems. Your role involves buidling end-to-end quality assurance processes, from validating data extraction and transformation to performance testing and troubleshooting.

RESPONSIBILITIES

• Data Pipeline Testing: Validate ETL processes for accuracy, test big data pipelines using Spark, Hive, and HBase, and implement automated tests (Pytest/JUnit) to support continuous integration.
• Data Quality Assurance: Ensure data consistency, integrity, and accuracy across pipelines and verify correctness from source to target systems.
• Performance and Scalability Testing: Test pipeline throughput, latency, and performance under high data volumes through load testing to ensure scalability and system stability.
• Data Engineering Validation: Ensure data conforms to schemas, formats, and business requirements, and validate data cleansing and transformation processes.
• Integration Testing: Test data flow between microservices and validate both batch and streaming data for operational consistency.
• System Integration Testing (SIT): Perform SIT as part of the CI/CD pipeline to validate the integrated components of data pipelines and ensure seamless system interactions.
• API and Microservices Testing: Validate the functionality, security, and performance of APIs and microservices, ensuring smooth communication and data flow between services in the data pipeline.
• Monitoring and Troubleshooting: Use monitoring tools like Splunk and Dynatrace to track pipeline health, and perform log analysis for troubleshooting errors in pipelines or APIs.

SKILLS & COMPETIENCES

• Data Engineering: Deep understanding of ETL processes, big data technologies (Spark, Hive, HBase), and data validation.
• Automation Tools: Experience with Pytest, JUnit, or similar frameworks to automate testing in CI/CD environments.
• Performance Testing: Proficiency in load and performance testing tools to simulate high-volume data scenarios.
• System Integration Testing (SIT): Experience with SIT in CI/CD pipelines, ensuring smooth integration of all components and data flows.
• API and Microservices Testing: Expertise in testing APIs and microservices, including functionality, security, and performance validation using tools like Postman, SoapUI, or RestAssured.
• Data Quality: Expertise in ensuring data integrity, consistency, and cleansing processes across complex systems.
• Integration & Microservices: Knowledge of microservices architecture and testing integration between services and batch/streaming data flows.
• Monitoring & Troubleshooting: Familiarity with tools like Splunk Dynatrace, and strong problem-solving skills for root cause analysis.
• Collaboration & Leadership: Ability to lead QA teams, collaborate across departments, and mentor junior engineers in a fast-paced, Agile environment.

WORK EXPERIENCE & EDUCATION

• Requires 8+ years of professional experience is essential for understanding system architecture, programming, and technical troubleshooting.
• Outstanding written and verbal communication skills.
• Bachelors/master’s in computer science required.

​Bring out your best

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion

SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better and more equitable world.
SAP is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to the values of Equal Employment Opportunity and provide accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com
For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

EOE AA M/F/Vet/Disability:

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability.
Successful candidates might be required to undergo a background verification with an external vendor.

Requisition ID: 420479 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid.