Join SAP as a Senior Data and Applied Scientist in Gurugram, India, to design and scale advanced agentic AI systems and LLM-powered applications. In this full-time role, you will lead AI innovation, build enterprise ontologies, and mentor talent within a collaborative global environment.
Requirements
Bachelor's or Master's degree in Computer Science, Data Science, AI, or a related field.
7+ years of experience delivering ML and generative AI solutions in production.
Hands-on experience with LLM frameworks (LangChain, LlamaIndex, Semantic Kernel) and Python ML stacks (PyTorch, TensorFlow, Hugging Face).
Strong expertise in agentic AI systems, RAG, and prompt engineering.
SAP knowledge and familiarity with SAP data platforms are strong accelerators.
Skills & Responsibilities
Python and ML Frameworks: Develop and evaluate machine learning models using PyTorch, TensorFlow, and Hugging Face to drive scalable AI solutions.
Agentic AI & LLMs: Design multi-agent orchestration, planning, memory, and tool usage using frameworks like LangChain and LlamaIndex.
Enterprise Ontologies: Build and maintain semantic models and knowledge graphs to ground AI agents in accurate enterprise data.
MLOps & CI/CD: Implement robust CI/CD pipelines, containerization, and monitoring to ensure production readiness and security compliance.
Potential transition routes: People from Applied Scientist, Machine Learning Engineer, or AI Architect roles may bring strong modeling and system design skills, alongside meeting the 7+ years of production ML requirements.
Job description
Company Description
You'll collaborate with teams around the world, mentor rising talent, and participate in global forums. SAP's growth culture gives you the autonomy to explore new methods and the support to scale your impact internationally.
Job Description
What You Bring
Bachelor’s or Master’s degree (or pursuing one) in Computer Science, Data Science, AI, or a related field.
7+ years of experience delivering ML and generative AI solutions in production.
Deep working knowledge of SAP data models, metadata structures, and core business processes end-to-end. (SAP knowledge is a strong accelerator)
Hands-on experience with the SAP data and AI platform stack SAP Datasphere, SAP HANA Cloud Knowledge Graph Engine, SAP Business Data Cloud, SAP One Domain Model, SAP Graph API, and SAP Business Accelerator Hub.
Deep expertise across the W3C stack (OWL, RDF/RDFS, SKOS, SHACL) and/or property graph query languages (Cypher, GQL).
Strong expertise in agentic AI systems, including orchestration, planning, memory, and tool usage.
Hands-on experience with LLM frameworks (e.g., LangChain, LlamaIndex, Semantic Kernel).
Solid understanding of LLM techniques, including fine-tuning, prompt engineering, and RAG.
Strong Python skills with ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face).
Experience building scalable, reliable AI systems with a focus on performance and maintainability.
Familiarity with MLOps/LLMOps practices and cloud platforms (AWS, Azure, GCP).
Strong analytical thinking, problem-solving, and clear communication skills.
Hands-on experience with SAP BTP AI stack — SAP AI Core, Gen AI Hub, HANA Cloud, UCL registry for provisioning, and CAP/BTP services.
Familiarity with AI governance, Data Integrity, Handling DPP/PII, and audit/traceability.
Experience with CI/CD tooling (GitHub Actions, Jenkins, Piper) and containerization (Docker, Cloud Foundry/Kyma).
Understanding of security practices- SaaS based Security Standards, IAS (OAuth2, XSUAA), customer-managed keys, Malware scanning.
What You Build
Design and scale agentic AI systems, including multi-agent orchestration, tool integration, memory, and human-in-the-loop workflows.
Design and maintain enterprise ontologies and semantic models that give AI agents accurate, grounded understanding of SAP and connected business landscapes, harmonizing data from SAP and external providers into unified semantic layers.
Build LLM-powered applications using prompt engineering, RAG, tool calling, and reasoning pipelines.
Build AI capabilities including RAG pipelines, embeddings, vector databases, and enterprise knowledge grounding that make SAP's agents accurate and reliable in production.
Work with cloud and data platforms, including Databricks, SAP Datasphere, SAP HANA Cloud, AWS, Azure, and GCP to support reliable, scalable AI workflows.
Fine-tune and adapt LLMs for domain-specific use cases such as code generation, transformation, and automation.
Translate business requirements into end-to-end AI solutions, defining data, modelling, and evaluation strategies.
Apply machine learning, deep learning, and statistical modeling to develop and evaluate AI solutions using real-world enterprise datasets.
Develop and maintain high-quality data pipelines for training, validation, and continuous improvement.
Lead experimentation and optimization using prompt tuning, PEFT, and model selection techniques.
Ensure production readiness through evaluation, monitoring, observability, and cost-performance trade-offs.
Collaborate with cross-functional teams and mentor junior engineers’/data scientists.
Continuously evaluate emerging trends in generative AI and agentic systems.
Productize Agentic SaaS based solutions on SAP BTP with proper multi-tenancy and lifecycle management.
Embed security and compliance by design - secure secrets/credential handling and AI guardrails.
Where You Belong:
SAP Private Cloud Cross Technology and Architecture unit that is driving technology-empowering innovations in business and people. It is part of the global organization Private Cloud, dedicated to delivering innovative solutions to meet our customers’ unique business process needs in Private Cloud.
You will be joining a dynamic and passionate team dedicated to leveraging Agentic AI and Enterprise Ontologies to facilitate seamless interactions between individuals and information.
We foster a culture of collaboration, learning, and growth, encouraging all team members to contribute ideas and perspectives.
Enjoy the benefits of working within a diverse and international environment, with opportunities to collaborate with colleagues from around the globe.
Our vision is to become the premier strategic RISE with SAP enabler, driving accelerated innovation and technology adoption leveraging the SAP Business Technology Platform, focusing on a clean core approach.
Qualifications
Architectural thinking and hands-on coding skills. You design secure, scalable systems, reason about data structures and APIs, and use observability, 7+ years of experience delivering ML and generative AI solutions in production. Hands-on experience with the SAP data and AI platform stack SAP Datasphere, SAP HANA Cloud Knowledge Graph Engine, SAP Business Data Cloud, SAP One Domain Model, SAP Graph API, and SAP Business Accelerator Hub. Strong expertise in agentic AI systems, including orchestration, planning, memory, and tool usage.
Additional Information
About SAP With a global network of customers, partners, employees, and thought leaders, SAP helps the world run better and improves people’s lives. As a leader in enterprise applications and business AI, SAP stands at the nexus of business and technology. For over 50 years, organizations have trusted SAP to bring out their best by uniting business-critical operations spanning finance, procurement, HR, supply chain, and customer experience.
We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone, regardless of background, feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.
SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or complete your application, please send an email with your request to the Recruiting Operations Team: Careers@sap.com.
For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.
Qualified applicants will receive consideration for employment without regard to age, race, religion, national origin, ethnicity, gender (including pregnancy and childbirth), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.
Successful candidates might be required to undergo a background verification with an external vendor.
AI Usage in the Recruitment Process
For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.
Please note that any violation of these guidelines may result in disqualification from the hiring process.