Principal Data Scientist/ AI Application Development Expert

Job Description

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What You Build

Experience

• 14+ years of experience across Data Science, Artificial Intelligence, Machine Learning, Generative AI, and Enterprise Solution Architecture.
• Proven success designing and deploying enterprise‑grade AI/GenAI solutions using foundation models, Retrieval‑Augmented Generation (RAG), multi‑agent orchestration, and AI governance frameworks.
• Deep expertise in enterprise AI architecture, LLM‑based application development, AI agents, scalable AI platforms, applied research, and innovation management.
• Preference for candidates with notable contributions in research publications, patent filings, innovation programs, open‑source AI, or recognized industry thought leadership.

Key responsibilities

AI, GenAI, and LLM leadership

• Lead the architecture and development of advanced AI/ML and Generative AI solutions.
• Design enterprise‑scale LLM‑powered applications and intelligent assistants.
• Drive innovation in:
• Large Language Models (LLMs)
• Generative AI
• Agentic AI systems
• Retrieval‑Augmented Generation (RAG)
• Knowledge graphs
• Conversational AI
• AI copilots
• Autonomous agents
• Define an enterprise AI/GenAI strategy aligned with business transformation goals.
• Evaluate emerging foundation models, AI frameworks, and future AI technologies.

LLM and AI application engineering

• Architect and implement scalable LLM‑based applications using commercial and open‑source models.
• Design AI systems that integrate:
• Vector databases
• Semantic search
• Prompt orchestration
• Multi‑agent workflows
• Tool/function calling
• Memory management
• Context‑aware reasoning
• Build enterprise RAG pipelines and knowledge retrieval systems.
• Optimize prompts, inference pipelines, and model evaluation frameworks.
• Lead fine‑tuning, alignment, evaluation, and optimization of foundation models.
• Establish LLMOps practices for deployment, monitoring, observability, and governance.

Research and innovation

• Lead forward‑looking AI research initiatives and incubation programs.
• Publish technical papers, white papers, and innovation articles in reputable journals and conferences.
• Contribute to patent ideation, drafting, and submissions in AI/GenAI domains.
• Collaborate with academic institutions, innovation labs, startups, and cross‑functional R&D teams.
• Build PoCs, accelerators, and reusable AI frameworks to drive enterprise adoption.

Architecture and engineering

• Design end‑to‑end AI and GenAI architectures, including:
• Data ingestion and processing
• Model training and inference
• LLM orchestration frameworks
• Vector stores and embeddings
• MLOps / LLMOps
• AI governance and Responsible AI
• AI security and compliance
• Define cloud‑native AI architectures on AWS, Azure, GCP, SAP BTP, or hybrid platforms.
• Establish enterprise AI standards, reusable services, and scalable frameworks.

Stakeholder and team leadership

• Mentor data scientists, ML engineers, prompt engineers, and solution architects.
• Partner with leadership teams and customers to define AI transformation roadmaps.
• Lead architecture governance and innovation councils.
• Drive collaboration across engineering, product management, research, and business teams.

What You Bring:

Required Qualifications

• Bachelor’s or master’s degree in computer science, Artificial Intelligence, Data Science, Engineering, or related field.
• PhD preferred for research-focused candidates.
• 14+ years of industry experience with strong exposure to AI/ML, Generative AI, and enterprise architecture.
• Proven experience delivering production-grade AI and LLM-based enterprise solutions.

Technical Skills

AI & Machine Learning

• Machine Learning & Deep Learning
• Generative AI & Foundation Models
• Large Language Models (LLMs)
• NLP and Conversational AI
• Predictive Analytics
• Recommendation Systems
• Reinforcement Learning (preferred)

LLM & GenAI Technologies

• Prompt Engineering & Prompt Optimization
• Retrieval-Augmented Generation (RAG)
• AI Agents & Multi-Agent Systems
• Embeddings and Semantic Search
• Fine-Tuning and Model Adaptation
• Model Evaluation & Guardrails
• LLMOps and AI Observability

Frameworks & Tools

• LangChain
• LlamaIndex
• Semantic Kernel
• Hugging Face
• OpenAI APIs
• Vector Databases (Pinecone, Weaviate, ChromaDB, FAISS)
• TensorFlow, PyTorch, Scikit-learn

Architecture & Platforms

• Enterprise Solution Architecture
• Distributed AI Systems
• Microservices & API Architecture
• Cloud AI Platforms (AWS, Azure, GCP, SAP BTP)
• Kubernetes & Docker
• CI/CD for AI systems

Programming & Data Technologies

• Python, SQL, R
• Spark, Databricks
• Data Engineering & Big Data ecosystems

Preferred Qualifications

Candidates with the following will be strongly preferred:

• Research paper publications in reputed journals/conferences
• Patent submissions or granted patents in AI/GenAI domains
• Experience in innovation incubators or R&D organizations
• Hands-on expertise in enterprise GenAI transformation programs
• Experience building AI copilots, enterprise search, or autonomous AI agents
• Participation in open-source AI communities or technical forums
• Strong understanding of Responsible AI, AI Governance, and AI Security

Soft Skills

• Strategic and innovation-driven mindset
• Strong analytical and problem-solving capabilities
• Excellent communication and executive presentation skills
• Ability to influence senior leadership and customers
• Passion for emerging technologies and continuous learning

Key Success Metrics

• Successful delivery of scalable AI and LLM-based solutions
• Innovation impact and enterprise adoption
• Research publications and patent contributions
• AI platform scalability, governance, and operational maturity
• Team capability building and mentorship

Nice to Have

• Experience in SAP Business AI / Enterprise AI ecosystems
• Experience with Agentic AI and autonomous workflow orchestration
• Experience in AI incubation and prototype programs
• Conference speaking engagements or technical evangelism
• Exposure to Responsible AI frameworks and enterprise AI governance models

Where You Belong

SAP PCP Cross Technology and Architecture unit that is driving technology, empowering innovations in business and people. It is part of the global organization Private Cloud Products (PCP) dedicated to delivering innovative solutions to meet our customers’ unique business process needs in Private Cloud.

• You will be joining a dynamic and passionate team dedicated to leveraging AI to facilitate seamless interactions between individuals and information.

• We foster a culture of collaboration, learning, and growth, encouraging all team members to contribute ideas and perspectives.

• Enjoy the benefits of working within a diverse and international environment, with opportunities to collaborate with colleagues from around the globe.

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 446334 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid