AI Architect - GDH Data & AI Americas - Enterprise Solutions

Job Description

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What You'll Do

The AI Architect plays a key role in designing and delivering modern AI architectures that enable customers to accelerate their Business AI adoption journey. You will help customers define and implement AI strategies leveraging SAP Business AI capabilities, including Joule, Embedded AI, Custom AI, AI agents, and agentic AI architectures integrated with SAP and non-SAP landscapes.

In this role, you will design scalable and secure AI solutions, evaluate emerging AI technologies, define architectural roadmaps, and guide customers through the adoption of generative AI, agent-based systems, and intelligent business processes.

You will work closely with SAP product teams, AI engineers, data architects, hyperscaler experts, partners, and customer technical and executive stakeholders to ensure AI solutions are aligned with business goals, enterprise architecture standards, security requirements, and responsible AI principles.

Through strong technical leadership, customer engagement, and architectural expertise, you will drive the adoption of SAP Business AI Platform and help customers move toward the Autonomous Enterprise vision.

What You Bring

• Strong understanding of modern AI architectures, including Generative AI, Agentic AI, and AI orchestration patterns.
• Hands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, semantic search, and Retrieval-Augmented Generation (RAG) architectures.
• Strong knowledge of vector databases, vector search technologies, and knowledge retrieval strategies.
• Experience with AI agent frameworks and communication protocols such as MCP (Model Context Protocol), A2A (Agent-to-Agent), or similar agent interoperability standards.
• Experience designing multi-agent systems, tool calling mechanisms, and AI workflow orchestration.
• Knowledge of SAP Business AI portfolio, including Joule, Embedded AI, Custom AI, SAP AI Core, SAP Generative AI Hub, and AI Foundation services.
• Understanding of how AI integrates with enterprise data platforms such as SAP Business Data Cloud (BDC), Datasphere, SAP applications, and external data ecosystems.
• Experience with hyperscaler AI services (Azure AI, AWS AI services, Google Vertex AI) and open AI ecosystems.
• Knowledge of AI governance, security, privacy, responsible AI, and enterprise AI adoption considerations.
• Ability to translate business challenges into AI architecture strategies and communicate complex AI concepts to technical and executive audiences.
• Strong stakeholder management, storytelling, and consulting skills.
• Comfortable driving innovation and leading architectural discussions in complex customer environments.

EXPECTATIONS AND TASKS

1. AI Architecture Design & Strategy

• Design end-to-end enterprise AI architectures leveraging SAP Business AI Platform and complementary AI technologies.
• Define AI roadmaps covering use case prioritization, architecture decisions, technology selection, and adoption strategies.
• Design agentic AI architectures involving AI agents, MCP/A2A communication patterns, external tools, and enterprise systems.
• Define RAG architectures integrating enterprise knowledge, vector databases, and semantic search capabilities.

2. AI Solution Design & Integration

• Design AI solutions integrated with SAP applications (S/4HANA, SuccessFactors, Ariba, Concur), SAP BDC, Datasphere, and external platforms.
• Define integration patterns between AI services, enterprise data platforms, APIs, and business applications.
• Guide customers on the adoption of Joule, Embedded AI, Custom AI, and AI agents.

3. AI Governance, Security & Responsible AI

• Ensure AI architectures follow enterprise security, compliance, privacy, and responsible AI principles.
• Define governance models for AI models, prompts, agents, knowledge bases, and data access.
• Evaluate AI risks, hallucination mitigation strategies, and monitoring approaches.

4. Customer Advisory & Delivery Support

• Lead customer workshops, AI discovery sessions, architecture reviews, and executive discussions.
• Translate business challenges into AI adoption strategies and technical architectures.
• Support implementation teams with technical guidance, architecture validation, and troubleshooting.

5. Innovation & Continuous Improvement

• Stay current with emerging AI technologies, agentic AI frameworks, and market trends.
• Create reusable AI assets, reference architectures, accelerators, and best practices.
• Contribute to SAP communities, internal enablement programs, and AI knowledge sharing.
• Act as a thought leader in the adoption of SAP Business AI Platform and Autonomous Enterprise initiatives.

EDUCATION AND QUALIFICATIONS / SKILLS AND COMPETENCIES

Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Data Science, Engineering, Information Systems, or related fields.

WORK EXPERIENCE

• 10–15+ years of experience in enterprise architecture, AI architecture, data architecture, software engineering, or related technical roles.
• 3–5+ years of practical experience designing and implementing AI, machine learning, or Generative AI solutions.
• Experience delivering customer-facing AI transformation initiatives and large-scale enterprise programs.
• Hands-on experience with Generative AI solutions, LLM ecosystems, RAG architectures, vector databases, and AI agent frameworks.
• Experience with SAP Business AI technologies and/or market-leading AI platforms.
• Experience working with cloud AI services and modern AI development frameworks.

If you are interested in applying to the role, please submitt your English resume.

#DA 26 #LI-MR3

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 449040 | Work Area: Consulting and Professional Services | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid