Backend Developer - AI & Agentic Applications

Job Description

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

What you will build

We are looking for backend developers to join our team. This role focuses on building backend systems for AI-powered and agentic applications, with additional responsibility for Kubernetes-based deployment and service operation.

The developers will work closely with data scientists, machine learning engineers, and product owners to build reliable backend services, AI-enabled workflows, and production-grade agentic applications. The role is primarily engineering-oriented, with strong emphasis on backend system design, service reliability, Kubernetes-based deployment, monitoring, and practical collaboration with data science or machine learning colleagues.

Experience with machine learning engineering, LLM applications, RAG, recommendation systems, or agentic workflow development is highly preferred.

Key Responsibilities

• Design, develop, and maintain backend services, APIs, and service components for AI-related applications.
• Build backend systems for agentic applications, including tool execution, workflow orchestration, task planning, memory/state management, and integration with external systems.
• Work with data scientists and machine learning engineers to turn prototypes, models, retrieval pipelines, recommendation logic, and agentic workflows into reliable, production-ready backend services.
• Develop scalable and maintainable server-side applications with proper testing, logging, monitoring, error handling, and operational support.
• Support deployment and operation of backend services on Kubernetes.
• Build and maintain CI/CD pipelines using Jenkins or similar tools.
• Use monitoring and observability tools such as Grafana to support service operation, troubleshooting, and performance analysis.
• Participate in system design discussions, architecture reviews, troubleshooting, and production issue resolution.
• Collaborate with cross-functional teams to clarify requirements and deliver high-quality engineering solutions.
• Continuously improve system reliability, deployment efficiency, developer productivity, and engineering quality.

What you bring

• 3+ years of hands-on backend development experience, with strong proficiency in Python. Experience with another backend programming language such as Go, Java, TypeScript/Node.js, or Rust is a plus.
• Good understanding of backend system design, RESTful APIs, service integration, databases, and distributed systems fundamentals.
• Hands-on experience with PostgreSQL and OpenSearch, including data modeling, query design, indexing, integration, and troubleshooting.
• Good understanding of scalability, reliability, performance optimization, and service-level operation.
• Hands-on experience with containerized application deployment and operation on Kubernetes, with experience building or maintaining CI/CD pipelines using Jenkins or similar tools.
• Experience with observability, monitoring, logging, and dashboarding tools such as Grafana.
• Basic understanding of machine learning and deep learning concepts.
• Ability to write clean, maintainable, testable, and production-ready code.
• Good debugging, problem-solving, and communication skills.
• Ability to work effectively with data scientists, machine learning engineers, and other technical stakeholders.
• Strong engineering ownership and willingness to handle both development and operational responsibilities.

Preferred Qualifications

• Familiarity with LLM-based applications, RAG, embeddings, vector search, model evaluation, or AI system monitoring.
• Experience building backend systems for AI-related applications, such as LLM applications, RAG systems, search systems, recommendation systems, or data-driven services.
• Experience turning machine learning models, deep learning models into reliable production services.
• Experience with Spark or similar distributed data processing frameworks is a plus.
• Strong interest in AI-native software development and agentic applications, such as agent orchestration, tool calling, planning, memory, evaluation, and workflow automation.

Ideal Candidate Profile

The ideal candidate is a strong backend engineer who can build reliable production systems and is comfortable working in AI-related scenarios.

They should be able to work with data scientists and machine learning engineers, understand prototypes or algorithms, and help transform them into stable, scalable, and maintainable backend services.

A suitable candidate should also be interested in agentic applications and willing to work on systems that combine backend engineering, Kubernetes-based deployment, AI capabilities, monitoring, and workflow orchestration.

Role Focus

• Backend Engineering: High
• Agentic Application Development: High
• Kubernetes-based Deployment & Operation: Medium to High
• Jenkins / CI-CD: Medium
• Observability / Grafana: Medium
• AI / ML Engineering Collaboration: Medium to High
• Machine Learning Modeling: Optional / Nice to Have

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, gender (including pregnancy, childbirth, et al), sexual orientation, gender identity or expression, protected veteran status, or disability, in compliance with applicable federal, state, and local legal requirements.

Successful candidates might be required to undergo a background verification with an external vendor.

AI Usage in the Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process.

Please note that any violation of these guidelines may result in disqualification from the hiring process.

Requisition ID: 455500 | Work Area: Software-Design and Development | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Regular Full Time | Additional Locations: #LI-Hybrid