< Back to search

deepset • Germany Berlin

Senior DevOps Engineer

Employment type:  Full time

< Back to search

8.2

/10

Transparency ranking

Apply now

Job Description

Your mission

As a Senior DevOps Engineer at deepset, you will play a key role in the success of our end-to-end LLM platform.
Your focus will be on ensuring high performance, security, and availability to meet the needs of our enterprise customers.
You will collaborate closely with our engineering teams, developing automation and cloud infrastructure tooling while building the foundation that empowers our customers to succeed with our AI solutions.

Our mission

We are an AI startup that empowers developers to build applications that use natural language as the interface to data. Our open-source framework Haystack is used by thousands of developers to build LLM applications. Our LLM platform, deepset AI Platform, enables enterprises worldwide to unlock the potential of large language models for their business cases. Come join our team and work with tech experts on real-world cases, in a fast-paced and high-impact environment, and shape the AI space together with us.

Life at deepset

At deepset you will find an environment with equal opportunities to grow, share ideas, build relationships, and succeed. We believe every employee is important and generates a direct impact on our team’s success.
We are certified by Flexa® Careers as a flexible employer, and our remote first culture is designed to provide work-life balance, autonomy, and flexibility.
Our daily meetings, the in person "re:base", and the social events allow us to work with great synergy. We would like to invite you to visit our life page to learn more about our culture.

Your impact

  • You will solve performance and scalability challenges to support enterprise-ready LLM applications
  • You will be responsible for CI/CD and building tools to improve software development and deployment processes
  • You will implement monitoring and alerting strategies to guarantee service availability and optimal performance
  • You will collaborate with engineers on firefighting, maintaining pipelines, managing GitHub workflows, troubleshooting issues, and driving improvements
  • You will work configuring infrastructure for both SaaS and on-prem solutions while engaging with infrastructure clients’ teams
  • You will reinforce best practices within the organization to improve the reliability, scalability, and security of our software

Your profile

  • 5+ years experience of working with large scale production infrastructure
  • Experience in designing & building service-oriented architectures
  • Proficient with AWS, Kubernetes, GitOps (ArgoCD) and CI/CD
  • Experience operating solutions deployed on customers premises (private cloud and om-prem)
  • Working knowledge of Infrastructure as Code, preferably Terraform and Crossplane
  • Familiarity with Machine Learning/LLM or the motivation to learn about it
  • Pragmatism, troubleshooting skills, sense of responsibility, and independent work style

Perks

  • Remote-first or hybrid
    You can choose to work from home or any other workspace that suits you. We offer home office setup (equipment and furniture), and we would be happy to sponsor a coworking spot.
  • Grow
    Personal and professional growth is important to us. We have an annual learning and development budget, and also the opportunity to speak at conferences, internal knowledge sharing, and workshops.
  • Connect
    We have a virtual office, a monthly social budget to reconnect virtually or in person, online walks and talks with colleagues from other teams, and a flexible travel policy that enables you to meet colleagues in person for special occasions.
  • You are an owner
    All employees are enrolled in the employee stock option plan and own a part of the company.
  • Personal time off
    If you want to recharge and travel the world - there are 30 days of paid vacation.
  • Choose your tech
    The choice is yours among our pre-selected options, and we will provide what you need.
  • Pension fund and Health Insurance fitting with your main working location
    All full-time employees are eligible for the pension plan according to the legal guidelines in their location. We also offer health, dental, and vision for employees in the US, in compliance with the local market.
  • Travel Insurance
    We want you to be secure during your travels. Therefore, we offer every employee additional travel insurance.
  • Sports budget
    To boost your health and well-being, we offer a monthly allowance for your sports activity.
  • Oliva - employee mental wellbeing benefit
    To boost your well-being, we offer a benefit that helps you to respond to pivotal moments at work and beyond.
  • Dog-friendly
    Our main co-working partner Mindspace welcomes dogs, so you can also bring your best friend to the office and our HQ in Berlin also welcomes dogs
  • Enhanced days off for Family Sick Leave
    We offer additional days in case your child gets sick.
  • Additional days off
    We don't work on the 24th & the 31st of December.
  • Flexible working hours
    You can adapt your work to your private life.

What colleagues say

“I got to see the challenge of identifying use cases for AI and building and evaluating an LLM-based application first hand in my previous role. As a result, deepset’s mission to empower teams to leverage this transformational technology deeply resonated with me.
AI is one of the biggest innovations in technology that we have seen since the Internet. Having a chance to work and learn from a company that is at the heart of the ecosystem and has been accumulating expertise in this space since 2018 was an opportunity that I had to jump on!
I am super excited to have joined this incredibly talented team!” (Eliza, Product Manager)

"Deepset enables me to work with extremely talented and like-minded people on the tech I’m passionate about. It is just outstanding to find such a well-organized and yet creativity-encouraging environment. Seeing everyone is dedicated to the bone to pushing this thrilling technology to its limits puts the cherry on top.Needless to say: I'm proud to be part of deepset!” (Thomas, Senior NLP Engineer)

Company benefits

30 days annual leave + bank holidays
Company shutdown periods – Holiday Period (24th and 31st)
Dog friendly co-working space
Enhanced sick pay – for Family Sick Leave
Home office set up
Open to job sharing
Open to part-time employees
Teambuilding days
Personal development budgets
Health insurance
Co-working space allowance
Enhanced pension match/contribution
Pregnancy loss leave
Enhanced maternity leave
Shared parental leave
Enhanced paternity leave
Dog friendly office
Share options
401K
Referral bonus
Book budget
L&D budget
Book budget

Working at deepset

Company employees

80

Gender diversity (male:female:non-binary)

65:34:1

Funding levels

€44,5M

Currently Hiring Countries

Germany

Spain

United States

Office Locations

Awards & Achievements

Pet Friendly

Pet Friendly

Flexa awards 2025
Most flexible companies

Most flexible companies

Flexa100 2024
DeepTech, Data & AI

DeepTech, Data & AI

Industry awards 2023
Most flexible companies

Most flexible companies

Flexa100 2023
AI & VR

AI & VR

Industry awards 2022