Lead Data Engineer

Job Description

Available locations: Belfast, Birmingham, Glasgow, Bristol, Manchester or London

Working Style: 3 days a week in office, 2 days anywhere

Why this job matters

Data is a vital part of our business and with your help, we can improve the services that we provide to our customers through engineering excellence of our data products. You’ll be working on exciting data products which support TV, Broadband, Digital Voice and market leading technologies like Unbreakable Wifi. We deliver these critical services using the latest cloud technologies on AWS, GCP and Cloudera.

We are hiring a Lead Data Engineer to join our brilliant team. When you join us as a Lead Data Engineer, you’ll have the opportunity to be part of our Data & AI Enablement Team where you will help to design, build, and support high quality engineering products from our extensive data sources and multi-cloud environment.

As a team we believe in the agile principles of openness, transparency and continuous improvement, which underpin strong relationships with our business stakeholders.

There will be lots of opportunities to explore new technologies, develop new skills, innovate and grow as an engineer.

What you’ll be doing

• This is a developer first role in which you will design, build, and lead on the development and support of scalable data products for our business stakeholders.
• Agile development through story planning, estimation and retrospectives.
• Lead the continual improvement of our solutions, i.e. process improvements / operational monitoring / automation opportunities / security.
• Provide leadership to our other Data engineering development and support team, contribute to upkeep of our strategic data platform architecture, the data engineering community and associated standards.
• Collaborate with architects, designers, analysts, product specialists, other software and data engineers – in the support of our data products.
• Continual improvements using engineering excellence best practices.
• Demos and knowledge transfers to stakeholders around product developments.
• Spread your experience and knowledge to junior engineers.
• Improve automated testing and deployments using CI/CD pipelines.
• Expectation to line manage small team of junior data engineers.
• Continual learning through internal and external training.

What you'll bring

Mandatory

• Use of Hadoop / GCP /or AWS to build Big Data solutions
• Skilled in using some of these technologies such as Spark, Terraform, Kafka, Kinesis, BigQuery, Dataflow, and SQL.
• Proficient in programming languages such as Scala, Java, or Python.
• Experienced in designing, building, and maintaining scalable data pipelines and applications.
• Hands-on experience with Continuous Integration and Deployment strategies.
• Solid understanding of Infrastructure as Code tools.
• Experienced in using Confluence, JIRA, or other Atlassian tools.
• Knowledgeable in software version control with Git or SVN.
• Capable of presenting technical issues and successes to team members and Product Owners.
• Has experience of people management or desire to manage individuals on the team

Nice to Have

• Experience with Glue, Lambda, Kubernetes
• Enthusiastic about learning and applying new technologies (growth mindset).
• Ability to build new solutions and support our data solutions/products.

What's in it for you

• 10% on target bonus
• BT Pension scheme, minimum 5% Employee contribution, BT contribution 10%
• Life Assurance Cover
• Exclusive colleague discounts on our latest and greatest BT broadband packages, BT TV with TNT Sports and NOW Entertainment
• From January 2025, equal family leave: receive 18 weeks at full pay, 8 weeks at half pay and 26 weeks at the statutory rate. It’s for all parents, no matter how your family is made up.
• Enhanced women’s health support: including help with menopause symptoms, cancer screenings, period care and more.
• 25 days annual leave (not including bank holidays), increasing with service
• 24/7 private virtual GP appointments for UK colleagues
• 2 weeks carer’s leave
• World-class training and development opportunities

About us

BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have reached an inflection point in the transformation of our business.

Over the next two years, we will complete the UK’s largest and most successful digital infrastructure project – connecting more than 25 million premises to full fibre broadband. Together with our heavy investment in 5G, we play a central role in revolutionising how people connect with each other.

While we are through the most capital-intensive phase of our fibre investment, meaning we can reward our shareholders for their commitment and patience, we are absolutely focused on how we organise ourselves in the best way to serve our customers in the years to come. This includes radical simplification of systems, structures, and processes on a huge scale. Together with our application of AI and technology, we are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies.

Change on the scale we will all experience in the coming years is unprecedented. BT Group is committed to being the driving force behind improving connectivity for millions and there has never been a more exciting time to join a company and leadership team with the skills, experience, creativity, and passion to take this company into a new era.

A FEW POINTS TO NOTE:

Although these roles are listed as full-time, if you’re a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch.

We will also offer reasonable adjustments for the selection process if required, so please do not hesitate to inform us.

DON'T MEET EVERY SINGLE REQUIREMENT?

Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.