Data Engineering Specialist

Job Description

What you’ll be doing

• Data Engineering Specialist lead within their Squad; including coaching and mentoring other engineers within the Alliance ensuring all adhere to Engineering standards and best practice; facilitating workshops and running training sessions where needed
• Ensure both self and others take responsibility for achieving brilliant customer and business outcomes through high-quality execution, collaboration, and a focus on continuous improvement.
• Design and build data products and data pipelines that are cost effective, performant and resilient.
• Build both batch and NRT data pipelines.
• Ensure all data products delivered and maintained to a high quality, accurate, secure, and always adhere to data protection policies.
• Support Data Product documentation, including clear and comprehensive user guides, and runbooks to aid control and knowledge transfer.
• Operational maintenance of all data products

The skills and experience you will have under your belt

• Experience with CI/CD setups and infrastructure as code frameworks (ideally Terraform or OpenTofu)
• Experience with open-source big data frameworks (ideally Spark, Apache beam, or Apache Flink)
• Experience in Integration technologies like Kafka, API, Pub/Sub
• Experience with NRT data pipelines is highly desirable
• High proficiency with SQL, Python and one of Scala/Java
• Strong experience of cloud environments (ideally GCP) in the following areas.
• SQL and noSQL databases
• Orchestration tools
• Big data and ETL services
• Serverless compute services
• Experience with K8 and cloud networking is desirable but not required
• Strong data management and data architecture experience
• Strong understanding of data security and compliance processes
• Strong communication skills and ability to articulate complex technical concepts to both technical and non-technical stakeholders at all levels, written and verbal
• Excellent stakeholder management skills, planning skills and the ability to prioritise demand in line with business and commercial requirements.
• Strong experience leading / coaching and mentoring
• Experience working in Agile

The big decisions involved in this role

What is the problem we are trying to solve? What is the latency / frequency requirements of the data products? Is history required? How should we partition the data? How much will the query processing cost? What is the storage cost? Has alerting / monitoring been set up? Is there a more efficient way to develop this data product?

About EE and BT Group
We’re EE. We are the biggest mobile and broadband operator in the UK and we have a relationship in every second household in the country. But we’re for everyone, on any network – serving up new tech, new services, and heaps of inspiration for every aspect of your connected life.
We’ve been awarded the UK’s best network for the last 10 years. It’s central to our vision – to be the most personal customer-focused technology company in the UK.
That means earning a place on customers’ home screens by offering them more than ever before, whether that’s helping their home run smarter with EE Home, levelling up their play with EE Game, helping them work on their terms with EE Work, or even unleashing their kids’ learning with EE Learn.
We’re also part of BT Group, which we’re even bigger than you might think. Millions of people rely on us every day to help them live their lives, power their businesses, and keep their public services running. We connect friends to family, clients to colleagues, people to possibilities. We keep the wheels of business spinning, and the emergency services responding.
We think we’ve got something special here. We want everyone to feel proud about working at EE – and feel excited about where we’re going and what we’re going to do. Want to join in?

Why this job matters

The Data Engineering Specialist executes a range of workstreams in building and implementing processes to capture, manage, store and utilise structured and unstructured data from internal and external sources, turning business needs into the data that supports the BT Group's data strategies.

What you’ll be doing

1.Drives the design, coding, unit testing, and deployment of data processes'for ingestion and transformation of data while keeping data security and privacy in mind.
2.Leads the development of architecture and design patterns to process and store high volume data sets.
3.Leads key projects using advanced technical knowledge to drive new solutions to large, open-ended problems that may be ambiguous or lacking clear precedent.
4.Drives the use of best practices and delivery in an Agile process that consistently delivers a quality product for the organisation.
5.Drives the use of new or existing data to define key indicators to provide visibility into the quality of the BT Group's data, pipelines, and infrastructure.
6.Implements complex initiatives and projects, translating objectives into a scalable solution that meets end customers' needs within deadlines.
7.Mentors other data engineers, helping to improve the team's abilities by acting as a technical resource.
8.Champions, continuously develops and shares with team knowledge on emerging trends and changes in data engineering.

The skills you’ll need

Data SecurityDatabase Design/DevelopmentDevOpsData StorageData EngineeringData IntegrationProgramming/ScriptingData QualityBig Data ProcessingCloud ComputingAgile MethodologiesData ManagementData AcquisitionData Model ManagementDecision MakingGrowth MindsetInclusive Leadership

Our leadership standards

Looking in:
Leading inclusively and Safely
I inspire and build trust through self-awareness, honesty and integrity.
Owning outcomes
I take the right decisions that benefit the broader organisation.

Looking out:
Delivering for the customer
I execute brilliantly on clear priorities that add value to our customers and the wider business.
Commercially savvy
I demonstrate strong commercial focus, bringing an external perspective to decision-making.

Looking to the future:
Growth mindset
I experiment and identify opportunities for growth for both myself and the organisation.
Building for the future
I build diverse future-ready teams where all individuals can be at their best.

About us

BT Group was the world’s first telco and our heritage in the sector is unrivalled. As home to several of the UK’s most recognised and cherished brands – BT, EE, Openreach and Plusnet, we have always played a critical role in creating the future, and we have reached an inflection point in the transformation of our business.

Over the next two years, we will complete the UK’s largest and most successful digital infrastructure project – connecting more than 25 million premises to full fibre broadband. Together with our heavy investment in 5G, we play a central role in revolutionising how people connect with each other.

While we are through the most capital-intensive phase of our fibre investment, meaning we can reward our shareholders for their commitment and patience, we are absolutely focused on how we organise ourselves in the best way to serve our customers in the years to come. This includes radical simplification of systems, structures, and processes on a huge scale. Together with our application of AI and technology, we are on a path to creating the UK’s best telco, reimagining the customer experience and relationship with one of this country’s biggest infrastructure companies.

Change on the scale we will all experience in the coming years is unprecedented. BT Group is committed to being the driving force behind improving connectivity for millions and there has never been a more exciting time to join a company and leadership team with the skills, experience, creativity, and passion to take this company into a new era.

A FEW POINTS TO NOTE:

Although these roles are listed as full-time, if you’re a job share partnership, work reduced hours, or any other way of working flexibly, please still get in touch.

We will also offer reasonable adjustments for the selection process if required, so please do not hesitate to inform us.

DON'T MEET EVERY SINGLE REQUIREMENT?

Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We're committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you're excited about this role but your past experience doesn't align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.