Data Engineering Specialist

Recruiter: Sakshi Mehrotra

Hiring Manager: Ravinder Singh

Career Grade: D

What you will be doing (Role Accountabilities)

This role is open for Kolkata/Gurgaon/Bengaluru

You’ll be a data engineering specialist within the data science team. Your responsibilities would include:

• Working with upstream data engineering teams to help investigate what data is available to support data science use cases
• Developing prototype SQL from a high-level business request, supplied by a data scientist
• Turning prototype SQL into a production grade pipeline
• Doing analysis to define data quality rules and validation checks
• Design and build data products and data pipelines that are cost effective, performant and resilient.
• Build both batch and NRT data pipelines.
• Building out Data Product documentation, including clear and comprehensive user guides, and runbooks to aid control and knowledge transfer.
• Operational maintenance of all data products our model’s rely on
• Ensure both self and others take responsibility for achieving brilliant customer and business outcomes through high-quality execution, collaboration, and a focus on continuous improvement.
• Developing our data product code templates
• Supporting the maintenance of our data platform infrastructure

What you’ll need to succeed (Skills & Experience)

• Stakeholder Communication: Excellent written and verbal communication skills, with the ability to adapt and moderate the explanation of technical concepts to suit the audience's level.
• Requirements Gathering: Ability to transform vague business requests into a set of clear, actionable technical requirements.
• Cloud Data Engineering: Strong data engineering experience within Google Cloud Platform (GCP).
• BigQuery SQL Optimization: Strong experience optimizing BigQuery SQL. This includes leveraging partitioning, clustering, and materialized views for performance and cost; diagnosing slot utilization bottlenecks via the Execution Graph; and applying a deep understanding of storage costs, billing mechanics, and best practices to avoid full-table scans.
• Pipeline Development: Comfortable developing data pipelines using Java and Python (experience developing Java Dataflow pipelines is highly desirable).
• CI/CD & IaC: Experience with CI/CD setups and Infrastructure as Code frameworks, ideally GitLab using Terraform.
• Docker Optimization: Proficiency in writing optimized Dockerfiles using multi-stage builds to minimize image sizes and reduce security vulnerabilities highly desirable but not required
• Streaming Technologies: Experience with event streaming technologies like Kafka and Pub/Sub is highly desirable, though not required

BT Group is the UK’s leading communications group and the holding company behind some of the country’s most recognised brands – including BT, EE, Openreach and Plusnet. Our purpose is as simple as it is ambitious: we connect for good. Our customers include consumers, small, medium and large businesses, public sector organisations and other communications providers.

BT Group’s role is about setting direction, unlocking value and creating the conditions for our brands and businesses to thrive.

Having come through the most capital-intensive phase of our fibre investment, our focus now is on what comes next – simplifying how we operate, using technology and AI to work smarter, and organising ourselves to serve customers better and grow sustainably. Group teams shape strategy, policy, brand, capital allocation and transformation, helping the whole organisation perform at its best.

We have a singular culture that unites all our people: we are customer-first challengers, who are committed, clear and connected. These behaviours unite us as one team to deliver for our colleagues, our customers, our stakeholders and the country. Joining BT Group means working at the heart of a business that matters to the UK, with the opportunity to shape decisions, influence outcomes and help set the future course of one of the country’s most important companies.