Data Engineer

As a Data Engineer, you will design, build, and manage data pipelines that support data-driven decision making and machine learning across various products and services. You will have the opportunity to impact both Microsoft’s strategy and the world-wide mission of one of the largest and most forward-leaning customers. The customer’s scenarios will be lighthouses for their markets and present an opportunity for Azure and Microsoft to learn and grow, create transformative technology offerings, and advance competitive advantages.

You will collaborate with stakeholders to understand data requirements, model data flows, transform raw data, ensure data quality, and comply with data governance standards. You will use your skills and experience in software engineering, data engineering, data platforms, and data visualization to deliver scalable and reliable data solutions.

This role is fully remote, and successful candidates can be located anywhere within the United Kingdom (UK). Travel would eventually be 10-20% and the role requires the ability to work with clients remotely.

Our team values collaboration, craftsmanship, and continuous learning. As a member of the team, you will be able to shape and grow a positive and productive engineering culture.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Collaborate with customer stakeholders to define data requirements, use cases, and metrics for data products or features.
• Design and document data models, schemas, and flows that meet business and analytical needs.
• Define data pipeline architecture and create data pipelines in Azure
• Extract, transform, and load data from various sources using query languages, tools, and APIs.
• Ensure data quality, completeness, and reliability across data pipelines.
• Develop and implement data tools, tests, and monitors to optimize data performance and troubleshoot issues.
• Comply with data governance policies and standards for data security, privacy, and classification.
• Contribute to the data glossary and data catalog to document data sources, definitions, and lineage.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, data modeling or data engineering work
  • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field
  • OR equivalent experience.
• Experience in data engineering, data science, software development, or data modeling.
  In-depth experience in programming languages, such as Python, Java, Scala, or C#.

Other Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings:
  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
  • This role will require UK security clearance. Applicants must also be willing to undergo security clearance checks by the UK Government.

Preferred Qualifications:

• Azure Data Lake experience.
• Experience with data tools, frameworks and practices including, Azure MLOps, pytorch or Pytorch lightning, Spark, Dask.
• Experience working with data file storage formats like netcdf and/or Zarr.
• Big Data ingestion experience
• Experience with data visualization tools, such as Power BI or Tableau.
• Experience with data governance and compliance standards, such as GDPR, CCPA, or HIPAA.
• Strong communication, collaboration, and problem-solving skills.

#azurecorejobs

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.