Data Engineer

Job Description

The Data Engineering function in Quantexa’s RnD department was setup in 2019 to centrally develop data engineering tools and best practices for use on Quantexa projects. After a successful first year, the remit of the team has widened and the team is now known as the Data Engineering & Demos team, encompassing three distinct sub-teams:

Data Engineering Accelerators

• Developing Quantexa’s standard code for cleansing, parsing and standardising data used in entity resolution
• Finding efficiency/performance improvements through big data testing and building performance tooling
• Owning best practices in entity resolution and network building

Trials

• Owning the Quantexa Trial platform, the first place prospective Quantexa clients get the opportunity to see the product in action using real data

• Working with data from various third party/open source data provider partners that is loaded into the Trial platform
• Developing and maintaining of Quantexa’s data packs – packaged up ETL and UI code that is also used heavily by delivery projects

Demos

• Developing, deploying and maintaining all Quantexa demos, showcasing the different use cases for the Quantexa Platform
• Implementing cutting edge new features developed by core RnD

• Designing and then building demos for novel use cases of the platform, opening up new markets for Quantexa.

More detailed information on the day to day activities of the three sub-teams can be shared on request. The teams all work together closely and team members are able to rotate between the teams to enable knowledge sharing and personal development.

What does a Data Engineering Accelerators role at Quantexa look like?

• We are looking for people who enjoy the following to join us:
  • Working in a fast moving, Agile environment
  • Data processing/ETL pipelines
  • Analysing and examining real and varied data
  • Full stack development, but with a heavy focus on the data processing/ETL side
  • Solving difficult problems with efficient, resilient, high impact code
  • Working in the cloud with production-grade systems
  • Defining best-practices and sharing expertise you’ve developed
  • Growing and thriving within one of the UK’s fastest growing scale-ups

Requirements

• Suitable candidates will have a proven track record in a number of the following areas:
  • A strong coding background, ideally in Scala or otherwise in a relevant language that will allow you to learn Scala quickly (e.g. Java/Python)
  • Big data experience, either from a software deployment/implementation or a data science perspective
  • Knowledge of at least one big data technology such as Spark, Hadoop or Elasticsearch
  • Experience working in an Agile environment
  • Experience of building data processing pipelines for use in production batch systems, including either traditional ETL pipelines and/or analytics pipelines
  • Experience in manipulating data through cleansing, parsing, standardising etc, especially in relation to improving data quality/integrity
  Our team members come from a variety of backgrounds and we are currently looking to recruit at most levels to support our extensive product roadmap. We are looking for individuals who want to develop their data engineering skillset whilst working across a wide range of the Quantexa tech stack. Engaging with our internal stakeholders is also a key part of the role – we work closely with delivery, solution/product owners, sales etc to design and develop our solutions. We have a great team culture, with regular socials and a strong presence in Quantexa’s London office, whilst maintaining a flexible working policy allowing for regular home working. We are a fast growing department within Quantexa, having tripled in size over the last 2 years, whilst Quantexa itself is one of the UK’s fastest growing scale-ups. Come and be a part of the next stage of the growth of our team and Quantexa as a whole!

Benefits

Why join Quantexa?

We know that just having an excellent glass door rating isn’t enough so brand-new WeWork office and put together a competitive package as a way of saying thank you for all your hard work and dedication.

We offer:

• Competitive Salary
• Company Bonus

• Private Healthcare, Life Insurance, and Income Protection
• Cyclescheme and Techscheme
• Pension Scheme with a company contribution of 6% (if you contribute 3%)
• 25 days annual leave (with the option to buy/sell up to 5 days) + birthday off!
• Amazing work environment

Quantexa is proud to be an Equal Opportunity Employer. We’re dedicated to creating an inclusive and diverse work environment, where everyone feels welcome, valued, and respected. We want to hear from people who are passionate about their work and align with our values. Regardless of race, beliefs, colour, national origin, gender, sexual orientation, age, marital status, neurodiversity or ableness – whoever you are, if you’re a curious, caring, and an authentic human being who wants to help push the boundaries of what’s possible, we want to hear from you.