Data Engineer

On behalf of DWP, we are looking for a Data Engineer for a 12 Month (Inside IR35) contract based hybrid 2 days per week in Manchester, Birmingham, Sheffield, Leeds, Newcastle or Blackpool

Working with DWP, you will be helping us to drive our priorities to:
. Help people to move into work and support those already in work to progress, with the aim of increasing overall workforce participation
. Help people to plan and save for later life, while providing a safety net for those who need it now
. Provide effective, efficient, and innovative services to the millions of claimants who rely on us every day, including the most vulnerable in society
. Improve experience of our services while maximising value for money for the taxpayer.

Note: SC Clearance is an essential requirement for this role, (as a minimum you will need to eligible for SC)

As a Data Engineer, you will be part of a team that delivers proactive, innovative and insightful data products via agile philosophies, using best in practice cloud technologies that tangibly improves the outcomes for millions of citizens across the country. You will work closely with stakeholders to develop and maintain modern robust data products and services. You will be an active member of the wider DWP data practice, contributing and learning from the wider community.

Key responsibilities include:

Translate business requirements to ensure they are clear and robust, and can be transformed into reusable production ready code and/or effective data models;

Define version control mechanisms and strategies for the source code of products;

Support Quality Assurance colleagues and Data Managers responsible for the day to day testing and live running of data products and services;

Shape solutions in a fit for purpose way; following the agreed principles and contribute to the overall Data Engineer Development life cycle;

Perform data profiling and quality measurements;

Design and develop reusable metadata libraries;

Own/ensure the stability of new products designed, including the on-going robustness, resilience and stability of these products;

Identify, manage and resolve issues preventing the delivery or continuous development of products; and

Support the growth of the team, by keeping abreast of market and industry trends, and sharing knowledge and experience with the rest of the team.

Within this specific role, you will act as an ETL developer, undertaking development of data pipelines on the Health Data and Analytics Platform. In this context:

Technical Skills:

Define version control mechanisms and strategies for the source code of the product

Develop automated data ingest routines, workflows and mappings for structured and unstructured data, utilising the Azure enterprise stack (eg Databricks, Data Factory, Synapse, Python, SQL).

Produce comprehensive test scripts to ensure code quality.

Have accountability for translating user requirements and Data models into effective, robust ETL solutions in line withbuild standards and ensure code is production ready.

Develop reusable code.

Collaborate with customers and other job roles within the team to meet our data delivery objectives.

The role may also require Line Management responsibilities of other Data Engineers

Knowledge and Experience required:

Experience of designing and developing data solutions using Microsoft Azure services for collection, storage, processing, analysis and security of data.

Please be aware that this role can only be worked within the UK and not Overseas.