Data Engineer - SC Clearance

Posted 1 day ago by Stott and May

£55,000 - £65,000 Annual
Permanent
Not Specified
Public Sector Jobs
Yorkshire, United Kingdom
Job Description

Data Engineer - SC Clearance
Leeds (Hybrid and Flexible Working Available)
65K + Bonus
*MUST HAVE ACTIVE SC CLEARANCE

Join a leading digital intelligence organisation working at the forefront of data-driven transformation for the public sector. We are looking for a Data Engineer with active SC Clearance to help evolve a successful proof-of-concept into a fully productionised and supported data platform using cutting-edge Microsoft Azure technologies.

What You'll Be Doing:
Over the past four years, our client has partnered with Mobilise to explore and validate a modern data warehouse and Business Intelligence ecosystem. This journey included a full proof-of-concept, showcasing the potential of Microsoft's data stack to unlock actionable insights and improve internal reporting capabilities.

We are now entering the next phase: transforming this proof-of-concept into a robust, scalable, and secure production environment. You'll play a key role in delivering this vision as part of an agile team focused on:

Developing scalable Azure Data Factory pipelines

Implementing STAR schema-based data models in Azure SQL

Enhancing security, manageability, and cost-efficiency of data operations

Building reusable, templated data ingestion processes

Applying data segregation, masking, and pseudonymisation techniques

What You'll Bring:
MUST HAVE:

Active Security Clearance (SC) - This is a non-negotiable requirement due to the sensitive nature of the project.

Technical Skills:
Azure Data Factory (ADF):

Incremental dimension creation to reduce compute and data processing costs

Integration using managed identities or service principals for secure authentication

Parallelism and performance tuning for ADF pipelines

Templating for reusable, scalable ingestion patterns

Azure SQL:

Integration with Microsoft Entra ID (formerly Azure AD)

STAR schema implementation for analytic models

Standardising naming conventions and schema organisation

Migrating data processing logic from Power BI to the SQL layer

Applying robust data security, masking, and pseudonymisation techniques

What's In It For You:
Competitive pension scheme

Employee share plans

Flexible benefits (including green car scheme, private healthcare, and lifestyle discounts)

Annual performance-related bonus (where eligible)