Data Engineer

On behalf of Companies House, we are looking for a Data Engineer inside IR35 for a 6 month contract based remotely

Companies House drives confidence in the economy and makes the UK a great place to start, and run, a business.

As an executive agency sponsored by The Department for Business and Trade (DBT) we have the ability to play a leading role in the right against corrupt business practices by providing the transparency and clarity necessary for the UK to continue to be regarded as a world-leading place to do business.

Companies House is undergoing an historic change - to our systems, culture, services, and ways of working. Our people are at the heart of these changes.

The Economic Crime and Corporate Transparency Act (2023) gives Companies House the power to play a more significant role in disrupting economic crime and supporting economic growth.

These changes represent the biggest opportunity for Companies House in almost 170 years. This move will help us achieve the kind of culture we want - one which drives high performance and where our brilliant people can flourish.

As a Data Engineer, your main responsibilities will be:

Key Responsibilities:

*Design, develop, and maintain AWS data pipelines.

*Use AWS Database Migration Service (DMS) to implement and manage change data capture ingestion.

*Implement and manage Change Data Capture (CDC) validation and processing pipelines using AWS services to ensure data consistency and accuracy.

*Use Terraform for infrastructure as code to automate deployment and management of AWS resources.

*Collaborate with cross-functional teams to understand data requirements and deliver solutions.

*Ensure data security, integrity, and compliance with industry standards.

Qualifications / Experience:

*Proven experience in Oracle log mining or AWS Binary Reader, and Change Data Capture (CDC) techniques.

*Snowflake and DBT Labs experience would be beneficial.

*Expertise in AWS DMS and general AWS data engineering.

*Proficiency in Terraform for infrastructure automation.

*Strong SQL and Oracle database management skills.

*Familiarity with data warehousing concepts and ETL processes.

Please be aware that this role can only be worked within the UK and not Overseas.

Disability Confident

As a member of the Disability Confident Scheme, Companies House guarantees to interview all candidates who have a disability and who meet all the essential criteria for the vacancy. In cases where we have a high volume of candidates who have a disability who meet all the essential criteria, we will interview the best candidates from within that group.

Armed Forces Covenant / Commitment

Companies House guarantees to interview veterans or spouses / partners of military personnel who meet all the essential criteria for the vacancy. In cases where we have a high volume of ex-military candidates / military spouses or partners, who meet all of the essential criteria, we will interview the best candidates from within that group.

In applying for this role, you acknowledge the following "this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different".