Data Platform Migration Lead

On behalf of UKRI, we are looking for a Data Platform Migration Lead (Inside IR35) for a 14 Month contract based REMOTELY.

Context: Innovate UK is implementing a Data Strategy with new data and AI solutions to improve productivity, automate processes, and enhance customer experience. The Data Platform Migration Lead will play a key role in migrating from a Legacy platform to a new AWS data platform.

Job Purpose:
Lead the migration to the new AWS data platform by managing external suppliers and Matrix-managed internal resources. Serve as a technical lead and hands-on data developer, designing and developing Back End data integrations (ETL functions), addressing data quality issues, and implementing all necessary migration changes to data models and other integration functionalities. Oversee the activity pipeline, prioritise tasks, and ensure effective collaboration between internal and external teams.

As a Data Platform Migration Lead, your main responsibilities will be to:
. Manage the data migration pipeline and team resources to meet quality targets.
. Lead the design and implementation of migration tasks for AWS services (eg, S3, Glue, API Gateway, Batch, Lambda).
. Design and manage changes to data models, ETLs, and other integration functionality.
. Collaborate with Data Platform Leads to align transitions with business needs.
. Address migration challenges and propose process improvements.
. Build and optimize Back End ETL systems and data platforms.
. Ensure effective deployment standards and manage handover of BAU activities.
. Work closely with external suppliers to ensure deliverables are planned and met, challenging them when necessary.
. Hands-on involvement in AWS migration tasks, ensuring technical and operational efficiency.
. Address supplier issues and ensure clarity and delivery of project goals.

Essential:
. Agile experience with strong hands-on experience in Python, Java, and AWS development.
. Proven expertise in data engineering with structured and unstructured datasets.
. Experience deploying and operating AWS Databases (RDS, Aurora, Athena, Dynamo) and AWS DevOps knowledge.
. Proficiency in SQL and large-scale database technologies (MySQL, PostgreSQL, Oracle, MongoDB).
. Experience with integration platforms (eg, AWS API Gateway, Mulesoft (optional).
. Development skills in Shell, Java, R and/or other data-oriented languages very beneficial.
. Ability to build and optimize data sets, 'big data' data pipelines and architectures.
. Familiarity with AWS infrastructure components like S3, Route53, and CloudFormation.
. Exposure to pipeline technologies and MI tools (Spark, PowerBI, QuickSight, Alteryx) advantageous.
. Proficient with Atlassian tools (Jira, Confluence).
. Skilled in architecture, solution design, stakeholder management, and root cause analysis.
. Prepared to engage in hands-on activities to manage team capacity and ensure the delivery schedule is met in the defined sprint schedules.

Please be aware that this role can only be worked within the UK and not Overseas.

Disability Confident

As a member of the Disability Confident Scheme, UKRI guarantees to interview all candidates who have a disability and who meet all the essential criteria for the vacancy. In cases where we have a high volume of candidates who have a disability who meet all the essential criteria, we will interview the best candidates from within that group. This scheme encourages candidates with a disability and/or neurodivergence to apply.

Armed Forces Commitment

UKRI guarantees to interview veterans or spouses/partners of military personnel who meet all the essential criteria for the vacancy. In cases where we have a high volume of ex-military candidates/military spouses or partners, who meet all of the essential criteria, we will interview the best candidates from within that group.

In applying for this role, you acknowledge the following "this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different".