Leave us your email address and we'll send you all the new jobs according to your preferences.
Azure Data Engineer
Posted 11 hours 18 minutes ago by KennedyPearce Consulting
£55,000 - £70,000 Annual
Permanent
Not Specified
Factory Jobs
London, United Kingdom
Job Description
Summary:
We are partnered with a fast-growing FinTech group looking to expand their data engineering team. As a Data Engineer, you will have extensive experience working with Azure cloud services, CI/CD, SQL, and Python. In this role, you will design, build, and maintain scalable data pipelines, optimise data storage solutions, and ensure data integrity and availability across their clients' platforms.
Key Responsibilities:- Develop, maintain, and optimise ETL processes using Azure services such as Azure Data Factory, Azure Functions, and Logic Apps.
- Create and manage data workflows that extract data from various sources, transform it, and load it into Azure Data Lakes, Azure Synapse Analytics, or Azure SQL Databases.
- Ensure that infrastructure is designed for scalability, security, and cost-effectiveness using Azure-native tools like Azure Monitor, Azure Security Centre, and Azure Cost Management.
- Design and optimise data storage solutions using Azure services, including Azure Blob Storage, Azure Synapse Analytics, Azure SQL Database, and Cosmos DB.
- Ensure data is stored efficiently and securely, with appropriate backup and disaster recovery strategies using Azure Backup, Azure Site Recovery, and Azure Key Vault.
- Develop Python scripts to automate data processing tasks within Azure, leveraging Azure Functions, Azure Batch, or Databricks to improve workflow efficiency.
- 2-5 years of experience as a Data Engineer.
- Hands-on experience with Python, Java, R (or similar).
- Experience with cloud platforms such as Azure.
- Extensive experience with SQL (MySQL/SQL Server).
- Experience with data pipeline orchestration tools, such as Azure Data Factory or Apache Airflow.
- Familiarity with CI/CD pipelines and version control systems (e.g., Azure DevOps, Git).
- £55k - £70k
- Bonus of 20-30%.
- Opportunities for professional development and certification.
- 3 days working from home per week.
KennedyPearce Consulting
Related Jobs
Head of Data Engineering
- £110,000 - £125,000 Annual
- London, United Kingdom
IT Systems & database analyst
- £40,500 - £49,500 Annual
- Shropshire, Telford, United Kingdom, TF1 1
Head Of Supply Planning (m/f/x)
- Schleswig-Holstein, Elmshorn, Germany, 25335
Coordination And Steering Of Key Performance Indicators (kpi) For Factory Planning (d/m/f/x)
- Baden-Württemberg, Sindelfingen, Germany, 71063
Office Administration
- £12 Hourly
- West Midlands, Dudley, United Kingdom, DY1 1