Data Engineer

We are looking for a Data Engineer with proven experience with Databricks, including strong experience Python/ PySpark. This is an initial 6 month contract; you will be required onsite 3 days per week.

• Experience in managing teams of Data Engineers and Data Scientists working for 3rd
• Proven experience with Databricks, including building and optimizing Databricks notebooks and workflows.
• Demonstrated expertise in designing and implementing scalable, fault-tolerant data pipelines using Databricks.
• Strong proficiency in SQL and Python/PySpark for data transformation and analysis
• Experience integrating Databricks with other Azure data services, such as Azure Data Factory, Azure Synapse, and Azure DevOps
• Knowledge of data modelling techniques, including the creation of relational and dimensional data models
• Familiarity with data governance best practices, including data quality management and master data management.
• Passion for staying up to date with the latest Databricks features, capabilities, and industry trends.
• Proactive problem-solving mindset and a commitment to delivering high-quality data engineering solutions.
• Ability to collaborate effectively with cross-functional teams, including data analysts and data scientists.
• Excellent written and verbal communication skills for documenting processes and presenting findings

Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.