Data Engineer

An exciting opportunity has arisen for a Data Engineer to join a dynamic company focused on building and improving its data systems. The role involves designing, optimising, and maintaining scalable data solutions to support the organisation's decision-making process. You will work with senior engineers and use a range of cloud-based tools and Microsoft technologies to ensure seamless data management. The organisation prides itself on offering a supportive work environment, where innovation, collaboration, and continuous learning are encouraged. It focuses on delivering high-quality services through data-driven insights, and the Data Engineer will play a key role in this mission. Key Responsibilities: The role will involve assisting in the creation and upkeep of data pipelines that facilitate smooth data transfer throughout the business. You'll handle the end-to-end ETL processes, using tools like Azure Data Factory and SQL to move and transform data as needed. Additionally, you'll contribute to migrating data from legacy systems into a cloud-based infrastructure on Azure, ensuring the transition is efficient and secure. Data models and warehousing solutions will be a key part of your work. You'll help in developing structures that support effective business intelligence and reporting, ensuring data flows smoothly between different systems. Collaborating closely with other teams, such as Business Intelligence and IT, you will play a pivotal role in ensuring that data is integrated correctly across multiple platforms. You'll also work with tools like Azure Synapse and Azure Data Factory to manage data storage, optimising processes to ensure data is secure, organised, and accessible. Managing data lakes and setting up secure access for various business units will be part of your day-to-day activities. In addition, you will contribute to the development of reports and dashboards in Power BI. These reports will provide valuable insights to different teams across the company, and you'll ensure that all data presented is accurate, consistent, and timely. Should any issues arise with reporting, you'll be tasked with troubleshooting and ensuring everything runs smoothly. Your work will also involve maintaining high standards of data security and governance, working alongside senior engineers to implement best practices. You will ensure compliance with relevant regulations and make sure the company's data is handled in line with internal security policies. Requirements: Experience working in a data engineering role, ideally with a minimum of two years in the field. Practical experience with Microsoft-based tools such as Power BI, SSIS, Azure Synapse, and Azure Data Factory. Proficiency in SQL for managing relational databases and handling complex queries. A good understanding of ETL processes and data warehousing concepts. Strong analytical skills and the ability to solve problems using data-driven approaches. Good communication skills and the ability to work collaboratively in a team-oriented environment. A passion for data and a desire to learn new technologies and approaches. Desirable: Hands-on experience with Azure cloud services, including data lake management and Azure Synapse. Familiarity with data extraction from CRM systems, such as Microsoft Dynamics. Experience in creating effective dashboards and reports using Power BI.