We are seeking a skilled Azure Data Engineer to join my clients team in Manchester or London within the Housing Association sector. This role offers an exciting opportunity to deliver cutting-edge data solutions using the Microsoft Azure technology stack, supporting data-driven decision-making processes across the organisation. The successful candidate will be responsible for designing and implementing cloud-based data solutions while ensuring data accuracy, security, and accessibility.
Salary: £55,000 - £65,000
Location: Manchester or London
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and architectures using Microsoft Azure technologies.
- Work closely with stakeholders to translate business requirements into technical specifications and data solutions.
- Utilise Azure components such as Data Factory, Data Lake, Data Bricks, Synapse, Logic Apps, and Functions to build robust ETL processes.
- Ensure best practices in data modelling using Kimball methodology within enterprise data warehouse environments.
- Support data quality initiatives, master data management, profiling, cleansing, and reporting using tools like Microsoft Purview and Master Data Services.
- Develop and maintain analytics and business intelligence solutions with Power BI and related tools.
- Implement security and governance measures to maintain high standards for data integrity and compliance.
- Collaborate with cross-functional teams within an Agile framework, including product owners, architects, and analysts.
Essential Skills and Experience:
- Proven experience with relational databases (e.g. SQL Server), Big Data, and warehousing concepts.
- Strong experience with Azure Data Lake, Data Factory, Synapse, Data Bricks, Logic Apps and Functions.
- Thorough understanding of ETL and BI platforms, data modelling using Kimball methodology, and data warehouse strategy.
- Experience with master data management, data quality frameworks, Microsoft Purview, and related tooling.
- Proficiency in Python, Scala, or PySpark for data engineering tasks.
- Solid understanding of Microsoft technology stack including SharePoint, PowerPivot, and Power BI.
- Experience in data integration, external data loading mechanisms, and information repository development.
Desirable Skills:
- Exposure to PowerShell scripting.
- Familiarity with DevOps, CI/CD, IaaS, PaaS, SaaS, and containerisation tools.
- Experience in developing pilots, proofs of concept, or technical prototypes.
- Knowledge of Semarchy for master data management.
- Experience with NEC Housing Management System and PL/SQL.
- Familiarity with Total Mobile, Total Repairs, and Total Connect Repairs solutions.
This is an excellent opportunity for a motivated and experienced Azure Data Engineer to make a meaningful impact on the delivery and evolution of data capabilities in the housing sector. If you are passionate about data and technology, and enjoy working in a collaborative and forward-thinking environment, we would love to hear from you.