Description
Greenrich is looking for fill the following role. Interested candidates, please send cv's to [email protected] : *Azure Data Engineer*Client : *Public Sector services*Duration : *Initially 12 months*Location : London (NW1) / Hybrid (mostly 2 days onsite)Day Rate : £350 IR35 Determination : Outside (TBC)IlR, PSW, British Citizen and Dependent are eligible.*Skills and ExperienceEssential*: • Proven experience as a Data Engineer, working on large-scale data integration and analytics projects. • Strong expertise with Azure Cloud Services, including Azure Data Factory (ADF), Azure Synapse Analytics, and Azure Blob Storage. • Hands-on experience with Snowflake for data warehousing, modeling, and performance optimization. • Proficiency in Python for data engineering, automation, and ETL development. • Solid understanding of SQL for querying and managing relational databases. • Familiarity with data lake architectures, data pipelines, and schema design principles. • Experience with data governance, security, and compliance frameworks.*Desirable*: • Experience with IoT data processing and working on smart city or similar projects. • Knowledge of real-time data streaming technologies like Azure Event Hub or Apache Kafka. • Proficiency in visualization tools like Power BI or Tableau. • Understanding of geospatial data processing and analytics.*Key Responsibilities* • Design, develop, and optimize scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Azure Synapse Analytics. • Build and maintain robust data integration workflows to connect various sources, ensuring high data quality and performance. • Implement and manage Snowflake-based data warehousing solutions for advanced analytics and reporting. • Collaborate with cross-functional teams to support the development of data-driven smart city applications. • Write efficient, reusable, and scalable Python scripts for data processing, transformation, and automation tasks. • Develop and enforce data governance standards, ensuring data security and compliance. • Monitor, troubleshoot, and optimize data pipelines and workflows to ensure reliability and efficiency. • Work with large, complex datasets to deliver insights that support smart city initiatives, such as IoT data, public transport, and environmental analytics.*Qualifications* • Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field. • Azure certifications (e.g., Azure Data Engineer Associate) are a strong plus.