Description
Location: London ideally but open to Birmingham, Manchester or Newcastle
Duration: 6+ months contract
Overview:
We are looking for a skilled Data Engineer with expertise in Databricks and Microsoft Power Platform Automate engines to design, build, and optimize data workflows and automation solutions.
Key Responsibilities:
- Develop, implement, and maintain data pipelines using Databricks (Apache Spark, Delta Lake, MLflow).
- Design and optimize ETL/ELT workflows to process large datasets efficiently.
- Automate data processing and integration tasks using Power Automate, Power Apps, and Power BI.
- Work with Azure Data Services (Azure Data Lake, Synapse Analytics, Data Factory, Azure SQL) to manage data storage and processing.
- Create low-code automation workflows to enhance data accessibility and business process efficiency.
- Implement API integrations and Power Automate connectors to link various data sources.
- Monitor troubleshoots,and optimizesdataworkflowsforperformanceandreliability.Collaboratedwithdataanalysts,businessstakeholders,andsoftwareteamstoenableself-serviceanalyticsandreporting.StayupdatedonemergingtrendsinDatabricksPowerPlatformandcloudautomationtechnologies.
Required Skills & Qualifications:
3+ years of experience in datengineeringETLdevelopmentorclouddataprocessing.StrongknowledgeofPowerAutomateandPowerAppsforworkflowautomationandprocessoptimizationExperiencewithAzureDataServices(DataLakeSynapseAzureSQLDataFactory).ProficiencyinSQLandPythonfordatatransformationandautomation.Hands-onexperiencewithAPIintegrationRESTServices,andPowerPlatformconnectorsStronganalyticalproblem-solvingskillswiththeabilitytoworkindependentlyorin ateam.PriyankaSharmaSeniorDeliveryConsultantOffice02033759240Emailpsharma@vallumassociatescom