Description
Responsibilities:
- Design and implement scalable data pipelines and ETL processes using Azure and Databricks technologies.
- Lead technical discussions with clients and stakeholders to gather requirements and propose solutions.
- Work on high-profile projects with well-known clients across various sectors.
- Help clients realize the potential of data science, machine learning, and scaled data processing within the Azure/Databricks ecosystem.
- Mentor junior team members and support their personal development.
- Take ownership for the delivery of core solution components.
- Knowledge sharing through show-and-tells and contributing towards internal reusable assets.
- Support with planning, requirements refinement, and work estimation.
Skills and Experiences:
- Design and develop end-to-end data solutions leveraging Azure services for batch, real-time, and streaming workloads (including data ingestion, cleansing, modelling, and integration).
- Strong background in enterprise data platform development, concepts, and methods such as data warehouses and data lakehouse, with the ability to adapt based on requirements.