LI
LA International Computer Consultants Ltd
Data Architect
Description
Hybrid role with weekly travel to Leeds (2 days)
6 month contract initial
Responsibilities:
- Design, deploy, and manage Databricks clusters on Google Cloud Platform (GCP), ensuring optimal performance, scalability, and reliability.
- Provide expertise in Databricks architecture, configuration, and administration, following best practices and industry standards.
- Collaborate with data engineering, data science, and analytics teams to understand their requirements and provide technical guidance and solutions.
- Optimize Databricks workloads and processes for performance, cost-efficiency, and scalability.
- Monitor and troubleshoot Databricks clusters, identifying and resolving issues proactively.
- Implement security measures and ensure compliance with data governance and privacy regulations.
- Design and implement data pipelines and workflows, integrating Databricks with other GCP services and tools.
- Stay up to date with the latest advancements in Databricks, GCP, and data engineering technologies, evaluating their applicability to our environment.
- Mentor junior team members by providing guidance and support in Databricks administration and architecture.
Requirements:
- Minimum of 5 years of experience as a Databricks Admin/Architect with a strong focus on Google Cloud Platform (GCP).
- Extensive experience in designing, deploying, managing Databricks clusters; notebooks; jobs; libraries.
- Deep understanding of Databricks architecture; configuration; performance optimization techniques.
- Strong knowledge of GCP services including Compute Engine; BigQuery; Cloud Storage; Dataflow; Pub/Sub.
- Proficiency in scripting languages like Python or Scala for automation; terraform; data engineering tasks.
- Experience with data engineering principles/tools such as ETL/data pipelines/data modelling.
- Strong troubleshooting/problem-solving skills able to identify/resolving complex issues timely.
- Excellent communication/collaboration skills able to work effectively cross-functionally.
- GCP certifications such as Google Cloud Certified - Data Engineer or Professional Cloud Architect are highly desirable.
LA International is a HMG approved ICT Recruitment & Project Solutions Consultancy operating globally from the largest single site in the UK as an IT Consultancy or Employment Business & Agency depending upon the precise nature of work for security cleared jobs or non-clearance vacancies LA International welcomes applications from all sections of the community & people with diverse experience/backgrounds.
Award Winning LA International winner of Recruiter Awards for Excellence Best IT Recruitment Company Best Public Sector Recruitment Company & overall Gold Award winner has now secured most prestigious business award any business can receive The Queens Award for Enterprise: International Trade for second consecutive period.