Description
GCP
Architect
Databricks
Banking
We are seeking an experienced Databricks Architect/Admin to design, deploy, and manage Databricks clusters on Google Cloud Platform (GCP). The ideal candidate will have a strong focus on optimal performance, scalability, and reliability, and will provide expertise in Databricks architecture, configuration, and administration.
Responsibilities
- Design, deploy, and manage Databricks clusters on Google Cloud Platform (GCP), ensuring optimal performance, scalability, and reliability.
- Provide expertise in Databricks architecture, configuration, and administration, following best practices and industry standards.
- Collaborate with data engineering, data science, and analytics teams to understand their requirements and provide technical guidance and solutions.
- Optimize Databricks workloads and processes for performance, cost-efficiency, and scalability.
- Monitor and troubleshoot Databricks clusters, identifying and resolving issues proactively.
- Implement security measures and ensure compliance with data governance and privacy regulations.
- Design and implement data pipelines and workflows integrating Databricks with other GCP servicesand tools.
- Stay up to date with the latest advancements in Databricks,GCP,and data engineering technologies,and evaluate their applicability to our environment.
- Mentor junior team members providing guidanceand support inDatabricks administrationand architecture.
Essential Skills
- Minimum of 5 years of experience as a Databricks Admin/Architect with a strong focus on Google Cloud Platform (GCP).
- Extensive experience in designing,deploying,and managingDatabricksclusters notebooks,jobs,and libraries.
- Deep understanding ofDatab riksarchitecture configuration,and performance optimization techniques.
- Strong knowledge of GCP services including Compute Engine BigQueryCloud Storage Dataflowand Pub/Sub.
- Proficiencyin Scripting languages like Python or Scala for automation terraformanddataengineering tasks.
- Experiencewithdataengineering principlesandtools such as ETL,data pipelines.
- Excellent troubleshootingandproblem-solving skillswiththe abilityto identifyandresolvecomplexissuesin atimely manner.
- Excellent communicationandcollaboration skillswiththe abilitytoworkeffectivelyincross-functional teams.
Additional Skills & Qualifications
-GCP certifications such as Google Cloud Certified - Data Engineer or Google Cloud Certified - Professional Cloud Architect are highly desirable.
Location
Sheffield UK
Rate/Salary
500.00 - 650.00 GBP Daily
Trading as TEKsystems.Allegis Group Limited Bracknell RG12 1RT United Kingdom.No2876353.Allegis Group Limited operatesas an Employment BusinessandeEmployment Agencyasset outinthe Conductof EmploymentAgenciesandeEmployment BusinessesRegulations2003.TEKsystems isacompanywithin the AllegisGroupnetworkofcompanies(collectivelyreferredtoas"AllegisGroup").Aerotek,AstonCarter,EASi,TalentisSolutions TEKsystems StamfordConsultantsandt heStamfordGroupareAllegisGroupbrands.Ifyouapply yourpersonaldatawillbeprocessedasdescribedinthe AllegisGroupOnlinePrivacyNoticeavailableatourwebsite.ToaccessourOnlinePrivacyNotice which explainswhatinformationwemaycollectuseshareandestoreaboutyou,anddescribesyourrightsandoverchoicesaboutthis pleasego ourwebsite.Wepartofaglobalnetworkofcompaniesandasresultthepersonal datayouprovidewillbesharedwithinAllegisGroupandtransferredan dprocessedoutside theUKSwitzerlandan dEuropeanEconomicAreasubjecttotheprotectionsdescribedinthe Allegis Group Online Privacy Notice.Westorepersonaldata intheUKEEASwitzerlandan dtheUSA.Ifyouwouldlike toexercise yourprivacyrightspleasevisit the "Contacting Us" sectionofourOnlinePrivacyNoticeonourwebsitefordetailsonhowtocontactus.To protectyourprivacyands ecuritywemaytakesteps toverifyyouridentitysuchasapasswordandus erIDifthereisanaccountassociatedwithyourrequestoridentifyinginformation suchasyouraddressordateofbirthbeforeproceedingwithyourrequest.commitmentsundertheUKDataProtectionAct EU-U.S.PrivacyShieldortheSwiss-U.S.PrivacyShield.