Description
Company Overview:
We are global IT recruitment specialists that provide support to clients across the UK, Europe, and Australia. We have an excellent job opportunity for you.
Role Details:
Location: Northampton
Duration: 6 months
Job Description:
We are seeking a highly skilled and experienced Senior Cloud Platform Data Engineer (SME) to join our dynamic Payment Gateway team in Fleet, UK. As an SME, you will serve as a subject matter expert, providing technical leadership, guidance, and best practices across the team. You will play a critical role in designing, developing, and implementing complex data solutions on cloud platforms (primarily AWS), ensuring they meet the highest standards of quality, scalability, and performance.
Key Responsibilities:
- Serve as a subject matter expert in cloud data engineering, providing technical guidance and mentorship to the team.
- Drive the design, development, and implementation of complex data pipelines and ETL/ELT processes using cloud-native technologies (eg., AWS Glue, AWS Lambda, AWS S3, AWS Redshift, AWS EMR).
- Develop and maintain data quality checks, validation rules,and data lineage documentation.
- Collaborate with data analysts,data scientists,business stakeholders,and product owners to understand their data needs and translate them into innovativeand effective technical solutions.
- Troubleshootand resolve complexdata quality issues ,performance bottlenecks ,and production incidents.
- Participate in theevaluation ,selection ,and implementationof newdata technologiesand tools.
- Adhere toand champion best practicesin data engineering ,including datasecurity ,privacy,and governance .
- Define andenforce data engineering standards ,processes,and best practiceswithin the team .
- Developand maintain CI/CD pipelinesfordata engineering workflowsusing tools like Jenkins .
- Automate dataingestion ,transformation,and loading processes .
- Work closelywith DevOps teamsand otherengineering teams to ensure smooth deploymentandooperations ofdatapipelines .
- Experience workingon Linux platformsand managingdata on Linux Servers .
- Stay abreastofthe latestadvancementsin cloud computinganddata engineeringtechnologies .
- Contribute tothe developmentand improvementof the team's overallperformanceandefficiency .
- May leadsmall projectsor initiativeswithin thedataengineeringteam .
Qualifications:
- Bachelor's degree in Computer Science ,Computer Engineering or arelated field .
- 7+ years ofexperience indatacengineering witha strongfocusoncloudplatforms(preferablyAWS).
- 3+ years ofexperienceasaseniorengineeror SME ina datacengineeringrole .
- Solid experienceworkingonLinuxplatforms .
- ExperiencewithCI/CDpipelinesandtookslikeJenkins .
- StrongunderstandingofDevOpsmethodologiesandprinciples.
- Solidunderstandingofdatwarehousing,data modelling,anddataintegration principles.
- Proficiencyin at leastoneScripting/programminglanguage(eg.,PythonScalaJava).
- ExperiencewithSQLan NoSQL databases.
- Familiaritywithdatqualityanda datagovernancebestpractices.
Stronganalyticalproblem-solving skills .
Excellentcommunicationinterpersonal,presentation skills .
Desired Skills:
Experience with containerization technologies (eg., Docker,Kubernetes).
Experience with datastreaming platforms(eg.,Kafka,Kinesis).
Experience withdatavisualizationanda BusinessIntelligence tools .
ExperiencewithAgiledevelopmentmethodologies .
AWS Certifications(eg.,AWS CertifiedDataAnalytics-Specialty,AWS CertifiedSolutionsArchitect)