Description
Job Title: Principal Data EngineerDuration = 6 Months with likelihood of extending to 12Location = UK (Remote)Principal Data Engineer Who you'll work withYou’ll be a member of a global team working on GenAI initiative. Client’s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm.We are seeking an experienced data engineer to shape and accelerate the delivery of target state data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others. Your impact within our firm.We are looking to staff a rockstar Principal Data Engineer to join Lilli team in enabling GenAI application with data. You’ll learn what it’s like to build and work on a GenAI product that has Firm-wide impact.As part of the team, you sit at the technical side and work closely with product professional to deliver data processing capabilities enabling top use cases to transform how we work using GenAI. You collaborate with cross-functional teams, including product managers, data scientists, engineers, data engineers, designers, and Firm stakeholders, to define product requirements, prioritize features, and drive a successful delivery.You will be leading multiple workstreams that include work related to data infrastructure, data engineering framework & adoption, developer productivity, data processing capabilities, GenAI-agents data enablement and more.What you'll doAs a Principal Data Engineer, you will be responsible for making critical technical design decisions that shape our data infrastructure. You will mentor and apprentice data engineers, fostering their growth and ensuring they adhere to best practices. Your role includes influencing the data engineering team structure to optimize delivery and maximize impact. You will also be accountable for the quality of deliverables, ensuring that all code meets high standards of reliability, scalability, and performance. Your leadership and expertise will drive the team to achieve excellence in all aspects of data engineering.Skills8+ years of professional experience as a data engineer, with a strong focus on cloud- based data engineering using AWS servicesExperience leading teams of engineering professionalsCreation of enterprise-grade data solutions at large scaleExpertise with Python developmentFluency with data architecture & data engineering patterns and ability to apply them appropriatelyExperience with relational databases and vector storesStrong experience with containerization technologies and AWS ECSPracticing high coding standards with clean code, modularity, error handling, testing automation and moreVery driven, superstrong on execution and output orientation, likes to get job done attitude and ability to figure things out independently. Able to work in complex and very fast paced environmentInterest in Generative AI and other ML topicsKedro framework experience as a plusHolds their ground, opinionated, not afraid to speak up at any levelFamiliarity with agile principles and product developmentExcellent problem-solving skills and the ability to analyze and resolve complex data engineering challengesStrong communication and collaboration skills, with the ability to work effectively in a cross-functional team environmentData Engineer DutiesWho you'll work withYou’ll be a member of a global team working on GenAI initiative. Client’s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm.We are seeking an experienced data engineer to shape and accelerate the delivery of target state data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others.Your impact within our firmWe are looking for a Data Engineer with expertise in Python development, who is passionate about cloud- based data engineering using AWS services and loves to build data solutions as part of multi-disciplinary team.You would be working closely with digital product professionals, data scientists, cloud engineers and others.You’ll be a member of a global team working on GenAI initiative, based in one of our European offices. Our Client’s Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use.You will work in a team of data engineers to develop data ingestion pipelines, create and mature data processing capabilities that ingest data into a data system used by GenAI applications.Your work would include but won't be limited to creation of the python code, tests, creation and modification of GitHub Action CICD pipelines, working with AWS-based infrastructure and docker containers.What you'll do You will work in a team of data engineers to develop data ingestion pipelines, create and mature data processing capabilities that ingest data into a data system used by GenAI applications. Work includes but not limited to creation of the python code, tests, creation and modification of GitHub Action CICD pipelines, working with AWS-based infrastructure and docker containersSkills3+ years of professional experience as a data engineer, with a strong focus on cloud- based data engineering using AWS servicesExpertise with Python developmentPracticing high coding standards with clean code, modularity, error handling, testing automation and moreStrong experience with relational databasesVery driven, superstrong on execution and output orientation, likes to get job done attitude and ability to figure things out independently. Able to work in complex and very fast paced environmentHands-on experience with DockerSolid and demonstrable background in data pipeline performance and diagnosticsInterest in Generative AI and other ML topicsKedro framework experience as a plusHolds their ground, opinionated, not afraid to speak up at any levelFamiliarity with agile principles and product developmentExcellent problem-solving skills and the ability to analyze and resolve complex data engineering challengesStrong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment