Description
Title: Principal Data Engineer Duration: 6 Months with likelihood of extending to 12Location: UK (Remote) Who you'll work withYou’ll be a member of a global team working on GenAI initiative. Client's Tech Ecosystem function is responsible for developing and delivering all technology solutions for the firm’s internal use. We are taking a cloud-first approach to transform our data platforms and analytical applications across the firm. We are seeking an experienced data engineer to shape and accelerate the delivery of target state data platform enabling GenAI use-cases. We want a passionate specialist who loves to build data solutions as part of multi-disciplinary team, working closely with digital product professionals, data scientists, cloud engineers and others. Your impact within our firm.We are looking to staff a rockstar Principal Data Engineer to join Lilli team in enabling GenAI application with data. You’ll learn what it’s like to build and work on a GenAI product that has Firm-wide impact.As part of the team, you sit at the technical side and work closely with product professional to deliver data processing capabilities enabling top use cases to transform how we work using GenAI. You collaborate with cross-functional teams, including product managers, data scientists, engineers, data engineers, designers, and Firm stakeholders, to define product requirements, prioritize features, and drive a successful delivery.You will be leading multiple workstreams that include work related to data infrastructure, data engineering framework & adoption, developer productivity, data processing capabilities, GenAI-agents data enablement and more. What you'll doAs a Principal Data Engineer, you will be responsible for making critical technical design decisions that shape our data infrastructure. You will mentor and apprentice data engineers, fostering their growth and ensuring they adhere to best practices. Your role includes influencing the data engineering team structure to optimize delivery and maximize impact. You will also be accountable for the quality of deliverables, ensuring that all code meets high standards of reliability, scalability, and performance. Your leadership and expertise will drive the team to achieve excellence in all aspects of data engineering. Skills8+ years of professional experience as a data engineer, with a strong focus on cloud- based data engineering using AWS servicesExperience leading teams of engineering professionalsCreation of enterprise-grade data solutions at large scaleExpertise with Python developmentFluency with data architecture & data engineering patterns and ability to apply them appropriatelyExperience with relational databases and vector storesStrong experience with containerization technologies and AWS ECSPracticing high coding standards with clean code, modularity, error handling, testing automation and moreVery driven, superstrong on execution and output orientation, likes to get job done attitude and ability to figure things out independently. Able to work in complex and very fast paced environmentInterest in Generative AI and other ML topicsKedro framework experience as a plusHolds their ground, opinionated, not afraid to speak up at any levelFamiliarity with agile principles and product developmentExcellent problem-solving skills and the ability to analyze and resolve complex data engineering challengesStrong communication and collaboration skills, with the ability to work effectively in a cross-functional team environment