Description
Senior Data Consultant / Engineer
Contract Details:
- Initial 3-month contract
- £525-565 per day, Outside IR35
- Start date: 10th of February 2025
- Remote – 1 day per month in Bristol
- Contractor must be based in the UK
Company Overview:
Unify are proud to be exclusive representing a cutting edge Startup who are experiencing rapid growth. As the team scales and matures, the business is looking to engage the services of a Senior Data Consultant / Engineer on a contract basis for initially 3 months, to help them build a robust, futureproof data warehouse system to enhance and optimize their Data capabilities.
About the Team:
They're a fast growing team with 8 engineers and the foundations of a data science team. They are transitioning towards a data-driven culture, focusing on enhancing access to their data and enabling reporting capabilities without extensive engineering involvement.
Current Data Infrastructure:
- Data Flow: Data is collected primarily through API, but also via client side analytics.
Data Stores:
- Primary Store: MongoDB, storing the majority of their data.
Reporting Tool:
- ElasticSearch, used increasingly for serving reports and analytics through frontend applications.
Challenges:
- Latency issues with large data volumes.
Difficulty generating ad-hoc reports without engineering support.
Objectives:
1. Unlock access to existing data to allow their data scientist to generate reports independently.
2. Optimise current data systems and usage.
3. Support the business in harnessing AI capabilities for data analysis.
4. Create a robust and efficient data warehouse to streamline reporting processes and accommodate future growth.
Scope of Responsibilities:
1. System Review: Assess the current data architecture and reporting capabilities.
2. Stakeholder Collaboration: Work closely with the VP of Engineering, senior engineers, tech leads, and data scientists to gather requirements and understand business needs.
3. Design and Proposal: Produce a proposal outlining the architecture and design of the new data warehouse, considering factors such as scalability, performance, and cost. Include recommendations for optimisations of current systems. Present this proposal no later than the end of Month 1.
4. Implementation: Develop and implement the data warehouse using appropriate technology (such as AWS, BigQuery, Snowflake). Ensure that the architecture is well-documented and meets identified requirements.
5. Handover: Assist in onboarding a newly recruited mid-level data engineer; provide comprehensive documentation for them to understand system.
Deliverables:
1. A documented proposal for the new database architecture
2. Recommendations for improvements/optimisations
3. Implementation ensuring it meets performance/reporting needs
4.Comprehensive documentation/training for new engineer
5.Final rollout/verification
Technical Skills & Qualifications Required:
1.Proven experience designing/implementing databases
2.Proficiency in MongoDB & ElasticSearch desirable; strong experience with alternative solutions (BigQuery/Snowflake) preferred
3.Strong understanding/data modeling & ETL processes required
4.Ability conduct performance analyses/troubleshoot latency issues essential
5.Excellent communication skills necessary/collaborating technical/nontechnical stakeholders required
6.Ideally experience similar role/startup environment or Fintech industry preferred
Project Methodology:
The core Engineering team follows ShapeUp process; contractor not required adhere strictly framework but expected visible/present progress updates throughout contract duration.
Contact Information:
Please reach out to our Talent Manager Mark Brereton for more information.
Thanks