Description
Location: London
Requirements:
- Advanced ability as a Senior Java Data Engineer/Data Architect
- AWS (EC2, ECS, EKS, Glue)
- Excellent Java ability
- Some Python experience
- Spark proficiency
- Experience with Airflow or Dagster
- Knowledge of at least one of the following:
- Apache Iceberg
- DBT
- Dremio
- Snowflake
Desirable Skills:
- Experience with data mesh architectures
Role Overview:
You will join a number of teams that are responsible for the core engineering of a large amount of financial trading data. The data is currently ingested into and stored in an AWS data lake. This is being migrated to a data mesh architecture. You will work within a team of 4-5 engineers that will contribute towards this migration, working with AWS Glue, Athena, Python, Java, Iceberg, DBT, Arrow and Dremio.
Working Arrangement:
They have a very flexible hybrid working setup of 1-2 days/month in the office.
Duration:
12-24 months
Rate:
£650-950/day