Description
Location: London
You MUST have the following:
- Experience as a Senior DevOps Engineer/SRE/Python Developer in an Agile environment
- Strong experience delivering solutions in the AWS (Amazon Web Services) cloud
- Advanced ability in CI/CD DevOps tools
- Good experience with open-source Kubernetes - lower-level engineering and tweaks
- Experience working with data engineering teams
- Python
- Experience with 2 or more of the following:
- Kafka
- Airflow
- Spark
- PySpark
- Dremio
- Ignite
- DBT
- Iceberg
- Arrow
- Glue
- Athena
The following is DESIRABLE not essential:
- Java (J2EE or Core Java)
- Golang
Role Description:
You will join a team of 6/7 Data DevOps Engineers that are operating in a central team that support a number of data engineering teams. The data engineering teams are working with a very modern tech stack that includes AWS, Glue, Athena, Airflow, PySpark, Spark, Dremio, DBT, Iceberg and Apache Arrow. The ideal candidate will come from a similar environment and have experience setting up automated processes for the data engineers.
Working Conditions:
There is a very flexible working from home policy.
Duration:
12-24 months
Rate:
£650-900/day