Insight International (UK) Ltd

Data Engineer (Iceberg and Scala)
Apply Now

πŸ“… Date Posted

Jan 24, 2025

πŸ’Ό Job Type

CONTRACTOR

πŸ“ Location

Milton Keynes

πŸ’΅ Rate

Unknown

Description

Role: Data Engineer with Iceberg and Scala
Location: Milton Keynes, UK
Job Type: Contract

Job Description:
As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.

Must have:
- AWS
- ETL
- EMR
- GLUE
- Spark/Scala
- Java
- Python

Good to have:
- Cloudera – Spark, Hive, Impala, HDFS
- Informatica PowerCenter
- Informatica DQ/DG
- Snowflake Erwin

Qualifications:
β€’ Bachelor's or master’s degree in computer science, Data Engineering, or a related field.
β€’ 5 to 8 years of experience in data engineering, including working with AWS services.
β€’ Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR.
β€’ Knowledge on Cloudera based hadoop is a plus.
β€’ Strong ETL development skills and experience with data integration tools.
β€’ Knowledge of data modeling, data warehousing, and data transformation techniques.
β€’ Familiarity with data quality and data governance principles.
β€’ Strong problem-solving and troubleshooting skills.
β€’ Excellent communication and teamwork skills, with the ability to collaborate with technical and non-technical stakeholders.
β€’ Knowledge of best practices in data engineering, scalability, and performance optimization.
β€’ Experience with version control systems and DevOps practices is a plus.

Share:
Interested in this job?
Apply Now

Subscribe Newsletter

Sign up to our newsletter to get Outside IR35 jobs directly to your inbox.