II
Insight International (UK) Ltd
Data Engineer (Iceberg and Scala)
Description
Role: Data Engineer with Iceberg and Scala
Location: Milton Keynes, UK
Job Type: Contract
Job Description:
As a Data Engineer with Iceberg experience, you will play a crucial role in the design, development, and maintenance of our data infrastructure. Your work will empower data-driven decision-making and contribute to the success of our data-driven initiatives.
Must have:
- AWS
- ETL
- EMR
- GLUE
- Spark/Scala
- Java
- Python
Good to have:
- Cloudera β Spark, Hive, Impala, HDFS
- Informatica PowerCenter
- Informatica DQ/DG
- Snowflake Erwin
Qualifications:
β’ Bachelor's or masterβs degree in computer science, Data Engineering, or a related field.
β’ 5 to 8 years of experience in data engineering, including working with AWS services.
β’ Proficiency in AWS services like S3, Glue, Redshift, Lambda, and EMR.
β’ Knowledge on Cloudera based hadoop is a plus.
β’ Strong ETL development skills and experience with data integration tools.
β’ Knowledge of data modeling, data warehousing, and data transformation techniques.
β’ Familiarity with data quality and data governance principles.
β’ Strong problem-solving and troubleshooting skills.
β’ Excellent communication and teamwork skills, with the ability to collaborate with technical and non-technical stakeholders.
β’ Knowledge of best practices in data engineering, scalability, and performance optimization.
β’ Experience with version control systems and DevOps practices is a plus.