Description
We are seeking a highly skilled AWS Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions on AWS, leveraging Iceberg, PySpark, AWS Glue, and AWS Lambda. You will work closely with cross-functional teams to build robust data pipelines and optimize data workflows for high performance and efficiency.
Key Skills:
- Strong expertise in Apache Iceberg
- Hands-on experience with AWS Glue
- Proficiency in PySpark for distributed data processing and transformations.
- Proficiency in Athena
- Experience with AWS Lambda for event-driven data processing and automation.
- Strong understanding of data lakehouse architectures, partitioning strategies, and performance tuning.
- Solid experience working with AWS services such as S3, IAM, CloudWatch, Step Functions, and Athena.
- Proficiency in NoSQL databases.