Outside IR35 contract jobs

Description

Location:
- Fully onsite near Worcester/Great Malvern/Gloucester

Daily Rate:
- Up to £700 outside IR35

Duration:
- 6 months with possible extension

Clearance:
- Must be SC cleared; DV preferred

Note:
- This position can be contract or permanent (up to £90k)

---

Role Overview:
Methods Analytics are seeking a seasoned Senior Data Engineer (Infrastructure) to join our team. This role is essential for designing, building, and maintaining sophisticated data infrastructure systems that operate across both on-premises and Azure cloud environments. The position involves deploying and managing scalable data operations that support advanced analytics and data-driven decision-making, crucial for our organisational growth and innovation.

---

Requirements:

1. Develop and Manage Data Pipelines:
- Design, construct, and maintain efficient and reliable data pipelines using Python.
- Support both streaming and batch data processing across structured, semi-structured, and unstructured data in on-premises and Azure environments.

2. Hybrid Cloud and Data Storage Solutions:
- Implement and manage data storage solutions leveraging both on-premises infrastructure and Azure.
- Ensure seamless data integration and accessibility across platforms.

3. Containerisation and Orchestration:
- Utilise Docker for containerisation.
- Use Kubernetes for orchestration to ensure scalable deployment of applications across cloud-based & on-premises environments.

4. Workflow Automation:
- Employ tools such as Apache NiFi & Apache Airflow to automate workflows within hybrid environments.

5. Event Streaming Experience:
- Utilise event-driven technologies like Kafka/Apache NiFi/Apache Flink effectively handle real-time streams efficiently

6 .Security Compliance : Manage security setups access controls incorporating Keycloak protect integrity comply legal standards all platforms

7 .Data Search Analytics : Oversee enhance Elasticsearch setups robust searching analytics capabilities mixed infrastructures settings

8 .Database Management Administer optimize PostgreSQL databases ensuring high performance availability diverse deployment scenarios

---

Essential Skills Experience :

1.Strong Python Skills Expertise Scripting automating processes varied environments

2.Demonstrable ETL ELT Workflows Development Optimization Particularly Hybrid On Premise Azure Environments

3.Hybrid Cloud Architecture Profound Knowledge Integrating On Premise Infrastructure With Services

4.Containerization Orchestration Solid Docker Kubernetes Managing Applications Both Platforms

5.Workflow Automation Practical Tools Apache Nifi Airflow Hybrid Environments

6.Event Streaming Proven Ability Managing Deploying Platforms Kafka Nifi Flink

7.Data Security Implementing Practices Including Keycloak Multiple Platforms

8.Search Database Management Strong Background Elasticsearch PostgreSQL Spanning Infrastructures

---

Your Impact :

In this role you will empower business leaders make informed decisions delivering timely accurate actionable insights robust hybrid infrastructure expertise drive seamless integration premises based solutions enhancing flexibility scalability operations champion adoption modern architectures tooling pivotal cultivating culture mentoring advancing practices

---

Desirable Skills Experience :

Certifications Relevant Technologies Highly Beneficial Strengthen Application Minimum Years Significant Exposure Managing Settings