Data Engineer - Multi-Cloud

UBDS Group is seeking a skilled Data Engineer to support the design, development, and optimisation of data platforms across complex transformation programmes. This role is suited to an engineer with hands-on experience in data pipelines, cloud platforms, and ETL processes, who is looking to further develop their expertise in a collaborative, delivery-focused environment.

You will contribute to building reliable, scalable data solutions that enable analytics, reporting, and operational use cases.

Key Responsibilities

• Develop and maintain data pipelines and ETL processes using cloud-native technologies (e.g. Spark)
• Support integration of cloud and on-premise data sources
• Assist in implementing event-driven data pipelines, improving performance and scalability
• Contribute to the development of data access layers and reusable ETL components
• Support the onboarding of new data sources, including preparation and transformation of datasets
• Work with senior engineers to implement data engineering best practices and standards
• Contribute to CI/CD pipelines and Infrastructure as Code (IaC) activities
• Operate within AWS and Azure environments, supporting deployment and maintenance of data solutions
• Work with services such as:
• AWS: EC2, EMR, S3, Lambda
• Azure: Blob Storage and related services
• Collaborate with wider teams to ensure data quality, reliability, and performance
• Participate in knowledge sharing and continuous improvement activities

Skills & Experience

Essential

• Experience in data engineering or ETL development
• Working knowledge of data pipelines and data processing frameworks (e.g. Spark or similar)
• Experience with cloud platforms (AWS and/or Azure; exposure to both preferred)
• Understanding of ETL processes and data integration concepts
• Basic experience with Infrastructure as Code (e.g. Terraform) and/or CI/CD tools (e.g. GitLab)
• Familiarity with key services such as:
• AWS: EC2, S3 (EMR/Lambda exposure beneficial)
• Azure: Blob Storage
• Understanding of version control and collaborative development practices
• Awareness of data security and governance considerations

Desirable

• Experience working with event-driven architectures or streaming technologies
• Exposure to data access layers or data platform design
• Experience in public sector or regulated environments
• Knowledge of cloud networking fundamentals
• Exposure to fraud, analytics, or large-scale data use cases

Security Requirements

• This role requires Security Clearance (SC).
• Candidates must be eligible and willing to undergo the clearance process.

Engineering Practices

• Developing understanding of DevOps and agile delivery practices
• Commitment to writing maintainable, scalable code
• Willingness to adopt automation and reusable patterns
• Participation in code reviews and team collaboration

Personal Attributes

• Eager to learn and develop technical skills
• Strong problem-solving ability
• Collaborative and team-oriented
• Comfortable working in fast-paced delivery environments