Overview
As a Data Platform Engineer, you will design, build, and optimize modern data pipelines and analytical data models for health data across London. You’ll work with cross-functional teams to deliver secure, scalable data solutions that support analytical delivery and decision-making. You’ll evolve ingestion, transformation, and数据 modelling practices using Microsoft Fabric, Snowflake, and Azure, turning complex requirements into production-quality data products. Your work directly impacts Population Health Management and strategic commissioning. This role offers hands-on engineering with measurable impact in a dynamic NHS setting.
Responsibilities
- Design, build and optimize scalable data pipelines from source to curated data products
- Develop data orchestration, transformation and integration solutions with automated ETL/ELT processes
- Create robust analytical data models (Dimensional, Lakehouse, Data Vault, semantic)
- Automate manual processes to boost productivity and reduce analyst intervention
- Implement modern engineering disciplines: Git, CI/CD, automated testing, monitoring, IaC
- Ensure data quality, reliability, validation, reconciliation, monitoring and backfill
- Contribute to performance, scalability, and efficient resource use across Fabric, Snowflake, and Azure
- Support Analytics, Data Science and AI by enabling pipelines for ML solutions
- Collaborate with analysts, scientists and stakeholders to solve real analytical problems
- Demonstrate measurable improvements in processing time, data quality and delivery
Key requirements
- Experience designing, building, testing and maintaining modern data pipelines and analytical data models
- Knowledge of data lifecycle: ingestion, orchestration, transformation, modelling, deployment, monitoring, optimization
- Proficiency with Microsoft Fabric, Snowflake, Azure; OneLake; Lakehouse architectures
- ETL/ELT tooling and orchestration (Airflow, Data Factory, Fivetran, Matillion)
- Dimensional modelling, Data Vault, data lineage, data quality, MLOps
- Git, CI/CD, IaC, automation, testing, monitoring
- Security governance, encryption, GDPR, data masking/tokenisation
- Experience with large-scale data, near real-time feeds, performance tuning
- Strong communication abilities to explain technical concepts to non-technical stakeholders
- NHS context and governance considerations a plus
- collaborative
- problem-solving
- clear communication
- Microsoft Fabric
- Snowflake
- Azure
…
