Lead Data Engineer
- Senior, hands-on data engineering leadership role at a high-growth UK technology consultancy
- Palantir, cloud data platforms and large-scale data processing focus
- Hybrid working with UK-wide client engagement
- Salary £75,000 to £105,000
- UK work authorisation required
About the Company
Our client is a high-growth technology consultancy with a 30-year track record of delivering transformational digital projects across government, healthcare and a wide range of private sector clients. With a values-driven culture built on honesty, creativity and cooperation, this is an organisation where talented engineers can build solutions that have a genuinely positive impact on people’s lives.
The Role
A senior, hands-on leadership position for an experienced Data Engineer who wants to design and build data processing solutions at scale while leading and developing a team. Working in agile teams, you will take ownership of whole components and subsystems, set development standards, and be accountable for the quality of the codebase and how well it meets user needs. Alongside delivery, you will advise customers on technical implications, contribute to proposals and manage, coach and develop a small number of engineers. This role suits someone who is as comfortable writing code as they are shaping technical direction.
Key Responsibilities
- Take ownership of the design, development, testing and defect resolution of whole components or subsystems
- Lead hands-on design and development of ETL and ELT data pipelines using open source and commercial platforms, including Palantir
- Define and enforce development best practice, coaching team members to ensure consistency
- Work with architects to deliver the robustness, performance and non-functional needs of data pipelines
- Own standards and execution of unit and integration testing within the team
- Lead troubleshooting and performance tuning activities
- Work with Operations and Security teams to ensure solutions are operationally ready and compliant
- Advise customers on effort and technical implications of user stories, and contribute to technical proposals
- Manage, coach and develop a small number of engineers, supporting performance and career development
What You’ll Need
Essential:
- Experience leading a team of engineers delivering data-intensive system components
- Strong commercial experience working with Palantir
- Proficient software development experience in Java, Scala or Python
- Experience with data processing platforms such as AWS, Azure, GCP or Databricks
- Expert SQL skills for analytical use cases
- Expert understanding of distributed data stores and data processing frameworks
- Proficiency in designing analytical and operational data models
- Experience applying standards for design patterns, development and operational readiness
- Ability to communicate technical design clearly, both written and verbally
- UK work authorisation
Desirable:
- Experience with data warehouse methods and techniques
- AWS, Azure or GCP certification in data services
- Active participation in development or technology communities
- Commitment to continuous improvement and sharing data best practice
Why Apply?
- Salary of £75,000 to £105,000
- Lead hands-on engineering on large-scale, high-impact programmes across government, healthcare and the private sector
- High-growth business with a 30-year track record and a strong values-driven culture
- Genuine opportunity to shape technical standards and coach the next generation of engineers
- Collaborative, supportive environment focused on developing outstanding people
- Hybrid working with UK-wide client exposure
Interested?
For a confidential conversation about this opportunity, connect with Justin Donaldson on LinkedIn or submit your CV via the link below.
Skills:Python Cloud SQL Palantir Consulting
WHJS1_NI
…