Consulting Manager

Overview

As a Senior Data Engineer at Artefact, you will design and maintain scalable data pipelines and lead data projects to deliver business impact. You will collaborate with architects, analysts, and stakeholders to translate requirements into robust solutions while mentoring engineers. You’ll drive governance, security, and CI/CD practices, and explore new technologies to elevate the data platform. This role combines hands-on engineering with team leadership in a fast-growing, data-driven environment.

Responsibilities

• Design, build, and maintain scalable data pipelines using SQL and Python with Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow or PySpark
• Lead integration of complex data systems ensuring data consistency across platforms
• Implement CI/CD for data pipelines to improve efficiency and quality
• Collaborate with data architects, analysts, and stakeholders to translate requirements into technical implementations
• Oversee and mentor a team of data engineers to ensure high-quality deliverables
• Develop and enforce data governance, security, and compliance practices
• Optimize data retrieval and develop dashboards/reports for business teams
• Continuously evaluate new technologies to enhance data engineering capabilities

Key requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
• 3+ years in data engineering with strong SQL, Python, and big data tech
• Experience building scalable data workflows using cloud-native orchestration tools and distributed processing frameworks
• Experience with Infrastructure as Code tooling such as Terraform
• Strong CI/CD and DevOps/DevSecOps understanding
• Proven leadership in managing data engineering teams
• Problem-solving skills and ability to work with ambiguity
• Proficiency with AI-assisted workflows to optimise task efficiency
• Excellent communication and interpersonal skills
• Knowledge of data architecture including data mesh, data lake, data warehouse, and data lakehouse

• leadership
• communication
• problem-solving
• SQL
• Python
• Databricks

…