Overview
Lead Data Engineer – Pontypridd, South Wales
Salary: £51,000 – £56,000 Dependant on Experience
Basis: Full time
Equal Opportunities
At Transport for Wales we value diversity. It makes us stronger, helps us understand our customers better, make better decisions and be more innovative. Everyone’s different and has their own perspective so we’re building a diverse team that mirrors the communities we serve. Through this we’re determined to be one of Wales’ leading inclusive employers. We’re creating an inclusive transport network that everyone in Wales can be proud of.
Who we are
At Transport for Wales, we’re on a mission to transform transport in Wales and make it fit for the future, whether that’s rail, bus, walking or cycling. We want to inspire a nation to change the way it travels, so that we all travel more sustainably and help to combat the climate emergency we’re all facing.
We’re an open and inclusive place to work, where everyone is welcome and our people are supported to reach their full potential. We want to create an environment where our people can grow and succeed. This is key to enabling us to deliver on the promises we’ve made to the people of Wales to build a sustainable transport network that meets their needs.
Role responsibilities
The Lead Data Engineer will design, build, and maintain robust, scalable, and secure data pipelines and platform that enable Transport for Wales’ (TfW) to make data-driven decisions.
- Drive the provision of a resilient and future-ready data platform that underpins organisational growth, supports cross-functional analytics, and enables data-driven decision-making by developing and deploying scalable data pipelines leveraging a Microsoft Azure-first approach, utilising tools such as Fabric, Data Factory, Databricks, and Synapse Analytics to ensure workflows are modular, testable, and well-governed.
- Implement robust data management practices focused on data domains, quality, and lineage by integrating data from multiple internal and external sources into a cohesive system to ensure that data is comprehensive, accurate, and traceable, supporting reliable business analysis and reporting.
- Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource-efficient data processing, meeting the organisation’s evolving analytical and operational demands.
- Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processes, empowering stakeholders to make informed decisions based on high-quality, processed information.
Who we’re looking for
- Degree or MSc in Computer/Data Science or Data Engineering or equivalent experience in data engineering, data management, or a related field.
- Proven experience in designing, building, and maintaining data pipelines using tools such as Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles.
- Experience of using programming languages such as Python, Scala and SQL and of data transformation, testing, and automation
.
- Demonstrable knowledge of data modelling (star/snowflake schemas, dimensional models) and data warehousing within platforms such as Azure Synapse Analytics.
- Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud-based architectures
Welsh Language Skills
The ability to speak/write Welsh would make a great addition to your application, but it is not essential for this role.
Transport for Wales supports and promotes the use of the Welsh Language by employees and will encourage them to develop, improve and maintain their Welsh Language skills. We fully support our people who want to improve their Welsh language skills, and personal development for Welsh Language skills are offered in a variety of ways such as online learning, classroom courses and funding attendance at local community courses.
Next steps
Does this role sound like the opportunity you are looking for? Do you want to find out more? See attached Job Description for further details.
Transport for Wales is a disability leader. We are happy to discuss any reasonable adjustments you may need in the recruitment process or as part of the role if you are successful.
This advert will close at midnight on the day of the application closing date stated above. We do encourage you to submit your application as early as possible.
Please note, we reserve the right to close this vacancy early if we receive sufficient applications.
Note that you must hold the permanent right to work in the UK. We are not currently able to provide sponsorship.
IMPORTANT: Before applying for this role, please make sure you have the right to work in the country where the role is based. Unless it clearly stipulates within in the job advert above that the hiring company is looking to or able to sponsor applicants it is deemed that the hiring employer will only consider applications from those able to comply with and work in the country where the role is based.
