Data Engineer - London or Derby up to £55,000 with 10% bonus
About our client
Our client has a stated mission to provide high-quality, digitally enabled rolling stock solutions that help deliver a safe, efficient and sustainable railway
In the last 8 years they have invested £3bn, including the commissioning of over 2,500 new passenger and freight vehicles, and with a plan to invest over £1bn into UK rail in the coming years to deliver high quality new and refurbished vehicles for passengers and freight customers
However, financing new trains is not the endgame for them. Their asset stewardship role includes management of assets to ensure performance, safety and long-term suitability over their full economic life
About the team
They are now seeking a highly experienced Data Engineer to join the Fleet function, a small multi-disciplinary team that supports corporate and project governance, risk management and audits of train operating companies, suppliers and internal processes. The team is part of the Operations Directorate reporting to the Chief Operating Officer
Role Purpose
This role will support the delivery and development of the Digital Portfolio. Taking advantage of the unified data platform, with overall responsibility for managing and maintaining existing data pipelines, monitoring of workloads, root cause analysis, data quality monitoring and escalation of technical issues to the Product Owner.
Please note the role does not have any sponsorship or visa support and you must have immediate ongoing right to work in the UK with no restrictions.
Responsibilities
• Monitoring and recovery of Azure Data Factory and Databricks jobs
• Proactive monitoring of data quality
• Subject matter expert on data sources, ingestion methods and data quality levels
• Developing associated data governance policies and internal processes
• Develop and maintain digital services data quality KPIs
• Maintaining and monitoring of user facing dashboards and other Digital products
• Updating and patching of existing Digital software products
• Documenting root cause analysis outputs
Technical Requirements
• Microsoft Azure Experience
• Knowledge of Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc
• Strong Python and SQL skills for manipulating data
• Apache Spark and/or Databricks experience
• Experience using BI visualisation tools, such as Power BI
• Experience in managing end-to-end analytics pipelines (batch and streaming) suitable for data science workload consumption
• Experience in root-cause analysis and post-incident reporting in a production environment
Knowledge and Qualifications
• A relevant degree in Computer Science, Engineering, and/or relevant certificates
• Azure Data Engineer Associate is desirable
• Knowledge of railway industry rolling stock, organisation and players
• Data ingestion methods for real-time and batch ingestion
• PySpark
• Debugging Apache Spark workloads
• Experience using BI visualisation tools, such as Power BI
A great place to work
We are seeking the very best talent to join the team, and offer an excellent salary, along with bonus and benefits.
• Competitive salary and bonus with an excellent pension scheme
• Financial wellbeing support with life assurance and healthcare cash plan
• Flexible working with enhanced family friendly policies including adoption & shared parental leave benefits
• Enhanced Armed Forces policies
• Ongoing support with professional and personal development
• 25 days’ annual leave + Bank Holidays + option to buy and sell up to 5 days additional leave, long service awards and Star awards
• Season ticket loan, Cycle to work scheme, free parking
This is a fantastic opportunity to join a great organisation with excellent people and a road map for the future to grow and develop the business
To apply please send your CV and confirm your salary expectation and notice period please to
