Were looking for a Senior Data Engineer to join the Asset Data & Insights value stream. Youll lead the design, development and operations of robust, scalable data pipelines using modern cloud technologies-empowering real-time analytics, advanced BI, and data-driven decision-making across SSE Thermal. Youll need hands-on expertise with the Databricks ecosystem, a strong command of data engineering best practices, and a growth mindset that balances technical excellence with collaboration and continuous improvement. Experience in an asset-intensive or energy environment is desirable, as is familiarity with Agile product delivery and cloud-based data platforms.

You Will

As Senior Data Engineer, youll architect and optimise our cloud data infrastructure-ensuring high-quality, accessible data for operational and strategic use.

- Build and maintain production-grade data pipelines using Databricks (Python, PySpark, Delta Live Tables, Unity Catalog) to serve downstream analytics and reporting.

- Optimise data architecture for performance, scalability, and reliability, proactively monitoring data health and troubleshooting pipeline issues.

- Mentor junior engineers and foster a knowledge-sharing culture through documentation, pairing, and architectural guidance.

- Collaborate with analysts, product teams, and business stakeholders to translate requirements into performant, well-structured data solutions.

- Champion secure, compliant data engineering practices, contributing to governance, CI/CD, and DevSecOps alignment.

Proven experience building modern data pipelines in Azure Databricks, including asset bundles, Unity Catalog, and Delta Live Tables.

- Strong Python and PySpark skills, alongside advanced SQL proficiency for query performance, data modelling, and transformation logic.

- Hands-on experience with version control (Git), CI/CD pipelines, and Agile development workflows in a data engineering context.

- Demonstrated ability to work cross-functionally with analysts, architects, and product teams to deliver impactful data solutions.

- Knowledge of cloud-native data architecture (data lakes, lakehouse, ELT) and a passion for staying at the forefront of modern data stack tools and techniques.

SSE has a bold ambition - to be a leading energy company in a net zero world. We're building the world's largest offshore wind farm. Transforming the grid to provide greener electricity for millions of people and investing over £20 billion in homegrown energy, with £20 billion more in the pipeline.

Our IT division powers growth across all SSE business areas by making sure we have the systems, software and security needed to take the lead in a low carbon world. They provide expertise, advice and day-to-day support in emerging technologies, data and analytics, cyber security and more.

Salary: £42,600 - £64,000 + performance-related bonus and a range of benefits to support your finances, wellbeing and family.

Working Pattern: Permanent | Full Time | Flexible First options available, Enjoy discounts on private healthcare and gym memberships. Wellbeing benefits like a free online GP and 24/7 counselling service. Interest-free loans on tech and transport season tickets, or a new bike with our Cycle to Work scheme. As well as generous family entitlements such as maternity and adoption pay, and paternity leave.