Observability Engineer

We're a hybrid business, which means you'll have flexibility alongside time together with your team. In this role, you can expect at least two days per month in our London office, helping you stay connected, collaborate, and do your best work for our customers. Note that there may be an expectation of other ad-hoc office days where necessary., Our SRE team is a high-trust, high-impact group of engineers who bring software engineering principles to operational reliability. We are hands-on developers and systems thinkers who build scalable, observable, and resilient platforms. Working closely with other Engineering, Data, and Platform & Operations (PlatOps) teams, we help them build reliable, cost-efficient, and easy-to-diagnose systems and services. We also help the Site Operations Engineering (SOE) team lead incident response, improve deployment safety, and guide teams towards a sustainable model of service ownership. We collect, process, and export large volumes of telemetry data every day and are constantly evolving our approach to cost-efficiency. Observability is a first-class concern that shapes how we build and support services across the business. Message From the Principal Engineer: "Hi! I'm Dan, the Principal Site Reliability Engineer here at Dunelm. The SRE team has evolved quite a bit since I started three years ago. We have moved from an engineer-per-team 'embedded' engagement model to a combination 'tools & consulting' model. This has allowed us to scale our coverage more effectively and deliver more meaningful impact throughout Dunelm's service teams. The other big change has been moving from proprietary instrumentation to OpenTelemetry, giving us better flexibility, consistency, and control of the telemetry that we ingest, process, and export. I'm looking forward to receiving your application and hopefully welcoming you into our team." Interview Process 1. Introductory video call (around 45 minutes) with the Principal Engineer and Product Delivery Lead to get to know each other, explain the role, and hear about your experience, goals, and approach to work. 2. Technical Discussion (90 minutes) with a few members of the SRE team. You will work through scenario-based questions designed to help you to highlight your knowledge, specific approaches and where you feel any improvements could be made. Important note: we understand the pressure people are under now in applying for multiple jobs and our straightforward two-stage process, without a practical aspect, is hopefully a refreshing change. However, please read this job description carefully. 1. Engineering & Automation Build automation and reliability tooling using well-architected, maintainable, testable, and easy to read & understand code. Contribute to shared libraries, observability components, and internal platforms. 2. Observability Instrumentation Help evolve our observability strategy across systems and services. Drive how we collect, process, sample, and surface logs, distributed traces and metrics using OpenTelemetry. Focus on high-quality telemetry that enables fast diagnosis, cost efficiency, and meaningful visibility across the stack. 3. Service Levels & Ownership Help teams truly own their services by helping to define and adopt meaningful SLIs and SLOs. Guide product teams in using observability data to make reliability measurable. 4. Incident Response Participate in on-call investigations when issues arise. Drive blameless post-incident reviews and help to identify observability gaps, recommend mitigating actions that stem losses, but also permanent fixes that prevent recurrence. 5. Infrastructure & Pipelines Model infrastructure using tools such as Pulumi, CDK, and Terraform in AWS and other PaaS and SaaS providers. Improve pipelines and support safe deployment strategies (e.g. canary, blue / green). 6. Mentoring & Team Growth Help support and coach other engineers. Participate in technical discussions and share knowledge through pairing, planning, and documentation. 7. Continuous Learning and Innovation Stay ahead of emerging practices in observability. Lead team proof-of-concepts and introduce new patterns or tools that improve our platform. 8. Strategic Development Contribute to the prioritisation of the SRE roadmap. Help shape observability tooling, telemetry patterns, and platform-wide approaches to service ownership and reliability. 9. Aligning to Business Goals Use observability insights to support product goals. Help to ensure SRE priorities align with Dunelm's wider objectives for quality, performance, and customer experience., At Dunelm, our shared values of Act Like Owners, Keep Listening & Learning, Long-Term Thinking, and Stronger Together serve as the foundation for our success. These values guide us continuously; improving our practices and ensure we dedicate our time to what truly matters. As an Observability Engineer in the SRE team, you will exemplify these key behaviours:

• Support and build trust with teammates, always assuming positive intent
• Communicate clearly and share knowledge to build shared understanding
• Stay curious, ask why, and always look to improve how things work
• Embrace change, adapt quickly, and take on a variety of challenges
• Drive innovation by looking for better ways forward and pushing for progress
D&I statement Dunelm is committed to becoming an inclusive business that is representative of our customers and locations. We recognise the value in diversity and welcome applications from all candidates regardless of age, race, religion, disability, gender or sexual identity, socio-economic background or education. We are committed to making Dunelm a place where everyone can enjoy a successful career and have systems in place to support all our colleagues. We are seeking applications from candidates who share our values and celebrate diversity in all its forms. Our commitment to you Accessibility allows everyone to have an equitable chance when applying and showing off their potential, which helps us create a more inclusive and diverse team that brings fresh ideas and perspectives. Should you need it, we have an accessibility tool available in the top menu to support you when you're completing your application. If you require any other reasonable adjustments during the application and assessment process, reach out to your recruitment partner. Please accept Functional Cookies to view this contentTech to the future Meet John, our Chief Tech and Innovation Officer, who shares insights into the exciting things happening in tech, why Dunelm is his happy place, and his unique route into the tech world.Work your way We want our colleagues to feel at home wherever they work, so that they are comfortable and can be their best selves. In addition, we want everyone to feel connected to the business, our strategy and the teams they work with. Where hybrid working is applicable, colleagues need to strike the right balance to fulfil both of these important factors. You will find the right mix of being at home, in the office & out in the business, bearing in mind business needs, job role and level of responsibility.Wellbeing is more than just a buzzword here From our Wellbeing Buddies and Mental Health First Aid training to our progressive parental leave, menopause policies and Colleague Support Fund, we're committed to supporting our colleagues in every area - and at every stage - of their lives. Through our partnership with the Retail Trust, everyone at Dunelm has free access to a 24/7 Virtual GP, as well as therapy and counselling, plus information, guidance and advice in all areas of financial, emotional and physical wellbeing.Look in our toy box Of course, you should never judge a business by its tech stack. But take a peek at the range of technologies our engineers and developers are currently playing with.Dazzling design At Dunelm, we love every aspect of the design process. We're continually researching new developments in packaging, materials and production methods, tapping into new data insights and keeping track of changing lifestyle trends. We're hugely collaborative in the way we work. Together, the teams here have a direct impact on our success, creating amazing products that drive sales and delight our customers, as well as providing direction for our wide and varied range of brands. Please accept Functional Cookies to view this content Please accept Functional Cookies to view this contentKeep on growing Join us on the tech side and you'll have access to a huge array of learning and development opportunities, including a variety of internally created workshops and externally accredited courses. We also have a substantial tech-specific budget to fund e-Learning licenses, conference visits, resources, and qualifications, plus dedicated mentors, well-being buddies and a wide range of network groups to support you as you progress. Housewarming & Settling In where you can find out more about the wider business, our culture, behaviours, networks and wellbeing support Thrive, our learning and skills platform which gives you a blended, bite-sized, social learning experience with learning relevant to your role Our Enterprise Leadership Programme designed specifically for our strong growth potential Heads of Department to help them reach the next level in their career Our INSPIRE Programme designed for our strong growth potential senior managers across the business to enhance their leadership capability Our EXPLORE Programme designed to prepare our next generation of Line Managers Personal Effectiveness workshops and self-led learning, also delivered through Thrive Apprenticeships opportunities relevant to your role - from level 2 (equivalent to GCSE) through to Level 7 (equivalent to Masters) Colleague Development Fund to support colleagues in accessing external training relevant to your role Coaching and mentoring opportunities to support you in your current role and help you prepare for the next Self-awareness tools to help you understand what really matters to you, and where your own talents and ambitions lie Progress conversations that reflect on how you're doing and define your focus areas for the coming months Career conversations that explore what you want from your career, in light of your current capabilities, potential and future aspirations


• Software Engineering: Languages
Most of our services are in TypeScript, Rust, and Python, so knowledge of at least one of these is required. However, deep knowledge of specific programming languages is not as important as understanding what the code is doing (or understanding what AI tells you the code is doing).
• Software Engineering: Principles
We value idiomatic, pragmatic, and testable code with strong, appropriate automated testing. How that code is produced (using AI and / or manually) is not as important as you being able to explain (and potentially defend it) in a code review.
• Architecture
Most of our services run on AWS and are serverless (Lambda) or containerised (ECS & Fargate), so specific knowledge of deploying and running software in those environments, plus general networking principles, is required.
• OpenTelemetry
We are moving towards as much OpenTelemetry as possible throughout the entirety of our technology stack, so OpenTelemetry knowledge is a must. Specifically, you need to know about the tools, SDKs, specifications etc.
• Observability Back-Ends
The ability to confidently use and configure observability back-end platforms is crucial for this role. Again, use of a specific platform is not as important as understanding how to interrogate telemetry to gain an understanding of systems and services or determining suitable alert rules., You will need to have a problem-solving and investigative mindset and be someone for whom attention to detail is extremely important. Desirable Skills
• Advanced OpenTelemetry
If you have previous experience helping to instrument, deploy, and run OpenTelemetry at scale in a production environment, please put that front-and-centre on your application.
• Incident Response
Experience participating in an on-call rotation and being part of incident investigation, root cause / contributing factors analysis and blameless post-incident reviews would be beneficial.
• Cost Optimisation
From head and tail sampling to metric cardinality to good old not generating unnecessary telemetry in the first place, we're very interested in someone who can help us tackle the trickiest observability and cloud cost problems. Let us know if you're that person!

Today, Dunelm is a leader in the £11bn UK homewares market. With over 200 stores across the country and a successful online operation - dunelm.com - we offer over 60,000 products across a broad range of categories. But where did it all begin?

Along with competitive salaries, we offer a range of other great benefits to recognise the unique contribution you bring. Salary Advance so you can access up to 50% of the money you've earned during the month, rather than having to wait until pay day Instant discounts with a range of other companies to help you stretch your budget Pension contributions to help you save for your retirement ShareSave scheme that enables you to save monthly and buy Dunelm shares at a discounted rate, building up your investments for a rainy day Continuous training and coaching to ensure you feel confident in your current role and ready for any new challenges Access to wellbeing support as and when you need it, including an online GP for you and your immediate family Colleague networks that give everyone a voice and create an environment where we all feel at home Outstanding development opportunities and all the support you need to grow your career the way you want 33 days annual holiday plus your birthday off to celebrate, and another day when you move home, so you can get settled in Generous discounts on all our own products, in-store and online to help you make your house a home Cycle to work scheme to help you keep your fitness up and your travel costs down Charity day off (paid, of course) so you can volunteer for a charity that matters to you