Software Engineer (Scheduler)
Isomorphic Labs, City of Westminster
Software Engineer (Scheduler)
Salary not available. View on company website.
Isomorphic Labs, City of Westminster
- Full time
- Permanent
- Onsite working
Posted today, 8 Nov | Get your application in now to be one of the first to apply.
Closing date: Closing date not specified
Job ref: 791be59d409a4e51a20af7cf83927c1b
Location ref: City of Westminster
Full Job Description
You will join our newly formed Scheduling team to own and extend the systems that orchestrate compute allocation to complex machine learning workloads running on Kubernetes. You will be responsible for optimizing our compute footprint, ensuring that dynamic batch inference and large-scale training runs are scheduled reliably and efficiently. We are looking for an engineer who operates comfortably at the intersection of distributed systems and modern ML infrastructure. You will design systems that support large-scale, topology-sensitive workloads, optimize batch queuing frameworks and write custom Kubernetes controllers. Your work will directly determine our ability to maximize hardware utilization and accelerate the pace of AI-driven drug discovery.,
- Own the Scheduling Layer: Design, operate, and extend ML workload scheduling systems to handle dynamic batch inference and long-running training workloads.
- Optimize Compute Utilization: Drive the implementation of scheduling policies like gang scheduling, topology-aware placement, and preemption to ensure efficient use across our fleets of committed GPUs and TPUs.
- Partner with Research: Collaborate directly with ML researchers and the broader Infrastructure team to understand workload behavior, troubleshoot bottlenecks, and turn research requirements into platform capabilities.
- Ensure Reliability: Build systems with clear failure semantics. Participate in the operational lifecycle of the scheduling ecosystem, designing robust processes, runbooks, and SLOs to maintain high availability.
- Build Custom Infrastructure: Build and maintain custom Kubernetes controllers, operators, and CRDs that adapt the cluster orchestration layer to the specific requirements of our ML pipelines.
Scheduling Frameworks: Practical experience building or operating cluster schedulers, batch systems, or queuing frameworks (e.g., Kueue, Volcano, Slurm). - Deep Kubernetes Expertise: Deep, hands-on Kubernetes experience, moving beyond standard usage to write and maintain custom K8s controllers, operators, or interacting directly with cluster orchestration APIs. Strong familiarity with K8s scheduler.
- Cloud Infrastructure Experience: Strong practical experience with cloud providers, focusing on compute provisioning, networking, and Infrastructure as Code to build scalable foundational environments.
- Adaptability: A solid foundation in DevOps/SRE best practices, with the ability to adapt these principles to the dynamic nature of AI accelerator infrastructure.
- Programming Proficiency: Strong programming skills, with high proficiency in Python or Go., Experience operating Kueue.
- Familiarity with ML infrastructure nuances: Nvidia GPUs, Google TPUs, gang scheduling, or collective networking.
- Previous experience in High-Performance Computing or maximizing utilization in environments with fixed/committed hardware constraints.
- Familiarity with GCP cloud compute infrastructure and Infrastructure as Code.
- Background in ML SWE or infrastructure SRE work supporting machine learning research activities.
Isomorphic Labs (IsoLabs) was launched in 2021 to advance human health by building on and beyond the Nobel-winning AlphaFold system. Since then, our interdisciplinary team of drug discovery experts and machine learning specialists has built powerful new predictive and generative AI models that accelerate scientific discovery at digital speed. Our name comes from the belief that there is an underlying symmetry between biology and information science. By harnessing AI's powerful capabilities, we can use it to model complex biological phenomena to help design novel molecules, anticipate how drugs will perform and develop innovative medicines to treat and cure some of the world's most devastating diseases. We have built a world-leading drug design engine comprising AI models that are capable of working across multiple therapeutic areas and drug modalities. We are continually innovating on model architecture and developing cutting-edge capabilities to advance rational drug design. Every day, and with each new breakthrough, we're getting closer to the promise of digital biology, and achieving our ambitious mission to one day solve all disease with the help of AI., We are guided by our shared values. It's not about finding people who think and act in the same way. These values help to guide our work and will continue to strengthen it. Thoughtful Thoughtful at Iso is about curiosity, creativity and care. It is about good people doing good, rigorous and future-making science every single day. Brave Brave at Iso is about fearlessness, but it's also about initiative and integrity. The scale of the challenge demands nothing less. Determined Determined at Iso is the way we pursue our goal. It's a confidence in our hypothesis, as well as the urgency and agility needed to deliver on it. Because disease won't wait, so neither should we. Together Together at Iso is about connection, collaboration across fields and catalytic relationships. It's knowing that transformation is a group project, and remembering that what we're doing will have a real impact on real people everywhere.
Direct job link
Relevant jobs
- Scientific Jobs in Bexley, Bexley
- Scientific Jobs in Bexleyheath, Bexley
- Scientific Jobs in Bromley, Barnsley
- Scientific Jobs in Bromley Common, Bromley
- Scientific Jobs in Camden Town, Greater London
- Scientific Jobs in City of Westminster
- Scientific Jobs in Croydon, Cambridgeshire
- Scientific Jobs in Ealing, Ealing
- Scientific Jobs in Enfield, Hyndburn
- Scientific Jobs in Greenwich, Amber Valley
- Scientific Jobs in Hackney
- Scientific Jobs in Hammersmith and Fulham, Hammersmith and Fulham
- Scientific Jobs in Harrow
- Scientific Jobs in Hillingdon, Hillingdon
- Scientific Jobs in Hounslow
- Scientific Jobs in Islington, Leeds
- Scientific Jobs in Kensington and Chelsea, Kensington and Chelsea
- Scientific Jobs in Kingston upon Thames
- Scientific Jobs in Lambeth, Lambeth
- Scientific Jobs in Lewisham
- Scientific Jobs in Merton, Oxfordshire
- Scientific Jobs in Orpington, Greater London
- Scientific Jobs in Richmond upon Thames
- Scientific Jobs in Sidcup, Greater London
- Scientific Jobs in Southwark
- Scientific Jobs in Sutton, Doncaster
- Scientific Jobs in Tower Hamlets, Tower Hamlets
- Scientific Jobs in Twickenham, Greater London
- Scientific Jobs in Wandsworth, Wandsworth
- Scientific Jobs in Wimbledon, Greater London