Senior Data Engineer & AI Expert

London - £600 - £750 per day Contract Posted by: Korn Ferry Posted: Monday, 3 August 2026

Applicants must be eligible to work in the specified location

Data/AI Engineer (Databricks) - Outside of IR35 Contract

We're taking an AI decision-support product from proof-of-concept to full production on Databricks and need a hands-on engineer to build, run and own it. It analyses data across ~1,000 sites, uses an LLM (Anthropic Claude) to generate per-site recommendations, and includes a conversational agent that lets managers question their own data. Delivery role, not advisory - you'll fill our gap in Databricks engineering, LLM pipelines and agent development, and build the capability in-house.

Initial 6 Month Contract (Ext) & Remote Working

What you'll do

Build ingestion pipelines (PySpark) into a governed medallion layer in Unity Catalog.
Productionise the LLM pipeline - run Claude across the estate on a schedule, with retries and validation gates.
Build and tune the conversational agent - grounding, guardrails, benchmarking.
Own evaluation (prompt versioning, MLflow) and CI/CD across dev/UAT/prod.

Essential

Production Databricks (Unity Catalog, Delta, medallion, Workflows).
Python/PySpark and strong SQL.
Production LLM/API integration - batch inference, automated quality checks.
Conversational/text-to-SQL agents over enterprise data.
CI/CD for data platforms; Azure.

Nice to have

Databricks Genie/Mosaic AI, MLflow, RAG, Power BI.

About Korn Ferry

Korn Ferry unleashes potential in people, teams, and organizations. We work with our clients to design optimal organization structures, roles, and responsibilities. We help them hire the right people and advise them on how to reward and motivate their workforce while developing professionals as they navigate and advance their careers. To learn more, please visit our website

Location London, UK

Industry IT

Duration 6 months (+ext)

Start Date ASAP

Rate £600 - £750 per day

Employment Business Korn Ferry

Contact Charlie Laxton

Telephone 800-466-4489

Reference JS-BBBH1689302

Posted Date 8/3/2026 4:58:48 PM

Permalink http://www.careerboard.com/gmc2L

#s1-Gen

Production Databricks (Unity Catalog, Delta, medallion, Workflows).
Python/PySpark and strong SQL.
Production LLM/API integration - batch inference, automated quality checks.
Conversational/text-to-SQL agents over enterprise data.
CI/CD for data platforms; Azure.

London - £600 - £750 per day Contract Posted by: Korn Ferry Posted: Monday, 3 August 2026
Build ingestion pipelines (PySpark) into a governed medallion layer in Unity Catalog.
Productionise the LLM pipeline - run Claude across the estate on a schedule, with retries and validation gates.
Build and tune the conversational agent - grounding, guardrails, benchmarking.
Own evaluation (prompt versioning, MLflow) and CI/CD across dev/UAT/prod.

3 Korn Ferry jobs in England & Wales