Azure Data Engineer Microsoft Fabric ETL West London Hybrid / Remote Flexibility

Sure IT, City of Westminster

Azure Data Engineer Microsoft Fabric ETL West London Hybrid / Remote Flexibility

Salary not available. View on company website.

Sure IT, City of Westminster

  • Full time
  • Permanent
  • Onsite working

Posted today, 6 Nov | Get your application in now to be one of the first to apply.

Closing date: Closing date not specified

Job ref: 9c288094b6a9479480f3c6d36d2ac523

Location ref: City of Westminster

Full Job Description

  • Ingest, warehouse, and store data at scale within the Azure cloud platform to create core data assets.
  • Apply hands-on experience with Microsoft Fabric through active project work.
  • Build high-value Data Products from Data Assets to fulfill commercial needs.
  • Collaborate closely with Operations, Architecture, Delivery, Product, and Software Engineering teams to release platform increments.
  • Contribute toward solution-level architecture, design, and continuous improvement of ADF and Synapse pipelines.
  • Own releases end-to-end from development to production following DevOps and CI/CD methodologies.
  • Migrate Legacy databases and storage systems to modern Azure cloud lakes and data warehouses.
  • Integrate AI-driven capabilities into the coding, testing, and documentation of data engineering artifacts.

    Minimum 3+ years of hands-on experience designing and developing complex ETL/ELT pipelines in the cloud using Azure Data Factory and Azure Synapse.
  • Practical experience working in both Serverless and SQL pools in Synapse Analytics.
  • Direct client project experience working within Microsoft Fabric.
  • Strong background in creating detailed data mappings from high-level requirements to solution-level execution.
  • Comprehensive understanding of data warehousing concepts across lakes and traditional databases, covering the full ETL lifecycle.
  • Proficiency in relational databases (SQL Server, MySQL), NoSQL, writing complex queries, and developing Stored Procedures.
  • Hands-on experience working with PySpark Notebooks for data ingestion and provisioning.
  • Strong understanding of Agile methodologies, automation scripting, and DevOps/CI/CD pipelines.
  • Desirable Skills:
  • Coding experience in Python, PySpark, or similar languages.
  • Experience utilizing AI-driven automation for coding, documentation, and testing.
  • Exposure to other Azure technologies such as Power BI and Power Automate.
  • Experience working with non-relational databases (CosmosDB, MongoDB) and handling unstructured data.
  • Prior background working in the automotive or intelligence/data-provider industries.
  • Soft Skills:
  • Strong communication, problem-solving, and collaboration skills.
  • High attention to detail with the ability to meet tight deadlines.

Direct job link

https://www.jobs24.co.uk/job/azure-data-engineer-microsoft-fabric-etl-west-127701323