Technology Architect - Databricks

# Technology Architect - Databricks at N Consulting LtdWork mode: Hybrid Number of days a week worked in the office: 3 Contract duration: 8 months Location: London End client: Bank --------------------------------------- JOB DETAILS Role Title: Technology Architect Technology Architect - Databricks with over 12 years of experience in designing and leading large scale data engineering, analytics, and cloud transformation initiatives. The ideal candidate will have deep expertise in Databricks, big data architectures, cloud platforms (Azure), and modern data engineering frameworks. This role will be responsible for defining end to end architectural solutions, driving best practices, and guiding engineering teams to deliver scalable, secure, and cost optimized data platforms. \

• Design end to end data platforms leveraging Databricks Lakehouse architecture, Delta Lake, Unity Catalog, and ML/AI workloads. \ Define data ingestion, transformation, governance, and consumption frameworks
aligned to enterprise standards. \
• Evaluate and recommend architectural improvements, new tools, and emerging technologies. \ Develop reference architectures, solution blueprints, and best-practice playbooks for Databricks implementations. \ Architect scalable ETL/ELT pipelines using PySpark, Spark SQL, Delta Live Tables, and Databricks Workflows. \ Implement performance optimization strategies for notebooks, clusters, job orchestration, and data storage. \ Guide teams in building curated, governed data models leveraging Delta Lake Medallion Architecture (Bronze-Silver-Gold). #J-18808-Ljbffr