Lead Data Engineer
Made Tech, Abertawe
Lead Data Engineer
Salary not available. View on company website.
Made Tech, Abertawe
- Full time
- Permanent
- Remote working
Posted 1 week ago, 9 Jun | Get your application in now before you're too late!
Closing date: Closing date not specified
job Ref: de1536054939462e90d0fde249de9830
Full Job Description
As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage.,
- Define, shape and perfect data strategies in central and local government.
- Help public sector teams understand the value of their data, and make the most of it.
- Establish yourself as a trusted advisor in data driven approaches using public cloud services like AWS, Azure and GCP.
- As employee growth is a huge focus here, we would expect you to contribute to our recruitment efforts and take on line management responsibilities.
Data Analytics, Design, Statistics, Infrastructure, Json, Pair Programming, Engineers, One, Data Quality, Data Integration, Public Sector, It, Uml, Orchestration, Hadoop, C4, Apache Spark, Data Systems, Diagrams, Scrum, Docker, Learning, Proficiency in Git (inc. Github Actions) and able to explain the benefits of different branch strategies. - Strong experience in IaC and able to guide how one could deploy infrastructure into different environments.
- Knowledge of handling and transforming various data types (JSON, CSV, etc) with Apache Spark, Databricks or Hadoop.
- Good understanding of possible architectures involved in modern data system design (Data Warehouse, Data Lakes, Data Meshes)
- Ability to create data pipelines on a cloud environment and integrate error handling within these pipelines.
- You understand how to create reusable libraries to encourage uniformity or approach across multiple data pipelines.
- Able to document and present end-to-end diagrams to explain a data processing system on a cloud environment.
- Some knowledge of how you would present diagrams (C4, UML, etc.)
- Enthusiasm for learning and self-development.
- You have experience of working on agile delivery-lead projects and can apply agile practices such as Scrum, XP, Kanban.
- Can own the cloud infrastructure underpinning data systems through a DevOps approach.
- Design and implement efficient data transformation processes at scale, both in batch and streaming use cases.
- You are a skilled Data Engineer who has delivered data platforms.
- Knowledge of SOLID, DRY and TDD principles and how to practically implement these into a project.
- You can demonstrate a commercial mindset when on projects to grow accounts organically with senior stakeholders.
- You have the experience to improve resilience into a project by checking for software vulnerabilities and implement appropriate testing strategies (unit integration, data quality, etc)
- You are skilled at offering guidance on how one would implement a robust DevOps approach in a data project.
- You can comfortably talk about tools needed such as DataOps in areas such as orchestration, data integration and data analytics. DESIRABLE EXPERIENCE Experience in the following things isn't essential, but it's highly desirable!
- Working at a technology consultancy
- Working with Docker and virtual environments as part of the development and CI/CD process.
- Working with senior stakeholders to gather requirements and keep them engaged with
- Experience in working with a team of engineers using a variety of techniques such as pair programming or mob programming.
- Working with data scientists to productionise advanced data deliverables, such as machine learning models
- Working knowledge of statistics
- Working with multidisciplinary digital and technology teams
- Working within the public sector
- Working with data scientists to productionise advanced data deliverables, such as machine learning models
We are always listening to our growing teams and evolving the benefits available to our people. As we scale, as do our benefits and we are scaling quickly. We've recently introduced a flexible benefit platform which includes a Smart Tech scheme, Cycle to work scheme, and an individual benefits allowance which you can invest in a Health care cash plan or Pension plan. We're also big on connection and have an optional social and wellbeing calendar of events for all employees to join should they choose to. Here are some of our most popular benefits listed below: ️ 30 days Holiday - we offer 30 days of paid annual leave ️ Flexible Working Hours - we are flexible with what hours you work Flexible Parental Leave - we offer flexible parental leave options Remote Working - we offer part time remote working for all our staff Paid counselling - we offer paid counselling as well as financial and legal advice.
Direct job link
Relevant jobs
- Tech / Digital / IT Jobs in Aberdare, Rhondda Cynon Taf - Rhondda Cynon Taf
- Tech / Digital / IT Jobs in Aberdaugleddau, Sir Benfro - Pembrokeshire
- Tech / Digital / IT Jobs in Y Fenni, Sir Fynwy - Monmouthshire
- Tech / Digital / IT Jobs in Aberteifi, Sir Ceredigion - Ceredigion
- Tech / Digital / IT Jobs in Bangor
- Tech / Digital / IT Jobs in Barri, Bro Morgannwg - the Vale of Glamorgan
- Tech / Digital / IT Jobs in Bridgend, Cumbria
- Tech / Digital / IT Jobs in Caerffili, Caerffili - Caerphilly
- Tech / Digital / IT Jobs in Cardiff
- Tech / Digital / IT Jobs in Caerfyrddin, Sir Gaerfyrddin - Carmarthenshire
- Tech / Digital / IT Jobs in Casnewydd
- Tech / Digital / IT Jobs in Bae Colwyn, Conwy - Conwy
- Tech / Digital / IT Jobs in Cwmbran, Tor-faen - Torfaen
- Tech / Digital / IT Jobs in Doc Penfro, Sir Benfro - Pembrokeshire
- Tech / Digital / IT Jobs in Glyn Ebwy, Blaenau Gwent - Blaenau Gwent
- Tech / Digital / IT Jobs in Hwlffordd, Sir Benfro - Pembrokeshire
- Tech / Digital / IT Jobs in Llanelli, Sir Gaerfyrddin - Carmarthenshire
- Tech / Digital / IT Jobs in Maesteg, Pen-y-bont ar Ogwr - Bridgend
- Tech / Digital / IT Jobs in Merthyr Tudful, Merthyr Tudful - Merthyr Tydfil
- Tech / Digital / IT Jobs in Mold, Sir y Fflint - Flintshire
- Tech / Digital / IT Jobs in Castell-nedd, Castell-nedd Port Talbot - Neath Port Talbot
- Tech / Digital / IT Jobs in Newport, Middlesbrough
- Tech / Digital / IT Jobs in Penarth, Bro Morgannwg - the Vale of Glamorgan
- Tech / Digital / IT Jobs in Pontypool, Tor-faen - Torfaen
- Tech / Digital / IT Jobs in Pontypridd, Rhondda Cynon Taf - Rhondda Cynon Taf
- Tech / Digital / IT Jobs in Port Talbot, Castell-nedd Port Talbot - Neath Port Talbot
- Tech / Digital / IT Jobs in Prestatyn, Sir Ddinbych - Denbighshire
- Tech / Digital / IT Jobs in Rhondda, Rhondda Cynon Taf - Rhondda Cynon Taf
- Tech / Digital / IT Jobs in Rhuthun, Sir Ddinbych - Denbighshire
- Tech / Digital / IT Jobs in Abertawe
- Tech / Digital / IT Jobs in Wrecsam, Wrecsam - Wrexham
Similar jobs for you
Lead Data Engineer
Leidos, Inc.,
- Full time
- Permanent
Apply on company site
Lead Data Engineer
Royal London Group,
- Full time
- Permanent
Apply on company site
Lead Data Engineer
CGI Group Inc.,
- Full time
- Permanent
Apply on company site
Lead Data Engineer
Made Tech,
- Full time
- Permanent
Apply on company site
Lead Data Engineer
Made Tech,
- Full time
- Permanent
Apply on company site