Skip to main content
Please wait, loading

Job summary

Main area
Data Management
Grade
NHS AfC: Band 8a
Contract
Permanent
Hours
Full time - 37.5 hours per week
Job ref
161-NELICB-164-B
Employer
NHS North East London Integrated Care Board
Employer type
NHS
Site
Unex Tower
Town
Stratford
Salary
£58,698 - £65,095 per annum inc HCA
Salary period
Yearly
Closing
26/07/2024 23:59

Employer heading

NHS North East London Integrated Care Board logo

Senior Data Engineer

NHS AfC: Band 8a

NHS North East London Integrated Care Board (ICB) was formed on 1 July 2022.

We are an exciting new organisation putting the needs of communities at the heart of our commissioning arrangements.

We are working with local people and partners across health, social care and the voluntary sector in innovative ways to improve health and wellbeing for all our communities. Our key priority in the next year will be to develop closer integrated and collaborative ways of working with all our partners to implement our Out of Hospital Strategy.

We can only do this with great staff who are encouraged and supported, which is why we invest in them, listen to them, make sure we are representative of our populations and that we foster their health and wellbeing.

Please note that all vacancies will be subject to a 6 months' probation period in line with the Probation Policy.

Job overview

The Data Management and System Development Team at Northeast London ICB are looking to recruit two data engineers.  

You will be working with Customers, Project Managers and Analysts to ingest and prepare date for analysis.  

Using modern cloud hosted data engineering technologies, such as Azure Synapse, Azure Data Factory, Snowflake, DBT and developed applications you will be key to loading, publishing, and securing data on to our analysis platform

Main duties of the job

To work as a whole system in determining and improving the outcomes for the citizen and reduce inequalities by bringing data together into a single repository. This means working more closely with our partners to deliver an integrated system.

We will be suing the data to predict the cause and effect of patient conditions and predict well in advance when a patient will have a potentially life threatening condition and the potential causes and direct risk factors, we have an opportunity to reduce the risk factors and reduce the impact of the potential cause and save the associated hospital activity whilst giving a much better patient outcome.

We want to use data to support the integrated clinical care and therefore the data will need to be accurate, timely and varied to enable the most information brought together to make decisions.

You will manage the data ingestion lifecycle working with the stakeholders, clinicians and other developers to build the data rules so the data will be presented in a useful and easy to use format for users.

The role will require the use of cloud technologies and working with anything from small spreadsheets to data sets with billions of rows.  This is an exciting opportunity with a team that is continually looking to be involved in the latest technologies to look at ways to help prevent illness in patients. You will be part of team that can have an integral part of system to save patient lives.

Working for our organisation

NHS North East London Integrated Care Board (ICB) was formed on 1 July 2022.

We are an exciting new organisation putting the needs of communities at the heart of our commissioning arrangements.

We are working with local people and partners across health, social care and the voluntary sector in innovative ways to improve health and wellbeing for all our communities. Our key priority in the next year will be to develop closer integrated and collaborative ways of working with all our partners to implement our Out of Hospital Strategy.

We can only do this with great staff who are encouraged and supported, which is why we invest in them, listen to them, make sure we are representative of our populations and that we foster their health and wellbeing.

Please note that all vacancies will be subject to a 6 months' probation period in line with the Probation Policy.

Detailed job description and main responsibilities

The post holder will

Undertake the following duties and responsibilities:

  • Engage with all stakeholders to identify requirements where appropriate and working directly with the team technical lead to agree the requirements, deliverables and timescales
  • Build and manage all the data ingestion processes
  • Work with the senior data engineers on the information lifecycle to produce useful data for customers
  • Communicate and engage with stakeholders to understand what the business wants and the benefits of the data needed
  • Help with Eliciting these requirements to help build a picture for the developers to create a solution with the right datasets
  • Liaise with data quality and standards lead to build rules in the data processing which are likely to be highly complex
  • Help the developers to obtain quantitative and qualitative data on the healthcare dataset to analyse, determine and promote data driven decisions
  • Ingest data from a myriad of sources in varying of formats. Some of these may be highly complex
  • Define standard import template
  • Work closely with the Project Manager to help deliver weekly and monthly project reports and highlight key risks and issues suggesting any remedial or proactive actions
  • Link with the team lead to report issues and raise risks, giving daily or weekly update
  • You will be expected to test that the output meets the requirements before handing over to the testers
  • You should be able to work in an agile environment following an agile approach
  • Work across the whole CCG to prioritise and accommodate new items and work with the team lead to estimate and agree timescale
  • Ensure projects are compliant with IG, GDPR and DPA regulations, guidance and training by liaising with the relevant SMEs
  • Experience of working as a Data integration enginee
  • Knowledge and experience SQL
  • Knowledge and experience with cloud technologies

Please see the attached Job Description for full duties and responsibilities.

Person specification

Education & Qualifications

Essential criteria
  • Degree or relevant experience in Computers Science, Data Analysis or Data Engineering
Desirable criteria
  • Further training or significant experience in Data Management, Data Engineering

Knowledge & Experience

Essential criteria
  • Experience of Microsoft data engineering stack e.g., SSIS, SQL, ADF, Synapse, Azure DevOps Pipelines.
  • Experience in cloud data platforms e.g. Snowflake.
  • Experience in coding (Python, C#, Java, Javascript/ECMAScript)
  • Experience using Git and Azure DevOps
  • Experience of designing and building solutions to ingesting data
  • Knowledge of AWS or Azure technologies
Desirable criteria
  • Experience in working in the command line / powershell
  • Knowledge of NHS Datasets and terminology
  • Aware of NHS Information Governance and patient confidentially rules

Skills & Abilities

Essential criteria
  • Proven record of being able to deliver to tight deadlines.
  • Self-starter, able to work effectively within a team or individually.
  • Strong business engagement, communication and stakeholder management skills
Desirable criteria
  • The aptitude and desire to quickly pickup new technologies with little assistance.

Employer certification / accreditation badges

Documents to download

Apply online now

Further details / informal visits contact

Name
David Cunliffe
Job title
Head of Digital Development
Email address
[email protected]
Apply online nowAlert me to similar vacancies