Senior Data Engineer

Job overview

We are seeking an experienced and forward-thinking Senior Data Engineer to play a pivotal role in the development of a modern data platform, that underpins reporting, analytics, and decision-making across clinical and corporate services.  The role will apply data modelling techniques and engineering skills to integrate complex data source, ensuring that high-quality, trusted data is available to support better patient outcomes, service improvement, and organisational performance.

This role offers the opportunity to make a significant impact within an organisation where data is increasingly central to delivering high-quality healthcare services.

Main duties of the job

The Senior Data Engineer will:

• Assist in the design and implementation of Extract, Transform & Load (ETL) processes to ingest data from multiple sources into central data repositories.
• Support the design and development of data models.
• Use data modelling and engineering skills to support operational systems, business intelligence, and analytics.

Detailed job description and main responsibilities

Duties and Responsibilities

Data Engineering

• To assist in the design and implementation of Extract, Transform & Load (ETL) processes to ingest data from multiple sources into central data repositories.
• Support the design and development of data models that are robust, maintainable, and aligned with the organization’s IT architecture and standards.
• To specify and develop processes for complex datasets using a wide-ranging technical and analytical skill set.
• To ensure the integrity of the data extracted from Trust transactional systems and held within the data warehouse.
• To ensure records are complete, valid and accurate and adhere to NHS data dictionary definitions.
• Design, code, test and implement efficient and robust database schemas plus SQL Queries, Views, Stored Procedures, and Triggers as part of data warehouse development.
• Provide ongoing source of expertise in database design, development and maintenance of the data environment. Identify, report on and implement new techniques, tools and best practices where they will benefit the organisation.
• To maintain technical, professional and specialist knowledge and understanding – and be competent in the use – of a wide range of specialist software packages, including, but not limited to Microsoft SQL Server (including MSSQL, Reporting Services, Integration Services, Analytical Services) and Power BI.
• To specify and develop solutions that will automate, schedule and improve upon current processes within the data warehouse function.
• Interpret; analyse; investigate; and resolve complex data warehouse problems and. evaluate and analyse a range of options to implement the most cost-effective solution to prevent reoccurrence of the problems.
• Comfortable in data modelling techniques and tools to design and manage data structures.
• To create and maintain high quality documentation for all data warehouse and data engineering related processes.
• Able to document using approaches such as Entity Relationship diagrams, Data Flow Diagrams or Star Schema Diagrams.
• Develop detailed technical designs, SOPs, and post-incident reports to support continuous improvement.
• Keep documentation up to date to minimise recurrence of issues and support future development.

Analysing and Judgement

• Diagnose and resolve complex technical issues

• Independently exercise sound judgment in complex situations, requiring thorough analysis, and interpretation of patterns and anomalies in data.
• Analyse, investigate and resolve complex data queries and data quality issues (e.g. missing data, erroneous data, inaccurate data translation) using in-depth knowledge and advanced analysis skills.

Planning and Organising

• Ability to organise, prioritise and manage a complex, high‑volume workload, including adjusting plans at short notice to meet shifting priorities across departments. For example, coordinating tasks and data requirements for the delivery of the Trust’s PowerBI project. Use proven organisational skills to influence and empower less experienced stakeholders in a project.
• Able to ensure timely, appropriate updates to managers and project managers, highlighting areas of concerns around meeting deadlines.
• Ability to delegate appropriately to ensure the team meets deadlines.
• To inform and make recommendations to support the digital deployment and roll out of project plans.

Reporting

• Support the development of business intelligence (BI) reporting systems, ensuring solutions are efficient, scalable, and future proof.
• Design and develop systems to support the production of nationally mandated datasets, adhering to relevant standards and timelines.
• Deliver Trust-wide data models that support operational processes, performance monitoring, and financial reporting, with careful consideration of sensitive data requirements.
• Collaborate with Data Analysts across the Trust to define and implement business rules for automated data cleansing, ensuring high-quality datasets that support accurate decision-making and performance monitoring.
• Recommend and implement changes to IM&T practices and procedures in response to evolving reporting requirements or identified data quality concerns.
• Ensure all data models comply with current and emerging national standards, including NHS data definitions and regulatory frameworks.

Stakeholder Collaboration

• Engage with clinical stakeholders, third-party vendors, and technical teams to gather requirements, manage priorities, and deliver solutions that support clinical workflows.
• Liaise with experts in other departments’ e.g. Performance and Analytics team, and suppliers of clinical systems to obtain information for further data integration and processing.
• Report regularly on project progress, risks, and outcomes to ensure transparency and alignment across teams.
• Act as a key technical advisor during digital transformation initiatives such as system migrations, upgrades and procurements.
• Communicate complex integration concepts to non-technical stakeholders, fostering shared understanding and trust.