Senior Data Engineer

Job overview

The Royal Marsden NHS Foundation Trust is a centre of excellence for research, education, and care in the treatment of Cancer.

The Trust has an outstanding reputation for information and has recently implemented a new digital health record, data warehouse and business intelligence solutions.

The information team currently support management and clinicians throughout the organisation by providing information and analysis for planning, decision making, quality assurance and improvement. We are further developing our analytical tools and capabilities to rapidly increase the utilisation of anonymised clinical data to support research and to maximise the use of clinical data to increase understanding of the disease and treatment outcomes. We are looking for motivated experienced data engineer to join our team, to play a pivotal role supporting the Information Development Manager to shape, develop, and maintain the Trusts new data ecosystem.    You will be educated to degree level and have experience and expertise in developing and maintaining Microsoft based SQL data warehouses and producing technical documentation to support  a wide range of users.

You must be self-motivated and possess excellent interpersonal skills and the ability to establish effective working relationships with all levels of staff within and external to the organisation.

For more information, please contact Des Campbell, Information Development Manager at [email protected]

Main duties of the job

1.1.    To develop, maintain and support the corporate data warehouse and Trusted Research Environment. This will include and is not limited to data engineering tasks, data pipeline development,  and resolving performance issues.

1.2.    To work with our cloud hosting provider to ensure effective resource utilisation and consumption patterns.

1.3.    To develop complex data structures, data models and Extract Transformation and Load processes using Azure Synapse Analytics and related Azure services to support the trust Data warehouse at the direction of the Database Architect and Data Infrastructure Manager.

1.4.    To apply data engineering techniques including data wrangling, cleansing, transformation and integration to ensure high-quality data pipelines and datasets.

1.5.    Develop, implement, and assist in the maintenance of a data asset catalogue to facilitate data discovery.

Detailed job description and main responsibilities

For further information on this role, please see the attached detailed Job Description and Person Specification

• To work as part of the Information Development team to develop, support, and enhance the corporate data warehouse environment.
• Support the integrity of the data warehouse and contribute to the design and implementation of adequate back-up solutions.
• Contribute to business continuity and disaster recovery planning.
• Maintain an in-depth knowledge of Microsoft Azure Synapse Analytics, and related Azure data services, and provide expert advice regarding their application, act as a point of escalation for investigation and resolution of complex technical issues.
• Lead the development and implementation data pipelines using Synapse Pipelines and other ETL/ELT tools to ingest, transform and load data from various sources.
• Act as the SME for data engineering, providing authoritative input on schema design, data quality, and interoperability.