Data Engineer

Job overview

Responsible as part of a team to deliver high quality business and complex clinical reporting structures from disparate systems within a consistent and stable framework that is monitored and assured. We are seeking an experienced Data Engineer with a strong background in SQL Server and a commitment to formal change management procedures (RFC) and version control (Git). We are at the start of a five-year Data Engineering modernisation programme; this includes the adoption of Python for developing data pipelines, automating data integration, and building robust data solutions.

We are proud to be a diverse and inclusive organisation and there is a choice of staff networks that help you meet like-minded people. The Christie supports flexible working, enquiries welcomed.  Previous experience of working for the NHS or in a healthcare environment is not essential for this role.

12-month fixed term (renewable)

Main duties of the job

To deliver and maintain data transfer pipelines between clinical/operational source systems and the Christie Central Data Repository (CCDR).  Ensure that all extract, transform and load (ETL) processes are robust, operate efficiently and fully documented.

Learn and assist in the development of new tools, technologies and methods of working as they are identified to ensure that they deliver the intended benefits.  Support the migration process from legacy reporting and database systems.

Provide a technical support service to all users of Data Engineering, understanding and communicating detailed technical requirements/processes with non-technical staff, managing priorities and expectation of service users. Manage unpredictable support workload.

Detailed job description and main responsibilities

DUTIES AND RESPONSIBILITIES

Develop and maintain complex data transfer pipelines from source systems to the Trust Data Warehouse and Data Marts.

Analyse and interpret requirements and specifications from the Business Intelligence Analysts to inform data construct design, development and assurance processes.

Support the appropriate data warehousing design and software development methodologies agreed for use within the team.

Produce detailed technical specifications and documentation for the support, maintenance, monitoring and quality assurances of ETL processes.

Investigate, support, correct and prevent issues relating to existing Trust developed data reporting systems and processes, identifying issues and implementing resolutions in a timely manner.

Participate in the sprint planning process to determine durations and any dependencies with planned development work.

Develop test plans, and supporting test data, for the developed services in order to validate their stable and maintainable operation against requirements.

Ensure that skills and knowledge are kept up-to-date through professional development.

Make recommendations on new tools, technologies and techniques that can be adopted by the team.

Participate in regular exercises to test business continuity and disaster recovery plans.

Human Resources

Line manage (if applicable) in line with appropriate policies, procedures, working practices and guidelines, ensuring all resources are deployed to maximise an efficient and effective delivery of support services to patients and users.

As requested, provide reports on progress, status and achievements for own work.

Undertake and support the development of staff/placements in line with personal development reviews and other associated guidance.

Provide guidance for staff from own or other disciplines on own subject area, when required.

On limited occasions, by exception, the post holder may be required to work unsociable hours to support and/or enable the delivery of key programmes or projects.

Financial/Physical Resources

Be responsible for the safe and efficient use of hardware, software and financial resources.

Where required, liaise with external agencies, suppliers and contractors ensuring delivery of service is in line with agreed contracts and value for money.

Ensure the post holder adheres to Trust Standing Financial Instructions (SFIs) and procurement guidelines.

Project Management

Advise and participate in the development and implementation of projects as part of planned development sprint cycles.

Ensure project tasks, where required, are successfully delivered in line with agreed timescales and budgets.

Work with line manager to ensure any project management documentation or reports are delivered in line with agreed standards and timescales.

Policy/Service Development/Governance

Act as an ambassador for Digital Services by developing and maintaining excellent working relationships with users across the organisation to deliver a high quality professional service as part of the a development team.

Pro-actively participate in ensuring that Digital services delivered within the Trust reflect best practice with respect to organisational, NHS and legislative requirements and guidelines including IT Infrastructure Library (ITIL), Data Protection Act 2018, Information Standards, Information Security and compliance with NHS Information Governance.

Ensure all documentation relating to own area is complete and fit for purpose and all releases relating to hardware, software and documentation is controlled.

Ensure there is a proactive and comprehensive approach to risk management and be responsible for service continuity for own area.

Contribute to Root Cause Analysis (RCA) for allocated incidents and problems; instigating action when required, liaising with other team members and managers, as appropriate.

Business Continuity Management

Be familiar with the Trust and Department level Business Continuity Plan and personal responsibilities within, where applicable.