Senior Data Engineer
NHS Jobs London
Leadership Mentor and coach other members of the Data Engineering team, including supporting building long-term capability in the team. Champion quality across the Digital, Data and Technology teams. Communicating between the technical and non-technical Communicate effectively with technical and non-technical stakeholders.
Support and host discussions within a multidisciplinary team, with potentially difficult dynamics. Be an advocate for the team externally and can manage differing perspectives. Continual service improvement You know how to analyse current processes, identify and implement opportunities to optimise processes, and lead and develop a team of experts to deliver service improvements.
You help to evaluate and establish requirements for the implementation of changes through policy and standards. Data analysis and synthesis Undertake data profiling and source system analysis, including documenting complex source-to-target mappings.
Present clear insights to colleagues to support the end use of the data. Facilitate and lead discussions on data accuracy with teams. Data development process Design, build and test data products that are complex or large scale. Build and contribute to teams to complete data integration services.
Data innovation Understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage. Data integration design Produce relevant data models across multiple subject areas. Explain which models to use for which purpose and compare / align different models.
Understand industry-recognised data modelling patterns and standards, and when to apply them. Select and implement the appropriate technologies to deliver resilient, scalable and future-proofed data solutions. Data modelling Produce relevant data models across multiple subject areas.
Explain which models to use for which purpose and compare / align different models. Understand industry-recognised data modelling patterns and standards, and when to apply them. Data operations Ensure the data operational environment is maintained, and with appropriate monitoring and coverage, automating remediation action(s) where possible.
Lead on regular preventative maintenance activities that are complex. Develop and maintain accurate data knowledge documentation. Partner with other enabling technology teams to ensure we provide a fit-for-purpose, performant data service to users.
Financial management Understand how to balance cost versus value Consider the impact of user needs Ordering IT equipment / services for your team Governance Ensure our data engineering and operational practices consider secure by design principles, and clinical safety principles throughout the lifecycle partnering with supporting teams (information governance, information security, and clinical safety) to ensure successful outcomes.
Metadata management Contribute to and update the metadata repository. Suggest changes to improve current metadata repositories. Understand a range of tools for storing and working with metadata. Advise less experienced members of the team about metadata management.
Ownership and initiative You can take accountability of issues that occur and be proactive in searching for potential problems. You know how to achieve excellent user outcomes. Problem resolution (data) Respond to incidents and problems in databases, data processes, data products and services as they occur.
Initiate actions, monitor services and identify trends to resolve problems. Determine the appropriate remedy and assist with its implementation, and with preventative measures. Programming and build (data engineering) Use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations.
Collaborate with others to review specifications where appropriate. Ensure engineering is in-line with agreed standards, including strict version control. Lead the build of data flows / data streaming systems. Service focus You know how to see the bigger picture and can investigate how to get the best of underlying services.
You will represent data engineering in service design and transition activities, to ensure a smooth transition of products from delivery into live service. Service reporting Responsible for ensuring that the service management platform and associated tooling is kept up to date with across your portfolio of services.
Produce relevant reports in a standard format and agreed timeframe. Add a commentary that provides an interpretation of the data set. Technical understanding Understand the core technical concepts related to the role and apply them with guidance.
Demonstrate knowledge of emerging tools and techniques. Technical breadth Have experience in more than one data engineering technology (SQL, Oracle, etc) Testing Review requirements and specifications and define test conditions. Identify issues and risks associated with work.
Support and host discussions within a multidisciplinary team, with potentially difficult dynamics. Be an advocate for the team externally and can manage differing perspectives. Continual service improvement You know how to analyse current processes, identify and implement opportunities to optimise processes, and lead and develop a team of experts to deliver service improvements.
You help to evaluate and establish requirements for the implementation of changes through policy and standards. Data analysis and synthesis Undertake data profiling and source system analysis, including documenting complex source-to-target mappings.
Present clear insights to colleagues to support the end use of the data. Facilitate and lead discussions on data accuracy with teams. Data development process Design, build and test data products that are complex or large scale. Build and contribute to teams to complete data integration services.
Data innovation Understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage. Data integration design Produce relevant data models across multiple subject areas. Explain which models to use for which purpose and compare / align different models.
Understand industry-recognised data modelling patterns and standards, and when to apply them. Select and implement the appropriate technologies to deliver resilient, scalable and future-proofed data solutions. Data modelling Produce relevant data models across multiple subject areas.
Explain which models to use for which purpose and compare / align different models. Understand industry-recognised data modelling patterns and standards, and when to apply them. Data operations Ensure the data operational environment is maintained, and with appropriate monitoring and coverage, automating remediation action(s) where possible.
Lead on regular preventative maintenance activities that are complex. Develop and maintain accurate data knowledge documentation. Partner with other enabling technology teams to ensure we provide a fit-for-purpose, performant data service to users.
Financial management Understand how to balance cost versus value Consider the impact of user needs Ordering IT equipment / services for your team Governance Ensure our data engineering and operational practices consider secure by design principles, and clinical safety principles throughout the lifecycle partnering with supporting teams (information governance, information security, and clinical safety) to ensure successful outcomes.
Metadata management Contribute to and update the metadata repository. Suggest changes to improve current metadata repositories. Understand a range of tools for storing and working with metadata. Advise less experienced members of the team about metadata management.
Ownership and initiative You can take accountability of issues that occur and be proactive in searching for potential problems. You know how to achieve excellent user outcomes. Problem resolution (data) Respond to incidents and problems in databases, data processes, data products and services as they occur.
Initiate actions, monitor services and identify trends to resolve problems. Determine the appropriate remedy and assist with its implementation, and with preventative measures. Programming and build (data engineering) Use agreed standards and tools to design, code, test, correct and document moderate-to-complex programs and scripts from agreed specifications and subsequent iterations.
Collaborate with others to review specifications where appropriate. Ensure engineering is in-line with agreed standards, including strict version control. Lead the build of data flows / data streaming systems. Service focus You know how to see the bigger picture and can investigate how to get the best of underlying services.
You will represent data engineering in service design and transition activities, to ensure a smooth transition of products from delivery into live service. Service reporting Responsible for ensuring that the service management platform and associated tooling is kept up to date with across your portfolio of services.
Produce relevant reports in a standard format and agreed timeframe. Add a commentary that provides an interpretation of the data set. Technical understanding Understand the core technical concepts related to the role and apply them with guidance.
Demonstrate knowledge of emerging tools and techniques. Technical breadth Have experience in more than one data engineering technology (SQL, Oracle, etc) Testing Review requirements and specifications and define test conditions. Identify issues and risks associated with work.
Analyse and report test activities and results. Community of practice Develop and maintain a network of professionals to enable continuous learning and a community which can share, learn, and keep up to date on the broader technology and data landscape Other Duties: Occasional work may be required outside of core business hours to support major projects / programmes All other reasonable requests
NoirLondon
Senior Data Engineer Python, PySpark - Remote
Data Engineer, Senior Data Engineer, Python, PySpark, SQL, C#, Big Data, Databricks, R, Machine Learning, AI, Agile, Scrum, TDD, BDD, CI / CD, SOLID principles, Github, Azure DevOps, Jenkins, Terraform...
London
this opportunity
A great opportunity has arisen for a Lead Data Engineer to join our engineering team and make a real difference!
Working in the Enterprise Data Provisioning Platform, you can help shape the Group’s ambition by enabling the bank to gain value from...
Moorfields Eye Hospital NHS Foundation TrustLondon
and joining up systems and data across to better meet the needs of citizens.
The data engineering service provides a central platform to support the Trust’s data analytics, reporting and day-to-day operational service delivery and responsible for the end...