Lead Data Engineer
Government Recruitment Service | Liverpool | findajob.dwp.gov.uk |
As Lead Data Engineer you will be instrumental in the development and implementation of core borders and immigration-related management information assets within the Home Office.
The Home Office is the lead government Department for immigration and passports, crime, police, fire, and counter terrorism – significant issues which are at the heart of the agenda of HM Government. The challenges and opportunities the Department faces are significant and rapidly changing in the global environment in which we operate.
Strong analytical advice is needed to navigate these challenges, and the Home Office has a reputation for putting analysis at the heart of decision-making.
Part of the Home Office Analysis & Insight directorate (HOAI), the Performance Reporting & Analysis Unit (PRAU) provides reporting and analysis of performance for the Migration & Borders Mission and associated operational Capabilities. We support Ministers, the Executive Committee, Policy and Operational leads and other analytical functions with the management information (MI) that they need, as well as producing data for publication and other forms of external release.
The Unit also provides advice and support to others in the Department on how to make best use of performance information and is leading on the transformation of MI systems and capabilities.
The Data Integration team within PRAU are at the heart of multi-year transformation of the MI model and systems, introducing a cloud-based, sustainable and agilely-delivered, MI platform and service called Vantage. As a key leader in this programme, you will be working in a challenging and exciting space that demands enthusiasm, creativity and careful management.
PRAU is geographically spread across four primary locations (London, Liverpool, and Sheffield and Croydon). Candidates will need to agree a base location of either Croydon, Liverpool or Sheffield with a requirement for periodic attendance at other Home Office locations.
As the Operational Lead Data Engineer, you will deliver the data engineering vision for Vantage as set by the Principal Data Engineer. You will focus on designing, coordinating, and implementing numerous complex data flows to connect operational systems, data for analytics and BI systems.
Working in tandem with the Technical Lead Data Engineer and supporting the Principal Data Engineer with managing the unit and getting the most from the available resource.
Responsible for several data engineering sub teams, you will be providing support and management direction to their deliveries. Promoting best practice, continuous improvement, conflict resolution, constructively challenging delays, and removing blockers to project and programme deliveries.
You will need to develop management information assets sustainably, while remaining agile and adaptive - aligning to the unit’s data strategy of building integrity, performance, scalability, security and maintainability into those designs, while being responsive to emerging business pressures and priorities.
You will identify and deliver new data sources and develop ETL (Extract, Transform, Load) processes, collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems.
You will work closely with the Technical Lead Data Engineer to embed new ways of working and strive to build a culture of continuous personal development. You will be open to and encourage views from all our developers and partners (a mixture of civil servants and contract suppliers), to maintain and build on our reputation for achieving great things despite the significant challenge.
Working with our various stakeholders (operational units, MI teams, Business Analysts, Senior Managers, etc), you will exercise key stakeholder management skills to manage expectations, listen and interpret business needs, communicate progress and facilitate difficult conversations (for example around technical or data limitations, or prioritisation), while building a 'service culture' around data.
You will lead data management, data engineering and analytical projects, working collaboratively with other teams and stakeholders to acquire and ingest new data sources, set standards, and ensure implementation and adherence to these.
You will embed and asses best practice, be responsible for data architecture decisions, provide technical direction and assistance, develop and share performance enhancements, exploit cloud computing opportunities, champion data engineering across the Department, and assist in the development of technical skills across PRAU and beyond.
Where business needs allow, some roles may be suitable for a combination of office and home-based working. This is a non-contractual arrangement where all employees will be expected to spend a minimum of 60% of their working time in an office, subject to local estates capacity, by Spring 2024.
Applicants can request further information regarding how this may work in their team from the Vacancy Holder (see advert for contact details).
Recruitment and Retention Allowance (RRA)
This post is eligible for a DDaT RRA. Successful candidates with exceptional skills and experience may apply for an annual RRA of between £4,261 to £9,950. This allowance is subject to an initial review within six months of taking up the post and thereafter an annual review in-line with departmental priorities and could be reduced or withdrawn at any time.
Due to business requirements this vacancy is only available on Full time hours.
The Home Office is the lead government Department for immigration and passports, crime, police, fire, and counter terrorism – significant issues which are at the heart of the agenda of HM Government. The challenges and opportunities the Department faces are significant and rapidly changing in the global environment in which we operate.
Strong analytical advice is needed to navigate these challenges, and the Home Office has a reputation for putting analysis at the heart of decision-making.
Part of the Home Office Analysis & Insight directorate (HOAI), the Performance Reporting & Analysis Unit (PRAU) provides reporting and analysis of performance for the Migration & Borders Mission and associated operational Capabilities. We support Ministers, the Executive Committee, Policy and Operational leads and other analytical functions with the management information (MI) that they need, as well as producing data for publication and other forms of external release.
The Unit also provides advice and support to others in the Department on how to make best use of performance information and is leading on the transformation of MI systems and capabilities.
The Data Integration team within PRAU are at the heart of multi-year transformation of the MI model and systems, introducing a cloud-based, sustainable and agilely-delivered, MI platform and service called Vantage. As a key leader in this programme, you will be working in a challenging and exciting space that demands enthusiasm, creativity and careful management.
PRAU is geographically spread across four primary locations (London, Liverpool, and Sheffield and Croydon). Candidates will need to agree a base location of either Croydon, Liverpool or Sheffield with a requirement for periodic attendance at other Home Office locations.
As the Operational Lead Data Engineer, you will deliver the data engineering vision for Vantage as set by the Principal Data Engineer. You will focus on designing, coordinating, and implementing numerous complex data flows to connect operational systems, data for analytics and BI systems.
Working in tandem with the Technical Lead Data Engineer and supporting the Principal Data Engineer with managing the unit and getting the most from the available resource.
Responsible for several data engineering sub teams, you will be providing support and management direction to their deliveries. Promoting best practice, continuous improvement, conflict resolution, constructively challenging delays, and removing blockers to project and programme deliveries.
You will need to develop management information assets sustainably, while remaining agile and adaptive - aligning to the unit’s data strategy of building integrity, performance, scalability, security and maintainability into those designs, while being responsive to emerging business pressures and priorities.
You will identify and deliver new data sources and develop ETL (Extract, Transform, Load) processes, collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems.
You will work closely with the Technical Lead Data Engineer to embed new ways of working and strive to build a culture of continuous personal development. You will be open to and encourage views from all our developers and partners (a mixture of civil servants and contract suppliers), to maintain and build on our reputation for achieving great things despite the significant challenge.
Working with our various stakeholders (operational units, MI teams, Business Analysts, Senior Managers, etc), you will exercise key stakeholder management skills to manage expectations, listen and interpret business needs, communicate progress and facilitate difficult conversations (for example around technical or data limitations, or prioritisation), while building a 'service culture' around data.
You will lead data management, data engineering and analytical projects, working collaboratively with other teams and stakeholders to acquire and ingest new data sources, set standards, and ensure implementation and adherence to these.
You will embed and asses best practice, be responsible for data architecture decisions, provide technical direction and assistance, develop and share performance enhancements, exploit cloud computing opportunities, champion data engineering across the Department, and assist in the development of technical skills across PRAU and beyond.
Where business needs allow, some roles may be suitable for a combination of office and home-based working. This is a non-contractual arrangement where all employees will be expected to spend a minimum of 60% of their working time in an office, subject to local estates capacity, by Spring 2024.
Applicants can request further information regarding how this may work in their team from the Vacancy Holder (see advert for contact details).
Recruitment and Retention Allowance (RRA)
This post is eligible for a DDaT RRA. Successful candidates with exceptional skills and experience may apply for an annual RRA of between £4,261 to £9,950. This allowance is subject to an initial review within six months of taking up the post and thereafter an annual review in-line with departmental priorities and could be reduced or withdrawn at any time.
Due to business requirements this vacancy is only available on Full time hours.
Don’t miss out on new job vacancies!
Create a job alert for: Principal Systems Engineer, Liverpool
It's free, and you can cancel email updates at any time