Data Engineer - Azure / ADF / Databricks - Burton upon Trent
Michael Page Burton upon Trent
About Our Client
Global Pharmaceutical Services provider
Job Description
This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers.Key Responsibilities:
• Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business.
• Explore solutions for optimising the performance of the strategic data platform pipelines, following development design principles
• Develop and scale the cloud data platforms utilising CI / CD pipelines and Terraform.
• Help identify and implement the approach to data modelling our business processes in a manner that allows for agile implementation and improvement.
• Technical implementation of process protocols, quality measures and outcome definitions that allow us to use our data as Real-World evidence.
• Work with the analytics team to understand and build solutions that combine internal insight, patient outcomes, and external data feeds - creating an opportunity to explore big data and machine learning algorithms.
• Support the implementation of the security controls that ensure patient data privacy and full compliance with the Data Protection Act / GDPR
• Help develop and implement the strategic data platform for insights including support to NHS National KPIs and standard operational/financial reporting, Standard Pharma Offerings, Bespoke Customer Solutions, Commercial/Financial Analytics/Planning and Internal Self-Service reporting.
• Identify key processes where BI can link our business operations with our patients.
• Help develop and implement the data acquisition strategy ensuring that data is available when needed, accurate and understood.
Key Technical Skills required:
• Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI
• Extensive experience of working with Azure Data Factory & Databricks
• Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL)
• Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience.
• Microsoft DevOps source control software and development lifecycle software
• Developing and maintaining objects within Data Warehouses / Lakehouses.
• Experience of working with business data domains / data as a product (Data Mesh).
• Metadata management / Data quality
The Successful Applicant
• Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI
• Extensive experience of working with Azure Data Factory & Databricks
• Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL)
• Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience.
• Microsoft DevOps source control software and development lifecycle software
• Developing and maintaining objects within Data Warehouses / Lakehouses.
• Experience of working with business data domains / data as a product (Data Mesh).
• Metadata management / Data quality
What's on Offer
Opportunity to work on a major Data Engineering programme
Opportunity to work with a global organisation
Global Pharmaceutical Services provider
Job Description
This Global Pharmaceutical Services provider are looking for a Data Engineer to work within their growing Business Intelligence technical service function. You will be supporting the technical development of their cloud data platforms, offering the options for near real time process reporting solutions. You will work on designing and developing their company data acquisition strategy allowing for near real time process reporting and full support of contractual reporting to customers.Key Responsibilities:
• Monitor and maintain ETL processes to ensure the continuation of an accurate data reporting platform for the business.
• Explore solutions for optimising the performance of the strategic data platform pipelines, following development design principles
• Develop and scale the cloud data platforms utilising CI / CD pipelines and Terraform.
• Help identify and implement the approach to data modelling our business processes in a manner that allows for agile implementation and improvement.
• Technical implementation of process protocols, quality measures and outcome definitions that allow us to use our data as Real-World evidence.
• Work with the analytics team to understand and build solutions that combine internal insight, patient outcomes, and external data feeds - creating an opportunity to explore big data and machine learning algorithms.
• Support the implementation of the security controls that ensure patient data privacy and full compliance with the Data Protection Act / GDPR
• Help develop and implement the strategic data platform for insights including support to NHS National KPIs and standard operational/financial reporting, Standard Pharma Offerings, Bespoke Customer Solutions, Commercial/Financial Analytics/Planning and Internal Self-Service reporting.
• Identify key processes where BI can link our business operations with our patients.
• Help develop and implement the data acquisition strategy ensuring that data is available when needed, accurate and understood.
Key Technical Skills required:
• Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI
• Extensive experience of working with Azure Data Factory & Databricks
• Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL)
• Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience.
• Microsoft DevOps source control software and development lifecycle software
• Developing and maintaining objects within Data Warehouses / Lakehouses.
• Experience of working with business data domains / data as a product (Data Mesh).
• Metadata management / Data quality
The Successful Applicant
• Extensive experience of working with Azure data platform technologies including Data Lake gen 2, Synapse, Analysis Services, Power BI
• Extensive experience of working with Azure Data Factory & Databricks
• Extensive SQL knowledge (Microsoft SQL Server 2005+) and experience working with relational databases, query authoring (T-SQL)
• Microsoft SQL server Integrated Services (SSIS) including ETL/ELTL design and development experience.
• Microsoft DevOps source control software and development lifecycle software
• Developing and maintaining objects within Data Warehouses / Lakehouses.
• Experience of working with business data domains / data as a product (Data Mesh).
• Metadata management / Data quality
What's on Offer
Opportunity to work on a major Data Engineering programme
Opportunity to work with a global organisation
The National CollegeSheffield, 40 mi from Burton upon Trent
This is where you come in. As a Data Engineer, you will be part of the team that is responsible for the development and operation of the data warehouse stack and data quality, integrating additional data sources and providing processed data for consumption, BI...
Michael PageSolihull, 28 mi from Burton upon Trent
About Our Client
The organisation is a well-established, prestigious leader in the engineering sector with global reach
The HR Data and Reporting Manager will report to the Head of Reward and play a pivotal role in the HR team, you will focus...
TwinklSheffield, 40 mi from Burton upon Trent
here to support you on your journey.
Head of Data Engineering
Location: Flexible - Remote/ Hybrid/ On-Site
Job Type: Permanent, full time
Ready to embark on a thrilling journey in the world of EdTech?
Twinkl, the UK's leading digital education...