Platform Engineer
London
Get The Future You Want!
Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible.Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Your Role:
- Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.
- Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.
- Establish best practices for cloud security, scalability, and performance.
- Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.
- Ensure high availability, scalability, and fault tolerance of Airflow clusters.
- Implement monitoring, alerting, and logging for Airflow and related components.
- Perform upgrades and patches for platform-related components.
- Oversee capacity planning, resource allocation, and optimization of Airflow workers.
- Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control.
- Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements.
- Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
- Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies.
- Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues.
- Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition
Your Profile:
- Deploy and manage scalable, secure cloud infrastructure for platforms like Astronomer Airflow and AccelData, ensuring high availability and performance.
- Integrate vendor products with data lakes, storage, and compute services, while maintaining robust monitoring, alerting, and logging systems.
- Oversee configuration, upgrades, and maintenance of Airflow environments, including version control integration and resource optimization.
- Collaborate with cloud providers (e.g., AWS) to support data pipeline scalability, and implement infrastructure improvements for automation and efficiency.
- Build analytical tools and data pipelines using AWS and SQL to deliver actionable insights and support cross-functional teams in resolving platform-related issues.
About Capgemini
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world while creating tangible impact for enterprises and society. It is a responsible and diverse group of 350,000 team members in more than 50 countries.With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market-leading capabilities in AI, cloud, and data, combined with its deep industry expertise and partner ecosystem.
The Group reported 2023 global revenues of €22.5 billion.
Get The Future You Want | www.capgemini.com
TelentLondon
Reactive Fire Engineer - Nights
Job Description
When you join our Engineering Team at Telent, you'll be empowered to innovate and drive common solutions, working closely with technical experts who are proud of the impact their work makes. Come...
TelentLondon
Reactive Fire Engineer - Nights
Job Description
When you join our Engineering Team at Telent, you'll be empowered to innovate and drive common solutions, working closely with technical experts who are proud of the impact their work makes. Come...
TelentLondon
Reactive Fire Engineer - Nights
Job Description
When you join our Engineering Team at Telent, you'll be empowered to innovate and drive common solutions, working closely with technical experts who are proud of the impact their work makes. Come...