Data Engineer (Enterprise DataWarehouse Developer)
LMAX Group London
As a Data Engineer, you’ll design and maintain data scrapers and data pipelines, design & optimize analytics & relational databases, and build analytics models using DBT and bespoke aggregation engines. You’ll work closely with business stakeholders, other BI Developers and DataOps as well as System engineers to support both data and application integrations using bespoke tools written in Python/Java, as well as tools such as Meltano, Airflow, Mulesoft/Snaplogic, Apache NIFI, and Kafka, ensuring a robust, well-modelled, and scalable data analytics infrastructure running on MySQL and Postgres style databases primarily.
Requirements
Essential Skills / Experience:
SQL, Data Modelling & Database Administration- Advanced SQL development and deep understanding of RDBMS concepts and engines
- 5+ years' experience designing dimensional models (Kimball-style stars/Inmon schemas)
- Practical knowledge of Data Warehouse infrastructure architecture and best practices
- Practical database design, development, administration knowledge (any RDBMS)
- Strong understanding of data governance, quality, and privacy (e.g. GDPR compliance)
- Proficiency in ELT/ETL processes
- Strong experience in data ingestion, transformation & orchestration technology (ETL tools such as Informatica, Datastage, SSIS, etc..) or open source Meltano, Airbyte, and Airflow
- Proven experience with DBT (data build tool)
- Proficiency with business intelligence tools (Power BI, Tableau, SAP BI, or similar).
- Hands-on experience with API development and integration (REST/SOAP)
- Proficiency in at least 1 object/procedural/functional language (e.g: Java, PHP, Python)
- Familiarity with EAI tools such as MuleSoft/SnapLogic or Apache NiFi
Desirable Skills / Experience:
- Experience with infrastructure-as-code tools such as Terraform and Ansible
- Experience with version control (e.g. Git, SVN) and CI/CD workflows for deployment
- Experience scraping external data sources using Beautiful Soup, Scrapy, or similar
- Familiarity with Database Replication & CDC technologies such as Debezium
- Familiarity with message & event-driven architecture, including tools like AWS MQ, Kafka
- Exposure to cloud database services (e.g., AWS RDS, Snowflake)
- 25 days of holiday
- Bonus
- Pension contribution
- Private medical, dental, and vision coverage
- Life assurance
- Critical illness cover
- Wellness contribution program with access to ClassPass
- Plumm Platform
- Five volunteering days
- Give as You Earn initiative
- Learning and development programs
- Electric Vehicle Scheme
- Cycle to Work Scheme
- Season Ticket Loan
NoirCity of London, 2 mi from London
Data Engineer – Investment Banking – London/ Hybrid
Data Engineer, SQL Data Engineer, Java, Python, Spark, Scala, SQL, Snowflake, OO programming, Snowflake, Databricks, Data Fabric, design patterns, SOLID principles, ETL, Unit...
Harnham - Data & Analytics RecruitmentLondon
PRINCIPAL DATA ENGINEER
LONDON
£107,000
THE COMPANY
This consumer-tech powerhouse brings together several market-leading ecommerce brands, serving over 10 million customers across Europe. Now in an exciting phase of growth and innovation...
London
Senior Data Engineer - Cloud (Contract)
London - 2-3 days per week in office
£95.00 - £115.00 per hour (via umbrella)
6. month contract - likely to extend (project expected to run through to Easter next year)
Are you a skilled Software or Data...