Data Engineer - Reply
Data Engineer
About Data Reply:Data Reply is the Reply Group company offering a broad range of analytics and data processing services. We operate across different industries and business functions, working directly with executive level professionals, enabling them to achieve meaningful outcomes through effective use of data.
We find that one of the biggest problems experienced by our clients today is being overwhelmed with the amount of data that they face and not knowing how to leverage it to their advantage. The vast landscape of available technology stacks and models means that choosing the right ones can be a daunting task.
Most companies know that their data is valuable, and that they should be making the most out of it to stay competitive, but often don't know where to begin or what to prioritise. At Data Reply, we pride ourselves on helping clients make the right decisions to build their data strategy.
With our consultants' expertise, we map the right technologies to meet our clients' business needs. We deal in bespoke solutions, and offer in house training to ensure that our clients realise the full value of their big data solution. www.data.reply.com
Role overview:As a Data Engineer joining our Data Reply team in London, you will design and develop high-performance big data applications, manage complex data sets, and work across the full development lifecycle. You'll work across a variety of projects as a consultant using big data technologies such as SQL, AWS and Databricks to add business value and collaborate with global clients.
The role offers extensive training, structured career progression, and opportunities to work with leading brands in a vibrant, technology-driven environment.
Responsibilities:
- As a big data consultant, you'll translate functional requirements into technical requirements
- Design and develop high performing and stable end-to-end big data applications to perform complex processing of batch and real-time massive volumes of data in a multi-tenancy cloud environment
- As a big data Engineer, you will develop and implement tools for data acquisition, extraction, transformation, management, and manipulation of large and complex data sets
- You'll be involved in all aspects of development - design, development, build, deployment, monitoring and operations
- Research and experiment with emerging technologies and industry trends with a view to bringing business value through early adoption
About the candidate:
- A minimum Bachelor's degree is required in Computer Science or in a directly related IT discipline
- At least 1-2 years' experience with handling big data projects using SQL and Python
- You can demonstrate tangible experience using AWS and Databricks
- Excellent communications skills: an ability to communicate with impact, ensuring complex information is articulated in a meaningful way to wide and varied audiences
- A passion for technology and a strong interest in pursuing a specialist careers path as a Big Data Engineer
- A strong understanding of key Python concepts related to data engineering is needed as a foundation on which to build (e.g. Pandas, numpy, Python file handling, JSON)
- You possess solid understanding of AWS cloud environments, including S3, LAMBDA, RDS, AWS CDK or Terraform, Dynamo DB
- Flexibility regarding local business travelling
Reply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law.
Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.