Upload CV

Data Engineer – Digital / Global Sport Streaming – London

Data Analytics

Greater London Permanent £55000 - £65000 per annum + Bonus + Benefits

Data Engineer – Digital / Global Sport Streaming – London

Salary: £55,000 – £65,000 + bonus + benefits

Due to the success of their business last year, my client is currently looking to hire a talented Data Engineer.

The Data Engineer will be responsible for the development and delivery of the data warehouse and supporting infrastructure. The Data Engineer will help the analytics team use the data collected to build and improve user-facing product features.

The Data Engineer will be responsible for choosing optimal solutions to integrate with the architecture used across the company.

The Data Engineer will have knowledge of data analysis, end user requirements analysis, and business requirements analysis to develop a clear understanding of the business needs and to incorporate these needs into technical solutions. It is essential that you have a solid understanding of physical database design principles, and the system development life cycle.

Responsibilities: Data Engineer – Digital / Global Sport Streaming – London

  • Be responsible for maintaining the existing ETL pipelines built using Luigi (Python) and Pandas. The backend is a Redshift database and a variety of third party APIs.
  • Ensure the infrastructure available can meet the solution requirements.
  • Plan, design and conduct tests of the implementations, correcting errors and re-testing to achieve an acceptable result.
  • Oversee the generation of new data products for the BI and Product teams.
  • Improve the performance of our Redshift data warehouse.
  • Monitor and enhance the performance of the whole pipeline – monitoring using Elasticsearch / Kibana.
  • Migrate the ETL process from static EC2 instances to a continuous delivery model – using the technologies you deem best for the job.
  • Investigate ways of improving the performance and reliability of the ETL process.
  • Research real-time streaming analytics to complement our traditional data warehouse setup.

Technical Skills: Data Engineer – Digital / Global Sport Streaming – AWS, Python, Redshift – London

  • Ability to communicate complex technical solutions in a non-technical manner
  • Experience using AWS
  • To be proficient in designing efficient and robust ETL workflows
  • Experience with relational databases (PostGreSQL, Redshift) and key-value stores (e.g. Redis)
  • Professional experience with Python (at least 1 year)
  • Previous experience working with a Workflow management tool (Airflow, Azkaban, Luigi…)
  • Experience of database design and best practices
  • Understanding how data is ingested from different sources and combined / transformed into a single
  • Strong knowledge of API technologies
  • Experience of writing solution design documentation

Please send across to me the most up to date copy of your CV to eobiechefu@welovesalt.com or call me on 0207 928 2525

Job Reference: 76345422

Salary: £55000 - £65000 per annum + Bonus + Benefits

Salary per: Annum

Job Duration:

Job Start Date: ASAP

Apply Now

Here are some related jobs

Data Analytics

Statistician / Advanced Analytics Consultant – London

Advanced Analytics Consultant / Statistician - German Speaking My client is global leader in the marketing sciences space. In short, they analyse the data generated in the world and create…

£40000.00 - £55000.00 per annum + benefits
Data Analytics

Data Scientist/Quantitative Analyst

This is a fantastic opportunity to join one the UK's emerging energy markets and be part of a historic moment as the country adapts for a more sustainable future. We…

£60000 - £80000 per annum + benefits
Data Analytics

Quantitative Analyst/Data Scientist

This is a fantastic opportunity to join one the UK's emerging energy markets and be part of a historic moment as the country adapts for a more sustainable future. We…

£60000 - £80000 per annum + benefits
×
UK

Upload your CV

Upload your CV and one of our consultants will be in touch with you as soon as possible.






Please let us know where you are, or where you would like to be in the world so we can point you in the right direction.




Cookie Consent×

Salt uses cookies to improve the user experience of our site. Cookies allow you to have a more enhanced journey through the site when searching for a specific job or location. They also allow for social sharing through Facebook, Twitter and LinkedIn. Whose doesn’t like cookies? Unfortunately it’s not those kind of cookies we are referring to but they are there to help us understand how our site is being used and give you a better service. You can find out more about how Salt uses cookies here. By continuing to use the Salt site you are consenting to use our cookies.

OK