Senior Big Data Software Engineer


Greater London Permanent £70000.00 - £90000.00 per annum + bonus+benefits+package

Senior Big Data Engineer (Hadoop, Jenkins, Spark, Hive, Map Reduce, Python)


A British multinational retailer and much-loved brand seek a Big Data Engineer (Hadoop, Python, Spark, Hive, Map Reduce, Jenkins) who loves to push the boundaries of new technologies and solve real-world business problems. If you are a Big Data Engineer who is naturally curious and inquisitive who perhaps is working on the latest technology but not able to autonomously design end to end software solutions into a productionised operations environment, then this could be for you!

Working as a Big Data Engineer in a senior capacity you will be able to create exceptional personalised customer experiences and solve difficult business problems. This is a very challenging and rewarding opportunity where you will not only mentor other team members and lead design workshops, but you will work on a range of technologies including Impala, Oozie, Mule, Kafka and Python to name a few.

The Big Data development team is growing and as Big Data Engineer (Hadoop, Python, Spark, Hive, Map Reduce, Jenkins) you will be part of a highly collaborative team that is integral to the technical decisions and architectures for the company.

Senior Big Data Engineer – What you will bring;

  • Previous Big Data experience building Python frameworks within Hadoop environments to solve large-scale problems.
  • A strong understanding of distributed systems and experience using open source frameworks to build applications.
  • Some technologies we are using include Python, Impala, Spark, Hive, Oozie, Flume, Kafka, Mule, Apigee, Map Reduce, Jenkins and Github.
  • Proven experience designing end to end software solutions, delivering elegant code into a productionised operations environment
  • Curiosity, positive attitude, personable in nature and a great communicator, be highly motivated and a result driven individual.
  • DevOps tools such as Jenkins or GIT
  • Experience delivering in a live, agile, continuous delivery environment using best practices.
  • Experience with REST API and working in the cloud although this is advantageous but essential.
  • Hadoop ecosystem experience with ideally some Cloudera experience

No one day is the same here, however you will design, build, implement and maintain generic components for ingestion, validation, and structuring of disparate data sources into the Big Data platform. Using industry best practices, you will produce standardised coding designs and document generic solutions to the point they can be re-used by other members of the team to perform builds.

As Big Data Engineer you will interact with the business, architecture or other members of the team to define and refine requirements and test components and peer review.

In return you will receive a competitive salary with industry leading benefits and work for a major retailer pioneering new concepts working with a highly intelligent and gifted team of individuals.

Job Reference: JO-1802-132790

Salary: £70000.00 - £90000.00 per annum + bonus+benefits+package

Salary per: Annum

Job Duration:

Job Start Date: 07/05/2018

Job Type:

Job Location:

Job Industry:

Apply Now

Here are some related jobs


Application Support Developer – Work From Home

We are looking for an experienced Application Support Developer to join one of the worlds leading providers for Pre and Post graduate professional qualifications in Europe and the US. This…

£40000 - £45000 per annum + work from home

Lead Developer / Technical Architect

I'm looking for an experience Lead Developer / Technical Architect to work on a 6 month extendable contract based in London. The position will be working with a large digital…

Up to £650 per day

Marklogic Developer – Digital Business – Java, XML, XSLT, XQuer

Marklogic Developer - Digital Business - Java, XML, XSLT, XQuery, NOSQL - London BridgeRate: Competitive Length: 3-6 months This is an urgent requirement for my client who are looking to…

£600 - £700 per day

Upload your CV

Upload your CV and one of our consultants will be in touch with you as soon as possible.

Please let us know where you are, or where you would like to be in the world so we can point you in the right direction.

Cookie Consent×

Salt uses cookies to improve the user experience of our site. Cookies allow you to have a more enhanced journey through the site when searching for a specific job or location. They also allow for social sharing through Facebook, Twitter and LinkedIn. Whose doesn’t like cookies? Unfortunately it’s not those kind of cookies we are referring to but they are there to help us understand how our site is being used and give you a better service. You can find out more about how Salt uses cookies here. By continuing to use the Salt site you are consenting to use our cookies.