Senior Big Data Engineer

We are currently partnered with an amazing Data, Predictive Analytics and AI business who helps companies transform their performance by having access and insight into huge amounts of data. Using the most innovative machine learning techniques they provide automation in customer journeys, understanding their previous success’, what’s working and what can be improved going forward.

They are now looking for a Senior Data Engineer to focus on their big data platforms and developing new and existing data pipelines utilising AWS, delivering technical solutions from requirements and working on huge data sets.

You will be:

• Operate as a team member of a Scrum Agile/Kanban team
• Design, development and peer review new functionality in various code languages
• Work as a senior developer for the various data sourcing in Hadoop
• Work as a senior developer for developing analytics algorithm on top of ingested dat
• Ensuring new code is tested, coordinating with QA staff and building new code into continuous testing automation.

Ideally for this roles they do need someone with experience in:

• Experience as senior developer using Java, Python, Flask, PySpark and Pandas
• Experience in HDFS, Spark, Scala & Yarn along with data access techniques like Hive, Impala, Hue.
• Experience in Kafka or similar streaming technology
• Experience in writing Unit and Functional test code using BDD practices
• Oracle experience
• Must have worked in agile methodology, RAD
• Must be familiar with software best practices such as TDD test driven development, BDD Behavior-driven development, continuous integration etc
• Passonate about writing high quality code

If the above is of interest then please get in touch.

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://welovesalt.com/privacy-policy/.