Data Engineer

I’m currently seeking a Data Engineer to work for a globally renowned Financial Services organisation. This opportunity is to be help build and be part of a ground breaking Big Data ecosystem.

This organisation recognises that the in order for them to grow they must use the latest technologies to innovate an build a truly unique data system.

We seeking candidates who are creative and technical to drive new ideas into the industry.

Require skills:

• Management of Hadoop cluster, with all included services and an ability to solve any ongoing issues with its operation
• Proficiency with Hadoop v2, MapReduce, HDFS
• Experience with building stream-processing systems
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
• Experience with NoSQL databases, such as HBase, MongoDB
• Knowledge of various ETL techniques and frameworks,
• Experience with various messaging systems, such as Kafka
• Experience with Big Data ML toolkits, such as Dask, SparkML, or H2O
• Experience with Google Cloud Platform/Hortonworks
• Experience in Python, particularly the scientific stack and Anaconda
• Able to integrate multiple large data sources and databases into one system

Day Rate: £550.00 to £600.00 /day