Machine Learning Data Engineer

6 Months – Outside IR35 – Hybrid working (Home/London)

Our client is looking for a data engineer to join a new team with the goal of implementing new technologies and pipelines for data processing, data classification, and data governance. You will be working closely with other data engineers and data scientists.

Requirements

– Experience developing and maintaining data pipelines, Data Lakes, ML training loops, and data operations workflows

– Experience working on production deployment of Machine Learning AI solutions

– Experience with Python including pyspark, pandas, numpy is essential

– Experience with Spark, AWS Glue, Athena, Delta Lake, Redshift

– Experience managing relational databases (we use Aurora Postgres)

– Experienced with the AWS cloud platform

– Experience with containers and scheduling tools (we use Docker on ECS)

Nice to have

– Experience with Natural Language Processing (NLP)

– Experience with Supervised and Unsupervised Machine Learning Algorithms

– Experience with Sagemaker

– Experience with Terraform and infrastructure as code

– Experience working with CI/CD pipeline tools such as CircleCI, Jenkins etc