Principal Data Engineer

Principal Data Engineer
West End, London

£75,000 – £95,000

We are working with a leading mar-tech company hiring a Principal Data Engineer responsible for continually improving and maintaining Greenfield Data Platforms. You will support the wider data science and data engineering teams through a combination of rigorous automation and tooling.

Here you will enjoy an enviable environment where you will have many opportunities to work on completely varied and different projects working with large data and distributed systems across operations and software.

• As Principal Data Engineer you will collaborate with software engineers and data scientists to build data driven products.
• You will provide leadership proactively suggesting ways to improve the data platform and full analytics capability
• You will be involved in stakeholder engagements across product features, technical design sessions, retrospectives and planning.
• You will ensure adequate test coverage of your products (load and performance)
• Productionise and build ETL pipelines and work with ingestion data flows
• Work alongside Data Scientists to help them build production ready code
• Build API’s with appropriate levels of security, authentication and modelling.
• Build application components and AWS infrastructure

To be successful in this role:

• You will come from either a system engineering or software background, so you’re already best prepared to find and fix problems before they occur.
• You understand agile processes and know how to iterate on them
• You believe in TDD’s and code review
• You’re comfortable with system architecture, and able to reason about non-functional requirements like performance, scalability and security when designing systems.
• You will bring skills with Python, AWS (Lambda, EMR) Docker, Redshift and ETL.
• The entire tech stack; Scala, Go, Node.js, Data Modelling, R, Pandas. NumPy, Scikit-learn, Matplotlib, AWS SageMaker / DataPipeline / Kinesis, Jupyter, Qubole, Athena, Postgres, Spark, Hive, Pig, multiprocessing.
• In return you will build a leading AI platform using state of the art technology. You will join a diverse and talented team who practise TDD, continuous integration, weekly ‘Tech Share’ lunches, and regular hack days. You will receive a high spec MacBook Pro, and a range of benefits such as private medical, Life assurance and extensive holiday.

  Apply now for immediate interview!

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://welovesalt.com/privacy-policy/.