Data Engineer – Team Lead

Data Engineer – Team Lead

Tech Stack:

Good software comes from balancing trade-offs in any given context and we value engineers who practice this way of thinking. Having a polyglot attitude to various programming languages and tools is a must as some of the tech required includes:

• Python 3, Scala
• Apache Spark
• AWS cloud
• Databricks platform
• Airflow
• GoCD
• Terraform
• Pandas
• Jupyter

About the role:

As a Senior Data Engineer, you’ll be responsible for ensuring the development of our robust data platform. You’ll be part of the Data Intelligence team which brings together all of the diverse data sources that has access to and turning it into intelligence.

What you’ll be doing:

Working closely with a cross functional team of data scientists, engineers and product managers, you’ll be an integral part of the data engineering chapter and be involved in developing big/fast data services to meet business objectives. Additionally, alongside other senior members, you’ll take part in shaping the team across aspects such as resourcing, technology and product.

You’ll also:

• Work with the business in designing and delivering data-driven products and promoting a data-driven culture
• Work with Engineers to develop big-data solutions
• Collaborate with Data Scientists to productionise and deploy models
• Design cloud infrastructure solutions

What you’ll bring to the role:

• Software design patterns
• Code modularity/reusability
• Refactoring
• SOLID principles
• DRY principles
• TDD/BDD
• End-to-end testing

As a senior data engineer you’ll also have:

• Solid background of data pipeline design and architecture
• Experience in building and maintaining highly scalable data platforms
• Passionate about development of the latest big data frameworks
• Extensive experience with various data storage mechanisms

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://welovesalt.com/privacy-policy/.