Data Engineer

Data Engineer | London | 4 Months

I am currently looking for a Data Engineer with a background in software development to join a lead technology client of mine. This role will involve building a streaming first data platform improving overall customer engagement and experience.

Responsibilities

· Develop, build scalable and high-performant data enrichment processes, using the right development patterns and continuous deployment/integration practices.

· Collaborate with upstream system architects, data technical specialists, developers, data product managers, and end-users to support and resolve data issues.

· Participate in a DevOps environment (you build it, you run it) by managing and operating real-time and batch data solutions at scale.

· Design, develop, model and create data structures to integrate and prepare for reporting solutions and broader business intelligence application.

· Identify performance and data challenges, suggesting code and architecture improvements.

Experience

· Hands-on coding with significant experience in SQL and in one or more key software languages (e.g. Python, Scala, Java).

· Extensive SQL, all its facets, and have experience working with traditional (e.g. Teradata) or cloud-based data-warehouse (e.g. Redshift, Snowflake).

· Best fit data technologies and approaches to addressing performance, scalability, governance challenges.

· Understand the AWS cloud ecosystem, such as EMR, Lambda, S3, EC2, Cloud Formation, VPC, etc.

· Dimensional modeling concepts and other efficient data representations for optimizing SQL queries.

· Proven background in a variety of data technologies, such as Teradata, Hadoop, Spark, HBase, Hive, Presto and/or ETL frameworks.

· Knowledge of cloud infrastructures automation tools such as CloudFormation and Docker.

Streaming pipelines such as Kafka or Kinesis.

· Experience producing tested, secure, resilient and well-documented applications.

· Excellent interpersonal skills and verbal and written communication skills when working with both business and technical teams.

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://welovesalt.com/privacy-policy/.