Big Data Engineer

Salt Talent Search is looking for a Big Data Engineer for a leading Technology client on a yearly renewable contractual role.

Overview : You will be responsible for end-to-end development of Data Analytics Platform and AI/ML Ops use cases to take our data engineering and analytics team and system into the future. The candidate will be extensively involved in hands-on activities including POCs, design, documentation, development, and test of new functionality.

Job Scope :

• Design & Architecture: You help to design and implement an optimal data pipeline architecture for the analytics system
• Massive data: You will source / examine, analyze, engineer data pipelines for gigabytes/terabytes of structured and unstructured data with our platform to create value for customers
• Production deployment: You will be responsible for integration and deployment of the Data Ingestion & machine learning pipelines into production where your ideas can come to life.

Qualification:

• 10+ years of professional software development experience in Java or other programming languages
• Big data: You have extensive experience with data analytics and working knowledge of big data infrastructure such as Google Cloud, Big Query, Data Flow, Hadoop Eco System, HDFS, Apache Storm, Apache Spark. You’ve routinely built data pipelines with gigabytes/terabytes of data and understand the challenges of manipulating such large datasets.
• Cloud Exposure: Strong experience implementing systems and applications using distributed and cloud infrastructure. GCP preferred, but AWS or Azure are also okay.
• Data Modeling: Flair for data, schema, data model, PL/SQL, Star & snowflake schema, how to bring efficiency in data modeling for efficient querying data for analysis, understands criticality TDD and develops data validation techniques

If you are keen on this opportunity, then look further and hit the apply button for a confidential discussion with me.

CEI No: R1659595 / Licence No: 07C3147

Salt is acting as an Employment Business in relation to this vacancy.