Data Engineer

About the role

As a Senior Analyst Engineer, you will be focussed on building, maintaining, and supporting Big Data delivery automation pipelines utilising & promoting best DevOps practices. This role is both strategic and operational to ensure that technical solutions enable operational excellence, are secure, reliable, scalable, cost optimized and maintainable.

What you’ll be doing

• Creation and maintenance of delivery pipeline tooling. Including build/deploy/CI/infrastructure scripts, monitoring, logging
• Setting up automated environment provisioning that will setup secure cloud and on premise
• Supporting the infrastructure and application layer, both in Production and non-Production environments
• Supporting the build team (Dev and Test) to be self-sustained through training and troubleshooting
• Continually learning and researching best practices and tooling for Big Data delivery
• Proactively manage risk; meet all policy and compliance requirements; perform controls; adhere to Process and Procedures pertinent to role; and escalate events, issues, or breaches as they are identified (risk accountability forms part of all roles, as everyone is responsible for managing risk and compliance)

What you’ll bring

• Demonstrated experience in application development
• Proven background in deploying and managing Big Data solutions.
• Knowledge on Hadoop, Spark/ Pyspark eco-system (highly desirable).
• Experience in designed and implemented CI/CD pipelines.
• Demonstrated experience establishing environments in the cloud preferably AWS, and/or Azure
• Working knowledge of Cloud (AWS) environments
• Infrastructure as code frameworks: Teraform
• Linux administration (RHEL)
• Hands on experience with any RDS and SQL.
• Relevant tertiary qualification in related discipline

Salt is acting as an Employment Agency in relation to this vacancy.