Big Data Lead Developer

Big Data Developer
Salt are currently looking for a Big Data Developer for a client of ours based in West London.
The role will involve:

• Utilise the appropriate data development (ETL & ELT, stream processing), test and release model(s) to best fit the needs and be flexible with your approach
• A mixture of data ingestion and data transformation
• Have flexibility to undertake standard solution development as well as support rapid discovery, and prototyping, subsequently turning successful variants into production solutions
• Choose the appropriate solution to meet the need and determine how this should be developed
• Help enhance the organisation model for the development team
• Implement using demand and delivery processes, principles and standards
• Update and manage artefacts to be created by the team
• Develop and utilise your existing network to share, learn and enhance existing capabilities
• Help develop a high-class development team to the right level for success
• Manage on a day to day basis internal, contract and third-party resources to deliver solutions
• Manage the delivery to ensure we are achieving success
• Where appropriate, look to remove technical debt and deliver in repeatable, re-usable patterns
• Create a culture within the team of sharing and learning with each other, and wider networks

Essential Skills:

• Detailed knowledge of the tools, technologies, skills and processes required to deliver complex and complete development solutions on Big Data Technologies- Cloudera, Spark, Hive, Impala, Hadoop, Data Formats, Kafka, Python, Scala, Teradata, Informatica, SQL server
• Detailed understanding of development of data stores and data lakes and associated toolsets (Experience of programming- SQL, Python, Data Modelling and pipelining experience – Third Normal Form, Dimensional Modelling, Data blending, Data Visualisation experience – Tableau, Data Science tooling – R, SAS etc)
• Detailed knowledge of data development in a big data (Hadoop) and/or traditional data warehouses/toolsets using SQL or SQL based ETL capabilities
• Experience of leading expert teams in the use of these toolsets
• A strong user and advocate of continuous integration (CI, Jenkins a plus), continuous deployment and test driven development
• A deep understanding and experience of using a mix of delivery methodologies including Agile, Scrum and Waterfall delivery

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://welovesalt.com/privacy-policy/.