Big Data Architect

Big Data Architect

Salt are currently looking for a Big Data Architect for a client of ours based in West London.
The role will involve:

• Work as part of a Technical Design Authority to ensure consistent high quality designs across the BI programme that align with the wider BP Downstream landscape
• Manage, develop and document the solution architecture for the BI programme, working closely with stakeholders including Enterprise Architects, developers, analysts and Product owners
• Understand and formulate processing pipelines of large, complex data sets that meet functional / non-functional business requirements
• Outline baseline target architectures for the in scope BI solutions
• Review technical designs and provide effective guidance
• Be a keen advocate of quality and continual improvement
• Regularly communicate with key stakeholders across the business – challenging and holding them responsible as and when necessary

Role Deliverables:

• Big Data Key Decision Documents (KDDs) on architecture (tools, platform, interfaces, security, data transfer)
• Solution standards, principle and guidelines
• Design documentation (functional and non-functional requirements covering data processing, security, and ingestion)

Essential skills:

• Practical design and architecture hands on experience of Hive/Impala usage (Hadoop/Cloudera) with deep experience in the challenges dealing with big data – e.g. large tables / distribution of data, security design
• Data modelling/programming background experience (e.g. SQL, Python)
• Data modelling experience – i.e. information model standards and ‘traditional’ 1/2/3 normal form as well as dimensional modelling
• Experience with data science environments and technologies e.g. (R, SAS etc)
• Experience with visualisation tooling (e.g. Tableau, Power BI)
• Experience working with troubleshooting in big data environments – e.g. handling performance, data security and scalability

This job ad was posted by Salt. To find out more about Salt’s Privacy Policy and how your application is processed, please visit our website https://welovesalt.com/privacy-policy/.