Big Data Architect

Salt are incredibly excited to be working on one of the most advance Big Data Projects taking place in the US. Our globally recognized client is building a team of highly Technical Big Data experts who will be given the opportunity to work within a R&D environment. You will be working within a disruptive environment which prides Data revolution and working with cutting edge technologies which you will have a voice in deciding.

The Big Data architect should have led Highly scalable and extensible Big Data platforms with big data infrastructure that is scalable, highly performant, and able to handle diverse data sets. You should have a passion for the capabilities of Data and continually stay ahead of the curve with technologies and applying them to deliver a robust Big Data Platform.

• Experience in building data movement and integration pipelines (especially ETL/ELT) in a large-scale data environment
• Manage complex data dependencies across datasets and incremental data loading workflows
• Must Know how to scale systems and make them fast – SQL query Processing, Transactions and SQL performance issues
• Design and build efficient ETL/ELT process to move data through the data processing pipeline to meet the demands of the business use cases
• Be a key part of the data management team collaborating with data engineers, DevOps Engineers and analysts to design state of the art systems
• An advocate of Data to the business and passionate about educating other Product owners, Engineering teams
• Optimize and automate data ingestion, data processing and distribution data from variety of sources, including click stream data, ratings data, advertising data, 3rd party sources and sources not yet identified.

Tech

• Hadoop, Redshift, Python
• Kafka, Spark
• DI/DQ tools – Talend
• MDM tools – Falcon
• Git.
• AWS, linode, Azure, Heroku, OpenStack.
• Chef.
• Apache Kafka.
• NoSql Cassandra
• Linux/Unix based systems