Upload your CV
Upload your CV to our database.
Senior Data Engineer – Banking – Brussels (onsite in 2022)
Day rate: €600 – €700
Duration: 6 – 12 months
My client is currently looking for a Senior Data Engineer with design skills whose core objectives will be to:
– Collect, clean, prepare and load the necessary data onto Hadoop, our Data Analytics Platform, so that these can be used for reporting purposes; creating insights and responding to business challenges
– Act as a liaison between the team and other stakeholders and contribute to support the Hadoop cluster and the compatibility of all the different software that run on the platform (Scala, Spark, Python, …).
Identify the most appropriate data sources to use for a given purpose and understand their structures and contents, in collaboration with subject matter experts.
Extract structured and unstructured data from the source systems (relational databases, data warehouses, document repositories, file systems, …), prepare such data (cleanse, re-structure, aggregate, …) and load them onto Hadoop.
Actively support the reporting teams in the data exploration and data preparation phases.
Implement data quality controls and where data quality issues are detected, liaise with the data supplier for joint root cause analysis
Be able to autonomously design data pipelines, develop them and prepare the launch activities
Properly document your code, share and transfer your knowledge with the rest of the team to ensure a smooth transition into maintenance and support of production applications
Liaise with IT infrastructure teams to address infrastructure issues and to ensure that the components and software used on the platform are all consistent
Will be considered as assets: