Data Engineer Hadoop
The project involves building data extracts from a number of ERP systems and building reports for these. This role will involve working with the various ERP teams to get data mapping completed, test plans in place etc. as well as documenting specifications for reports. Primary Objectives and Skills At least 3+ years’ experience working as a data engineer at an enterprise level. Must have a knowledge of machine learning, such as pattern recognition, classification and predictive modelling. Enterprise experience in using Spark, Python, Hive and Hadoop HDFS. Have both relational and NOSQL DB experience, predominately in Oracle, PostgreSQL and MongoDB. Should have enterprise experience working with cloud technology, specifically AWS. To be proficient in both Python and Java. Be confident in developing end to end ETL processes. Additional Skillsets. Exposure to working with Hadoop preferably within the Cloudera stack. To have worked with large transactional data sets preferably within the financial sector. Familiar with source code management, and utilising GIT. Has experience following the practise of object orientated coding. Comfortable in presenting work to larger audiences. Education. #LI- GC1. This job originally appeared on RecruitIreland.com.
33 days ago