Big Data Engineer
Previous Job
Previous
Big Data Engineer
Ref No.: 18-40745
Location: Madison, Wisconsin
Position Type:Full Time/Contract
Start Date: 06/12/2018
Description:
  • Experience with Hadoop (HDinsight). [Mandatory]
  • Experience with Map-Reduce, Zookeeper, HDFS, Pig, Sqoop and Hive. [Mandatory]
  • Experience with Azure cloud services. [Mandatory]
  • Experience with scheduling tools like Control-M and Oozie. [Mandatory]
  • Experience monitoring Hadoop cluster performance . [Preferred]
  • Experience with SSIS and SQL Server. [Preferred]
  • Experience with programming language like Python or C#. [Preferred]
  • Knowledge of Linux system monitoring and analysis. [Preferred]
  • Understanding of ETL principles and how to apply them within Hadoop. [Preferred]
Knowledge of Spark and understanding of DAGs a plus. [Preferred]