Previous Job
Previous
Sr Hadoop Developer/Architect
Ref No.: 17-00957
Location: Brighton, Massachusetts
Position Type:Contract
DIRECT CLIENT REQUIREMENT
Job Title: Sr Hadoop Developer/Architect
Location: Brighton, MA
Duration: 6 months

Description:
  • Experience with Hadoop Ecosystem including Spark, Storm, HDFS, Hive, NIFI, Kafka, Sqoop, Hbase, Pig
  • Experience in developing Spark Streaming applications, getting the data using Nifi, writing the stream data into Kafka and analyzing the data through Spark
  • Experience in writing queries for moving data from HDFS to Hive and analyzing data using Hive-QL. Understanding Partitions, HiveQuery optimization, Bucketing etc.
  • Experience in Sqoop for moving data between RDBMS and HDFS.
  • Experience with Data Warehouse/ODS and ETL.
  • Experience in testing, debugging skills and troubleshooting support and development issues
  • Experience with design and development on multiple ODS and DW implementations.
  • Experience using Java to load data and to execute jobs

The key to this role is the Java and the Hadoop Ecosystem experience with map reduce, pig and clustering

Same basic development experience above, but then some experience with architecting:
  • Architecture and development of streaming & batch analytics platforms
  • Large scale log/event data management
  • Data modeling using Hadoop ecosystem
  • Strong Experience with event stream processing technologies such as spark streaming, Kafka