Previous Job
Previous
Big Data Developer 28715561
Ref No.: 18-58573
Location: Phoenix, MN or NJ, Arizona
Position Type:Right to Hire
Start Date: 08/14/2018
 Job Description :
Design and develop ETL data flows using Hive / Pig /Spark/ Unix scripts/ Talend jobs
Loading from disparate data sets.
Pre-processing using Hive / Pig /Spark/ python/ Unix scripting.
Design & implement work flow jobs using Talend & Unix / Linux scripting to perform ETL on Hadoop platform.
 
  • Strong in Java /SQL/ Python / Spark and PIG .
  • Large scale data manipulation / ETL .
  • hands-on experience in developing data solutions .
  • Expert-level skills and experience in Hadoop Map-Reduce .
  • Expert-level skills and experience in Hive .
  • Experience with HBase, Spark ,Talend , NoSQL databases-and streaming big data processing preferred.
  • Good skills and experience in Linux, XML, JSON, REST .
  • Understanding of database internals and data warehouse implementation techniques; working knowledge of SQL .
Implementation and design of distributed systems. Understanding and experience with UNIX and Shell scripting .