Previous Job
Previous
Hadoop Developer
Ref No.: 17-14143
Location: Bentonville, Arkansas
Job Description:
Areas to cover in each technology
Mapreduce
- Processing in Mapreduce
- Architecture of MR
- Shifting, Sortinf, Partitioner, Combining
- How does MR work
Hive
- Different types of Hive tables
- managed table, external table concepts
- Partitioning in Hive
- Bucketing
HDFS
- Read/write concepts
- how to transfer files from structured file system to hdfs
- how does hdfs function during node failures
- Replication concepts
- Architecture
Spark
- RDD
- Architecture
- spark streaming and spark sql
- Partitioner
Hbase
- Region server
- column family
- TTL

Kafka
- producer/consumer family
- failure handling in families
- architecture
- why kafka is faster
Storm
- Architecture
- how supervisor and nimbus works
- bolt
Flume
- use of flume
- Architecture
Oozie
- how to control mapper
- what are th dbs supporting oozie
Cassandra
- Architecture
- Ring concepts
- master/slave failure