Previous Job
Previous
Hadoop Lead
Ref No.: 17-19495
Location: San Antonio, Texas
Job Description
  • Work with Big Data Architect on requirements gathering and Solution Design sessions Development of reusable components like Data Ingestion framework which are used across projects Development of overall framework for Data Ingestion, Error handling, Logging mechanism etc.
  • Build distributed, reliable and scalable data pipelines to ingest and process data in batch mode.
  • Assign schemas and create Impala structures and assess quality of data sets. Develop unit test cases and review the test plans for Unit Testing Review the outcomes of the Unit Testing Peer review of the developed codes Fine tune Cloudera hadoop applications for high performance and throughput.