Previous Job
Previous
Big Data Developer
Ref No.: 18-07399
Location: Jersey City, New Jersey
Big Data Developer
The manager is looking for someone that has two or three projects with Big Data.


This role is for a big data developer with experience in designing and building enterprise data lakes using Hadoop eco system.

Responsibilities:
• Work as part of a Big Data warehouse build out team to migrate traditional warehouse environment to a Hadoop eco system
• Set up real-time message ingestion and processing and integrate with existing enterprise messaging bus
• Design , build, deploy data processing solution using streaming toolset
• Build near real-time pipelines that operate efficiently to handle huge volumes of incoming business activity
• Build ETL, ELT processes to handle large datasets and implement data transformation, enrichment, business rules and process flows

Qualifications:
• Overall 10 years of experience as a developer building data centric applications
• Experience in building application with in Java/J2EE and traditional database technologies
• At least 2 years of big data experience implementation on Hadoop ecosystem databases (like HDFS, Hive, Impala, Spark, Sqoop, Flume , Map-Reduce etc.)
• 2- 4 years of experience in dealing with large scale messaging applications using Tibco, MQ, Solace etc.
• Expert at streaming technology tool set like Kafka, Flume,Spark Streaming etc.
• Proficiency in one of the programming languages Java/Scala, python
• Experience working on premise or external/public cloud data warehouse environment
• Experience working in Cloudera Hadoop environment is a plus
• Strong analytical and problem solving skills
• Ability to research and solve complex technical issues
• Familiarity and comfort with participating in a high-performing geographically dispersed team
• Financial industry experience is a plus