Previous Job
Previous
Hadoop/ETL Developer
Ref No.: 18-00566
Location: Fairfax, Virginia
Position Type:Contract
Experience Level: 10 Years
Start Date: 08/10/2018
VLink is looking for a reliable, motivated and results-oriented Big Data senior Developer. The candidate
must have 8-10 years progressive experience in designing/developing IT solutions and at least 3 years'
experience in developing Big Data solutions using Hadoop stack in AWS cloud.
Successful candidate will be a self-starter with ability to work with multiple platforms, architectures, and
diverse technologies gathering requirements and design and develop ETL processes to transform
information from multiple sources. Work with a team of talented engineers to install, configure and develop
a highly scalable, fault tolerant, and responsive big data ELT platform with next generation streaming data
technologies. Perform as a key member of the team responsible for designing and supporting Hadoop Big
Data technology solutions around data collection, storage and enrichment in the Cloud. Develop proof of
concepts, evaluate technologies, and contribute to ideas that can turn into actionable implementations.
Basic Qualifications:
· 2-3 years of experience with designing stream processing data pipelines, including NiFi, Kafka,
Flume, or Apache Spark Streaming.
· At least 2 years of experience installing and configuring and securing real-time data ingestion
technology Apache NiFi
· Extensive experience with XML and JSON and parsing and enriching data preferably in the aviation
data/sensor data
· Experience with messaging-oriented application stacks, pub-sub architecture, and clustering and
brokers, queues, and topics
· Familiarity with Hadoop security frameworks such as Knox, Ranger and extending enterprise security
to ELT data pipelines.
· Ability to play a technical role as a part of a team, implement solutions based on industry standard
architecture patterns, loosely coupled architecture, Web-oriented architecture, and service-oriented
architecture
o Atleast 1 year of experience with search-based solutions for real-time indexing, analysis, and
visualization, including ElasticSearch, Kibana (ELK), Splunk, Solr, or others
o Experience with real-time data visualization techniques and enabling live analytics
o Experience with building distributed systems
o Experience with Java and other modern languages, including Scala, R, and Node.js
o Ability to be a real-time thinker who can imagine the future state
o Ability to code and debug and display an engineering background