Previous Job
Previous
Senior Big Data Engineer
Ref No.: 18-05090
Location: Charleston, South Carolina
Position Type:Direct Placement
Pay Rate : $ 100,000.00 - 200,000.00 /Year
Responsibilities
• Using dynamic programming languages, such as Scala and Python to architect, implement and integrate data
analytics tools for financial markets
• Proactively assisting other developers in diagnosing and solving issues with development and build environments
• Establishing and improving infrastructure in support of production, QA, and development systems
• Implementation of system monitoring infrastructure and tools, including dashboards
• Monitoring systems for issues in real-time, responding to them as they occur, and working proactively to
minimize future issues
• Level 3 support Requirements
 
Qualifications
• 5+ years of experience building large scale big data applications (spark streams, kafka streams, HDFS internals)
• Proactive with a high attention to detail and ability to manage multiple projects simultaneously
• Strong working knowledge of the Linux operating system, including basic system administration and a high
degree of comfort working from the command line
• Experience with version control software and SDLC principles
• Strong programming skills using Scala and Python
• Experience with containers, orchestration and CI/CD pipelines
• Experience with Open Source software including Puppet, Jenkins, Nagios, GNU make, Redmine, OpenLDAP,
FreeRADIUS, BIND, collectd, Graphite, Grafana, Hypertable, consul, zookeeper, and PostgreSQL are a bonus
• Financial experience is not required