Previous Job
Previous
DevOps Big Data Engineer
Ref No.: 18-04169
Location: New York, New York
Position Type:Direct Placement
Pay Rate : $ 150,000.00 /Year
DevOps- Big Data Engineer

 FT position in Soho NY, excellent comp, bonus and benefits plan


Position Overview
As a Big Data Engineer you will be designing and implementing systems that crunch and process billions of records a day and make them available in analytics platform, helping our clients to make smarter decisions that continuously improve their ad-impression quality.
What you will do:
  • Install Configure and Maintain Big Data platform as Apache Kafka, spark and Hadoop
  • Install Configure and Maintain Kubernetes clusters both on GCP and on premises
  • Building scalable infrastructure for stream processing as well as batch jobs
  • Contribute to the design and implementation of new products and features, making sure they are all developed so they fit nicely in our Continuous Delivery framework and processes
  • Contribute to general system health, monitoring and automation
  • Using diverse technology knowledge and a sense of curiosity to explore new and better ways to solve problems
  • Administer project management tools to continuously improve the efficiency of our organization
What you have done/Who you are:
  • Experience with container technology – Docker and Kubernetes (a must)
  • 3+ years of experience building production infrastructure and supporting SDLC (especially with Java, C# and Python software)
  • Experience with microservice architecture
  • DevOps Tools experience: Git/GitHub, Atlassian Suite, Teamcity, Maven and Nuget
  • Experience with software development methodologies such as continuous integration, continuous delivery and automated tests.
  • Expert in scripting (Bash, Python, C#, Java etc.) and good coding skills
  • Experience working with GCP or other public cloud
  • Experience working with GIT and GIT administration tools
  • Strong system skills in Windows and Linux environments
  • You have a genuine desire to automate processes and workflows
  • BSc in Computer Science/Engineering 
  • MSc is an advantage