Previous Job
Previous
Senior Big Data Engineer
Ref No.: 17-03665
Location: Chicago, Illinois
Position Type:Full Time
Pay Rate : $ 125,000.00 - 140,000.00 /Year
What will you do:
We are committed to DevOps and Continuous Delivery as key parts of our development philosophy. As part of this, we are building a cutting edge hardware integration layer and a backing suite of web services in order to support our explosive growth across our product lines. We are looking for an experienced systems and platform engineer who can help us build and design an infrastructure and platform that allows for migration towards a microservices architecture. We will use C#, Docker, AWS, Python, JVM, Big Data, and Apache Kafka as key components in our platform. Here are some areas that you will focus on:
  • Build and Delivery Pipelines - Architecting and building out build tools, automation, artifact repositories and pipelines across native mobile, C#, JVM and Python codebases. We use Jenkins today but could be convinced something else might work better.
  • Infrastructure as Code - We are using Ansible and moving towards Salt; we also use Terraform.
  • Databases/Big Data - Automation and tooling around our databases is integral to scaling our business. Today we use Postgres, Redshift, SqlServer, RabbitMQ, Redis. We will move beyond this in 2017 to incorporate Kafka and Big Data technology into the core of our platform.
  • Monitoring and Metrics - We're constantly optimizing for speed, as a way to deliver the best experience to our users. Being able to measure real time performance via Statsd and Graphite is key to tracking our performance.
  • Real Time Integrations and Analytics - Our Partners are crucial to our business. So we're building them a suite of analytics tools, to help them monitor and optimize rates and availability, to provide the best value to the customers.
  • Customer First - We believe in the best customer experience ever.

The following experience is relevant to us:
  • Minimum 7-10 years experience.
  • A clear history of self-direction on complex projects, excellent communication skills, and a portfolio (github) that demonstrates these.
  • BS in Computer Science or a solid background of CS fundamentals.
  • Your background will be that of a system builder who has had considerable experience in a highly-complex technical operations private/cloud-based environment.
  • Proven track record of defining and designing reliable, scalable, distributed systems running on AWS or other public cloud infrastructure.
  • Experience managing and automating configuration of relational database clusters.
  • Core understanding of agile development processes and working in an agile organization.
  • Experience in two or more of C#, Java/Scala/Clojure, C++, and/or Go.
  • Demonstrated experience building solutions around CI, release management, deployment, and monitoring.
  • Experience in Windows administration
Nice to haves are
  • Experience working with Big Data technologies and/or Data Science.
  • Experience in Linux administration

Third Party Applications Not Accepted