Previous Job
Previous
Senior Data Engineer
Ref No.: 18-00364
Location: New York, New York
Title: Senior Data Engineer
Location: New York, NY or Charlotte NC
Contract Duration: 6 - 24 months

Our client is looking for engineers with broad and deep skill sets and experiences to help move them forward. They want self-starters who will bring distinctive expertise but who are excited to step outside their comfort zone and learn new skills.

As a Senior Data Engineer, you might work to improve our client's optimization algorithms, write code using Apache Spark, participate in architectural decisions for new components, or improve performance in collaboration with DevOps. In the same week, you could work on user-facing interfaces and reports with frontend developers, write code to import, process and QC terabytes of new data, and work with analysts and statisticians to ensure the validity of our processes.


Required Skills:
- Bachelor's degree in Computer Science or a related field (or 4 additional years of relevant work experience)
- A strong understanding of data structures, algorithms, and effective software design
- Significant development experience with a major modern language (e.g. Java, Scala, Python, Ruby, C/C++, etc.)
- Experience with a distributed/parallel computing engine such as Apache Spark or Hadoop
- Experience wrangling terabytes of big, complicated, imperfect data
- Significant experience working with structured and unstructured data at scale and comfort with a variety of different stores (key-value, document, columnar, etc.) as well as traditional RDBMSes and data warehouses
- Comfort with version control systems (e.g. Git, SVN)
- Excellent verbal and written communication skills; must work well in an agile, collaborative team environment


Additional Skills a Plus:
- Master's in Computer Science or a related field
- Experience with big data technologies such as Cassandra, Kafka, HBase
- Basic understanding of statistics and experience with statistical packages such as R, Matlab, SPSS, etc.
- Practical experience with supervised machine learning techniques
- Experience with AWS products (Redshift, EMR, S3, IAM, RDS, etc)
- Experience writing unit and functional tests
- Experience with front-end languages, especially Javascript, HTML5, and CSS3
- Strong background with test-driven development