Previous Job
Previous
Big Data Engineer
Ref No.: 17-04254
Location: San Mateo, California
RMG Job:YES
Job Title: Sr. Data Engineer
Location: San Mateo, CA
Duration: 12 months contract

Required Skills: Scala, Spark, RDD, Data Pipeline, Cassandra
 
Job Description:
Develop robust and scalable data infrastructure components for monitoring and tracking, messaging, real-time streaming and batch data processing use cases.
Integrate and productionize machine learning and statistical models into real-time services, as well as BI & Visualization layers.
Work closely with data scientists to assist on feature engineering, model training frameworks, and model deployments at scale.
Provide engineering leadership in the design and architecture of data infrastructure and applications.
 
Job Requirements:
2+ years of experience with big data processing in Spark, Hadoop, Hive and/or Redshift.
Expertise with Java or Scala.
Experience designing and developing data models, integrating data from multiple sources, building ETL pipelines, and supporting all aspects of the software development lifecycle. At this time, this role is not open to recent grads.
Strong SQL programming knowledge and experience.
Experience developing web services, API integrations, and data exchanges with third parties is preferred.
Ability to communicate quantitative analysis and analytical findings in a clear, precise, and actionable manner.
Energetic, enthusiastic, detail-oriented, and passionate about producing high-quality analytics deliverables.
Knowledge of basic statistical analysis and machine learning a plus.
MS/BS in Computer Science, MIS, Mathematics, Physics or other quantitative field or relevant work experience.
 
Required skills:
Strong Java (Must have) &/or Scala (Good to have)
Spark
MapReduce
Optimization
Spark Batch process in Hadoop
NoSQL (Cassandra / Mongo) &/or MySQL/PostgreSQL
SQL debug / validation