Previous Job
Previous
Senior Data Engineer
Ref No.: 18-05843
Location: Houston, Texas
Position Type:Direct Placement
Pay Rate : $ 130,000.00 - 150,000.00 /Year
We are looking for a Senior Data Engineer who also has a background in AWS. 
Fully paid benefits with one of the best known names in the Industry!

We have a visionary leadership team, a wealth of field data, and a team of data scientists and industry experts using next-gen techniques to solve complex problems. We are expanding our software development team. Come be a part of this exciting opportunity to work alongside the best creative minds in the business.
 
Responsibilities:
  • Research, Design and implement data integration(ELT/ETL) design patterns into RDBMS and NoSQL data stores.
  • Design and implement data architectures according to project requirements
  • Design and Implement data acquisition, validation and transformation processes
  • Monitor and optimize performance and advise infrastructure requirements
  • Define and implement data quality and lifecycle processes and policies.
  • Participate in software architecture, product ideation and project planning discussions
 
Qualifications:
  • Bachelor's degree in Business, MIS, or related field
  • At least 5 years of data ingestion and integration experience in Agile and Waterfall settings.
  • Strong experience with Python, SQL, bash for analysis and integration of data.
  • Experience with cloud (AWS preferred) based data and computing infrastructure
  • Proficient with Cassandra, Hbase, MongoDB and PostgreSQL
  • Experience with various streaming systems, such as Kafka or AWS Kinesis
 
Preferred Qualifications:
  • Upstream Oil and Gas industry experience will be a significant advantage
  • Familiarity with business process orchestration platforms such as Pega and Appian
  • Experience designing advanced data analytics and autoML tools such as H20, Tpot
  • Experience with version control and CI/CD tooling