Big Data Architect/Senior Hadoop Developer
Previous Job
Previous
Big Data Architect/Senior Hadoop Developer
Ref No.: 18-20134
Location: Toronto, Ontario
Position Type:Full Time/Contract
Start Date: 03/26/2018
 Responsibilities
  • Provide visionary leadership for projects related to big data technologies and software development support for new data products
  • Analyze latest big data analytic technologies and their innovative applications and bring best practices to the team
  • Develop on Horton Works Hadoop platform which enables collection, modeling, and analysis of massive data sets from numerous sources
  • Must be able to work in an Agile environment, working experience using Scrum.
  • Facilitate technology evaluation within engineering to drive architecture and design, and build.
 
Qualifications
  • Senior 10 years IT application development experience with last 3 to 4 years in big data experience.
  • Extensive knowledge and 3+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop distributions, and Spark streaming, Kafka, Spark advanced analytics, NoSQL data warehouses such as Cassandra, data processing frameworks like Apache Nifi, Talend, Spring XD
  • 3+ years' experience in designing and implementing big data solutions. This includes creating the requirements analysis, design of the technical architecture, design of the application design and development, testing, and deployment of the proposed solution
  • 4+ years' programming/scripting languages Java and Scala, python, R, Pig
  • Experience working with and evaluating open source technologies and demonstrated ability to make objective choices
  • Experience architecting highly scalable, highly concurrent and low latency systems
  • Knowledge of software/data design methods, data structures, and modeling standards
  • Working Experience with continuous integration and continuous delivery tools
  • Experience with more than one data streaming technologies
  • Understanding of Machine Learning skills (like Apache Mahout, Spark MLib)
  • Nice to have Ops Experiences on Nifi and DSE.”
  • Cassandra/DSE in the responsibilities section: