Previous Job
Previous
Bigdata Consultant
Ref No.: 18-49122
Location: New York City, New York
Position Type:Full Time/Contract
Start Date: 07/13/2018
 Job Description:
Develop tools for proactive and predictive support of  Data Governance program.  Responsible for ensuring that the architecture, framework and standards are enforced.
Leverage Cloudera Manager and Cloudera Navigator to integrate with Informatica BDE/Intelligent Data platform to drive Risk Assessment Scorecard process.
Create data integration tools and job tracker daemons to determine deficiencies and controls (i.e. where new ETL objects are introduced but lacking Collibra elements, PanDQ rules, Data Catalogue entries, DevOps controls/FH jobs)
Create real-time tool trackers and daemons to determine where there's holes/gaps on the platform in the areas of security, entitlements, storage, processing efficiencies, table optimization (i.e. incremental loads vs cache)
Leverage Cloudera Data Encryption or determine masking guidelines for PII data.  Create processes to protect the HDFS and data environments from data breaches (i.e. copy from PROD to non-PROD).