Previous Job
Developer - Data Quality Tools & Controls
Ref No.: 18-05341
Location: New York City, New York
You will be a developer for the Data Quality Tools & Controls program. In this role, your goal will be to develop a comprehensive Data Control & Surveillance toolset that spans across LCG systems. This focus will be on developing Data Quality utilities, tools, daemons, and controls in both the Big Data and relational DB environments. This will be a data control reconnaissance process that will look for data ingestion anomalies. The goal is to detect irregularities in the LCG Data Governance program systematically by developing a controls framework to prevent risk and minimize "holes” in our DG process. Ultimately the health of our data can be quantified with a Risk Assessment Scorecard by source, data element, or data concept. This can range from upstream/downstream processing of data, ETL, file handling, storage, entitlements, data masking, and lineage. The candidate will be a Senior Developer role with hands-on Big Data development background. The candidate will be responsible for working with resources across India as well as NY with strict adherence to data quality delivering projects and tasks on time.

Key Responsibilities
Developer in the newly formed Data Quality Tools & Controls program. Data ingestion is comprised of ETL workflows (Informatica/BDE), Database development (DB2), Big Data development (Cloudera/Scala/Hadoop), batch stream processing (UNIX/Autosys), as well as dashboards (Tableau, Other).
Develop tools for proactive and predictive support of LCG Data Governance program. Responsible for ensuring that the architecture, framework and standards are leveraged in concert with the development teams.
Leverage Cloudera Manager and Cloudera Navigator to integrate with Informatica BDE/Intelligent Data platform.
Create data ingestion tools and job tracker daemons to determine deficiencies and controls (i.e. where new ETL objects are introduced but lacking Collibra elements, PanDQ rules, LCG Data Catalogue entries, DevOps controls/FileHandler jobs)
Create real-time tool trackers and daemons to determine where there's holes/gaps on the platform in the areas of security, entitlements, storage, processing efficiencies, table optimization (i.e. incremental loads vs cache)
Leverage Cloudera Data Encryption or determine masking guidelines for PII data. Create processes to protect the HDFS and data environments from data breaches (i.e. copy from PROD to non-PROD)

Skills/ Qualifications
Bachelor's degree in Computer Science, Software Engineering, Information Technology, or related field required.
Overall 8+ year's technology experience desired. At least 5 years of experience as a Big Data developer with experience in complex data projects. Financial industry preferred.
At least 5 years of T-SQL experience with the ability to write queries to perform data analysis. A preference is given to DB2 v10+ databases.
Strong Experience in ETL Informatica/BDE, Cloudera Manager, Cloudera Navigator, Scala/Hadoop software libraries, Hue, HIVE, Impala, SQuirrel, DBArtisan software tools.
Experience with BI/Data visualization tools
Tableau is preferred.
UNIX and Autosys knowledge is preferred. Any JAVA experience is a plus.
Strong collaboration and communication skills.
Must be well organized and able to tailor communication based on the audience and level (clients versus technical staff versus technical management).

NTT DATA Services is a leading IT services provider and global innovation partner with 130,000 professionals based in over 50 countries. NTT DATA recently acquired Dell Services. NTT DATA Services emphasizes long-term commitment and combines global reach and local intimacy to provide premier professional services, including consulting, application services, business process, IT outsourcing, and cloud-based solutions. We are a part of NTT Group, one of the world's largest technology services companies, generating more than $100 billion in annual revenues and partner to 80% of the Fortune 100. Visit to learn how our consultants, projects, managed services, and outsourcing engagements deliver value for a wide range of businesses and government agencies.

The Company is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. The Company will consider all qualified applicants for employment without regard to race, color, religious creed, citizenship, national origin, ancestry, age, sex, sexual orientation, genetic information, physical or mental disability, veteran or marital status, or any other class protected by law. To comply with applicable laws ensuring equal employment opportunities to qualified individuals with a disability, the Company will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee unless undue hardship to the Company would result.