Previous Job
Data Engineer
Ref No.: 18-02274
Location: New York,, New York
Data Engineer
New York, NY
8 Month Contract

Our client - a major media and entertainment firm located in NYC - has an immediate need for a Data Engineer.

Position Description
The Data Engineer will be responsible for partnering with Revenue Analytics to onboard and optimize datasets which will be used in the Looker digital analytics platform. To be successful in the role you'll need to be intellectually curious, detail-oriented, open to new ideas, and possess a strong aptitude for quantitative methods. The role requires a strong statistical background, familiarity with modern data warehouses, experience with SQL-like tools, and knowledge of scripting languages (e.g., Python). Experience with predictive modeling or machine learning a plus.

Job Duties
  • Create solutions to transform data from various sources and load it into platforms such as Hadoop to create a data lake
  • Create and maintain transformations to summarize/aggregate data and load these so users can consume this data using various BI/Analytics tools.
  • Develop and maintain standards for administration and operation including the scheduling, running, monitoring, logging, management of errors, recovery from failures, and validation of outputs.
  • Contribute to the project planning process by estimating tasks and deliverables.
  • Work closely with Revenue Analytics team members to understand user requirements.
  • Be at the cutting edge of utilizing data about consumers in the media industry to improve audience experience.
  • Help out with complex analytical tasks.

Required Skills
  • 4+ years solid experience as a database developer in OLAP environment.
  • BS in computer science, math, physics or equivalent education/training/experience.
  • Experience with ETL's & Data pipelines
  • Experience performing QC & cleaning up dirty data
  • Experience with a "big data” platform such as Hadoop, NoSQL DB's or cloud based tools such as Amazon Redshift.
  • Experience with Hive and HiveQL
  • Experienced and comfortable with Unix/Linux operating systems
  • Expert knowledge in SQL, Python and shell scripting
  • Ability to work independently and take on projects

Additional skills desired
  • Knowledge of SparkQL and/or Postgress SQL would be ideal
  • Prior understanding and/or experience within a media and entertainment business, ad tech and related data.
  • Experience with media, Web analytics and consumer data systems is highly desired.

Key aspects of the position
  • Experience with ETLs and data pipelines
  • Experience with SQL-like big data query languages, HIVE in particular
  • Experience in Python
  • Experience working in UNIX

NTT DATA is a leading IT services provider and global innovation partner with 130,000 professionals based in over 50 countries. NTT DATA recently acquired Dell Services. NTT DATA emphasizes long-term commitment and combines global reach and local intimacy to provide premier professional services, including consulting, application services, business process, IT outsourcing, and cloud-based solutions. We're part of NTT Group, one of the world's largest technology services companies, generating more than $100 billion in annual revenues and partner to 80% of the Fortune 100. Visit to learn how our consultants, projects, managed services, and outsourcing engagements deliver value for a wide range of businesses and government agencies.
The Company is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. The Company will consider all qualified applicants for employment without regard to race, color, religious creed, citizenship, national origin, ancestry, age, sex, sexual orientation, genetic information, physical or mental disability, veteran or marital status, or any other class protected by law. To comply with applicable laws ensuring equal employment opportunities to qualified individuals with a disability, the Company will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee unless undue hardship to the Company would result.