Previous Job
Previous
Spark Scala ETL Lead
Ref No.: 17-16356
Location: Downingtown, Pennsylvania

• Good knowledge and hands on experience with ETL concepts (Pentaho)
• Interpret data source schemas and validate data integrity
• Hands on experience in implementing Spark jobs, facilitate at-rest and streaming data connections, jobs and integration using Spark.
• Hands on experience with programming in Scala
• Experience with S3
• Efficiently translate business requirements into technical execution
• Work with different teams to facilitate their data needs.
• Identify root cause of failures and improvements that reduce future occurrences
• Create and update technical documentation
• Coordinating ETL infra transition to move existing code and schedule into new environment.
• Coordinating with new ecosystem platform owners to transition HDFS dependent processes.
• Good at written and verbal communication.
• Work in a fast paced agile environment.
• Amazon Redshift and other related technologies are good to have.