Previous Job
Sr. Data Engineer
Ref No.: 18-13558
Location: McLean, Virginia
Sr. Data Engineer (Nifi)

Job Description
• Responsible for delivery in the areas of: big data engineering mainly data acquisition technology implementations (Nifi & Kafka)
• Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes ( Nifi/Kafka/ Storm)
• Construct data staging layers and fast real-time systems
• Utilize expertise in models that leverage the newest data sources, technologies, and tools, such as machine learning, Python, Hadoop, Spark, AWS, as well as other cutting-edge tools and applications for Big Data
• Investigate the impact of new technologies, applications, and data sources on the future secondary mortgage business
• Demonstrated ability to quickly learn new tools and paradigms to deploy cutting edge solutions.
• Develop both deployment architecture and scripts for automated system deployment in AWS
• Create large scale deployments using newly researched methodologies.
• Work in Agile environment
• Experience mentoring junior engineers

Basic Qualifications
• Bachelor's degree in Mathematics, Statistics, Computer Science
• 4+ years of experience with Nifi & Kafka
• 4+ years of experience with Hadoop including Hive and Spark
• At least 3 years' experience in Python & PySpark
• At least 10+ years of overall experience in Java

Preferred Qualifications
• Master's Degree in Computer Science
• 3+ years of experience working with AWS
• 2+ years of experience working with financial data
• 2+ years of experience with NoSQL databases
• Strong communication skills, with the ability to work both independently and in project teams