Previous Job
Previous
Data Engineerr
Ref No.: 18-71733
Location: Altanta, Georgia
Position Type:Full Time/Contract
Start Date: 09/28/2018
 Hi
 
Hope you are doing well,
 
My name is Mirza and I'm an IT recruiter at IDC Technologies. Our records show that you are an experienced IT professional with experience in. "Data Engineer on Google Cloud Platform”. This experience is relevant to one of my current openings
 
Data Engineer (Google Cloud Platform)
Atlanta, GA or Austin, TX
Fulltime – Permanent
 
  • Major Database/Data Warehouse tools:
  • Google Bigquery ( to build analytical datasets).
  • Google Storage (File system and this is the port of entry for all the data that lift from bastion as per the standard)
  • Google Bigtable & Data Store for application logs and stats.
  • Oracle runs in goggle engine as a Controller for Job scheduling.
 
Engines:
  • Google App engine (Data processing)
  • Compute Engine (Data processing and Application platform)
 
Tools:
  • Jenkins (To build a pipelines and CICD)
  • Concourse - CICD
  • FLOW (inbuilt tool for automated deployment)
  • Google Dataflow (Data pipeline to read from Pub/Sub).
  • Google Pub/Sub ( as Queues in google cloud)
 
Languages: (in order of precedence)
Python
Java
Groovy
Shell scripting
 
Roles and responsibilities:
  • Work on the following tasks for moving data to the Cloud:
  • Build the process required for optimal extraction, transformation, and loading of data from a wide variety of data sources to google cloud.
  • Create and maintain optimal data pipeline architecture replicating the existing process.
  • Analyze, explore and select the appropriate tools for data migration and transformation.
  • Assemble large, complex data sets that meet functional / non-functional business requirements.
  • Keep data separated and secured using masking and encryption.
  • Work with data and analytics experts to strive for greater functionality in data systems.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
 
Regards,


Mirza
Sr. IT Recruiter
Phone: 408-385-2664

Email: mirza.b@idctechnologies.com 
IDC Technologies.
LinkedIn:
https://www.linkedin.com/in/mirza-ismail-3b1956133/