Hi ,
Greetings from vy systems!
I hope you're doing well,
OPENING FOR Hadoop Engineer with CloudEra-Scottsdale AZ-(Onsite)
Title:Hadoop Engineer with CloudEra
Client : Mphasis
Location : Scottsdale AZ
Duration :Contract
Experience: 10+ yrs
Skills required:
Experience : 6-9 Years
Must have Primary skills required are Cloudera (Hadoop), Spark + Scala or Spark + Java and SQL
The resources should also have good understanding of Hive, Aerospike.
The resources should have strong analytical skills
Scope of work:
The team will need to work on the following aspects:
Documentation of lineage as per the existing template.
Understanding the DQ rules from the data science team.
Onboarding of new incremental datasets along with configuration of the DQ rules etc.
Perform data validation checks.
Copying of production data into test environments - to be confirmed.
Report on the DQ issues
Key Skills: