Hadoop Admin on w2 contract

Client : Leading global IT services firm

Hi,

Please let me know if you are comfortable for the below position

Hadoop Admin

Long term

Chicago, IL

Mandatory Skills:

1. Knowledgeable in SQL server DB

2. Aggressive self-starter, can operate without Infrastructure support

3. IOT experience

Desired Skills:

1. a. Config DB backup and recovery processes b. File system (Blob & HDFS) management and monitoring c. Manage and review Hadoop log files; house keeping d. Experience with at least one popular Hadoop flavor – Cloudera, HortonWorks, MapR e. Installation and Config of Hadoop projects such as Hive, Pig, HBase, Spark, etc. f. Performance optimization (MR job and other) g. Setup performance monitoring & tuning 

2. Cloud a. Solid experience managing & administering cloud platform - Azure, AWS, BigTable, etc. b. deploying Big Data solutions in Cloud c. Cluster install & config d. Capacity estimation and configure for elasticity e. Script automation for allocation, deallocation, etc. 

3. Establish Big Data Security a. Data at Rest & Transit b. Access from backend and front-end applications c. Row level security & Role based security d. integration - LDAP, AD, Okta 

4. Ingestion a. Sqoop, Kakfa, Storm – highly desirable b. ADF, Informatica Cloud, etc. are definite plus c. Setup processes for historical and incremental data ingestion 

5. Front-end access – Configure connectivity and interfaces enabling Cognos, Tableau, PowerBI, R, and SAS applications to access Hadoop Big data. 

6. Scheduler & Runtime environment – Configure YARN and Oozie for optimal resource utilization and end-to-end workflow process. 

7. Deploy and configure Neo4J (Graph DB), Document DB and emerging big data repositories 8. Big data modeling

Experience with at least one popular Hadoop flavor – Cloudera, HortonWorks, MapR e. Installation  and Configration of Hadoop projects