Hadoop Administrator
Arka Infotech Inc
Apply to this job San Francisco, CA, us on site Until 8/22/2026 H-1B sponsor history First posted March 21, 2025 Last posted March 21, 2025
Job description
Job Title: Senior Software Engineer
Experience: 8 – 11 years
Location: SFO/ Houston
Primary Skills:
Set up production Hadoop clusters with optimum configurations
Drive automation of Hadoop deployments, cluster expansion and maintenance operations
Manage Hadoop cluster, monitoring alerts and notification
Deployment of upgrades, updates and patches
Provide 24x7 tier-3 troubleshooting and break-fix support for production services
Diagnosis of installation & configuration issues
Diagnosis of cluster management issues
Diagnosis of performance issues
Job scheduling, monitoring, debugging and troubleshooting
Monitoring and management of the cluster in all respects, notably availability, performance and security
File system management and monitoring
Data transfer between Hadoop and other data stores (incl. relational database)
Ingesting additional data sources into Hadoop in either streaming or batch mode
Commissioning and decommissioning worker nodes
Configuring the cluster to be rack-aware
Set up High Availability/Disaster Recovery environment
Debug/Troubleshoot environment failures/downtime
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users
Set up security configurations in Hadoop
Performance tuning of Hadoop clusters and Hadoop Map Reduce routines
Manage and review Hadoop log files
Experience: 8 – 11 years
Location: SFO/ Houston
Primary Skills:
Set up production Hadoop clusters with optimum configurations
Drive automation of Hadoop deployments, cluster expansion and maintenance operations
Manage Hadoop cluster, monitoring alerts and notification
Deployment of upgrades, updates and patches
Provide 24x7 tier-3 troubleshooting and break-fix support for production services
Diagnosis of installation & configuration issues
Diagnosis of cluster management issues
Diagnosis of performance issues
Job scheduling, monitoring, debugging and troubleshooting
Monitoring and management of the cluster in all respects, notably availability, performance and security
File system management and monitoring
Data transfer between Hadoop and other data stores (incl. relational database)
Ingesting additional data sources into Hadoop in either streaming or batch mode
Commissioning and decommissioning worker nodes
Configuring the cluster to be rack-aware
Set up High Availability/Disaster Recovery environment
Debug/Troubleshoot environment failures/downtime
Working with data delivery teams to setup new Hadoop users. This job includes setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig and MapReduce access for the new users
Set up security configurations in Hadoop
Performance tuning of Hadoop clusters and Hadoop Map Reduce routines
Manage and review Hadoop log files
About this role
Summary
Manage and optimize Hadoop clusters, ensure security, performance, and troubleshooting.
Job title
Hadoop Administrator
Experience level
8-11 years
Industry
software
Location requirements
On-site in San Francisco, CA, with some flexibility
Salary
Not specified
Visa sponsorship
H-1B sponsor history
Management role
No
Skills & keywords
Required skills
Hadoopcluster managementLinuxKerberosHDFSHivePigMapReduce
Preferred skills
automationdisaster recoveryperformance tuninglog management
Specializations
Hadoopcluster managementperformance tuningsecuritybig data
Locations
Structured locations inferred from the posting.
San Francisco, CA, USA
On-site City
Related searches