The Hadoop Database Administrator / Hadoop DBA will be responsible for development and support of the open source Hadoop environment, including infrastructure planning, scaling and administration. The Hadoop Database Administrator / DBA will work closely with infrastructure, network, database, business intelligence and application teams to insure business applications are highly available and performing within agreed on service levels.
ESSENTIAL DUTIES AND RESPONSIBILITIES include the following:
Hadoop Database Administrator / Hadoop DBA provides day to day production support of our Hadoop infrastructure including;
Implement new Hadoop hardware infrastructure
OS integration and application installation
HDFS support and maintenance
Adding and removing cluster nodes
Backup and restores
Troubleshooting MapReduce Jobs as required
Cluster Monitoring and Troubleshooting
Manage and review Hadoop log files
Filesystem management and monitoring
Hadoop Cluster capacity planning
Design, implement and maintain security
Manage and review data backups
Execute system and disaster recovery processes as required
Hadoop Database Administrator / Hadoop DBA provide support and troubleshooting for BI issues associated with Hadoop
Provide support for legacy ETL environment as required
Work with the project and application development teams to implement new business initiatives as they relate to Hadoop
Hadoop Database Administrator / Hadoop DBA works with application teams to install operating system and Hadoop updates, patches, version upgrades as required.
Implement vulnerability and operating system patches to insure compliance and system integrity.
Works with business intelligence, ETL and application teams to troubleshoot complex problems that impact our customer's ability to perform required business functions.
JOB SPECIFICATIONS for the Hadoop Database Administrator / Hadoop DBA
3+ years supporting open source Linux operating systems (CENTOS, Debian, Fedora) and hardware in an enterprise environment.
3+ years' experience installing, configuring Linux based systems.
Strong scripting expertise including BASH, PHP, PERL, Java script and UNIX Shell.
Knowledge of java virtual machines (JVM) and multithreaded processing.
Expertise in typical system administration and programming skills such as storage capacity management, performance tuning, system dump analysis, and Tserver hardening (security).
Demonstrated ability to apply problem analysis and resolution techniques to complex system problems
Strong network background with a good understanding of TCP/IP, firewalls and DNS
DESIRED SKILLS/ EXPERIENCE:
Hands on experience with the Hadoop stack (MapReduce, Sqoop, Pig, Hive, Flume)
Knowledge of NoSQL platforms
Hands on experience with deploying and administering MySQL databases
Ability to read, understand, and build java code
Hands on experience with opens source monitoring tools including; Nagios and Ganglia
EDUCATION and/or EXPERIENCE:
BS degree in Computer Science or related field from four-year College or University