Hadoop Administrator

Location: Boston
Posted on: November 20, 2024

Job Description:

Hadoop Administrator in Boston, MA
The Hadoop Administrator in Boston, MA  will be responsible for collaborating with a team of developers to gain a complete understanding of the clients' needs. They apply industry best-practices and expertise regarding emerging technologies. They plan and conduct software testing, document technical specifications, and should be able to be relied upon to identify tools and resources, in support of customer initiatives, goals, and strategies.
 
Position Description:
• Design and implement data storage, schema and partition system as appropriate to Hadoop and related technologies like Hbase, Hive and Pig.
• Identify, assess, and recommend appropriate solutions to advice customer on cluster requirements and any limitations by applying industry best practices and expertise regarding emerging technologies, risk mitigation, and continuity planning to address back-up and recovery.
• Possess advanced Linux and Hadoop System Administration skills and networking, shell scripting, and system automation.
• Provides enterprise-level information technology recommendations and solutions in support of customer requirements.
• Use customer defined data sources and prototype processes to satisfy proof of concept.
• Develop design patterns for specific data processing jobs.
• Test various scenarios for optimized cluster performance and reporting.
• Prepare and deliver presentations to communicate deployment process for the proof of concept.
• Will serve as a point of contact between internal and external customers and program management.
• Ensures accurate documentation of technical specifications.
 
 
Required skills:
• 5+ years Linux or Unix System Administrator experience
• 3+ years Hadoop experience in the area of setup, configuration, or management
• 14+ years in Networking/Monitoring concepts and tools in a multi-platform data center environment
Linux  
• Kerberos and Securing Hadoop Clusters.
• Experience with systems monitoring tools -Nagios, helping tune, configure, and administer cluster
• Unix System Administrator experience
• Hadoop experience in the area of setup, configuration, or management
• Networking/Monitoring in a data center environment
• Hadoop cluster
• Cloudera’s Hadoop distribution.
• Pig, Hive and Hbase.
 
 
Education:
Certified Linux System Administrator - e.g. Red Hat Linux
Bachelors degree from an accredited college in a related discipline, or equivalent experience/combined education, with 11 years of professional experience; or 9 years of professional experience with a related Masters degree.
 

Keywords: , Cambridge , Hadoop Administrator, IT / Software / Systems , Boston, Massachusetts