iAd - Sr. Hadoop DevOps Engineer
Apple advertising provides an opportunity to redefine the advertising experience on mobile devices. It’s an exciting environment and a fast-paced development organization. We are looking to hire outstanding individuals to join our team of Site Reliability Engineers. Candidates should be able to troubleshoot various type of Network, System and Application related issues. Our team provides infrastructure and support by building and maintaining Hadoop clusters and application stack. We work in a high intensity environment with our end users and have very aggressive project delivery timelines. Great communication skills with Project Managers and engineers is an absolute must.
Description
As an iAd Senior Software Engineer, you will be responsible for the following:
- Design and implement scalable data platforms for our customer facing services
- Deploy and scale Hadoop infrastructure
- Hadoop / HDFS maintenance and operations
- Data cluster monitoring and troubleshooting
- Hadoop capacity planning
- OS integration and application installation
- Create runbooks for Offshore teams
- Participate in an Oncall schedule
- Partner with program management, network engineering, site reliability operations, and other related groups
Education Details
Bachelor’s degree in Computer Science or equivalent is required Master’s degree preferred
Key Qualifications
- Sound knowledge of UNIX and TCP/IP network fundamentals
- Expertise with Hadoop and its ecosystem Hive, Pig, Spark, HDFS, HBase, Oozie, Sqoop, Flume, Zookeeper etc.
- 5+ years managing clustered services, distributed systems, production data stores
- 3+ years experience administering and operating Hadoop clusters
- Cloudera CHD4 /CDH5 cluster management and capacity planning experience
- Ability to code well in at least one language (Shell, Ruby, Python, Java, Perl, Go)
- Ability to rapidly learn new software languages, frameworks and APIs quickly
- Sharp and tenacious troubleshooting skills
- Experience scripting for automation and config management (Chef, Puppet)
- Multi-datacenter deployment experience a plus