Focus on Spark, Shark development and Hadoop platform operation.
Setup SPARK, SHARK system. Tuning and fix 3 major bugs. Write a series wiki to introduce spark and shark.
Developed HDFS, YARN, HBASE plugin to send metrics to Company's Dashboard(A metrics collecting and displaying system), and send logs to Company's Central logging system.
Developed alert system based on collected metrics.
Developed HBase plugin to auto move and split hot regions, which has kept HBASE cluster running stably for months.
Help tuning the Fair-Scheduler system for yarn.
We¡¯ve updated our privacy policy so that we are compliant with changing global privacy regulations and to provide you with insight into the limited ways in which we use your data.
You can read the details below. By accepting, you agree to the updated privacy policy.
