[Hadoop 2009-2013]
it's around 2009 when I first met hadoop.
have managed a few clusters from some tens of machine cluster to 1000+ machine cluster.
mobile spatial statistics are one of the applications we've implemented over the 1000+ machine cluster.
implemented MR functions running daily/monthly to archive files into bigger ones using python and java.
our 1000+ hadoop cluster is Highly Available by heartbeat and DRBD.
have experiences on ganglia module implementation for hadoop monitoring, Hive, HDFS federation etc.
cloudera certified hadoop administrator.
[Log analysis 2014]
before I left docomo, I had been working on access log analysis for d-market using splunk, R, and python.
[Ad...