Taipei City, Taiwan, 0 Taiwan
VP of Apache Bigtop, Big Data Engineer at Yahoo!
Technology / Software / Internet
I’m an Apache Bigtop Project Committer and PMC member. The feature I developed in virtualization and containerization helps the community reinforce its automation and continuous integration pipeline for Hadoop ecosystem which yields better software quality with faster release cycles.
At Trend Micro, we built our own Hadoop Distribution to serve our own needs. My responsibilities was to build up an in-house Hadoop distribution(TMH) based on Apache Bigtop and develop a system that deploys and manages Hadoop cluster across 100+ nodes in Production.
Another achievement I have at Trend Micro was to develop a high-throughput, fault-tolerant distributed data streaming system that scales. The ...