Personal Information
Organization / Workplace
Taipei City, Taiwan, 0 Taiwan
Occupation
VP of Apache Bigtop, Big Data Engineer at Yahoo!
Industry
Technology / Software / Internet
About
I¨m an Apache Bigtop Project Committer and PMC member. The feature I developed in virtualization and containerization helps the community reinforce its automation and continuous integration pipeline for Hadoop ecosystem which yields better software quality with faster release cycles.
At Trend Micro, we built our own Hadoop Distribution to serve our own needs. My responsibilities was to build up an in-house Hadoop distribution(TMH) based on Apache Bigtop and develop a system that deploys and manages Hadoop cluster across 100+ nodes in Production.
Another achievement I have at Trend Micro was to develop a high-throughput, fault-tolerant distributed data streaming system that scales. The ...
Contact Details
Tags
docker
apache bigtop
apache hadoop
hadoop deployment
open source
career
apache spark
apache
big data
devops
hdfs
puppet
hadoop
quorum journal
apache hbase
apache thrift
apache flume
impala
ha
bigtop
vagrant
akka
cassandra
packaging
apache calcite
sql
optimization
tensorflow
distributed deep learning
apache software foundation
software industry
asf
software
See more
Users being followed by Evans Ye