San Francisco Bay Area United States
Infrastructure Engineering Manager at LinkedIn
Technology / Software / Internet
The dramatic growth of data is driving a massive need for scale-out. The clusters leveraged by internet-scale companies simply for processing the event stream would make the Top-500 supercomputer lists of a few years ago---and processing the event stream is only a small fraction of the infrastructure needed.
Machine-learned ranking and relevance drive business decisions and enhance member experience for industry and government---but at the same time are compounding the problem of scale.
I am thrilled to be leading the design and implementation of the infrastructure needed to drive this massive scale-out. For offline processing we can leverage classic Beowulf/MPI style clusters to map/...