際際滷shows by User: tcng3716 / http://www.slideshare.net/images/logo.gif 際際滷shows by User: tcng3716 / Mon, 17 Oct 2016 04:03:57 GMT 際際滷Share feed for 際際滷shows by User: tcng3716 Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid /slideshow/pulsar-realtime-analytics-at-scale-with-kafka-kylin-and-druid/67265966 pulsar-strata-share-161017040357
Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid. Presented at Strata + Hadoop World 2016]]>
Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid. Presented at Strata + Hadoop World 2016]]> Mon, 17 Oct 2016 04:03:57 GMT /slideshow/pulsar-realtime-analytics-at-scale-with-kafka-kylin-and-druid/67265966 tcng3716@slideshare.net(tcng3716) Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid tcng3716 Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid. Presented at Strata + Hadoop World 2016 <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/pulsar-strata-share-161017040357-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid. Presented at Strata + Hadoop World 2016
Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid from Tony Ng
]]> 6328 9 https://cdn.slidesharecdn.com/ss_thumbnails/pulsar-strata-share-161017040357-thumbnail.jpg?width=120&height=120&fit=bounds presentation 000000 http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 eBay Experimentation Platform on Hadoop /slideshow/experimentation-platform-on-hadoop-hadoop-summit-2015/49478713 ebayexperimentation-hadoopsummit2015-150616212100-lva1-app6892
Experimentation plays a vital role in business growth at eBay by providing valuable insights and prediction on how users will reach to changes made to the eBay website and applications. On a given day, eBay has several hundred experiments running at the same time. Our experimentation data processing pipeline handles billions of rows user behavioral and transactional data per day to generate detailed reports covering 100+ metrics over 50 dimensions. In this session, we will share our journey of how we moved this complex process from Data warehouse to Hadoop. We will give an overview of the experimentation platform and data processing pipeline. We will highlight the challenges and learnings we faced implementing this platform in Hadoop and how this transformation led us to build a scalable, flexible and reliable data processing workflow in Hadoop. We will cover our work done on performance optimizations, methods to establish resilience and configurability, efficient storage formats and choices of different frameworks used in the pipeline.]]>
Experimentation plays a vital role in business growth at eBay by providing valuable insights and prediction on how users will reach to changes made to the eBay website and applications. On a given day, eBay has several hundred experiments running at the same time. Our experimentation data processing pipeline handles billions of rows user behavioral and transactional data per day to generate detailed reports covering 100+ metrics over 50 dimensions. In this session, we will share our journey of how we moved this complex process from Data warehouse to Hadoop. We will give an overview of the experimentation platform and data processing pipeline. We will highlight the challenges and learnings we faced implementing this platform in Hadoop and how this transformation led us to build a scalable, flexible and reliable data processing workflow in Hadoop. We will cover our work done on performance optimizations, methods to establish resilience and configurability, efficient storage formats and choices of different frameworks used in the pipeline.]]> Tue, 16 Jun 2015 21:21:00 GMT /slideshow/experimentation-platform-on-hadoop-hadoop-summit-2015/49478713 tcng3716@slideshare.net(tcng3716) eBay Experimentation Platform on Hadoop tcng3716 Experimentation plays a vital role in business growth at eBay by providing valuable insights and prediction on how users will reach to changes made to the eBay website and applications. On a given day, eBay has several hundred experiments running at the same time. Our experimentation data processing pipeline handles billions of rows user behavioral and transactional data per day to generate detailed reports covering 100+ metrics over 50 dimensions. In this session, we will share our journey of how we moved this complex process from Data warehouse to Hadoop. We will give an overview of the experimentation platform and data processing pipeline. We will highlight the challenges and learnings we faced implementing this platform in Hadoop and how this transformation led us to build a scalable, flexible and reliable data processing workflow in Hadoop. We will cover our work done on performance optimizations, methods to establish resilience and configurability, efficient storage formats and choices of different frameworks used in the pipeline. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/ebayexperimentation-hadoopsummit2015-150616212100-lva1-app6892-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Experimentation plays a vital role in business growth at eBay by providing valuable insights and prediction on how users will reach to changes made to the eBay website and applications. On a given day, eBay has several hundred experiments running at the same time. Our experimentation data processing pipeline handles billions of rows user behavioral and transactional data per day to generate detailed reports covering 100+ metrics over 50 dimensions. In this session, we will share our journey of how we moved this complex process from Data warehouse to Hadoop. We will give an overview of the experimentation platform and data processing pipeline. We will highlight the challenges and learnings we faced implementing this platform in Hadoop and how this transformation led us to build a scalable, flexible and reliable data processing workflow in Hadoop. We will cover our work done on performance optimizations, methods to establish resilience and configurability, efficient storage formats and choices of different frameworks used in the pipeline.
eBay Experimentation Platform on Hadoop from Tony Ng
]]> 2359 3 https://cdn.slidesharecdn.com/ss_thumbnails/ebayexperimentation-hadoopsummit2015-150616212100-lva1-app6892-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Pulsar - Real-time Analytics at Scale /slideshow/pulsar-realtime-analytics-at-scale/47133095 pulsar-apachecon-2015-150417210027-conversion-gate01
Enterprises are Increasingly demanding realtime analytics and insights to power use cases like personalization, monitoring and marketing. We will present Pulsar, a realtime streaming system used at eBay which can scale to millions of events per second with high availability and SQL-like language support, enabling realtime data enrichment, filtering and multi-dimensional metrics aggregation. We will discuss how Pulsar integrates with a number of open source Apache technologies like Kafka, Hadoop and Kylin (Apache incubator) to achieve the high scalability, availability and flexibility. We use Kafka to replay unprocessed events to avoid data loss and to stream realtime events into Hadoop enabling reconciliation of data between realtime and batch. We use Kylin to provide multi-dimensional OLAP capabilities.]]>
Enterprises are Increasingly demanding realtime analytics and insights to power use cases like personalization, monitoring and marketing. We will present Pulsar, a realtime streaming system used at eBay which can scale to millions of events per second with high availability and SQL-like language support, enabling realtime data enrichment, filtering and multi-dimensional metrics aggregation. We will discuss how Pulsar integrates with a number of open source Apache technologies like Kafka, Hadoop and Kylin (Apache incubator) to achieve the high scalability, availability and flexibility. We use Kafka to replay unprocessed events to avoid data loss and to stream realtime events into Hadoop enabling reconciliation of data between realtime and batch. We use Kylin to provide multi-dimensional OLAP capabilities.]]> Fri, 17 Apr 2015 21:00:27 GMT /slideshow/pulsar-realtime-analytics-at-scale/47133095 tcng3716@slideshare.net(tcng3716) Pulsar - Real-time Analytics at Scale tcng3716 Enterprises are Increasingly demanding realtime analytics and insights to power use cases like personalization, monitoring and marketing. We will present Pulsar, a realtime streaming system used at eBay which can scale to millions of events per second with high availability and SQL-like language support, enabling realtime data enrichment, filtering and multi-dimensional metrics aggregation. We will discuss how Pulsar integrates with a number of open source Apache technologies like Kafka, Hadoop and Kylin (Apache incubator) to achieve the high scalability, availability and flexibility. We use Kafka to replay unprocessed events to avoid data loss and to stream realtime events into Hadoop enabling reconciliation of data between realtime and batch. We use Kylin to provide multi-dimensional OLAP capabilities. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/pulsar-apachecon-2015-150417210027-conversion-gate01-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Enterprises are Increasingly demanding realtime analytics and insights to power use cases like personalization, monitoring and marketing. We will present Pulsar, a realtime streaming system used at eBay which can scale to millions of events per second with high availability and SQL-like language support, enabling realtime data enrichment, filtering and multi-dimensional metrics aggregation. We will discuss how Pulsar integrates with a number of open source Apache technologies like Kafka, Hadoop and Kylin (Apache incubator) to achieve the high scalability, availability and flexibility. We use Kafka to replay unprocessed events to avoid data loss and to stream realtime events into Hadoop enabling reconciliation of data between realtime and batch. We use Kylin to provide multi-dimensional OLAP capabilities.
Pulsar - Real-time Analytics at Scale from Tony Ng
]]> 2014 3 https://cdn.slidesharecdn.com/ss_thumbnails/pulsar-apachecon-2015-150417210027-conversion-gate01-thumbnail.jpg?width=120&height=120&fit=bounds presentation 000000 http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Enterprise OSGi at eBay /slideshow/enterprise-osgi-at-ebay-12821567/12821567 ebay-osgi-impact-conference-120506175025-phpapp01
]]>
]]> Sun, 06 May 2012 17:50:24 GMT /slideshow/enterprise-osgi-at-ebay-12821567/12821567 tcng3716@slideshare.net(tcng3716) Enterprise OSGi at eBay tcng3716 <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/ebay-osgi-impact-conference-120506175025-phpapp01-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br>
Enterprise OSGi at eBay from Tony Ng
]]> 1551 4 https://cdn.slidesharecdn.com/ss_thumbnails/ebay-osgi-impact-conference-120506175025-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 eBay Architecture /slideshow/ebay-architecture/9892920 qcon-ebay-111026130119-phpapp01
]]>
]]> Wed, 26 Oct 2011 13:01:16 GMT /slideshow/ebay-architecture/9892920 tcng3716@slideshare.net(tcng3716) eBay Architecture tcng3716 <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/qcon-ebay-111026130119-phpapp01-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br>
eBay Architecture from Tony Ng
]]> 28154 14 https://cdn.slidesharecdn.com/ss_thumbnails/qcon-ebay-111026130119-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Calling All Modularity Solutions: A Comparative Study from eBay /slideshow/calling-all-modularity-solutions-a-comparative-study-from-ebay-9586634/9586634 modularitysolutions1-111007010017-phpapp02
]]>
]]> Fri, 07 Oct 2011 01:00:15 GMT /slideshow/calling-all-modularity-solutions-a-comparative-study-from-ebay-9586634/9586634 tcng3716@slideshare.net(tcng3716) Calling All Modularity Solutions: A Comparative Study from eBay tcng3716 <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/modularitysolutions1-111007010017-phpapp02-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br>
Calling All Modularity Solutions: A Comparative Study from eBay from Tony Ng
]]> 964 4 https://cdn.slidesharecdn.com/ss_thumbnails/modularitysolutions1-111007010017-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Yahoo! Application Platform Technical Deep Dive /slideshow/yahoo-application-platform-technical-deep-dive/2233241 open-hack-nyc-yap-v3-091015132553-phpapp01
Learn how to build applications for a platform that can reach 330M+ worldwide users! This session gives a technical overview of the Yahoo! Application Platform (YAP), which enables third-party applications to be embedded within popular Yahoo! destinations such as My Yahoo! and the Yahoo! home page. The session will cover key features of YAP, including Yahoo Markup Language (YML), Caja, Open Social, image cache and application editor. Next the talk will explain how to build an application for this platform as well as best practices to deliver great user experience from your application.]]>
Learn how to build applications for a platform that can reach 330M+ worldwide users! This session gives a technical overview of the Yahoo! Application Platform (YAP), which enables third-party applications to be embedded within popular Yahoo! destinations such as My Yahoo! and the Yahoo! home page. The session will cover key features of YAP, including Yahoo Markup Language (YML), Caja, Open Social, image cache and application editor. Next the talk will explain how to build an application for this platform as well as best practices to deliver great user experience from your application.]]> Thu, 15 Oct 2009 13:25:38 GMT /slideshow/yahoo-application-platform-technical-deep-dive/2233241 tcng3716@slideshare.net(tcng3716) Yahoo! Application Platform Technical Deep Dive tcng3716 Learn how to build applications for a platform that can reach 330M+ worldwide users! This session gives a technical overview of the Yahoo! Application Platform (YAP), which enables third-party applications to be embedded within popular Yahoo! destinations such as My Yahoo! and the Yahoo! home page. The session will cover key features of YAP, including Yahoo Markup Language (YML), Caja, Open Social, image cache and application editor. Next the talk will explain how to build an application for this platform as well as best practices to deliver great user experience from your application. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/open-hack-nyc-yap-v3-091015132553-phpapp01-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Learn how to build applications for a platform that can reach 330M+ worldwide users! This session gives a technical overview of the Yahoo! Application Platform (YAP), which enables third-party applications to be embedded within popular Yahoo! destinations such as My Yahoo! and the Yahoo! home page. The session will cover key features of YAP, including Yahoo Markup Language (YML), Caja, Open Social, image cache and application editor. Next the talk will explain how to build an application for this platform as well as best practices to deliver great user experience from your application.
Yahoo! Application Platform Technical Deep Dive from Tony Ng
]]> 2100 5 https://cdn.slidesharecdn.com/ss_thumbnails/open-hack-nyc-yap-v3-091015132553-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 https://cdn.slidesharecdn.com/profile-photo-tcng3716-48x48.jpg?cb=1583090305 - Software technical leader supported by progressively responsible roles throughout a 16+ years software development and management career - 12+ years relevant experience managing large, dynamic and global engineering teams. - Proven track record in delivering complex, scalable software infrastructure for both enterprise and consumer web - Extensive experience in developing and integrating open source software - Proven ability to attract and retain top engineering talents - Original member of engineering team that invented J2EE platform - Co-author of three technical books in Java and holder of 9 software patents. - Graduated from MIT and UC Berkeley with Master's degrees in Computer Scie... https://cdn.slidesharecdn.com/ss_thumbnails/pulsar-strata-share-161017040357-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/pulsar-realtime-analytics-at-scale-with-kafka-kylin-and-druid/67265966 Pulsar: Real-time Anal... https://cdn.slidesharecdn.com/ss_thumbnails/ebayexperimentation-hadoopsummit2015-150616212100-lva1-app6892-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/experimentation-platform-on-hadoop-hadoop-summit-2015/49478713 eBay Experimentation P... https://cdn.slidesharecdn.com/ss_thumbnails/pulsar-apachecon-2015-150417210027-conversion-gate01-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/pulsar-realtime-analytics-at-scale/47133095 Pulsar - Real-time Ana...