�ݺ�ߣshows by User: KishoreGopalakrishna

�ݺ�ߣshows by User: KishoreGopalakrishna / http://www.slideshare.net/images/logo.gif �ݺ�ߣshows by User: KishoreGopalakrishna / Mon, 18 May 2020 18:49:05 GMT �ݺ�ߣShare feed for �ݺ�ߣshows by User: KishoreGopalakrishna History of Apache Pinot /slideshow/history-of-apache-pinot/234215821 apachepinot-meetupmay5th-200518184906
Two of the most frequently asked questions about Pinot’s history are “Why did LinkedIn build Pinot?”, “How is it different from Druid, ElasticSearch, Kylin?”. In this talk, we will go over the use cases that motivated us to build Pinot and how it has changed the analytics landscape at LinkedIn, Uber, and other companies.]]>
Two of the most frequently asked questions about Pinot’s history are “Why did LinkedIn build Pinot?”, “How is it different from Druid, ElasticSearch, Kylin?”. In this talk, we will go over the use cases that motivated us to build Pinot and how it has changed the analytics landscape at LinkedIn, Uber, and other companies.]]> Mon, 18 May 2020 18:49:05 GMT /slideshow/history-of-apache-pinot/234215821 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) History of Apache Pinot KishoreGopalakrishna Two of the most frequently asked questions about Pinot’s history are “Why did LinkedIn build Pinot?”, “How is it different from Druid, ElasticSearch, Kylin?”. In this talk, we will go over the use cases that motivated us to build Pinot and how it has changed the analytics landscape at LinkedIn, Uber, and other companies. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/apachepinot-meetupmay5th-200518184906-thumbnail.jpg?width=120&height=120&fit=bounds" /> Two of the most frequently asked questions about Pinot’s history are “Why did LinkedIn build Pinot?”, “How is it different from Druid, ElasticSearch, Kylin?”. In this talk, we will go over the use cases that motivated us to build Pinot and how it has changed the analytics landscape at LinkedIn, Uber, and other companies.

History of Apache Pinot from Kishore Gopalakrishna

]]> 1529 0 https://cdn.slidesharecdn.com/ss_thumbnails/apachepinot-meetupmay5th-200518184906-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Building real time analytics applications using pinot : A LinkedIn case study /slideshow/building-real-time-analytics-applications-using-pinot-a-linkedin-case-study/141786370 buildingreal-timeanalyticsapplicationsusingpinotalinkedincasestudy-190423165550
LinkedIn's is the most advantageous social networking tool available to job seekers and business professionals today, with 610+ million members creating millions of posts, videos, and articles that generate tens of millions of shares, comments, and likes per day. LinkedIn has leveraged this activity data to build rich interactive user-facing analytics applications like “Who Viewed My Profile”, Talent Insights, Ad Analytics, and Publisher Analytics, among others. These applications are all powered by Pinot, as are internal dashboards, anomaly detection and root cause analysis platform like ThirdEye. This talk will present how Pinot has become the de-facto solution for serving analytic queries in milliseconds, ad-hoc reporting, monitoring & Anomaly Detection on multidimensional data. ]]>
LinkedIn's is the most advantageous social networking tool available to job seekers and business professionals today, with 610+ million members creating millions of posts, videos, and articles that generate tens of millions of shares, comments, and likes per day. LinkedIn has leveraged this activity data to build rich interactive user-facing analytics applications like “Who Viewed My Profile”, Talent Insights, Ad Analytics, and Publisher Analytics, among others. These applications are all powered by Pinot, as are internal dashboards, anomaly detection and root cause analysis platform like ThirdEye. This talk will present how Pinot has become the de-facto solution for serving analytic queries in milliseconds, ad-hoc reporting, monitoring & Anomaly Detection on multidimensional data. ]]> Tue, 23 Apr 2019 16:55:50 GMT /slideshow/building-real-time-analytics-applications-using-pinot-a-linkedin-case-study/141786370 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Building real time analytics applications using pinot : A LinkedIn case study KishoreGopalakrishna LinkedIn's is the most advantageous social networking tool available to job seekers and business professionals today, with 610+ million members creating millions of posts, videos, and articles that generate tens of millions of shares, comments, and likes per day. LinkedIn has leveraged this activity data to build rich interactive user-facing analytics applications like “Who Viewed My Profile”, Talent Insights, Ad Analytics, and Publisher Analytics, among others. These applications are all powered by Pinot, as are internal dashboards, anomaly detection and root cause analysis platform like ThirdEye. This talk will present how Pinot has become the de-facto solution for serving analytic queries in milliseconds, ad-hoc reporting, monitoring & Anomaly Detection on multidimensional data. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/buildingreal-timeanalyticsapplicationsusingpinotalinkedincasestudy-190423165550-thumbnail.jpg?width=120&height=120&fit=bounds" /> LinkedIn's is the most advantageous social networking tool available to job seekers and business professionals today, with 610+ million members creating millions of posts, videos, and articles that generate tens of millions of shares, comments, and likes per day. LinkedIn has leveraged this activity data to build rich interactive user-facing analytics applications like “Who Viewed My Profile”, Talent Insights, Ad Analytics, and Publisher Analytics, among others. These applications are all powered by Pinot, as are internal dashboards, anomaly detection and root cause analysis platform like ThirdEye. This talk will present how Pinot has become the de-facto solution for serving analytic queries in milliseconds, ad-hoc reporting, monitoring & Anomaly Detection on multidimensional data.

Building real time analytics applications using pinot : A LinkedIn case study from Kishore Gopalakrishna

]]> 15012 12 https://cdn.slidesharecdn.com/ss_thumbnails/buildingreal-timeanalyticsapplicationsusingpinotalinkedincasestudy-190423165550-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Pinot: Realtime Distributed OLAP datastore /slideshow/pinot-realtime-distributed-olap-datastore/54701463 pinotcoursera-151103183418-lva1-app6892
Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. It can ingest data from offline data sources (such as Hadoop and flat files) as well as online sources (such as Kafka). Pinot is designed to scale horizontally.]]>
Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. It can ingest data from offline data sources (such as Hadoop and flat files) as well as online sources (such as Kafka). Pinot is designed to scale horizontally.]]> Tue, 03 Nov 2015 18:34:18 GMT /slideshow/pinot-realtime-distributed-olap-datastore/54701463 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Pinot: Realtime Distributed OLAP datastore KishoreGopalakrishna Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. It can ingest data from offline data sources (such as Hadoop and flat files) as well as online sources (such as Kafka). Pinot is designed to scale horizontally. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/pinotcoursera-151103183418-lva1-app6892-thumbnail.jpg?width=120&height=120&fit=bounds" /> Pinot is a realtime distributed OLAP datastore, which is used at LinkedIn to deliver scalable real time analytics with low latency. It can ingest data from offline data sources (such as Hadoop and flat files) as well as online sources (such as Kafka). Pinot is designed to scale horizontally.

Pinot: Realtime Distributed OLAP datastore from Kishore Gopalakrishna

]]> 908039 1162 https://cdn.slidesharecdn.com/ss_thumbnails/pinotcoursera-151103183418-lva1-app6892-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Multi-Tenant Data Cloud with YARN & Helix /slideshow/mutiltenant-data-cloud-with-yarn-helix/35556450 helix-yarn-hadoopsummit2014-140606014107-phpapp02
Building applications on YARN with Helix]]>
Building applications on YARN with Helix]]> Fri, 06 Jun 2014 01:41:07 GMT /slideshow/mutiltenant-data-cloud-with-yarn-helix/35556450 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Multi-Tenant Data Cloud with YARN & Helix KishoreGopalakrishna Building applications on YARN with Helix <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/helix-yarn-hadoopsummit2014-140606014107-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds" /> Building applications on YARN with Helix

Multi-Tenant Data Cloud with YARN & Helix from Kishore Gopalakrishna

]]> 5643 9 https://cdn.slidesharecdn.com/ss_thumbnails/helix-yarn-hadoopsummit2014-140606014107-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Helix talk at RelateIQ /slideshow/helix-talk/27311916 helixtalk-131017170712-phpapp02
]]>
]]> Thu, 17 Oct 2013 17:07:12 GMT /slideshow/helix-talk/27311916 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Helix talk at RelateIQ KishoreGopalakrishna <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/helixtalk-131017170712-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds" />

Helix talk at RelateIQ from Kishore Gopalakrishna

]]> 8862 9 https://cdn.slidesharecdn.com/ss_thumbnails/helixtalk-131017170712-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds presentation White http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Untangling cluster management with Helix /slideshow/helix-onecol/24818947 helixonecol-130731172657-phpapp01
Helix provides an abstraction for a system developer to separate coordination and management tasks from component functional tasks of a distributed system. The developer defines the system behavior via a state model that enumerates the possible states of each component, the transitions between those states, and constraints that govern the system’s valid settings. Helix does the heavy lifting of ensuring the system satisfies that state model in the distributed setting, while also meeting the system’s goals on load balancing and throttling state changes. We detail several Helix-managed production distributed systems at LinkedIn and how Helix has helped them avoid building custom management components. We describe the Helix design and implementation and present an experimental study that demonstrates its performance and functionality.]]>
Helix provides an abstraction for a system developer to separate coordination and management tasks from component functional tasks of a distributed system. The developer defines the system behavior via a state model that enumerates the possible states of each component, the transitions between those states, and constraints that govern the system’s valid settings. Helix does the heavy lifting of ensuring the system satisfies that state model in the distributed setting, while also meeting the system’s goals on load balancing and throttling state changes. We detail several Helix-managed production distributed systems at LinkedIn and how Helix has helped them avoid building custom management components. We describe the Helix design and implementation and present an experimental study that demonstrates its performance and functionality.]]> Wed, 31 Jul 2013 17:26:57 GMT /slideshow/helix-onecol/24818947 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Untangling cluster management with Helix KishoreGopalakrishna Helix provides an abstraction for a system developer to separate coordination and management tasks from component functional tasks of a distributed system. The developer defines the system behavior via a state model that enumerates the possible states of each component, the transitions between those states, and constraints that govern the system’s valid settings. Helix does the heavy lifting of ensuring the system satisfies that state model in the distributed setting, while also meeting the system’s goals on load balancing and throttling state changes. We detail several Helix-managed production distributed systems at LinkedIn and how Helix has helped them avoid building custom management components. We describe the Helix design and implementation and present an experimental study that demonstrates its performance and functionality. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/helixonecol-130731172657-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds" /> Helix provides an abstraction for a system developer to separate coordination and management tasks from component functional tasks of a distributed system. The developer defines the system behavior via a state model that enumerates the possible states of each component, the transitions between those states, and constraints that govern the system’s valid settings. Helix does the heavy lifting of ensuring the system satisfies that state model in the distributed setting, while also meeting the system’s goals on load balancing and throttling state changes. We detail several Helix-managed production distributed systems at LinkedIn and how Helix has helped them avoid building custom management components. We describe the Helix design and implementation and present an experimental study that demonstrates its performance and functionality.

Untangling cluster management with Helix from Kishore Gopalakrishna

]]> 7345 10 https://cdn.slidesharecdn.com/ss_thumbnails/helixonecol-130731172657-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Data driven testing: Case study with Apache Helix /slideshow/data-driven-testing/19161428 datadriventesting-130419101043-phpapp02
Case study of how we used Helix not only to build the distributed system but also to test it. We built a Chaos monkey to simulate failures and developed tools in Helix to parse zookeeper transaction logs, controller and participant logs and reconstructed the exact sequence of steps that led to a failure. Once we get the exact sequence of steps, we reproduce the events using Helix for orchestration.]]>
Case study of how we used Helix not only to build the distributed system but also to test it. We built a Chaos monkey to simulate failures and developed tools in Helix to parse zookeeper transaction logs, controller and participant logs and reconstructed the exact sequence of steps that led to a failure. Once we get the exact sequence of steps, we reproduce the events using Helix for orchestration.]]> Fri, 19 Apr 2013 10:10:43 GMT /slideshow/data-driven-testing/19161428 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Data driven testing: Case study with Apache Helix KishoreGopalakrishna Case study of how we used Helix not only to build the distributed system but also to test it. We built a Chaos monkey to simulate failures and developed tools in Helix to parse zookeeper transaction logs, controller and participant logs and reconstructed the exact sequence of steps that led to a failure. Once we get the exact sequence of steps, we reproduce the events using Helix for orchestration. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/datadriventesting-130419101043-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds" /> Case study of how we used Helix not only to build the distributed system but also to test it. We built a Chaos monkey to simulate failures and developed tools in Helix to parse zookeeper transaction logs, controller and participant logs and reconstructed the exact sequence of steps that led to a failure. Once we get the exact sequence of steps, we reproduce the events using Helix for orchestration.

Data driven testing: Case study with Apache Helix from Kishore Gopalakrishna

]]> 8125 11 https://cdn.slidesharecdn.com/ss_thumbnails/datadriventesting-130419101043-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds presentation White http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Apache Helix presentation at Vmware /slideshow/apache-helix-presentation-at-vmware/17015942 helixvmware-130307142638-phpapp01
Apache Helix presentation at Vmware. Download the file to see animations]]>
Apache Helix presentation at Vmware. Download the file to see animations]]> Thu, 07 Mar 2013 14:26:37 GMT /slideshow/apache-helix-presentation-at-vmware/17015942 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Apache Helix presentation at Vmware KishoreGopalakrishna Apache Helix presentation at Vmware. Download the file to see animations <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/helixvmware-130307142638-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds" /> Apache Helix presentation at Vmware. Download the file to see animations

Apache Helix presentation at Vmware from Kishore Gopalakrishna

]]> 5410 10 https://cdn.slidesharecdn.com/ss_thumbnails/helixvmware-130307142638-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Apache Helix presentation at ApacheCon 2013 /slideshow/apache-con-buildingddsusinghelix/16844377 apacheconbuildingddsusinghelix-130228165757-phpapp01
Building distributed systems using Helix]]>
Building distributed systems using Helix]]> Thu, 28 Feb 2013 16:57:57 GMT /slideshow/apache-con-buildingddsusinghelix/16844377 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Apache Helix presentation at ApacheCon 2013 KishoreGopalakrishna Building distributed systems using Helix <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/apacheconbuildingddsusinghelix-130228165757-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds" /> Building distributed systems using Helix

Apache Helix presentation at ApacheCon 2013 from Kishore Gopalakrishna

]]> 7637 8 https://cdn.slidesharecdn.com/ss_thumbnails/apacheconbuildingddsusinghelix-130228165757-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation White http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 Apache Helix presentation at SOCC 2012 /slideshow/helix-socc-v10final/14818942 helixsoccv10final-121020224413-phpapp02
Untangling Cluster Management with Helix SOCC 2012 presentation]]>
Untangling Cluster Management with Helix SOCC 2012 presentation]]> Sat, 20 Oct 2012 22:44:11 GMT /slideshow/helix-socc-v10final/14818942 KishoreGopalakrishna@slideshare.net(KishoreGopalakrishna) Apache Helix presentation at SOCC 2012 KishoreGopalakrishna Untangling Cluster Management with Helix SOCC 2012 presentation <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/helixsoccv10final-121020224413-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds" /> Untangling Cluster Management with Helix SOCC 2012 presentation

Apache Helix presentation at SOCC 2012 from Kishore Gopalakrishna

]]> 6515 6 https://cdn.slidesharecdn.com/ss_thumbnails/helixsoccv10final-121020224413-phpapp02-thumbnail.jpg?width=120&height=120&fit=bounds presentation White http://activitystrea.ms/schema/1.0/post

http://activitystrea.ms/schema/1.0/posted

0 https://cdn.slidesharecdn.com/profile-photo-KishoreGopalakrishna-48x48.jpg?cb=1642869982 Passionate about building large scale distributed systems!. Data Infra Engineer at LinkedIn. Tech Lead/Architect for Pinot, a Real time Analytics Platform and ThirdEye (Anomaly Detection Framework to monitor Business Metrics). Creator of Apache Helix (Generic Cluster management Framework) (http://helix.apache.org). Founding member of the team that built Espresso (Document oriented NoSQL data store), Databus (Change Data Capture). Prior to LinkedIn, I worked extensively on Ad systems at Yahoo. Built Apache S4, a real time stream processing framework. https://cdn.slidesharecdn.com/ss_thumbnails/apachepinot-meetupmay5th-200518184906-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/history-of-apache-pinot/234215821 History of Apache Pinot https://cdn.slidesharecdn.com/ss_thumbnails/buildingreal-timeanalyticsapplicationsusingpinotalinkedincasestudy-190423165550-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/building-real-time-analytics-applications-using-pinot-a-linkedin-case-study/141786370 Building real time ana... https://cdn.slidesharecdn.com/ss_thumbnails/pinotcoursera-151103183418-lva1-app6892-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/pinot-realtime-distributed-olap-datastore/54701463 Pinot: Realtime Distri...