際際滷shows by User: ctrezzo / http://www.slideshare.net/images/logo.gif 際際滷shows by User: ctrezzo / Wed, 04 May 2016 23:31:22 GMT 際際滷Share feed for 際際滷shows by User: ctrezzo A Secure Public Cache For YARN Application Resources /slideshow/a-secure-public-cache-for-yarn-application-resources-61688793/61688793 hadoopmeetupmay-shared-cache-v12-no-notes-160504233122
A talk given at the SF Hadoop User group on May 3 2016. The YARN shared cache is a feature that aims to reduce the overhead of resource localization without requiring application developers to coordinate manually. Leveraging the shared cache, applications can securely share resources localized by a different application or even a different user. In this talk, we will give an overview of the shared cache architecture and a solid foundation for developers who want to build YARN applications that leverage this feature. Additionally, we will discuss some of the benefits we have seen from using the shared cache at Twitter.]]>
A talk given at the SF Hadoop User group on May 3 2016. The YARN shared cache is a feature that aims to reduce the overhead of resource localization without requiring application developers to coordinate manually. Leveraging the shared cache, applications can securely share resources localized by a different application or even a different user. In this talk, we will give an overview of the shared cache architecture and a solid foundation for developers who want to build YARN applications that leverage this feature. Additionally, we will discuss some of the benefits we have seen from using the shared cache at Twitter.]]> Wed, 04 May 2016 23:31:22 GMT /slideshow/a-secure-public-cache-for-yarn-application-resources-61688793/61688793 ctrezzo@slideshare.net(ctrezzo) A Secure Public Cache For YARN Application Resources ctrezzo A talk given at the SF Hadoop User group on May 3 2016. The YARN shared cache is a feature that aims to reduce the overhead of resource localization without requiring application developers to coordinate manually. Leveraging the shared cache, applications can securely share resources localized by a different application or even a different user. In this talk, we will give an overview of the shared cache architecture and a solid foundation for developers who want to build YARN applications that leverage this feature. Additionally, we will discuss some of the benefits we have seen from using the shared cache at Twitter. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/hadoopmeetupmay-shared-cache-v12-no-notes-160504233122-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> A talk given at the SF Hadoop User group on May 3 2016. The YARN shared cache is a feature that aims to reduce the overhead of resource localization without requiring application developers to coordinate manually. Leveraging the shared cache, applications can securely share resources localized by a different application or even a different user. In this talk, we will give an overview of the shared cache architecture and a solid foundation for developers who want to build YARN applications that leverage this feature. Additionally, we will discuss some of the benefits we have seen from using the shared cache at Twitter.
A Secure Public Cache For YARN Application Resources from ctrezzo
]]> 244 7 https://cdn.slidesharecdn.com/ss_thumbnails/hadoopmeetupmay-shared-cache-v12-no-notes-160504233122-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Hadoop Summit 2015: A Secure Public Cache For YARN Application Resources /slideshow/hadoop-summit2015-yarnsharedcachev12/49245564 hadoopsummit2015-yarn-shared-cache-v12-150611001431-lva1-app6892
In this talk, we will give a technical deep dive into the new YARN shared cache feature (i.e. YARN-1492) and explore the benefits we are currently seeing on our production clusters at Twitter. The YARN shared cache aims to optimize the considerable amount of network bandwidth and storage spent on resource localization in YARN. Some of this is mitigated by the NodeManager localization service, but this requires YARN application writers to coordinate resource sharing manually. As YARN deployments continue to grow and the type of YARN applications become more diverse, this coordination becomes increasingly difficult. The YARN shared cache allows applications to securely share resources uploaded by a different instance of the same application, a different application all together, or even a different user. We will give an overview of the shared cache architecture, cover the various components that make up the feature, and give a solid foundation for developers who want to build YARN applications that leverage the shared cache. Additionally, we will use the MapReduce application as a case study for discussion about best practices and the benefits we have seen on our production clusters at Twitter.]]>
In this talk, we will give a technical deep dive into the new YARN shared cache feature (i.e. YARN-1492) and explore the benefits we are currently seeing on our production clusters at Twitter. The YARN shared cache aims to optimize the considerable amount of network bandwidth and storage spent on resource localization in YARN. Some of this is mitigated by the NodeManager localization service, but this requires YARN application writers to coordinate resource sharing manually. As YARN deployments continue to grow and the type of YARN applications become more diverse, this coordination becomes increasingly difficult. The YARN shared cache allows applications to securely share resources uploaded by a different instance of the same application, a different application all together, or even a different user. We will give an overview of the shared cache architecture, cover the various components that make up the feature, and give a solid foundation for developers who want to build YARN applications that leverage the shared cache. Additionally, we will use the MapReduce application as a case study for discussion about best practices and the benefits we have seen on our production clusters at Twitter.]]> Thu, 11 Jun 2015 00:14:31 GMT /slideshow/hadoop-summit2015-yarnsharedcachev12/49245564 ctrezzo@slideshare.net(ctrezzo) Hadoop Summit 2015: A Secure Public Cache For YARN Application Resources ctrezzo In this talk, we will give a technical deep dive into the new YARN shared cache feature (i.e. YARN-1492) and explore the benefits we are currently seeing on our production clusters at Twitter. The YARN shared cache aims to optimize the considerable amount of network bandwidth and storage spent on resource localization in YARN. Some of this is mitigated by the NodeManager localization service, but this requires YARN application writers to coordinate resource sharing manually. As YARN deployments continue to grow and the type of YARN applications become more diverse, this coordination becomes increasingly difficult. The YARN shared cache allows applications to securely share resources uploaded by a different instance of the same application, a different application all together, or even a different user. We will give an overview of the shared cache architecture, cover the various components that make up the feature, and give a solid foundation for developers who want to build YARN applications that leverage the shared cache. Additionally, we will use the MapReduce application as a case study for discussion about best practices and the benefits we have seen on our production clusters at Twitter. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/hadoopsummit2015-yarn-shared-cache-v12-150611001431-lva1-app6892-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> In this talk, we will give a technical deep dive into the new YARN shared cache feature (i.e. YARN-1492) and explore the benefits we are currently seeing on our production clusters at Twitter. The YARN shared cache aims to optimize the considerable amount of network bandwidth and storage spent on resource localization in YARN. Some of this is mitigated by the NodeManager localization service, but this requires YARN application writers to coordinate resource sharing manually. As YARN deployments continue to grow and the type of YARN applications become more diverse, this coordination becomes increasingly difficult. The YARN shared cache allows applications to securely share resources uploaded by a different instance of the same application, a different application all together, or even a different user. We will give an overview of the shared cache architecture, cover the various components that make up the feature, and give a solid foundation for developers who want to build YARN applications that leverage the shared cache. Additionally, we will use the MapReduce application as a case study for discussion about best practices and the benefits we have seen on our production clusters at Twitter.
Hadoop Summit 2015: A Secure Public Cache For YARN Application Resources from ctrezzo
]]> 3464 3 https://cdn.slidesharecdn.com/ss_thumbnails/hadoopsummit2015-yarn-shared-cache-v12-150611001431-lva1-app6892-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 HBase Replication /slideshow/ctrezzo-h-basecon13replication/24629562 ctrezzohbasecon13replication-130725151711-phpapp01
A talk given on HBase Replication at HBaseCon 2013.]]>
A talk given on HBase Replication at HBaseCon 2013.]]> Thu, 25 Jul 2013 15:17:11 GMT /slideshow/ctrezzo-h-basecon13replication/24629562 ctrezzo@slideshare.net(ctrezzo) HBase Replication ctrezzo A talk given on HBase Replication at HBaseCon 2013. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/ctrezzohbasecon13replication-130725151711-phpapp01-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> A talk given on HBase Replication at HBaseCon 2013.
HBase Replication from ctrezzo
]]> 4043 2 https://cdn.slidesharecdn.com/ss_thumbnails/ctrezzohbasecon13replication-130725151711-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation White http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 HBase @ Twitter /slideshow/h-base-meetup/24352978 hbasemeetup-130717144217-phpapp01
A presentation given at an HBase meetup hosted at Twitter on 7/16/2013. Authors: Gary Helmling and Chris Trezzo.]]>
A presentation given at an HBase meetup hosted at Twitter on 7/16/2013. Authors: Gary Helmling and Chris Trezzo.]]> Wed, 17 Jul 2013 14:42:17 GMT /slideshow/h-base-meetup/24352978 ctrezzo@slideshare.net(ctrezzo) HBase @ Twitter ctrezzo A presentation given at an HBase meetup hosted at Twitter on 7/16/2013. Authors: Gary Helmling and Chris Trezzo. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/hbasemeetup-130717144217-phpapp01-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> A presentation given at an HBase meetup hosted at Twitter on 7/16/2013. Authors: Gary Helmling and Chris Trezzo.
HBase @ Twitter from ctrezzo
]]> 7643 3 https://cdn.slidesharecdn.com/ss_thumbnails/hbasemeetup-130717144217-phpapp01-thumbnail.jpg?width=120&height=120&fit=bounds presentation White http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 https://public.slidesharecdn.com/v2/images/profile-picture.png https://cdn.slidesharecdn.com/ss_thumbnails/hadoopmeetupmay-shared-cache-v12-no-notes-160504233122-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/a-secure-public-cache-for-yarn-application-resources-61688793/61688793 A Secure Public Cache ... https://cdn.slidesharecdn.com/ss_thumbnails/hadoopsummit2015-yarn-shared-cache-v12-150611001431-lva1-app6892-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/hadoop-summit2015-yarnsharedcachev12/49245564 Hadoop Summit 2015: A ... https://cdn.slidesharecdn.com/ss_thumbnails/ctrezzohbasecon13replication-130725151711-phpapp01-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/ctrezzo-h-basecon13replication/24629562 HBase Replication