ºÝºÝߣshows by User: MingMa4 / http://www.slideshare.net/images/logo.gif ºÝºÝߣshows by User: MingMa4 / Fri, 12 Jun 2015 16:10:52 GMT ºÝºÝߣShare feed for ºÝºÝߣshows by User: MingMa4 Improving HDFS Availability with Hadoop RPC Quality of Service /MingMa4/hadoop-rpcqoshadoopsummit2015 hadoop-rpc-qos-hadoopsummit2015-150612161052-lva1-app6892
Heavy users monopolizing cluster resources is a frequent cause of slowdown for others. With only one namenode and thousands of datanodes, any poorly written application is a potential distributed denial-of-service attack on namenode. In this talk, you will learn how to prevent slowdown from heavy users and poorly-written applications by enabling IPC Quality of Service (QoS), a new feature in Hadoop 2.6+. On Twitter’s and eBay’s production clusters, we’ve seen response times of 500 milliseconds with QoS off drop to 10 milliseconds with QoS on during heavy usage. We’ll cover how IPC QoS works and share our experience on how to tune performance.]]>
Heavy users monopolizing cluster resources is a frequent cause of slowdown for others. With only one namenode and thousands of datanodes, any poorly written application is a potential distributed denial-of-service attack on namenode. In this talk, you will learn how to prevent slowdown from heavy users and poorly-written applications by enabling IPC Quality of Service (QoS), a new feature in Hadoop 2.6+. On Twitter’s and eBay’s production clusters, we’ve seen response times of 500 milliseconds with QoS off drop to 10 milliseconds with QoS on during heavy usage. We’ll cover how IPC QoS works and share our experience on how to tune performance.]]> Fri, 12 Jun 2015 16:10:52 GMT /MingMa4/hadoop-rpcqoshadoopsummit2015 MingMa4@slideshare.net(MingMa4) Improving HDFS Availability with Hadoop RPC Quality of Service MingMa4 Heavy users monopolizing cluster resources is a frequent cause of slowdown for others. With only one namenode and thousands of datanodes, any poorly written application is a potential distributed denial-of-service attack on namenode. In this talk, you will learn how to prevent slowdown from heavy users and poorly-written applications by enabling IPC Quality of Service (QoS), a new feature in Hadoop 2.6+. On Twitter’s and eBay’s production clusters, we’ve seen response times of 500 milliseconds with QoS off drop to 10 milliseconds with QoS on during heavy usage. We’ll cover how IPC QoS works and share our experience on how to tune performance. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/hadoop-rpc-qos-hadoopsummit2015-150612161052-lva1-app6892-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Heavy users monopolizing cluster resources is a frequent cause of slowdown for others. With only one namenode and thousands of datanodes, any poorly written application is a potential distributed denial-of-service attack on namenode. In this talk, you will learn how to prevent slowdown from heavy users and poorly-written applications by enabling IPC Quality of Service (QoS), a new feature in Hadoop 2.6+. On Twitter’s and eBay’s production clusters, we’ve seen response times of 500 milliseconds with QoS off drop to 10 milliseconds with QoS on during heavy usage. We’ll cover how IPC QoS works and share our experience on how to tune performance.
Improving HDFS Availability with Hadoop RPC Quality of Service from Ming Ma
]]> 3986 7 https://cdn.slidesharecdn.com/ss_thumbnails/hadoop-rpc-qos-hadoopsummit2015-150612161052-lva1-app6892-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 https://public.slidesharecdn.com/v2/images/profile-picture.png Proven track records of delivering service/production software/prototype on schedule. Technical and management leadership skills with rich industrial experience in areas such as distributed system, search engine and multimedia technology. http://research.microsoft.com/~mingma/