ºÝºÝߣshows by User: VinayKumarChella / http://www.slideshare.net/images/logo.gif ºÝºÝߣshows by User: VinayKumarChella / Wed, 11 Sep 2019 18:54:52 GMT ºÝºÝߣShare feed for ºÝºÝߣshows by User: VinayKumarChella Building and running cloud native cassandra /slideshow/building-and-running-cloud-native-cassandra-170927934/170927934 buildingandrunningcloud-nativecassandra-190911185453
This session will re-evaluate Cassandra’s relationship with runtime and build systems, pointing out ways that the existing systems fall down, and identifying avenues for improvement. Over the past few years, a number of platforms have emerged for running user code. Container runtimes like Docker, container orchestrators such as Kubernetes, and metrics collections agents like Prometheus and Spectator have all gained popularity and mind-share. Cassandra functionality such as metrics, bootstrapping, and monitoring integrates with the newer paradigms, but in an ad-hoc and improvised fashion. By taking a purposeful approach to integrating with these new methods of deployment, the Cassandra community can more fully benefit from their advertised strengths. The Cassandra build system based on Ant+Ivy dates to the early 2000’s, and reflects legacy complexity that could be avoided with modern build systems. Cassandra’s system package builds are not much better and often fail to integrate with industry standards such as systemd. Iterating on the existing systems is difficult, but this technical debt slows innovation in our build systems. In this talk, we propose solutions to make building, deploying and monitoring Cassandra easy and low overhead, while taking advantage of cloud advancements wherever possible.]]>
This session will re-evaluate Cassandra’s relationship with runtime and build systems, pointing out ways that the existing systems fall down, and identifying avenues for improvement. Over the past few years, a number of platforms have emerged for running user code. Container runtimes like Docker, container orchestrators such as Kubernetes, and metrics collections agents like Prometheus and Spectator have all gained popularity and mind-share. Cassandra functionality such as metrics, bootstrapping, and monitoring integrates with the newer paradigms, but in an ad-hoc and improvised fashion. By taking a purposeful approach to integrating with these new methods of deployment, the Cassandra community can more fully benefit from their advertised strengths. The Cassandra build system based on Ant+Ivy dates to the early 2000’s, and reflects legacy complexity that could be avoided with modern build systems. Cassandra’s system package builds are not much better and often fail to integrate with industry standards such as systemd. Iterating on the existing systems is difficult, but this technical debt slows innovation in our build systems. In this talk, we propose solutions to make building, deploying and monitoring Cassandra easy and low overhead, while taking advantage of cloud advancements wherever possible.]]> Wed, 11 Sep 2019 18:54:52 GMT /slideshow/building-and-running-cloud-native-cassandra-170927934/170927934 VinayKumarChella@slideshare.net(VinayKumarChella) Building and running cloud native cassandra VinayKumarChella This session will re-evaluate Cassandra’s relationship with runtime and build systems, pointing out ways that the existing systems fall down, and identifying avenues for improvement. Over the past few years, a number of platforms have emerged for running user code. Container runtimes like Docker, container orchestrators such as Kubernetes, and metrics collections agents like Prometheus and Spectator have all gained popularity and mind-share. Cassandra functionality such as metrics, bootstrapping, and monitoring integrates with the newer paradigms, but in an ad-hoc and improvised fashion. By taking a purposeful approach to integrating with these new methods of deployment, the Cassandra community can more fully benefit from their advertised strengths. The Cassandra build system based on Ant+Ivy dates to the early 2000’s, and reflects legacy complexity that could be avoided with modern build systems. Cassandra’s system package builds are not much better and often fail to integrate with industry standards such as systemd. Iterating on the existing systems is difficult, but this technical debt slows innovation in our build systems. In this talk, we propose solutions to make building, deploying and monitoring Cassandra easy and low overhead, while taking advantage of cloud advancements wherever possible. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/buildingandrunningcloud-nativecassandra-190911185453-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> This session will re-evaluate Cassandra’s relationship with runtime and build systems, pointing out ways that the existing systems fall down, and identifying avenues for improvement. Over the past few years, a number of platforms have emerged for running user code. Container runtimes like Docker, container orchestrators such as Kubernetes, and metrics collections agents like Prometheus and Spectator have all gained popularity and mind-share. Cassandra functionality such as metrics, bootstrapping, and monitoring integrates with the newer paradigms, but in an ad-hoc and improvised fashion. By taking a purposeful approach to integrating with these new methods of deployment, the Cassandra community can more fully benefit from their advertised strengths. The Cassandra build system based on Ant+Ivy dates to the early 2000’s, and reflects legacy complexity that could be avoided with modern build systems. Cassandra’s system package builds are not much better and often fail to integrate with industry standards such as systemd. Iterating on the existing systems is difficult, but this technical debt slows innovation in our build systems. In this talk, we propose solutions to make building, deploying and monitoring Cassandra easy and low overhead, while taking advantage of cloud advancements wherever possible.
Building and running cloud native cassandra from Vinay Kumar Chella
]]> 1591 2 https://cdn.slidesharecdn.com/ss_thumbnails/buildingandrunningcloud-nativecassandra-190911185453-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 How netflix manages petabyte scale apache cassandra in the cloud /slideshow/how-netflix-manages-petabyte-scale-apache-cassandra-in-the-cloud/170926413 hownetflixmanagespetabytescaleapachecassandrainthecloud-190911184426
At Netflix, we manage petabytes of data in Apache Cassandra which must be reliably accessible to users in mere milliseconds. To achieve this, we have built sophisticated control planes that turn our persistence layer based on Apache Cassandra into a truly self-driving system. We will start with the user interface that Netflix developers use to interact with their Cassandra databases and dive deep into the automation that powers it all. From cluster creation, through scaling up, to cluster death, complex automation drives large fleets of virtual machines hosted on the AWS cloud. First, we will cover the basics of how Netflix deploys Apache Cassandra. In particular, this begins with how we mold Apache Cassandra to the Netflix philosophy of immutable infrastructure, including managing software and hardware upgrades in the face of ever-failing hardware. Then we will explore the concrete techniques needed for such a massive deployment, specifically pull-based control planes and auto-healing strategies. Next, we will cover how Netflix has automated complex but critical Apache Cassandra maintenance tasks such as continuous snapshot backups and always-on anti-entropy repair for keeping our datasets safe and consistent. Both of these systems have gone through multiple architectural evolutions, and we have learned many lessons along the way. Lastly, we will share some of the ways this has gone wrong, and what you can do to avoid them. We will cover a few case studies of major Cassandra outages at Netflix, their root cause, and what we learned from those incidents. At the end of this talk, we hope that participants leave with concrete understanding of the challenges in running massive scale Apache Cassandra as well as solid advice and techniques for building their own self-driving data persistence layer.]]>
At Netflix, we manage petabytes of data in Apache Cassandra which must be reliably accessible to users in mere milliseconds. To achieve this, we have built sophisticated control planes that turn our persistence layer based on Apache Cassandra into a truly self-driving system. We will start with the user interface that Netflix developers use to interact with their Cassandra databases and dive deep into the automation that powers it all. From cluster creation, through scaling up, to cluster death, complex automation drives large fleets of virtual machines hosted on the AWS cloud. First, we will cover the basics of how Netflix deploys Apache Cassandra. In particular, this begins with how we mold Apache Cassandra to the Netflix philosophy of immutable infrastructure, including managing software and hardware upgrades in the face of ever-failing hardware. Then we will explore the concrete techniques needed for such a massive deployment, specifically pull-based control planes and auto-healing strategies. Next, we will cover how Netflix has automated complex but critical Apache Cassandra maintenance tasks such as continuous snapshot backups and always-on anti-entropy repair for keeping our datasets safe and consistent. Both of these systems have gone through multiple architectural evolutions, and we have learned many lessons along the way. Lastly, we will share some of the ways this has gone wrong, and what you can do to avoid them. We will cover a few case studies of major Cassandra outages at Netflix, their root cause, and what we learned from those incidents. At the end of this talk, we hope that participants leave with concrete understanding of the challenges in running massive scale Apache Cassandra as well as solid advice and techniques for building their own self-driving data persistence layer.]]> Wed, 11 Sep 2019 18:44:26 GMT /slideshow/how-netflix-manages-petabyte-scale-apache-cassandra-in-the-cloud/170926413 VinayKumarChella@slideshare.net(VinayKumarChella) How netflix manages petabyte scale apache cassandra in the cloud VinayKumarChella At Netflix, we manage petabytes of data in Apache Cassandra which must be reliably accessible to users in mere milliseconds. To achieve this, we have built sophisticated control planes that turn our persistence layer based on Apache Cassandra into a truly self-driving system. We will start with the user interface that Netflix developers use to interact with their Cassandra databases and dive deep into the automation that powers it all. From cluster creation, through scaling up, to cluster death, complex automation drives large fleets of virtual machines hosted on the AWS cloud. First, we will cover the basics of how Netflix deploys Apache Cassandra. In particular, this begins with how we mold Apache Cassandra to the Netflix philosophy of immutable infrastructure, including managing software and hardware upgrades in the face of ever-failing hardware. Then we will explore the concrete techniques needed for such a massive deployment, specifically pull-based control planes and auto-healing strategies. Next, we will cover how Netflix has automated complex but critical Apache Cassandra maintenance tasks such as continuous snapshot backups and always-on anti-entropy repair for keeping our datasets safe and consistent. Both of these systems have gone through multiple architectural evolutions, and we have learned many lessons along the way. Lastly, we will share some of the ways this has gone wrong, and what you can do to avoid them. We will cover a few case studies of major Cassandra outages at Netflix, their root cause, and what we learned from those incidents. At the end of this talk, we hope that participants leave with concrete understanding of the challenges in running massive scale Apache Cassandra as well as solid advice and techniques for building their own self-driving data persistence layer. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/hownetflixmanagespetabytescaleapachecassandrainthecloud-190911184426-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> At Netflix, we manage petabytes of data in Apache Cassandra which must be reliably accessible to users in mere milliseconds. To achieve this, we have built sophisticated control planes that turn our persistence layer based on Apache Cassandra into a truly self-driving system. We will start with the user interface that Netflix developers use to interact with their Cassandra databases and dive deep into the automation that powers it all. From cluster creation, through scaling up, to cluster death, complex automation drives large fleets of virtual machines hosted on the AWS cloud. First, we will cover the basics of how Netflix deploys Apache Cassandra. In particular, this begins with how we mold Apache Cassandra to the Netflix philosophy of immutable infrastructure, including managing software and hardware upgrades in the face of ever-failing hardware. Then we will explore the concrete techniques needed for such a massive deployment, specifically pull-based control planes and auto-healing strategies. Next, we will cover how Netflix has automated complex but critical Apache Cassandra maintenance tasks such as continuous snapshot backups and always-on anti-entropy repair for keeping our datasets safe and consistent. Both of these systems have gone through multiple architectural evolutions, and we have learned many lessons along the way. Lastly, we will share some of the ways this has gone wrong, and what you can do to avoid them. We will cover a few case studies of major Cassandra outages at Netflix, their root cause, and what we learned from those incidents. At the end of this talk, we hope that participants leave with concrete understanding of the challenges in running massive scale Apache Cassandra as well as solid advice and techniques for building their own self-driving data persistence layer.
How netflix manages petabyte scale apache cassandra in the cloud from Vinay Kumar Chella
]]> 7015 8 https://cdn.slidesharecdn.com/ss_thumbnails/hownetflixmanagespetabytescaleapachecassandrainthecloud-190911184426-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Safer restarts, faster streaming, and better repair, just a glimpse of cassandra 4.0 /VinayKumarChella/safer-restarts-faster-streaming-and-better-repair-just-a-glimpse-of-cassandra-40-147316009 saferrestartsfasterstreamingandbetterrepairjustaglimpseofcassandra4-190523183641
Safer restarts, faster streaming, and better repair, just a glimpse of Cassandra 4.0]]>
Safer restarts, faster streaming, and better repair, just a glimpse of Cassandra 4.0]]> Thu, 23 May 2019 18:36:41 GMT /VinayKumarChella/safer-restarts-faster-streaming-and-better-repair-just-a-glimpse-of-cassandra-40-147316009 VinayKumarChella@slideshare.net(VinayKumarChella) Safer restarts, faster streaming, and better repair, just a glimpse of cassandra 4.0 VinayKumarChella Safer restarts, faster streaming, and better repair, just a glimpse of Cassandra 4.0 <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/saferrestartsfasterstreamingandbetterrepairjustaglimpseofcassandra4-190523183641-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Safer restarts, faster streaming, and better repair, just a glimpse of Cassandra 4.0
Safer restarts, faster streaming, and better repair, just a glimpse of cassandra 4.0 from Vinay Kumar Chella
]]> 870 2 https://cdn.slidesharecdn.com/ss_thumbnails/saferrestartsfasterstreamingandbetterrepairjustaglimpseofcassandra4-190523183641-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Live traffic capture and replay in cassandra 4.0 /slideshow/live-traffic-capture-and-replay-in-cassandra-40-147315678/147315678 livetrafficcaptureandreplayincassandra4-190523183525
Capturing live traffic in a typical micro-services setup is one of the industry standard strategies for various needs including testing, canary, and dark launches, but when it comes to databases, capturing and replaying live traffic is quite challenging but equally critical. Cassandra is one of the few databases which supports a live traffic capture and replay feature out of the box starting with 4.0. As part of this talk, Vinay Chella will dive deeper into the query logging framework that is introduced in Cassandra 4.0, and the features built on top of this framework, including full query logging, audit logging, and traffic replay. At end of this talk, you will learn how to use audit logging, live traffic capture and replay features in the upcoming release of Cassandra.]]>
Capturing live traffic in a typical micro-services setup is one of the industry standard strategies for various needs including testing, canary, and dark launches, but when it comes to databases, capturing and replaying live traffic is quite challenging but equally critical. Cassandra is one of the few databases which supports a live traffic capture and replay feature out of the box starting with 4.0. As part of this talk, Vinay Chella will dive deeper into the query logging framework that is introduced in Cassandra 4.0, and the features built on top of this framework, including full query logging, audit logging, and traffic replay. At end of this talk, you will learn how to use audit logging, live traffic capture and replay features in the upcoming release of Cassandra.]]> Thu, 23 May 2019 18:35:25 GMT /slideshow/live-traffic-capture-and-replay-in-cassandra-40-147315678/147315678 VinayKumarChella@slideshare.net(VinayKumarChella) Live traffic capture and replay in cassandra 4.0 VinayKumarChella Capturing live traffic in a typical micro-services setup is one of the industry standard strategies for various needs including testing, canary, and dark launches, but when it comes to databases, capturing and replaying live traffic is quite challenging but equally critical. Cassandra is one of the few databases which supports a live traffic capture and replay feature out of the box starting with 4.0. As part of this talk, Vinay Chella will dive deeper into the query logging framework that is introduced in Cassandra 4.0, and the features built on top of this framework, including full query logging, audit logging, and traffic replay. At end of this talk, you will learn how to use audit logging, live traffic capture and replay features in the upcoming release of Cassandra. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/livetrafficcaptureandreplayincassandra4-190523183525-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Capturing live traffic in a typical micro-services setup is one of the industry standard strategies for various needs including testing, canary, and dark launches, but when it comes to databases, capturing and replaying live traffic is quite challenging but equally critical. Cassandra is one of the few databases which supports a live traffic capture and replay feature out of the box starting with 4.0. As part of this talk, Vinay Chella will dive deeper into the query logging framework that is introduced in Cassandra 4.0, and the features built on top of this framework, including full query logging, audit logging, and traffic replay. At end of this talk, you will learn how to use audit logging, live traffic capture and replay features in the upcoming release of Cassandra.
Live traffic capture and replay in cassandra 4.0 from Vinay Kumar Chella
]]> 875 1 https://cdn.slidesharecdn.com/ss_thumbnails/livetrafficcaptureandreplayincassandra4-190523183525-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Cassandra serving netflix @ scale /slideshow/cassandra-serving-netflix-scale/114950783 cassandraservingnetflixscale-180917074839
This talk is from ApacheCon North America 2017 - Cassandra serving netflix @ scale - https://apachecon2017.sched.com/event/9zvG/cassandra-serving-netflix-scale-vinay-chella-netflix https://www.youtube.com/watch?v=2l0_onmQsPI&index=3&t=284s&list=PL7uQt4PWyRW0XoVhEnNcSdCw5ufLEn9HA]]>
This talk is from ApacheCon North America 2017 - Cassandra serving netflix @ scale - https://apachecon2017.sched.com/event/9zvG/cassandra-serving-netflix-scale-vinay-chella-netflix https://www.youtube.com/watch?v=2l0_onmQsPI&index=3&t=284s&list=PL7uQt4PWyRW0XoVhEnNcSdCw5ufLEn9HA]]> Mon, 17 Sep 2018 07:48:39 GMT /slideshow/cassandra-serving-netflix-scale/114950783 VinayKumarChella@slideshare.net(VinayKumarChella) Cassandra serving netflix @ scale VinayKumarChella This talk is from ApacheCon North America 2017 - Cassandra serving netflix @ scale - https://apachecon2017.sched.com/event/9zvG/cassandra-serving-netflix-scale-vinay-chella-netflix https://www.youtube.com/watch?v=2l0_onmQsPI&index=3&t=284s&list=PL7uQt4PWyRW0XoVhEnNcSdCw5ufLEn9HA <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/cassandraservingnetflixscale-180917074839-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> This talk is from ApacheCon North America 2017 - Cassandra serving netflix @ scale - https://apachecon2017.sched.com/event/9zvG/cassandra-serving-netflix-scale-vinay-chella-netflix https://www.youtube.com/watch?v=2l0_onmQsPI&amp;index=3&amp;t=284s&amp;list=PL7uQt4PWyRW0XoVhEnNcSdCw5ufLEn9HA
Cassandra serving netflix @ scale from Vinay Kumar Chella
]]> 2967 3 https://cdn.slidesharecdn.com/ss_thumbnails/cassandraservingnetflixscale-180917074839-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Query and audit logging in cassandra /slideshow/query-and-audit-logging-in-cassandra/114949096 queryandauditloggingincassandra-180917073623
This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#chella Audit logging is one of the most critical features in an enterprise-ready database in terms of security compliance. Furthermore, live traffic troubleshooting is critical for operators to troubleshoot production issues quickly. While past versions have lacked these critical features, the Cassandra team understood the need for better solutions and in the upcoming release of Cassandra both of these features now come out of the box which makes Cassandra even more awesome to work with. Cassandra now supports Audit logging and query logging as part of C* itself. As part of this talk, audience will learn about how to enable, configure, and tune audit logging for their C* clusters and how to log live traffic/queries for serverel needs including troubleshooting or even live traffic reply]]>
This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#chella Audit logging is one of the most critical features in an enterprise-ready database in terms of security compliance. Furthermore, live traffic troubleshooting is critical for operators to troubleshoot production issues quickly. While past versions have lacked these critical features, the Cassandra team understood the need for better solutions and in the upcoming release of Cassandra both of these features now come out of the box which makes Cassandra even more awesome to work with. Cassandra now supports Audit logging and query logging as part of C* itself. As part of this talk, audience will learn about how to enable, configure, and tune audit logging for their C* clusters and how to log live traffic/queries for serverel needs including troubleshooting or even live traffic reply]]> Mon, 17 Sep 2018 07:36:23 GMT /slideshow/query-and-audit-logging-in-cassandra/114949096 VinayKumarChella@slideshare.net(VinayKumarChella) Query and audit logging in cassandra VinayKumarChella This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#chella Audit logging is one of the most critical features in an enterprise-ready database in terms of security compliance. Furthermore, live traffic troubleshooting is critical for operators to troubleshoot production issues quickly. While past versions have lacked these critical features, the Cassandra team understood the need for better solutions and in the upcoming release of Cassandra both of these features now come out of the box which makes Cassandra even more awesome to work with. Cassandra now supports Audit logging and query logging as part of C* itself. As part of this talk, audience will learn about how to enable, configure, and tune audit logging for their C* clusters and how to log live traffic/queries for serverel needs including troubleshooting or even live traffic reply <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/queryandauditloggingincassandra-180917073623-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#chella Audit logging is one of the most critical features in an enterprise-ready database in terms of security compliance. Furthermore, live traffic troubleshooting is critical for operators to troubleshoot production issues quickly. While past versions have lacked these critical features, the Cassandra team understood the need for better solutions and in the upcoming release of Cassandra both of these features now come out of the box which makes Cassandra even more awesome to work with. Cassandra now supports Audit logging and query logging as part of C* itself. As part of this talk, audience will learn about how to enable, configure, and tune audit logging for their C* clusters and how to log live traffic/queries for serverel needs including troubleshooting or even live traffic reply
Query and audit logging in cassandra from Vinay Kumar Chella
]]> 3401 3 https://cdn.slidesharecdn.com/ss_thumbnails/queryandauditloggingincassandra-180917073623-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Looking towards an official cassandra sidecar netflix /slideshow/looking-towards-an-official-cassandra-sidecar-netflix/114948831 lookingtowardsanofficialcassandrasidecar-netflix-180917073400
This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#netflix2 Operating C* can involve a lot of required manpower, complex automation, or both. Some of this complexity comes from operational/configuration activity of the underlying kernel and hardware but much of it is operation complexity stemming from C* itself. Some examples of this complexity are restarting the database in a safe way, reliability backing up and restoring snapshots, monitoring the health of the datastore, and even ensuring eventual consistency through repair. As a result of these complexities, C* operators end up with complicated operational setups, which are expensive to build, manage and monitor. As part of this talk, we will share lessons learned in managing such complexity via our Priam sidecar including recent innovations in how our sidecar ensures the highest possible uptime and correctness of Cassandra. We then use this to motivate building in the management sidecar directly as part of C* itself (CASSANDRA-14395). ]]>
This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#netflix2 Operating C* can involve a lot of required manpower, complex automation, or both. Some of this complexity comes from operational/configuration activity of the underlying kernel and hardware but much of it is operation complexity stemming from C* itself. Some examples of this complexity are restarting the database in a safe way, reliability backing up and restoring snapshots, monitoring the health of the datastore, and even ensuring eventual consistency through repair. As a result of these complexities, C* operators end up with complicated operational setups, which are expensive to build, manage and monitor. As part of this talk, we will share lessons learned in managing such complexity via our Priam sidecar including recent innovations in how our sidecar ensures the highest possible uptime and correctness of Cassandra. We then use this to motivate building in the management sidecar directly as part of C* itself (CASSANDRA-14395). ]]> Mon, 17 Sep 2018 07:34:00 GMT /slideshow/looking-towards-an-official-cassandra-sidecar-netflix/114948831 VinayKumarChella@slideshare.net(VinayKumarChella) Looking towards an official cassandra sidecar netflix VinayKumarChella This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#netflix2 Operating C* can involve a lot of required manpower, complex automation, or both. Some of this complexity comes from operational/configuration activity of the underlying kernel and hardware but much of it is operation complexity stemming from C* itself. Some examples of this complexity are restarting the database in a safe way, reliability backing up and restoring snapshots, monitoring the health of the datastore, and even ensuring eventual consistency through repair. As a result of these complexities, C* operators end up with complicated operational setups, which are expensive to build, manage and monitor. As part of this talk, we will share lessons learned in managing such complexity via our Priam sidecar including recent innovations in how our sidecar ensures the highest possible uptime and correctness of Cassandra. We then use this to motivate building in the management sidecar directly as part of C* itself (CASSANDRA-14395). <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/lookingtowardsanofficialcassandrasidecar-netflix-180917073400-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> This talk is from Distributed Data Summit SF 2018 - http://distributeddatasummit.com/2018-sf/sessions#netflix2 Operating C* can involve a lot of required manpower, complex automation, or both. Some of this complexity comes from operational/configuration activity of the underlying kernel and hardware but much of it is operation complexity stemming from C* itself. Some examples of this complexity are restarting the database in a safe way, reliability backing up and restoring snapshots, monitoring the health of the datastore, and even ensuring eventual consistency through repair. As a result of these complexities, C* operators end up with complicated operational setups, which are expensive to build, manage and monitor. As part of this talk, we will share lessons learned in managing such complexity via our Priam sidecar including recent innovations in how our sidecar ensures the highest possible uptime and correctness of Cassandra. We then use this to motivate building in the management sidecar directly as part of C* itself (CASSANDRA-14395).
Looking towards an official cassandra sidecar netflix from Vinay Kumar Chella
]]> 3001 1 https://cdn.slidesharecdn.com/ss_thumbnails/lookingtowardsanofficialcassandrasidecar-netflix-180917073400-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 A glimpse of cassandra 4.0 features netflix /slideshow/a-glimpse-of-cassandra-40-features-netflix/102195635 aglimpseofcassandra4-180612200401
These slides are from the recent meetup @ Uber - Apache Cassandra at Uber and Netflix on new features in 4.0. Abstract: A glimpse of Cassandra 4.0 features: There are a lot of exciting features coming in 4.0, but this talk covers some of the features that we at Netflix are particularly excited about and looking forward to. In this talk, we present an overview of just some of the many improvements shipping soon in 4.0. ]]>
These slides are from the recent meetup @ Uber - Apache Cassandra at Uber and Netflix on new features in 4.0. Abstract: A glimpse of Cassandra 4.0 features: There are a lot of exciting features coming in 4.0, but this talk covers some of the features that we at Netflix are particularly excited about and looking forward to. In this talk, we present an overview of just some of the many improvements shipping soon in 4.0. ]]> Tue, 12 Jun 2018 20:04:01 GMT /slideshow/a-glimpse-of-cassandra-40-features-netflix/102195635 VinayKumarChella@slideshare.net(VinayKumarChella) A glimpse of cassandra 4.0 features netflix VinayKumarChella These slides are from the recent meetup @ Uber - Apache Cassandra at Uber and Netflix on new features in 4.0. Abstract: A glimpse of Cassandra 4.0 features: There are a lot of exciting features coming in 4.0, but this talk covers some of the features that we at Netflix are particularly excited about and looking forward to. In this talk, we present an overview of just some of the many improvements shipping soon in 4.0. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/aglimpseofcassandra4-180612200401-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> These slides are from the recent meetup @ Uber - Apache Cassandra at Uber and Netflix on new features in 4.0. Abstract: A glimpse of Cassandra 4.0 features: There are a lot of exciting features coming in 4.0, but this talk covers some of the features that we at Netflix are particularly excited about and looking forward to. In this talk, we present an overview of just some of the many improvements shipping soon in 4.0.
A glimpse of cassandra 4.0 features netflix from Vinay Kumar Chella
]]> 6535 7 https://cdn.slidesharecdn.com/ss_thumbnails/aglimpseofcassandra4-180612200401-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Data Stores @ Netflix /slideshow/data-stores-netflix/75115416 datastoresnetflix-170418045825
Data Stores @ Netflix Cassandra Architecture and Scalability on AWS ]]>
Data Stores @ Netflix Cassandra Architecture and Scalability on AWS ]]> Tue, 18 Apr 2017 04:58:25 GMT /slideshow/data-stores-netflix/75115416 VinayKumarChella@slideshare.net(VinayKumarChella) Data Stores @ Netflix VinayKumarChella Data Stores @ Netflix Cassandra Architecture and Scalability on AWS <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/datastoresnetflix-170418045825-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Data Stores @ Netflix Cassandra Architecture and Scalability on AWS
Data Stores @ Netflix from Vinay Kumar Chella
]]> 1643 5 https://cdn.slidesharecdn.com/ss_thumbnails/datastoresnetflix-170418045825-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Honest performance testing with NDBench /slideshow/honest-performance-testing-with-ndbench/66450517 honestperformancetestingwithndbenchv1-160927044152
Apache Cassandra makes it possible to execute millions of operations per second in scalable fashion. Harnessing the power of C* leaves many developers pondering about the following:   - Is my data model appropriate and not going to end up as wide partition(s) causing heap pressure and other issues? - How do I tune my connection pool configuration? What are the optimal settings for my environment ? - What is my C* cluster capacity in terms of number of IOPs for a given 95th and 99th latency? - How do I perf-test my data access layer?   In this talk, Vinay Chella, Cloud Data Architect @ Netflix, will share open source tools, techniques and platform(NDBench) that Netflix uses to perf-test their C* fleet with simulations millions of operations per second. ]]>
Apache Cassandra makes it possible to execute millions of operations per second in scalable fashion. Harnessing the power of C* leaves many developers pondering about the following:   - Is my data model appropriate and not going to end up as wide partition(s) causing heap pressure and other issues? - How do I tune my connection pool configuration? What are the optimal settings for my environment ? - What is my C* cluster capacity in terms of number of IOPs for a given 95th and 99th latency? - How do I perf-test my data access layer?   In this talk, Vinay Chella, Cloud Data Architect @ Netflix, will share open source tools, techniques and platform(NDBench) that Netflix uses to perf-test their C* fleet with simulations millions of operations per second. ]]> Tue, 27 Sep 2016 04:41:52 GMT /slideshow/honest-performance-testing-with-ndbench/66450517 VinayKumarChella@slideshare.net(VinayKumarChella) Honest performance testing with NDBench VinayKumarChella Apache Cassandra makes it possible to execute millions of operations per second in scalable fashion. Harnessing the power of C* leaves many developers pondering about the following:   - Is my data model appropriate and not going to end up as wide partition(s) causing heap pressure and other issues? - How do I tune my connection pool configuration? What are the optimal settings for my environment ? - What is my C* cluster capacity in terms of number of IOPs for a given 95th and 99th latency? - How do I perf-test my data access layer?   In this talk, Vinay Chella, Cloud Data Architect @ Netflix, will share open source tools, techniques and platform(NDBench) that Netflix uses to perf-test their C* fleet with simulations millions of operations per second. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/honestperformancetestingwithndbenchv1-160927044152-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Apache Cassandra makes it possible to execute millions of operations per second in scalable fashion. Harnessing the power of C* leaves many developers pondering about the following:   - Is my data model appropriate and not going to end up as wide partition(s) causing heap pressure and other issues? - How do I tune my connection pool configuration? What are the optimal settings for my environment ? - What is my C* cluster capacity in terms of number of IOPs for a given 95th and 99th latency? - How do I perf-test my data access layer?   In this talk, Vinay Chella, Cloud Data Architect @ Netflix, will share open source tools, techniques and platform(NDBench) that Netflix uses to perf-test their C* fleet with simulations millions of operations per second.
Honest performance testing with NDBench from Vinay Kumar Chella
]]> 818 5 https://cdn.slidesharecdn.com/ss_thumbnails/honestperformancetestingwithndbenchv1-160927044152-thumbnail.jpg?width=120&height=120&fit=bounds presentation Black http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 Real world repairs /slideshow/real-world-repairs-66450453/66450453 realworldrepairsv1-160927043730
At a millions of operation/sec entropy is inevitable. How does Netflix deal with this data inconsistency? and What it takes Netflix to repair their fleet of C* systems for keeping Entropy to it’s minimum? In this talk, Vinay Chella, Cloud Data Architect @ Netflix will shed light on Netflix's AntiEntropy strategy and problems that arise at scale. He will discuss repair strategies and how Netflix repairs petabytes of data while maintaining a strict SLA for client applications and giving seamless movie experience to its customers . Come learn about different repair strategies, tools and techniques to repair your C* clusters. ]]>
At a millions of operation/sec entropy is inevitable. How does Netflix deal with this data inconsistency? and What it takes Netflix to repair their fleet of C* systems for keeping Entropy to it’s minimum? In this talk, Vinay Chella, Cloud Data Architect @ Netflix will shed light on Netflix's AntiEntropy strategy and problems that arise at scale. He will discuss repair strategies and how Netflix repairs petabytes of data while maintaining a strict SLA for client applications and giving seamless movie experience to its customers . Come learn about different repair strategies, tools and techniques to repair your C* clusters. ]]> Tue, 27 Sep 2016 04:37:30 GMT /slideshow/real-world-repairs-66450453/66450453 VinayKumarChella@slideshare.net(VinayKumarChella) Real world repairs VinayKumarChella At a millions of operation/sec entropy is inevitable. How does Netflix deal with this data inconsistency? and What it takes Netflix to repair their fleet of C* systems for keeping Entropy to it’s minimum? In this talk, Vinay Chella, Cloud Data Architect @ Netflix will shed light on Netflix's AntiEntropy strategy and problems that arise at scale. He will discuss repair strategies and how Netflix repairs petabytes of data while maintaining a strict SLA for client applications and giving seamless movie experience to its customers . Come learn about different repair strategies, tools and techniques to repair your C* clusters. <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/realworldrepairsv1-160927043730-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> At a millions of operation/sec entropy is inevitable. How does Netflix deal with this data inconsistency? and What it takes Netflix to repair their fleet of C* systems for keeping Entropy to it’s minimum? In this talk, Vinay Chella, Cloud Data Architect @ Netflix will shed light on Netflix&#39;s AntiEntropy strategy and problems that arise at scale. He will discuss repair strategies and how Netflix repairs petabytes of data while maintaining a strict SLA for client applications and giving seamless movie experience to its customers . Come learn about different repair strategies, tools and techniques to repair your C* clusters.
Real world repairs from Vinay Kumar Chella
]]> 466 2 https://cdn.slidesharecdn.com/ss_thumbnails/realworldrepairsv1-160927043730-thumbnail.jpg?width=120&height=120&fit=bounds presentation 000000 http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 CassandraSummit2015_Cassandra upgrades at scale @ NETFLIX /slideshow/cassandrasummit2015cassandra-upgrades-at-scale-netflix/53236135 1vjtlcxpr32ldjnwfhkh-signature-b0ab1ccdd5a316bc765714aa4479884fbb14f278b1c8a61326db0f0550f432c9-poli-150927033019-lva1-app6891
Cassandra Summit 2015 http://cassandrasummit-datastax.com/agenda/cassandra-upgrades-at-scale-netflix/]]>
Cassandra Summit 2015 http://cassandrasummit-datastax.com/agenda/cassandra-upgrades-at-scale-netflix/]]> Sun, 27 Sep 2015 03:30:19 GMT /slideshow/cassandrasummit2015cassandra-upgrades-at-scale-netflix/53236135 VinayKumarChella@slideshare.net(VinayKumarChella) CassandraSummit2015_Cassandra upgrades at scale @ NETFLIX VinayKumarChella Cassandra Summit 2015 http://cassandrasummit-datastax.com/agenda/cassandra-upgrades-at-scale-netflix/ <img style="border:1px solid #C3E6D8;float:right;" alt="" src="https://cdn.slidesharecdn.com/ss_thumbnails/1vjtlcxpr32ldjnwfhkh-signature-b0ab1ccdd5a316bc765714aa4479884fbb14f278b1c8a61326db0f0550f432c9-poli-150927033019-lva1-app6891-thumbnail.jpg?width=120&amp;height=120&amp;fit=bounds" /><br> Cassandra Summit 2015 http://cassandrasummit-datastax.com/agenda/cassandra-upgrades-at-scale-netflix/
CassandraSummit2015_Cassandra upgrades at scale @ NETFLIX from Vinay Kumar Chella
]]> 832 4 https://cdn.slidesharecdn.com/ss_thumbnails/1vjtlcxpr32ldjnwfhkh-signature-b0ab1ccdd5a316bc765714aa4479884fbb14f278b1c8a61326db0f0550f432c9-poli-150927033019-lva1-app6891-thumbnail.jpg?width=120&height=120&fit=bounds presentation 000000 http://activitystrea.ms/schema/1.0/post http://activitystrea.ms/schema/1.0/posted 0 https://cdn.slidesharecdn.com/profile-photo-VinayKumarChella-48x48.jpg?cb=1629235517  Strong experience in architect and development of NOSQL (Cassandra and MongoDB) Solutions, SQL Server Business Intelligence solutions, Client/Server and Web Based Applications. Involved in analysis, design and development of complex systems under Cassandra, SSIS, SSAS, Java, ASP.Net, C# .Net, SQL Server 2005/ 2008, Excel VBA, WCF  Ability to work on complex architectural projects as well as to design and build robust systems in NOSQL, Business Intelligence and Web Based applications  Ability to participate in a team environment and communicate effectively http://vinaykumarchella.wordpress.com https://cdn.slidesharecdn.com/ss_thumbnails/buildingandrunningcloud-nativecassandra-190911185453-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/building-and-running-cloud-native-cassandra-170927934/170927934 Building and running c... https://cdn.slidesharecdn.com/ss_thumbnails/hownetflixmanagespetabytescaleapachecassandrainthecloud-190911184426-thumbnail.jpg?width=320&height=320&fit=bounds slideshow/how-netflix-manages-petabyte-scale-apache-cassandra-in-the-cloud/170926413 How netflix manages pe... https://cdn.slidesharecdn.com/ss_thumbnails/saferrestartsfasterstreamingandbetterrepairjustaglimpseofcassandra4-190523183641-thumbnail.jpg?width=320&height=320&fit=bounds VinayKumarChella/safer-restarts-faster-streaming-and-better-repair-just-a-glimpse-of-cassandra-40-147316009 Safer restarts, faster...