ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo

Future Proofing MySQL by Robert Hodges, Continuent

?
?
Eero Teerikorpi
Eero Teerikorpi

Future-proofing = creating systems that last while parts change and improve. MySQL is not losing out to other solutions for data management. The real problem is using MySQL as a building block with other technologies that are changing rapidly.

1 of 21
Download to read offline
Future-Proofing MySQL for the Worldwide Data Revolution Robert Hodges, CEO ?Continuent 2012.
What is Future-Proo!ng? ? Future-proo!ng = creating systems that last while parts change and improve ? MySQL is not losing out to other solutions for data management ? The real problem is using MySQL as a building block with other technologies that are changing rapidly ?Continuent 2012 2
But Wait... Isn¡¯t MySQL Dead?? MySQL ¡°You were so open¡± Born May 25, 1995 Died 2008, 2009, 2010, 2011, 2012, ... ?Continuent 2012 3
Oracle/MySQL 5.6 Replication (On the Way) ? Global transaction IDs ? Parallel slave threads ? Crash safe slaves ? Optimized row updates ? Time delay replication ? Informational log events ?Continuent 2012 4
Galera Synchronous Clusters (New Arrival in 2012) ? Multi-master for InnoDB ? Synchronous replication avoids data loss ? Automatic cluster membership management ? Simple node provisioning model ? Based on innovative state-machine work from Fernando Pedone ?Continuent 2012 5
Tungsten Async Replication (2011 Belle of the Ball) ? All 5.6 features including parallel replication for MySQL 5.0 onwards ? Optimized support for failover ? Programmable transaction !ltering ? Backup/restore integration ? Multi-master, fan-in, and star replication ? Replication to/from Oracle and batch loading of data warehouses ? Replication to MongoDB ?Continuent 2012 6
Not Bad for a Dying Market THE$TOTAL$MARKET$FOR$MYSQL,$NOSQL$$ My/NewSQL,' AND$NEWSQL$$ 5%' NewSQL,'2%' 1000" 900" NoSQL,'5%' 800" 700" 600" Text 500" MySQL,'88%' 400" 300" 200" 100" 0" (451Group) 2011" 2012" 2013" 2014" 2015" ?Continuent 2012 7
MySQL Is Part of Bigger Trends ? Cloud and Big Data investment dwarf the MySQL marketplace ?Continuent 2012 8
21st Century CRM/Call Center Fat Client CRM Web CRM Web Accounting Application Application Call Session Data Online Legacy Transaction Hadoop Oracle Processing Analytics On-Premise Amazon Web Services Telephony Telephony Data Streams Data Streams ?Continuent 2012 9
Revolutionary Challenges for MySQL ? Failures in unstable cloud environments ? Zero-downtime maintenance ? Rapidly growing data volumes, esp. in cloud ? Distributing data to geographical regions ? Integration between MySQL, NoSQL, commercial RDBMS ? Supplying real-time analytics ? Technology upgrade/replacement ?Continuent 2012 10
The Cure for Mixed System Spaghetti Data Fabrics Encapsulated, fault-tolerant, horizontally scalable, globally accessible, integrated data ?Continuent 2012 11
Data Fabric Design Patterns ? Connector ? Fault-Tolerant Data Service Tungsten Connector ? Sharded Data Service ? Multi-Site Data Service ? Real-Time Data Bridge Three-node Tungsten Cluster ?Continuent 2012 12
1. Connector ? Single point of entry for applications ? Service catalog locates data within fabric ? Transparent connectivity, multiple protocols ? Security, auditing, performance management Connector Application Application Stack Stack Connector ?Continuent 2012 13
2. Fault-Tolerant Data Service ? Encapsulate redundant database copies ? Sync and async clustering models ? Protect against local DBMS failure ? Rolling maintenance of replicas Master/ Multi- Slave Master ?Continuent 2012 14
3. Sharded Data Service ? Partition datasets based on RAM / storage speed / resident set size ? Multiple buckets per server ? Look-up methods for locating data in buckets ? Re-sharding / migration for high growth ?Continuent 2012 15
4. Multi-Site Data Service ? Robust protection against region/site failures ? Geographic distribution of data ? Primary/DR vs. multi-master ? Eventually consistent replication for SQL Amazon East EU West US East APAC Tokyo Rackspace DFW ?Continuent 2012 16
5. Real-Time Data Bridge ? Replicate from logs in real-time ? Enable apps to get data from one data source ? Heterogeneous transfer and transformation ? High performance, low application impact Bridge Bridge Bridge ?Continuent 2012 17
Future-Proofed CRM/Call Center Data Fat Client CRM Web CRM Web Telephony Telephony Accounting Application Application Data Streams Data Streams Fabric Fabric Fabric Fabric Fabric Connector Connector Connector Connector Connector Bridge Bridge Call Session Bridge Bridge Data Legacy Oracle OLTP Primary Bridge Hadoop Analytics OLTP DR Data Marts ?Continuent 2012 18
Future-Proofed CRM/Call Center Data Fat Client CRM Web CRM Web Telephony Telephony Accounting Application Application Data Streams Data Streams Fabric Fabric Fabric Fabric Fabric Connector Connector Connector Connector Connector Bridge Bridge Call Session Bridge Bridge Data Legacy Oracle OLTP Primary Bridge Hadoop Analytics OLTP DR Data Marts ?Continuent 2012 19
MySQL Future-Proo!ng: Conclusion ? MySQL is doing great but the cloud and Big Data have created a new set of challenges ? Data Fabric architecture cures mixed system spaghetti and future-proofs MySQL ? Continuent products implement fabric design patterns ? Our humble ambition: cover the entire Data Fabric, not just MySQL ?Continuent 2012 20
560 S. Winchester Blvd., Suite 500 Our Blogs: San Jose, CA 95128 http://scale-out-blog.blogspot.com Tel +1 (866) 998-3642 http://datacharmer.blogspot.com Fax +1 (408) 668-1009 http://www.continuent.com/news/blogs e-mail: sales@continuent.com Continuent Web Page: http://www.continuent.com ?Continuent 2012.

More Related Content

Future Proofing MySQL by Robert Hodges, Continuent

  • 1. Future-Proofing MySQL for the Worldwide Data Revolution Robert Hodges, CEO ?Continuent 2012.
  • 2. What is Future-Proo!ng? ? Future-proo!ng = creating systems that last while parts change and improve ? MySQL is not losing out to other solutions for data management ? The real problem is using MySQL as a building block with other technologies that are changing rapidly ?Continuent 2012 2
  • 3. But Wait... Isn¡¯t MySQL Dead?? MySQL ¡°You were so open¡± Born May 25, 1995 Died 2008, 2009, 2010, 2011, 2012, ... ?Continuent 2012 3
  • 4. Oracle/MySQL 5.6 Replication (On the Way) ? Global transaction IDs ? Parallel slave threads ? Crash safe slaves ? Optimized row updates ? Time delay replication ? Informational log events ?Continuent 2012 4
  • 5. Galera Synchronous Clusters (New Arrival in 2012) ? Multi-master for InnoDB ? Synchronous replication avoids data loss ? Automatic cluster membership management ? Simple node provisioning model ? Based on innovative state-machine work from Fernando Pedone ?Continuent 2012 5
  • 6. Tungsten Async Replication (2011 Belle of the Ball) ? All 5.6 features including parallel replication for MySQL 5.0 onwards ? Optimized support for failover ? Programmable transaction !ltering ? Backup/restore integration ? Multi-master, fan-in, and star replication ? Replication to/from Oracle and batch loading of data warehouses ? Replication to MongoDB ?Continuent 2012 6
  • 7. Not Bad for a Dying Market THE$TOTAL$MARKET$FOR$MYSQL,$NOSQL$$ My/NewSQL,' AND$NEWSQL$$ 5%' NewSQL,'2%' 1000" 900" NoSQL,'5%' 800" 700" 600" Text 500" MySQL,'88%' 400" 300" 200" 100" 0" (451Group) 2011" 2012" 2013" 2014" 2015" ?Continuent 2012 7
  • 8. MySQL Is Part of Bigger Trends ? Cloud and Big Data investment dwarf the MySQL marketplace ?Continuent 2012 8
  • 9. 21st Century CRM/Call Center Fat Client CRM Web CRM Web Accounting Application Application Call Session Data Online Legacy Transaction Hadoop Oracle Processing Analytics On-Premise Amazon Web Services Telephony Telephony Data Streams Data Streams ?Continuent 2012 9
  • 10. Revolutionary Challenges for MySQL ? Failures in unstable cloud environments ? Zero-downtime maintenance ? Rapidly growing data volumes, esp. in cloud ? Distributing data to geographical regions ? Integration between MySQL, NoSQL, commercial RDBMS ? Supplying real-time analytics ? Technology upgrade/replacement ?Continuent 2012 10
  • 11. The Cure for Mixed System Spaghetti Data Fabrics Encapsulated, fault-tolerant, horizontally scalable, globally accessible, integrated data ?Continuent 2012 11
  • 12. Data Fabric Design Patterns ? Connector ? Fault-Tolerant Data Service Tungsten Connector ? Sharded Data Service ? Multi-Site Data Service ? Real-Time Data Bridge Three-node Tungsten Cluster ?Continuent 2012 12
  • 13. 1. Connector ? Single point of entry for applications ? Service catalog locates data within fabric ? Transparent connectivity, multiple protocols ? Security, auditing, performance management Connector Application Application Stack Stack Connector ?Continuent 2012 13
  • 14. 2. Fault-Tolerant Data Service ? Encapsulate redundant database copies ? Sync and async clustering models ? Protect against local DBMS failure ? Rolling maintenance of replicas Master/ Multi- Slave Master ?Continuent 2012 14
  • 15. 3. Sharded Data Service ? Partition datasets based on RAM / storage speed / resident set size ? Multiple buckets per server ? Look-up methods for locating data in buckets ? Re-sharding / migration for high growth ?Continuent 2012 15
  • 16. 4. Multi-Site Data Service ? Robust protection against region/site failures ? Geographic distribution of data ? Primary/DR vs. multi-master ? Eventually consistent replication for SQL Amazon East EU West US East APAC Tokyo Rackspace DFW ?Continuent 2012 16
  • 17. 5. Real-Time Data Bridge ? Replicate from logs in real-time ? Enable apps to get data from one data source ? Heterogeneous transfer and transformation ? High performance, low application impact Bridge Bridge Bridge ?Continuent 2012 17
  • 18. Future-Proofed CRM/Call Center Data Fat Client CRM Web CRM Web Telephony Telephony Accounting Application Application Data Streams Data Streams Fabric Fabric Fabric Fabric Fabric Connector Connector Connector Connector Connector Bridge Bridge Call Session Bridge Bridge Data Legacy Oracle OLTP Primary Bridge Hadoop Analytics OLTP DR Data Marts ?Continuent 2012 18
  • 19. Future-Proofed CRM/Call Center Data Fat Client CRM Web CRM Web Telephony Telephony Accounting Application Application Data Streams Data Streams Fabric Fabric Fabric Fabric Fabric Connector Connector Connector Connector Connector Bridge Bridge Call Session Bridge Bridge Data Legacy Oracle OLTP Primary Bridge Hadoop Analytics OLTP DR Data Marts ?Continuent 2012 19
  • 20. MySQL Future-Proo!ng: Conclusion ? MySQL is doing great but the cloud and Big Data have created a new set of challenges ? Data Fabric architecture cures mixed system spaghetti and future-proofs MySQL ? Continuent products implement fabric design patterns ? Our humble ambition: cover the entire Data Fabric, not just MySQL ?Continuent 2012 20
  • 21. 560 S. Winchester Blvd., Suite 500 Our Blogs: San Jose, CA 95128 http://scale-out-blog.blogspot.com Tel +1 (866) 998-3642 http://datacharmer.blogspot.com Fax +1 (408) 668-1009 http://www.continuent.com/news/blogs e-mail: sales@continuent.com Continuent Web Page: http://www.continuent.com ?Continuent 2012.