Charlotte Software Engineering Meetup - Jan.2015
1 like471 views
The slides for the talk at Charlotte Software Engineering meetup. http://www.meetup.com/Charlotte-Software-Engineering-Meetup/events/227454809/
Charlotte Software Engineering Meetup - Jan.2015
- 2. Majid Fatemian R E D V E N T U R E S @majidfn
- 3. Relational Non-Relational Key-Value Big Data
- 6. Relational
- 7. DATA
- 8. BIG DATA
- 9. Capture Search Storage Q u e r y Privacy Visualize Analysis
- 10. Non-Relational
- 11. 1 2 3 Non-Relational Cluster Schemaless
- 12. I. Document II. Key-Value III. Graph IV. Column MongoDB, CouchBase Memcache, Redis Neo4J, OrientDB Cassandra, HBase
- 17. 2 x 1 x 1 x
- 22. Application
- 28. Schema Relational { player_id: 1234, * level: 40, * duration: 75, * activity: activity, game_id: 4001, platform: WiiU, di鍖culty_level: medium, repetition: 178, score: 450, endurance:3 } { player_id: 1234, level: 12, duration: 120, activity: activity }
- 30. Distribution Relational Data C Data B Data A Data Access Layer
- 31. ACID Transaction Partitioning Replication Tools OPs Data Volume Fixed Schema Scale Up Manual Sharding + -
- 32. NoSQL ...
- 33. mongoDB 1 2 3 OPs Devs Community
- 34. Schema-less Non-Relational player_id: 1234, * level: 40, * duration: 75, * activity: activity, game_id: 4001, platform: WiiU, di鍖culty_level: 2, repetition: 178, score: 450, endurance:3 player_id: 1234, level: 75, duration: 120, activity: activity
- 39. Sharding Non-Relational Data A A Data B B Data C C {key}
- 56. Locking Non-RelationalDB Level (2.2) }Document Level (3.x)
- 58. Denormalized data Disk Space Expertise Complex Querying Eventual Consistency Resource Usage DB-Level Locking - Schema-Less Aggregated Data Large Scale Data Sharding Map/Reduce Memory Storage Journaling +
- 63. Total Sum Activity 1 Activity n Activity m
- 66. The Challenge
- 67. Inconsistency1
- 72. 2 Latency
- 74. Operations3
- 76. Availability4
- 77. Availability4 Plan for failure
- 81. Data Integrity5
- 82. Data Integrity5 Backward compatibility
- 84. Data Migration6
- 88. 1 One-Shot Migration 4 hours !!
- 89. 1 One-Shot Migration 4 hours !! Live !! 2 Profile versioning
- 90. +1
- 91. V +1 1
- 92. V +1 1
- 93. V +1 2
- 96. Final Results
- 97. Scalability 2011 2012 2013 2014
- 98. 9x response time
- 99. 3 years uptime
- 100. Go Hybrid!>
- 102. Thank YOU! @majidfn