Breaking the Monolith - v3
1 like555 views
Viedma outlines challenges in scaling a global video platform including a highly distributed user base, explosive growth, and demanding users. He proposes breaking the monolithic architecture into microservices with a service-oriented design, routing all requests through an API gateway. This includes using a publish/subscribe system with an event-driven architecture to improve scalability, availability, and performance across the large ecosystem. The goal is to reduce uncached response times to 25ms or less through an in-memory focus and optimizations like sorting and paging videos in Redis.
![[SCALA|AVAILA]BILITY
Service Oriented Architecture
Each vertical is a source of truth
Oceanus
(Videos)
Activities
(Behaviour)
Gaia
(Users)
Aphrodite
(Community)](https://image.slidesharecdn.com/breakingthemonolith-160216084728/85/Breaking-the-Monolith-v3-21-320.jpg)
Breaking the Monolith - v3
- 2. WHOAMI Cristobal Viedma Founder & CEO @Monkimun Former life: Head of Platform @Viki ($200M exit) Founder & CEO @Bluewalks
- 3. 80% of the world can only read <6% of the Internet W3techs 2015: http://w3techs.com/technologies/overview/content_language/all Unesco 2012: http://unesdoc.unesco.org/images/0018/001870/187016e.pdf
- 4. WHATISVIKI?
- 5. GLOBALTV
- 6. NOTADUMBTV
- 8. CHALLENGES
- 11. SMARTTVs Google TV, Samsung SmartTV, Roku...
- 12. HIGHLYDISTRIBUTED Data: viki.com Oct'12 Top 5 Cities: Singapore,Santiago, LaVictoria, Jakarta, New York
- 13. EXPLOSIVEGROWTH ~22M users winter12 (2500% growth). ~35M summer13
- 14. DEMANDINGUSERS viewers start leaving if video doesn't play in 2 secs ...and every sec of additional delay ~6% more jumping ship! Data: Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs. S. Shunmuga Krishnan, Ramesh K. Sitaraman, 2012
- 15. CHALLENGES Large Ecosystem Highly Distributed Explosive Growth Demanding Users
- 16. TITLEHERE
- 17. BREAKTHEMONOLITH
- 18. TITLEHERE
- 20. UNDERSTANDING Facts: Read heavy (writes can wait) Everything fits in memory Goal: 25ms uncached (10-100x better)
- 21. [SCALA|AVAILA]BILITY Service Oriented Architecture Each vertical is a source of truth Oceanus (Videos) Activities (Behaviour) Gaia (Users) Aphrodite (Community)
- 22. ONEGATE Hyperion (platform cluster) Everything routed through api.viki.io Oceanus (Videos) Activities (Behaviour) Gaia (Users) Aphrodite (Community)
- 25. Message / Events Queue Oceanus (Videos) Activities (Behaviour) Gaia (Users) Aphrodite (Community) Analytics Hyperion (cluster) viki.com Logs Segmenting Tool Subtitling tool Baboon (CMS) Hyperion (cluster) Hyperion (cluster) Devices (android, ios, etc) Partners (Samsung, Youtube, etc) 3rd Party Dev. (API) PlatformContentClients Knowledge EVENTDRIVENARCHITECTURE
- 26. CHALLENGES/FOCUS Scalability Availability Performance Large Ecosystem Highly Distributed Explosive Growth Demanding Users
- 27. PERFORMANCE Generation Time Network time Render time Hyperion Client
- 29. GENERATION Original (without latency) ~250ms Everything in memory ~15-100ms Sorting / VFind ~15ms Paging ~9ms Serializing ~5ms UNCACHED
- 30. HORRORFUNFACTS Alias - Redis 32bits VFIND - Redis fork JSON Concat in C
- 31. founders@monkimun.com https://angel.co/monkimun Nothing new Having fun & learning! https://github.com/karlseguin/scaling-viki
- 32. 80% of the world can only read <6% of the Internet W3techs 2015: http://w3techs.com/technologies/overview/content_language/all Unesco 2012: http://unesdoc.unesco.org/images/0018/001870/187016e.pdf
- 33. Research shows 2-6 years is the best age to learn a language Science 2005: http://www.sciencemag.org/content/310/5749/815
- 34. language learning is extremely bOOOring and so is gamifying it
- 36. A common language will accelerate growth and make the world more united and equal VISION
- 37. ADVISORS Kent Liu Ex-GM Asia for EA Mobile Ex-Director JAMDAT mobile (IPO + $680M exit) 500 Startups Leading global venture capital seed fund Razmig Hovaghimian Co-founder / CEO Viki Sr Executive Officer Rakuten Board Observer Rakuten Gwynne Shotwell SpaceX President & COO
- 38. founders@monkimun.com https://angel.co/monkimun cristobal@monkimun.com +1 415 528 99 71 +34 617 606 187 Psst, We are hiring!