More Related Content
What's hot (18)
Similar to My fox 扩容与数据迁移 (20)
My fox 扩容与数据迁移
- 2. 回顾
- 4. 数据离线批量写入
- 5. 透明的数据查询代理
- 6. 集群管理节点结构MyFOX路由表8冷节点（MySQL）30天无访问的冷数据新增热数据7.2k SATA盘，1T * 12，raid10内存:24G成本:1.6W / T12热节点（MySQL）15k SAS盘，300G * 12，raid10内存:24G成本:4.5W / T
- 7. 路由表…,cid=2KEY: thedate=20110811,cid=1…nodepathmodtimehittime…dbname.t_1dbname.t_2dbname.t_2节点2节点1
- 8. 装完数据UPDATE ... SETmodtime = NOW() WHERE ...modtime:每条路由对应的分片的数据更新时间
- 9. 路由访问SELECT node, path, modtimeFROM ... WHERE ...modtime:if (force_load ||!cache || modtime > cache.savetime) { // load data from mysql}
- 10. 同时…if (rand(1,100) <= 10) {}UPDATE ... SEThittime= NOW()WHERE ...Why we use “rand” here？NOT ONLY...BUT ALSO...
- 11. 决策SELECT node, path FROM ... WHEREhittime < ’30天前 ’ ANDisarchive = 0
- 13. 工作队列SELECT ... FROMtask_quequeWHEREtask_flag = FLAG_WAITANDtrytimes < 3ORDER BY priority ASC, trytimesASC,ABS(task_position – AGENT_POSITION) ASC,autokidASC
- 15. Federated“The?FEDERATED?storage engine is available beginning with MySQL 5.0.3. It is a storage engine that accesses data in tables of remote databases rather than in local tables.”http://dev.mysql.com/doc/refman/5.0/en/federated-storage-engine.html
- 16. CREATE TABLE dbname.t_2_fed ( ...) ENGINE = FEDERATED \CONNECTION=‘mysql://user:pass@172.1.1.1/dbname/t_2’dbname.t_2_feddbname.t_2dbname.t_2172.1.1.1172.1.1.2INSERT INTO dbname.t_2 SELECT * FROM dbname.t_2_fed
- 18. 例如：var task = { “path” : “dim_category_arch_0.t_92d_1”, “from” : “1,2,3,4,5,6,7,8”, “save” : “17,18,19,20”,}
- 20. 172.002.001.001
- 21. 172.001.003.002
- 23. 低碳
- 24. 稳定
- 25. 安全
- 26. 同机房
- 27. 同机柜
- 28. 同交换机滨笔地址“体现”物理部署
- 29. 一致性检查颁翱鲍狈罢
- 31. 卸磨杀驴/* 数据搬完第二天：*/DROP TABLE IF EXISTS dbname.t_2/* ON NODE 2 */Why NOT “right now”？
- 32. 小结
- 33. 从16到40贵别诲别谤补迟别诲
- 36. 每个肠丑耻苍办跨机房叁份冗余
- 37. 如果宕机，立即复制
- 38. …预告第叁讲：数据压缩