Db tech showcase2015 how to replicate between clusters
11 likes2,025 views
话す前提だから、コレだけ见ても伝わらないだろうな???
More Related Content
What's hot (20)
Viewers also liked (20)
Similar to Db tech showcase2015 how to replicate between clusters (20)
More from Hiroaki Kubota (9)
Recently uploaded (6)
Db tech showcase2015 how to replicate between clusters
- 1. MongoDB クラスター間レプリケーション MongoDB JP代表? 窪田 博昭 @crumbjp
- 2. Who are you ? MongoDBJP 代表 MongoDB歴４年 emin.co.jp ２０１４年１０月～
- 3. ブログ活动
- 4. 仕事の话
- 8. Zenclerk
- 9. Zenclerk
- 10. Zenclerk 毎月 PB 単位のデータを扱う 10TB単位のデータをMongoDBに保存 MainDB は 5 shard 構成（そんなにお高くないサーバ）
- 11. 困った
- 13. Zenclerk
- 14. それって厂迟补驳颈苍驳顿叠
- 16. でも惭辞苍驳辞顿叠って???
- 18. でも困ってるんだよ???
- 21. 出来た！！
- 23. 技术的な説明
- 25. 作戦 monmo_repl
- 27. 性能２ シビアなので選択肢が少ない c++ driver → 流石にちょっと?? node native driver → 少し遅かった mongo shell → 低機能だが高速
- 28. 性能３ mongo shell mongod, mongos の mongo client を直接使う （本体だから）node native driver より チューニングが進んでいるっぽい Tailable cursorの不随意closeが検知できな い???つらい???
- 31. oplogの注意点３ レプリ元と先の用途の違いを考慮 別々に運用したい場合関連オペレーション を塞き止める DB名、コレクション名を変えたい場合が ある データを選別して塞き止めたい（負荷が辛いが）
- 33. MMS backup agent
- 35. 嬉しい误算
- 38. Sharidngとchunk chunk no min max shard 1 $minKey key: ’b’, _id: 100 shard1 2 key: ’b’, _id: 101 key: ’b’, _id: 500 shard2 3 key: ’b’, _id: 501 key: ’b’, _id: 900 shard2 4 key: ’b’, _id: 901 $maxKey shard1 chunk2, 3 には新規insert は絶対に入らない shard1 に殆どの書き込みが集中する
- 39. 各shardの負荷を可視化 INFO, TS: Timestamp(1433592288, 132), DF: 1, C: 5000, {"loglv":100,"dry":false,"repllog":false} DUMP, BULK: xxxxxxxxx.yyyyyyyy01, {"i":0,"u":3124,"d":0,"m":0,"b":3124} DUMP, BULK: xxxxxxxxx.yyyyyyyy02, {"i":620,"u":1440,"d":0,"m":0,"b":2060} DUMP, BULK: xxxxxxxxx.yyyyyyyy03, {"i":11,"u":46,"d":0,"m":0,"b":57} DUMP, BULK: xxxxxxxxx.yyyyyyyy04, {"i":66,"u":0,"d":0,"m":0,"b":66} DUMP, BULK: xxxxxxxxx.yyyyyyyy05, {"i":6,"u":0,"d":0,"m":0,"b":6} DUMP, BULK: xxxxxxxxx.yyyyyyyy06, {"i":10,"u":0,"d":0,"m":0,"b":10} DUMP, BULK: xxxxxxxxx.yyyyyyyy07, {"i":6,"u":0,"d":0,"m":0,"b":6} DUMP, BULK: xxxxxxxxx.yyyyyyyy08, {"i":44,"u":0,"d":0,"m":0,"b":44} DUMP, BULK: xxxxxxxxx.yyyyyyyy09, {"i":0,"u":210,"d":0,"m":0,"b":210} DUMP, BULK: xxxxxxxxx.yyyyyyyy10, {"i":102,"u":0,"d":0,"m":0,"b":102} DUMP, BULK: xxxxxxxxx.yyyyyyyy11, {"i":200,"u":0,"d":0,"m":0,"b":200} DUMP, BULK: xxxxxxxxx.yyyyyyyy12, {"i":22,"u":0,"d":0,"m":0,"b":22} INFO, TS: Timestamp(1433592309, 59), DF: 1, C: 4927, {"loglv":100,"dry":false,"repllog":false} DUMP, BULK: xxxxxxxxx.yyyyyyyy01, {"i":33,"u":877,"d":0,"m":0,"b":910} DUMP, BULK: xxxxxxxxx.yyyyyyyy02, {"i":705,"u":1631,"d":0,"m":0,"b":2336} DUMP, BULK: xxxxxxxxx.yyyyyyyy03, {"i":81,"u":1488,"d":0,"m":0,"b":1569} DUMP, BULK: xxxxxxxxx.yyyyyyyy07, {"i":384,"u":0,"d":0,"m":0,"b":384} Shard１のレプリケーションログ Shard２のレプリケーションログ
- 41. もう惭辞苍驳辞顿叠怖くないよね