![Graphite[carbon]へのデータの送り方
?
?
?
?
?](https://image.slidesharecdn.com/2016-06-27netopscoding-03-msft-naokikit-j-web-post-160706234234/85/Monitoring-Intelligence-15-320.jpg)
![Perl sample code
use IO::Socket;
our $CARBON_SERVER = '10.20.1.1';
our $CARBON_PORT = 2003;
our $sock = IO::Socket::INET->new(
PeerAddr => $CARBON_SERVER,
PeerPort => $CARBON_PORT,
Proto => 'tcp'
);
my $time = time; my $value = something;
$sock->send("test.metric_name $value $time?n");
16
Graphite[carbon]へのデータの送り方 2](https://image.slidesharecdn.com/2016-06-27netopscoding-03-msft-naokikit-j-web-post-160706234234/85/Monitoring-Intelligence-16-320.jpg)
![様々な試み – デモ [Use case 6, 7]
? Recent Code Upgrade – New code, new eyeballs, new problems
? Fabric – Understanding an overall health](https://image.slidesharecdn.com/2016-06-27netopscoding-03-msft-naokikit-j-web-post-160706234234/85/Monitoring-Intelligence-21-320.jpg)
![Scripted Dashboard
? URL e.g.
? http://<server>/dashboard/script/<script_name>.js?router=<router_name>
? Javascript code on Grafana server
dashboard = { rows : [] };
routerName = ARGS.router;
dashboard.rows.push({
"panels": [
{"targets": [{"target": "prefix." + routerName + ".5minloadavg"}]}
]
});
return dashboard;](https://image.slidesharecdn.com/2016-06-27netopscoding-03-msft-naokikit-j-web-post-160706234234/85/Monitoring-Intelligence-26-320.jpg)
More Related Content
What's hot (20)
Similar to Monitoring Intelligence (20)
![[db tech showcase Tokyo 2015] C17:MySQL Cluster ユーザー事例紹介～ＪＲ東日本情報システム様における導入事例...](https://cdn.slidesharecdn.com/ss_thumbnails/dbts-tokyo-2015c17mysql-clusterhp-150619091220-lva1-app6891-thumbnail.jpg?width=560&fit=bounds)
![[Japan Tech summit 2017] DAL 005](https://cdn.slidesharecdn.com/ss_thumbnails/techsummit2017pdfdal005-171127040522-thumbnail.jpg?width=560&fit=bounds)
![[db tech showcase Tokyo 2017] A15: レプリケーションを使用したデータ分析基盤構築のキモ（事例）by 株式会社インサイトテ...](https://cdn.slidesharecdn.com/ss_thumbnails/a15-170912020524-thumbnail.jpg?width=560&fit=bounds)
Recently uploaded (13)
![ElasticsearchでSPLADEする [Search Engineering Tech Talk 2025 Winter]](https://cdn.slidesharecdn.com/ss_thumbnails/searchtech-250228102455-ddc5ce09-thumbnail.jpg?width=560&fit=bounds)
Monitoring Intelligence
- 3. 2010 2015 100K MillionsCompute Instances 10’s of PB ExabytesAzure Storage 10’s of TbpsDatacenter Network Pbps
- 6. ? すぐに新たな時系列データ収集を開始できること（SNMP, CLI, etc.） データ収集段階 ? 最新のライブデータを多角的に分析できるUIを備えること ? 元データに簡単なAPIでアクセスできること 分析段階 ? 分析結果やモデルを簡単に共有し、最新データに適用できること 共有段階 ? 各ネットワークエンジニアがすぐに直接check-in（または追加変更）できること 全過程を通じて プラットフォームへの要求
- 7. データ収集 蓄積 分析 時系列データを扱うためのOSS Graphite fluentd Kafka Influx DB, OpenTSDB Druid Grafana (Kibana) NorikraStorm ElasticSearch Kibana
- 9. Use case 1: Router code upgrade dashboard 9 http://gnsgraphite/dashboard#temp- RFC535884 非公開
- 10. Use case 2: Fiber cut時の挙動とその相関 10 http://gnsgraphite/dashboard#temp- RFC535884 非公開
- 11. Use case 3: ISIS table size per region 11 非公開
- 12. Use case 4: IGP収束時間 12 非公開
- 13. Use case 5: 各ルータの微視的データの相関 13 http://gnsgraphite/dashboard#temp- RFC535884 非公開
- 14. Graphite、Grafanaと各モジュールの関係 Router Router Router whisper SNMP, CLI, etc Data Feeders User StatsD/Carbon (Twisted Python) Graphite-web Django on WSGI MySQL or sqlite 8125/udp 2003/tcp 80/tcp Grafana provides more rich UI Code
- 16. Perl sample code use IO::Socket; our $CARBON_SERVER = '10.20.1.1'; our $CARBON_PORT = 2003; our $sock = IO::Socket::INET->new( PeerAddr => $CARBON_SERVER, PeerPort => $CARBON_PORT, Proto => 'tcp' ); my $time = time; my $value = something; $sock->send("test.metric_name $value $time?n"); 16 Graphite[carbon]へのデータの送り方 2
- 18. Graphiteからのデータの取得 2 ? ifInErrorsカウンタの上位10インターフェースリスト wget 'http://10.10.1.1/render?target=highestMax(perSecond(*.intf. *.ifInErrors),10) &from=-15min&rawData=true&format=csv‘ ? 便利な関数 ? perSecond() ? HighestAverage(*, 10) ? HighestCurrent(*, 10) ? sumSeries(*, 10) ? movingAverage(*, ’1hour’) ? timeShift(*, ’30d’) ? mostDeviant(10, *)
- 19. どんなデータを送っているか ? データソース ? SNMP, CLI, syslog ? データ量 ? 400K+700Kくらい (e.g. 1,000 router x 100 intf x 5 snmp = 500K)
- 20. ?
- 21. 様々な試み – デモ [Use case 6, 7] ? Recent Code Upgrade – New code, new eyeballs, new problems ? Fabric – Understanding an overall health
- 22. Use case 8: Optical LevelとifInErrorsの関係
- 23. Use case 9: Black Hole検知
- 24. Use case 10: Black Hole検知
- 25. Use case 11: Black Hole検知
- 26. Scripted Dashboard ? URL e.g. ? http://<server>/dashboard/script/<script_name>.js?router=<router_name> ? Javascript code on Grafana server dashboard = { rows : [] }; routerName = ARGS.router; dashboard.rows.push({ "panels": [ {"targets": [{"target": "prefix." + routerName + ".5minloadavg"}]} ] }); return dashboard;
- 27. 学んだこと ? Data-driven decision makingの有意性 ? コラボレーションの素晴らしさと難しさ ? トレーニング、データ収集、分析、APIを通じて ? ダッシュボードのライフサイクル管理 ? 生成タイミング、手法、寿命 ? システム管理コスト
- 28. ? 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.