際際滷

際際滷Share a Scribd company logo

the tooling of a modern and agile oracle dba

B
BertrandDrouvot

This presentation discusses tools for automating database operations and monitoring databases. It introduces Ansible for automation, and Telegraf, Influxdb, Grafana, Logstash, Elasticsearch, Kibana, and Kapacitor for collecting, storing, and visualizing metrics, logs, and alerts. The presentation includes a live demo of using these tools to provision an Oracle database, create performance dashboards, generate alerts, and view logs and audits. The goal is to provide a modern, agile approach to database administration.

1 of 18
Download to read offline
The tooling of a modern and agile Oracle DBA Bertrand Drouvot Expert Database Engineer bertrand.drouvot@digora.com
About me 2 Oracle DBA since about 20 years (currently focusing on PostgreSQL) OCP RAC certified Expert Exadata certified implementation specialist Kubernetes Administrator Blogger since 2012 Oracle ACE Oak table member @bertranddrouvot BasketBall fan
Challenge 3 DBaaS with automation for: Software installation Database creation Patching Upgrade Standby creation
Challenge 4 End user should access performance dashboards End user should access logs Security Team should access audit and logs Monitoring and alerting Same toold for all SGBD (oracle, postgres, mssql)
Tools 5 Ansible for automation Telegraf, Influxdb and grafana to collect, store and display performance metrics Logstash, elasticsearch and kibana to collect, store and display logs and audit Kapacitor for monitoring and alerting
What is this presentation about? 6 Brief overview of Ansible Brief overview of Telegraf, Influxdb and grafana Brief overview of Logstash, elasticsearch and kibana Brief overview of Kapacitor for monitoring and alerting Live demo
What this presentation is not? 7 In depth overview of Ansible In depth overview of Telegraf, Influxdb and grafana In depth overview of Logstash, elasticsearch and kibana In depth overview of Kapacitor for monitoring and alerting
Ansible 8 Ansible is a radically simple IT automation engine it uses no agents it's easy to deploy it uses a very simple language (YAML, in the form of Ansible Playbooks)
Telegraf, Influxdb, Kapacitor and Grafana 9 Telegraf is a plugin-driven server agent for collecting and reporting metrics Telegraf has integrations to source a variety of metrics, events, and logs InfluxDB is used as a data store for time-stamped data Kapacitor can process both stream and batch data from InfluxDB. It lets you plug in your own custom logic or user-defined functions to process alerts with dynamic thresholds, match metrics for patterns, compute statistical anomalies, and perform specific actions based on these alerts Grafana allows you to query, visualize, alert on and understand your metrics
Telegraf, Influxdb, Kapacitor and Grafana 10
Logstash, Elasticsearch and Kibana 11 Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite stash. Elasticsearch is a distributed, RESTful search and analytics engine (lucene) Kibana lets you visualize your Elasticsearch data
Logstash, Elasticsearch and Kibana 12
DBaaS 13 Lets prepare the system Lets install the 12.1.0.2 software Lets create a 12.1.0.2 database
Performance dashboards 14 Telegraf is installed Influxdb exists Grafana exists Lets deploy telegraf configuration files Lets generate some load (SLOB) Lets see the performance dashboard
Alerting 15 Telegraf configuration files are deployed Kapacitor is installed Lets deploy Kapacitor configuration files Lets see the alerts
Logs and Audit 16 Elasticsearch exists Kibana exists Lets deploy logstash Lets generate some activity (logon, stop/start, ORA-) Lets see the kibana dashboard
Questions
Si竪ge : 98 rue de Hochfelden F-67200 STRASBOURG Standard : +33 388 10 49 20 Fax : +33 388 10 82 27 www.digora.com www.digora.com

More Related Content

the tooling of a modern and agile oracle dba

  • 1. The tooling of a modern and agile Oracle DBA Bertrand Drouvot Expert Database Engineer bertrand.drouvot@digora.com
  • 2. About me 2 Oracle DBA since about 20 years (currently focusing on PostgreSQL) OCP RAC certified Expert Exadata certified implementation specialist Kubernetes Administrator Blogger since 2012 Oracle ACE Oak table member @bertranddrouvot BasketBall fan
  • 3. Challenge 3 DBaaS with automation for: Software installation Database creation Patching Upgrade Standby creation
  • 4. Challenge 4 End user should access performance dashboards End user should access logs Security Team should access audit and logs Monitoring and alerting Same toold for all SGBD (oracle, postgres, mssql)
  • 5. Tools 5 Ansible for automation Telegraf, Influxdb and grafana to collect, store and display performance metrics Logstash, elasticsearch and kibana to collect, store and display logs and audit Kapacitor for monitoring and alerting
  • 6. What is this presentation about? 6 Brief overview of Ansible Brief overview of Telegraf, Influxdb and grafana Brief overview of Logstash, elasticsearch and kibana Brief overview of Kapacitor for monitoring and alerting Live demo
  • 7. What this presentation is not? 7 In depth overview of Ansible In depth overview of Telegraf, Influxdb and grafana In depth overview of Logstash, elasticsearch and kibana In depth overview of Kapacitor for monitoring and alerting
  • 8. Ansible 8 Ansible is a radically simple IT automation engine it uses no agents it's easy to deploy it uses a very simple language (YAML, in the form of Ansible Playbooks)
  • 9. Telegraf, Influxdb, Kapacitor and Grafana 9 Telegraf is a plugin-driven server agent for collecting and reporting metrics Telegraf has integrations to source a variety of metrics, events, and logs InfluxDB is used as a data store for time-stamped data Kapacitor can process both stream and batch data from InfluxDB. It lets you plug in your own custom logic or user-defined functions to process alerts with dynamic thresholds, match metrics for patterns, compute statistical anomalies, and perform specific actions based on these alerts Grafana allows you to query, visualize, alert on and understand your metrics
  • 11. Logstash, Elasticsearch and Kibana 11 Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite stash. Elasticsearch is a distributed, RESTful search and analytics engine (lucene) Kibana lets you visualize your Elasticsearch data
  • 13. DBaaS 13 Lets prepare the system Lets install the 12.1.0.2 software Lets create a 12.1.0.2 database
  • 14. Performance dashboards 14 Telegraf is installed Influxdb exists Grafana exists Lets deploy telegraf configuration files Lets generate some load (SLOB) Lets see the performance dashboard
  • 15. Alerting 15 Telegraf configuration files are deployed Kapacitor is installed Lets deploy Kapacitor configuration files Lets see the alerts
  • 16. Logs and Audit 16 Elasticsearch exists Kibana exists Lets deploy logstash Lets generate some activity (logon, stop/start, ORA-) Lets see the kibana dashboard
  • 18. Si竪ge : 98 rue de Hochfelden F-67200 STRASBOURG Standard : +33 388 10 49 20 Fax : +33 388 10 82 27 www.digora.com www.digora.com