Update influxdb for fluent-package (#553)

Signed-off-by: Kentaro Hayashi <hayashi@clear-code.com>

Author: kenhys

how-to-guides/syslog-influxdb.md

@@ -1,101 +1,74 @@
 # Send Syslog Data to InfluxDB
 
-This article shows how to collect `syslog` data into [InfluxDB](http://github.com/influxdb/influxdb) using Fluentd.
+This article shows how to collect `syslog` data into [InfluxDB](https://github.com/influxdata/influxdb) using Fluentd.
 
 ![Syslog + Fluentd + InfluxDB](../.gitbook/assets/syslog-fluentd-influxdb.png)
 
 ## Prerequisites
 
-* A basic understanding of Fluentd
+* A basic understanding of [Fluentd](https://www.fluentd.org/)
 * A running instance of `rsyslogd`
+* [InfluxDB](https://www.influxdata.com/)
+* Your InfluxDB access token
+* [Chronograf](https://www.influxdata.com/time-series-platform/chronograf/)
 
-**In this guide, we assume we are running `td-agent` \(Fluentd package for Linux and macOS\) on Ubuntu Xenial.**
+You can install Fluentd via major packaging systems.
 
-## Step 1: Install InfluxDB
-
-InfluxDB supports Ubuntu, RedHat and macOS \(via `brew`\).
+* [Installation](../installation/)
 
-For more details, see [here](http://influxdb.com/download/).
+## Step 1: Install InfluxDB
 
-Since we are assumed to be on Ubuntu, the following two lines install InfluxDB:
+You can install InfluxDB via major packaging systems.
 
-```text
-$ wget https://dl.influxdata.com/influxdb/releases/influxdb_1.7.3_amd64.deb
-$ sudo dpkg -i influxdb_1.7.3_amd64.deb
-```
+* [Install InfluxDB OSS v2](https://docs.influxdata.com/influxdb/v2/install/)
 
 Once it is installed, you can run it with:
 
 ```text
 $ sudo systemctl start influxdb
 ```
 
-Then, you can verify that InfluxDB is running:
-
-```text
-$ curl "http://localhost:8086/query?q=show+databases"
-```
-
-If InfluxDB is running normally, you will see an object that contains the `_internal` database:
-
-```javascript
-{"results":[{"statement_id":0,"series":[{"name":"databases","columns":["name"],"values":[["_internal"]]}]}]}
-```
-
-Also, the following two lines install Chronograf:
-
-```text
-$ wget https://dl.influxdata.com/chronograf/releases/chronograf_1.7.7_amd64.deb
-$ sudo dpkg -i chronograf_1.7.7_amd64.deb
-```
-
-Once it is installed, you can run it with:
+Then, run the initial setup process and create/configure the following:
 
-```text
-$ sudo systemctl start chronograf
-```
+* Create `influxdb` user
+* Create proper operation token
+* Set `fluent` organization
+* Create `test` bucket
+* Crete access API token
 
-Then, go to localhost:8888 \(or wherever you are hosting Chronograf\) to access Chronograf's web console which is the successor to InfluxDB's web console.
+See [Set up InfluxDB](https://docs.influxdata.com/influxdb/v2/get-started/setup/).
 
-Create a database called `test`. This is where we will be storing `syslog` data:
+Then, you can verify that InfluxDB is running:
 
 ```text
-$ curl -i -XPOST http://localhost:8086/query --data-urlencode "q=CREATE DATABASE test"
+$ curl --header "Authorization: Token (INFLUXDB_ACCESS_TOKEN_HERE)" "http://localhost:8086/query?q=show+databases"
 ```
 
-If you prefer command line or cannot access port 8083 from your local machine, running the following command creates a database called `test`:
+If InfluxDB is running normally, you will see an object that contains the `_monitoring`, `_tasks` and `test` database:
 
-```text
-$ curl -i -X POST 'http://localhost:8086/write?db=test' --data-binary 'task,host=server01,region=us-west value=1 1434055562000000000'
+```javascript
+{"results":[{"statement_id":0,"series":[{"name":"databases","columns":["name"],"values":[["_monitoring"],["_tasks"],["test"]]}]}]}
 ```
 
 We are done for now.
 
 ## Step 2: Install Fluentd and the InfluxDB plugin
 
-On your aggregator server, set up Fluentd.
-
-For more details, see [here](https://www.fluentd.org/download).
+You can install Fluentd via major packaging systems.
 
-```text
-$ curl -L https://toolbelt.treasuredata.com/sh/install-ubuntu-xenial-td-agent3.sh | sh
-```
+* [Installation](../installation/)
 
 Next, install the InfluxDB output plugin:
 
-```text
-/usr/sbin/td-agent-gem install fluent-plugin-influxdb
-```
-
-For the vanilla Fluentd, run:
+If [`out_influxdb`](https://github.com/influxdata/influxdb-plugin-fluent) (fluent-plugin-influxdb-v2) is not installed yet, please install it manually.
 
-```text
-fluent-gem install fluent-plugin-influxdb
-```
+See [Plugin Management](..//installation/post-installation-guide#plugin-management) section how to install fluent-plugin-influxdb-v2 on your environment.
 
-You might need `sudo` to install the plugin.
+{% hint style='warning' %}
+Do not install fluent-plugin-influxdb, it does not support for InfluxDB v2.
+{% endhint %}
 
-Finally, configure `/etc/td-agent/td-agent.conf` as follows:
+Finally, configure `/etc/fluent/fluentd.conf` as follows:
 
 ```text
 <source>
@@ -106,24 +79,28 @@ Finally, configure `/etc/td-agent/td-agent.conf` as follows:
 
 <match system.*.*>
   @type influxdb
-  dbname test
-  flush_interval 10s # for testing
-  host YOUR_INFLUXDB_HOST # default: localhost
-  port YOUR_INFLUXDB_PORT # default: 8086
+  url http://localhost:8086
+  org fluent
+  bucket test
+  token "ACCESS_TOKEN_HERE"
+  use_ssl false
+  <buffer>
+    flush_interval 10s # for testing
+  <buffer>
 </match>
 ```
 
-Restart `td-agent` with `sudo service td-agent restart`.
+Restart `fluentd` with `sudo systemctl restart fluentd`.
 
 ## Step 3: Configure `rsyslogd`
 
-If remote `rsyslogd` instances are already collecting data into the aggregator `rsyslogd`, the settings for `rsyslog` should remain unchanged. However, if this is a brand new setup, start forward `syslog` output by adding the following line to `/etc/rsyslogd.conf`:
+If remote `rsyslogd` instances are already collecting data into the aggregator `rsyslogd`, the settings for `rsyslog` should remain unchanged. However, if this is a brand new setup, create `/etc/rsyslogd.d/90-fluentd.conf` and append the following line:
 
 ```text
-*.* @182.39.20.2:42185
+*.* @localhost:42185
 ```
 
-You should replace `182.39.20.2` with the IP address of your aggregator server. Also, there is nothing special about port `42185` \(do make sure this port is open though\).
+You should replace `localhost` with the IP address of your aggregator server. Also, there is nothing special about port `42185` \(do make sure this port is open though\).
 
 Now, restart `rsyslogd`:
 
@@ -135,13 +112,23 @@ $ sudo systemctl restart rsyslog
 
 Your `syslog` data should be flowing into InfluxDB every 10 seconds \(this is configured by `flush_interval`\).
 
-Clicking on `Explore` brings up the query interface that **lets you write SQL queries against your log data**.
+For visualizing incoming data, you can use the InfluxDB UI by default and as an option, you can use `Chronograf` with InfluxDB v2.
+
+You can install Chronograf via major packaging systems.
+
+* [Install Chronograf](https://docs.influxdata.com/chronograf/v1/introduction/installation/)
+
+{% hint style='info' %}
+Setup Chronograf "InfluxDB v2 Auth" to connect with InfludDB v2. See [Use Chronograf with InfluxDB OSS](https://docs.influxdata.com/influxdb/v2/tools/chronograf/).
+{% endhint %}
+
+Then, go to http://localhost:8888 and clicking on `Explore` brings up the query interface that **lets you write SQL queries against your log data**.
 
 And then click `Visualization` and select the line chart:
 
 ![Chronograf: Explore Data](../.gitbook/assets/chronograf-explore-data.png)
 
-Now, to count the number of lines of `syslog` messages per facility/priority:
+Now, switch to `Queries` to count the number of lines of `syslog` messages per facility/priority:
 
 ```sql
 SELECT COUNT(ident) FROM test.autogen./^system\./ GROUP BY time(1s)