mirror of
https://github.com/VictoriaMetrics/VictoriaMetrics.git
synced 2025-01-23 00:30:57 +01:00
23dcec3911
This commit adds the following changes:
- Added support to push datadog logs with examples of how to ingest data
using Vector and Fluentbit
- Updated VictoriaLogs examples directory structure to have single
container image for victorialogs, agent (fluentbit, vector, etc) but
multiple configurations for different protocols
Related issue https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6632
(cherry picked from commit e0930687f1)
40 lines
1.6 KiB
Markdown
40 lines
1.6 KiB
Markdown
# Docker compose Fluentd integration with VictoriaLogs
|
|
|
|
The folder contains examples of [Fluentd](https://www.fluentd.org/) integration with VictoriaLogs using protocols:
|
|
|
|
* [loki](./loki)
|
|
* [jsonline](./jsonline)
|
|
* [datadog](./datadog)
|
|
* [elasticsearch](./elasticsearch)
|
|
|
|
All required plugins, that should be installed in order to support protocols listed above can be found in a [Dockerfile](./Dockerfile)
|
|
|
|
To spin-up environment `cd` to any of listed above directories run the following command:
|
|
```
|
|
docker compose up -d
|
|
```
|
|
|
|
To shut down the docker-compose environment run the following command:
|
|
```
|
|
docker compose down
|
|
docker compose rm -f
|
|
```
|
|
|
|
The docker compose file contains the following components:
|
|
|
|
* fluentd - logs collection agent configured to collect and write data to `victorialogs`
|
|
* victorialogs - logs database, receives data from `fluentd` agent
|
|
* victoriametrics - metrics database, which collects metrics from `victorialogs` and `fluentd` for observability purposes
|
|
|
|
Querying the data
|
|
|
|
* [vmui](https://docs.victoriametrics.com/victorialogs/querying/#vmui) - a web UI is accessible by `http://localhost:9428/select/vmui`
|
|
* for querying the data via command-line please check [these docs](https://docs.victoriametrics.com/victorialogs/querying/#command-line)
|
|
|
|
Fluentd configuration example can be found below:
|
|
* [loki](./loki/fluent.conf)
|
|
* [jsonline](./jsonline/fluent.conf)
|
|
* [elasticsearch](./elasticsearch/fluent.conf)
|
|
|
|
Please, note that `_stream_fields` parameter must follow recommended [best practices](https://docs.victoriametrics.com/victorialogs/keyconcepts/#stream-fields) to achieve better performance.
|