VictoriaMetrics/app/vmagent
Nikolay 25ac2aac31
app/vmagent: allow to disabled on-disk persistence (#5088)
* app/vmagent: allow to disabled on-disk queue
Previously, it wasn't possible to build data processing pipeline with a
chain of vmagents. In case when remoteWrite for the last vmagent in the
chain wasn't accessible, it persisted data only when it has enough disk
capacity. If disk queue is full, it started to silently drop ingested
metrics.

New flags allows to disable on-disk persistent and immediatly return an
error if remoteWrite is not accessible anymore. It blocks any writes and
notify client, that data ingestion isn't possible.

Main use case for this feature - use external queue such as kafka for
data persistence.
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2110

* adds test, updates readme

* apply review suggestions

* update docs for vmagent

* makes linter happy

---------

Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>
2023-11-25 12:12:29 +02:00
..
common all: properly handle CPU limits set on the host system/container 2020-12-08 21:07:03 +02:00
csvimport app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
datadog app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
deployment Rootless docker images by default (#358) 2020-03-27 21:18:32 +02:00
graphite app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
influx app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
multiarch all: run apk update && apk upgrade in base Alpine Docker image in order to get all the recent security fixes 2023-02-09 14:03:02 -08:00
native app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
newrelic app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
opentelemetry app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
opentsdb app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
opentsdbhttp app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
prometheusimport app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
promremotewrite app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
remotewrite app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
static/css all: follow-up after 8edb390e21 2022-06-07 01:05:53 +03:00
vmimport app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
main.go app/vmagent: adds google pubsub as remoteWrite dst and ingest consumer (#713) 2023-11-20 22:43:26 +02:00
Makefile all: add makefile rules for GOARCH=s390x for all the VictoriaMetrics components 2023-02-26 12:38:48 -08:00
README.md lib/protoparser: decrease import.maxLineLen from 100MB to 10MB (#5364) 2023-11-24 13:13:33 +02:00
vmagent.png app/vmagent: update docs 2020-02-25 00:09:53 +02:00

See vmagent docs here.

vmagent docs can be edited at docs/vmagent.md.