VictoriaMetrics/lib/promscrape
Nikolay 25ac2aac31
app/vmagent: allow to disabled on-disk persistence (#5088)
* app/vmagent: allow to disabled on-disk queue
Previously, it wasn't possible to build data processing pipeline with a
chain of vmagents. In case when remoteWrite for the last vmagent in the
chain wasn't accessible, it persisted data only when it has enough disk
capacity. If disk queue is full, it started to silently drop ingested
metrics.

New flags allows to disable on-disk persistent and immediatly return an
error if remoteWrite is not accessible anymore. It blocks any writes and
notify client, that data ingestion isn't possible.

Main use case for this feature - use external queue such as kafka for
data persistence.
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2110

* adds test, updates readme

* apply review suggestions

* update docs for vmagent

* makes linter happy

---------

Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>
2023-11-25 12:12:29 +02:00
..
discovery lib/promscrape/discovery/kubernetes: propagate possible errors at newAPIWatcher() to the caller 2023-10-27 20:27:58 +02:00
discoveryutils lib/promauth: follow-up for e16d3f5639 2023-10-26 09:55:47 +02:00
testdata lib/promscrape: disable support for service discovery and metrics scrape via http2 2023-07-06 16:04:31 -07:00
client.go lib/promauth: follow-up for e16d3f5639 2023-10-26 09:55:47 +02:00
config_test.go lib/promauth: follow-up for e16d3f5639 2023-10-26 09:55:47 +02:00
config_timing_test.go lib/promscrape: optimize service discovery speed 2022-11-29 21:26:23 -08:00
config.go lib/promscrape: properly track the number of updated service discovery routines inside Config.mustRestart() 2023-10-26 09:56:36 +02:00
relabel_debug.go app/vmselect: small cleanup after 4f3f9950d0 2023-05-09 22:45:02 -07:00
scraper.go app/vmagent: allow to disabled on-disk persistence (#5088) 2023-11-25 12:12:29 +02:00
scrapework_test.go lib/promscrape: fix honor_labels behavior (#3739) 2023-02-01 12:02:04 -08:00
scrapework_timing_test.go lib/promscrape: add exported_ prefix to metric names exported by scrape targets if they clash with automatically generated metrics 2022-11-28 18:37:34 -08:00
scrapework.go all: consistently use %w instead of %s in when error is passed to fmt.Errorf() 2023-10-26 09:44:40 +02:00
statconn_test.go lib/promscrape: do not add a suggestion for enabling TCP6 in error message when the dial address is TCPv4 2023-10-27 14:06:49 +02:00
statconn.go lib/promscrape: do not add a suggestion for enabling TCP6 in error message when the dial address is TCPv4 2023-10-27 14:06:49 +02:00
targetstatus.go lib/promscrape: follow-up after 6aa50ca954 2023-07-20 21:54:09 -07:00
targetstatus.qtpl lib/promscrape: follow-up after 6aa50ca954 2023-07-20 21:54:09 -07:00
targetstatus.qtpl.go lib/promscrape: follow-up after 6aa50ca954 2023-07-20 21:54:09 -07:00