VictoriaMetrics

mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-12-26 20:30:10 +01:00

History

Aliaksandr Valialkin db557b86ee app/vmagent/remotewrite: follow-up for `f153f54d11` - Move the remaining code responsible for stream aggregation initialization from remotewrite.go to streamaggr.go . This improves code maintainability a bit. - Properly shut down streamaggr.Aggregators initialized inside remotewrite.CheckStreamAggrConfigs(). This prevents from potential resource leaks. - Use separate functions for initializing and reloading of global stream aggregation and per-remoteWrite.url stream aggregation. This makes the code easier to read and maintain. This also fixes INFO and ERROR logs emitted by these functions. - Add an ability to specify `name` option in every stream aggregation config. This option is used as `name` label in metrics exposed by stream aggregation at /metrics page. This simplifies investigation of the exposed metrics. - Add `path` label additionally to `name`, `url` and `position` labels at metrics exposed by streaming aggregation. This label should simplify investigation of the exposed metrics. - Remove `match` and `group` labels from metrics exposed by streaming aggregation, since they have little practical applicability: it is hard to use these labels in query filters and aggregation functions. - Rename the metric `vm_streamaggr_flushed_samples_total` to less misleading `vm_streamaggr_output_samples_total` . This metric shows the number of samples generated by the corresponding streaming aggregation rule. This metric has been added in the commit `861852f262` . See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6462 - Remove the metric `vm_streamaggr_stale_samples_total`, since it is unclear how it can be used in practice. This metric has been added in the commit `861852f262` . See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6462 - Remove Alias and aggrID fields from streamaggr.Options struct, since these fields aren't related to optional params, which could modify the behaviour of the constructed streaming aggregator. Convert the Alias field to regular argument passed to LoadFromFile() function, since this argument is mandatory. - Pass Options arg to LoadFromFile() function by reference, since this structure is quite big. This also allows passing nil instead of Options when default options are enough. - Add `name`, `path`, `url` and `position` labels to `vm_streamaggr_dedup_state_size_bytes` and `vm_streamaggr_dedup_state_items_count` metrics, so they have consistent set of labels comparing to the rest of streaming aggregation metrics. - Convert aggregator.aggrStates field type from `map[string]aggrState` to `[]aggrOutput`, where `aggrOutput` contains the corresponding `aggrState` plus all the related metrics (currently only `vm_streamaggr_output_samples_total` metric is exposed with the corresponding `output` label per each configured output function). This simplifies and speeds up the code responsible for updating per-output metrics. This is a follow-up for the commit `2eb1bc4f81` . See https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6604 - Added missing urls to docs ( https://docs.victoriametrics.com/stream-aggregation/ ) in error messages. These urls help users figuring out why VictoriaMetrics or vmagent generates the corresponding error messages. The urls were removed for unknown reason in the commit `2eb1bc4f81` . - Fix incorrect update for `vm_streamaggr_output_samples_total` metric in flushCtx.appendSeriesWithExtraLabel() function. While at it, reduce memory usage by limiting the maximum number of samples per flush to 10K. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5467 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6268		2024-07-15 20:24:01 +02:00
..
common	app/vmagent/remotewrite: follow-up for `f153f54d11`	2024-07-15 20:24:01 +02:00
csvimport	lib/protoparser/csvimport: extract stream parsing code into a separate stream package	2023-02-13 10:25:46 -08:00
datadogsketches	app/{vmagent,vminsert}: follow-up after `a1d1ccd6f2`	2024-02-07 01:28:05 +02:00
datadogv1	app/{vminsert,vmagent}: preliminary support for /api/v2/series ingestion from new versions of DataDog Agent	2023-12-21 20:50:55 +02:00
datadogv2	lib/protoparser/datadogv2: take into account source_type_name field, since it contains useful value such as kubernetes, docker, system, etc.	2023-12-21 23:05:41 +02:00
graphite	app/vmagent: code cleanup for Kafka and Google PubSub consumers / producers	2023-12-04 22:46:28 +02:00
influx	app/vminsert: replace hybrid sync.Pool+channel-based pool scheme for poolCtx with plain sync.Pool	2024-04-20 21:44:53 +02:00
native	app/vminsert: replace hybrid sync.Pool+channel-based pool scheme for poolCtx with plain sync.Pool	2024-04-20 21:44:53 +02:00
newrelic	app/{vmagent,vminsert}: follow-up for NewRelic data ingestion protocol support	2023-10-16 00:25:25 +02:00
opentelemetry	app/vmagent: simplify code after `509df44d03`	2024-04-02 17:58:13 +03:00
opentsdb	lib/protoparser/opentsdb: extract stream parsing code into a separate stream package	2023-02-13 10:03:16 -08:00
opentsdbhttp	lib/protoparser/opentsdbhttp: extract stream parsing code into a separate stream package	2023-02-13 10:16:03 -08:00
prometheusimport	lib/promscrape: make concurrency control optional (#5073 )	2023-10-02 21:32:11 +02:00
prompush	app,lib: fix typos in comments (#3804 )	2023-02-13 13:27:13 +01:00
promremotewrite	lib/prompb: change type of Label.Name and Label.Value from []byte to string	2024-01-14 22:33:21 +02:00
relabel	lib/prompb: change type of Label.Name and Label.Value from []byte to string	2024-01-14 22:33:21 +02:00
static/css	all: follow-up after `8edb390e21`	2022-06-07 00:57:09 +03:00
vmimport	app/vminsert: replace hybrid sync.Pool+channel-based pool scheme for poolCtx with plain sync.Pool	2024-04-20 21:44:53 +02:00
main.go	Revert `c6c5a5a186` and `b2765c45d0`	2024-07-03 23:51:56 +02:00
README.md	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00

README.md

vminsert routes the ingested data to vmstorage.