mirror of
https://github.com/VictoriaMetrics/VictoriaMetrics.git
synced 2025-01-20 23:39:48 +01:00
docs/stream-aggregation.md: clarify that stream aggregation is applied after all the configured relabeling
This is a follow-up after 68d2cb203d
This commit is contained in:
parent
6a8911ad38
commit
de3d5943eb
@ -503,13 +503,16 @@ with [additional enhancements](#relabeling-enhancements). The relabeling can be
|
|||||||
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
||||||
|
|
||||||
* At the `-remoteWrite.urlRelabelConfig` files. This relabeling is used for modifying labels for metrics
|
* At the `-remoteWrite.urlRelabelConfig` files. This relabeling is used for modifying labels for metrics
|
||||||
and for dropping unneeded metrics before sending them to a particular `-remoteWrite.url`.
|
and for dropping unneeded metrics before sending them to the particular `-remoteWrite.url`.
|
||||||
|
|
||||||
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
||||||
|
|
||||||
All the files with relabeling configs can contain special placeholders in the form `%{ENV_VAR}`,
|
All the files with relabeling configs can contain special placeholders in the form `%{ENV_VAR}`,
|
||||||
which are replaced by the corresponding environment variable values.
|
which are replaced by the corresponding environment variable values.
|
||||||
|
|
||||||
|
[Streaming aggregation](https://docs.victoriametrics.com/stream-aggregation.html), if configured,
|
||||||
|
is pefrormed after applying all the relabeling stages mentioned above.
|
||||||
|
|
||||||
The following articles contain useful information about Prometheus relabeling:
|
The following articles contain useful information about Prometheus relabeling:
|
||||||
|
|
||||||
* [Cookbook for common relabeling tasks](https://docs.victoriametrics.com/relabeling.html)
|
* [Cookbook for common relabeling tasks](https://docs.victoriametrics.com/relabeling.html)
|
||||||
|
@ -15,7 +15,8 @@ aliases:
|
|||||||
[vmagent](https://docs.victoriametrics.com/vmagent.html) and [single-node VictoriaMetrics](https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html)
|
[vmagent](https://docs.victoriametrics.com/vmagent.html) and [single-node VictoriaMetrics](https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html)
|
||||||
can aggregate incoming [samples](https://docs.victoriametrics.com/keyConcepts.html#raw-samples) in streaming mode by time and by labels before data is written to remote storage.
|
can aggregate incoming [samples](https://docs.victoriametrics.com/keyConcepts.html#raw-samples) in streaming mode by time and by labels before data is written to remote storage.
|
||||||
The aggregation is applied to all the metrics received via any [supported data ingestion protocol](https://docs.victoriametrics.com/#how-to-import-time-series-data)
|
The aggregation is applied to all the metrics received via any [supported data ingestion protocol](https://docs.victoriametrics.com/#how-to-import-time-series-data)
|
||||||
and/or scraped from [Prometheus-compatible targets](https://docs.victoriametrics.com/#how-to-scrape-prometheus-exporters-such-as-node-exporter).
|
and/or scraped from [Prometheus-compatible targets](https://docs.victoriametrics.com/#how-to-scrape-prometheus-exporters-such-as-node-exporter)
|
||||||
|
after applying all the configured [relabeling stages](https://docs.victoriametrics.com/vmagent.html#relabeling).
|
||||||
|
|
||||||
Stream aggregation ignores timestamps associated with the input [samples](https://docs.victoriametrics.com/keyConcepts.html#raw-samples).
|
Stream aggregation ignores timestamps associated with the input [samples](https://docs.victoriametrics.com/keyConcepts.html#raw-samples).
|
||||||
It expects that the ingested samples have timestamps close to the current time.
|
It expects that the ingested samples have timestamps close to the current time.
|
||||||
@ -389,7 +390,10 @@ Both input and output metric names can be modified if needed via relabeling acco
|
|||||||
## Relabeling
|
## Relabeling
|
||||||
|
|
||||||
It is possible to apply [arbitrary relabeling](https://docs.victoriametrics.com/vmagent.html#relabeling) to input and output metrics
|
It is possible to apply [arbitrary relabeling](https://docs.victoriametrics.com/vmagent.html#relabeling) to input and output metrics
|
||||||
during stream aggregation via `input_relabel_configs` and `output_relabel_config` options in [stream aggregation config](#stream-aggregation-config).
|
during stream aggregation via `input_relabel_configs` and `output_relabel_configs` options in [stream aggregation config](#stream-aggregation-config).
|
||||||
|
|
||||||
|
Relabeling rules inside `input_relabel_configs` are applied to samples matching the `match` filters.
|
||||||
|
Relabeling rules inside `output_relabel_configs` are applied to aggregated samples before sending them to the remote storage.
|
||||||
|
|
||||||
For example, the following config removes the `:1m_sum_samples` suffix added [to the output metric name](#output-metric-names):
|
For example, the following config removes the `:1m_sum_samples` suffix added [to the output metric name](#output-metric-names):
|
||||||
|
|
||||||
@ -402,9 +406,6 @@ For example, the following config removes the `:1m_sum_samples` suffix added [to
|
|||||||
regex: "(.+):.+"
|
regex: "(.+):.+"
|
||||||
```
|
```
|
||||||
|
|
||||||
`input_relabel_configs` and `output_relabel_config` is applied at the very end, after `-remoteWrite.relabelConfig`
|
|
||||||
and scrape relabeling was applied.
|
|
||||||
|
|
||||||
## Aggregation outputs
|
## Aggregation outputs
|
||||||
|
|
||||||
The aggregations are calculated during the `interval` specified in the [config](#stream-aggregation-config)
|
The aggregations are calculated during the `interval` specified in the [config](#stream-aggregation-config)
|
||||||
|
@ -514,13 +514,16 @@ with [additional enhancements](#relabeling-enhancements). The relabeling can be
|
|||||||
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
||||||
|
|
||||||
* At the `-remoteWrite.urlRelabelConfig` files. This relabeling is used for modifying labels for metrics
|
* At the `-remoteWrite.urlRelabelConfig` files. This relabeling is used for modifying labels for metrics
|
||||||
and for dropping unneeded metrics before sending them to a particular `-remoteWrite.url`.
|
and for dropping unneeded metrics before sending them to the particular `-remoteWrite.url`.
|
||||||
|
|
||||||
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
This relabeling can be debugged via `http://vmagent:8429/metric-relabel-debug` page. See [these docs](#relabel-debug) for details.
|
||||||
|
|
||||||
All the files with relabeling configs can contain special placeholders in the form `%{ENV_VAR}`,
|
All the files with relabeling configs can contain special placeholders in the form `%{ENV_VAR}`,
|
||||||
which are replaced by the corresponding environment variable values.
|
which are replaced by the corresponding environment variable values.
|
||||||
|
|
||||||
|
[Streaming aggregation](https://docs.victoriametrics.com/stream-aggregation.html), if configured,
|
||||||
|
is pefrormed after applying all the relabeling stages mentioned above.
|
||||||
|
|
||||||
The following articles contain useful information about Prometheus relabeling:
|
The following articles contain useful information about Prometheus relabeling:
|
||||||
|
|
||||||
* [Cookbook for common relabeling tasks](https://docs.victoriametrics.com/relabeling.html)
|
* [Cookbook for common relabeling tasks](https://docs.victoriametrics.com/relabeling.html)
|
||||||
|
Loading…
Reference in New Issue
Block a user