VictoriaMetrics/app
Aliaksandr Valialkin 3365dd508f
app/vmagent/remotewrite: do not spend CPU time on an attempt to send data to blocked queue if some queues are unblocked
Previously remotewrite.TryPush() was trying to send data to remote storages with blocked persistent queues,
if some persistent queues to other remote storage systems were unblocked. This resulted in excess CPU usage
on relabeling and stream aggregation for the remote storage with blocked queues.

The solution is to check whether some peristent storages have blocked queues and skip them before applying
per- -remoteWrite.url relabeling and streaming aggregation.

While at it, properly update per- -remoteWrite.url vmagent_remotewrite_samples_dropped_total and vmagent_remotewrite_push_failures_total
counters when global streaming aggregation cannot send data to remote storage systems because of blocked queues.
See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/5467 and https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6268 .

This is a follow-up for 87fd400dfc and f153f54d11

Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6248
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6065
2024-07-15 09:40:34 +02:00
..
victoria-logs app/victoria-logs/Makefile: add make victoria-logs-linux-loong64 build rule 2024-07-12 23:13:19 +02:00
vlinsert app/vlinsert/loki: use easyproto instead for parsing Loki protobuf messages 2024-07-10 03:05:55 +02:00
vlogsgenerator lib/logstorage: work-in-progress 2024-05-25 00:31:55 +02:00
vlselect app/vlselect/vmui: run make vmui-logs-update after 662e026279 2024-07-10 03:05:55 +02:00
vlstorage lib/logstorage: work-in-progress 2024-06-27 14:21:03 +02:00
vmagent app/vmagent/remotewrite: do not spend CPU time on an attempt to send data to blocked queue if some queues are unblocked 2024-07-15 09:40:34 +02:00
vmalert app/vmalert: switch from table-driven tests to f-tests 2024-07-12 22:45:50 +02:00
vmalert-tool deployment: build image for vmagent streamaggr benchmark (#6515) 2024-06-24 16:29:14 +02:00
vmauth all: consistently use 'any' instead of 'interface{}' 2024-07-10 00:23:26 +02:00
vmbackup app: consistently use t.Fatal* instead of t.Error* (except of app/vmalert and app/vmctl - these packages will be processed in a separate commit) 2024-07-11 16:01:25 +02:00
vmbackupmanager all: replace old https://docs.victoriametrics.com/vmbackupmanager.html url with the new one - https://docs.victoriametrics.com/vmbackupmanager/ 2024-04-18 02:04:39 +02:00
vmctl app/vmalert: switch from table-driven tests to f-tests 2024-07-12 22:45:50 +02:00
vmgateway all: replace old https://docs.victoriametrics.com/vmgateway.html url with the new one - https://docs.victoriametrics.com/vmgateway/ 2024-04-18 02:08:53 +02:00
vminsert deployment: build image for vmagent streamaggr benchmark (#6515) 2024-06-24 16:29:14 +02:00
vmrestore deployment: build image for vmagent streamaggr benchmark (#6515) 2024-06-24 16:29:14 +02:00
vmselect app: consistently use t.Fatal* instead of t.Error* (except of app/vmalert and app/vmctl - these packages will be processed in a separate commit) 2024-07-11 16:01:25 +02:00
vmstorage lib/mergeset: adds tracking for indexdb records drop (#6297) 2024-05-24 16:08:34 +02:00
vmui vmui/logs: add spinner to bar chart (#6577) 2024-07-09 18:27:23 +02:00