1810 Commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	1812d33a2d	lib/promscrape: automatically generate additional per-target labels for targets with non-zero series limit ... The following metrics are generated: - scrape_series_limit - scrape_series_current - scrape_series_limit_samples_dropped These metrics simplify alerting on targets, which expose too many time series See https://docs.victoriametrics.com/vmagent.html#automatically-generated-metrics and https://docs.victoriametrics.com/vmagent.html#cardinality-limiter for more details	2022-08-17 13:22:02 +03:00
Roman Khavronenko	0261118765	docs: add new article link (#2989) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-17 13:22:02 +03:00
Aliaksandr Valialkin	e5c61cac22	docs/CHANGELOG.md: group vmalert features closer to each other	2022-08-17 11:49:53 +03:00
Aliaksandr Valialkin	aa37e6b438	lib/promscrape: retry http requests if the server returns 429 status code ... The 429 status code means that the server is overwhelmed with requests. The client can retry the request after some wait time. Implement this strategy for service discovery and scrape requests. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-16 14:57:26 +03:00
Aliaksandr Valialkin	dc929e0d16	lib/storage: improve performance for /api/v1/labels and /api/v1/label/.../values endpoints when match[] filter matches small number of time series ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2978	2022-08-16 13:34:23 +03:00
Aliaksandr Valialkin	d39915ff8e	docs/MetricsQL.md: add the list of supported ... functions lines just before the corresponding lists ... This improves the readability a bit	2022-08-16 12:10:09 +03:00
Roman Khavronenko	436b4d90af	docs: update vmalert docs (#2987) ... * mention recently added `$alertID` and `$groupID` variables in the changelog * properly escape template examples in the vmalert's README Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 12:10:08 +03:00
Roman Khavronenko	0d5c403b6e	vmalert: support $alertID and $groupID in template variables (#2983) ... Support of these two variables allows building custom URLs with alert's ID and group ID params. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/517#issuecomment-1207141432 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-16 11:24:01 +03:00
Artem Navoiev	5ae251d074	fix typo in influx guide (#2984)	2022-08-16 11:23:59 +03:00
Aliaksandr Valialkin	7d7cf2b6fd	app/vmselect: follow-up after 63e0f16062 ... * Explicitly store a pointer to UserReadableError in the error interface. Previously Go automatically converted the value to a pointer before storing in the error interface. * Add Unwrap() method to UserReadableError, so it can be used transparently with the other code, which calls errors.Is() and errors.As(). * Document the change in docs/CHANGELOG.md	2022-08-15 13:53:19 +03:00
Roman Khavronenko	79e396dac9	docs: mention default vmalert's behavior change in Update notes (#2981) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-15 13:31:59 +03:00
Yury Molodov	dc52b283a3	vmui: shortcut keys legend (#2971) ... * feat: add shortcut modal * feat: add shortcut descriptions * app/vmselect/vmui: `make vmui-update` * docs/CHANGELOG.md: document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-15 12:04:30 +03:00
Yurii Kravets	d7dc7c81e7	doc: add upgrade/downgrade without downtime to FAQ (#2973) ... * doc: add upgrade/downgrade without downtime to FAQ Added info on how to upgrade or downgrade VictoriaMetrics without downtime to FAQ Based on reply https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2944#issuecomment-1207502038 * Udate pr Fixing format	2022-08-15 11:31:00 +03:00
Aliaksandr Valialkin	c27bd63f6c	lib/promscrape: update links to sd_configs from Prometheus site to https://docs.victoriametrics.com/sd_configs.html	2022-08-15 01:40:48 +03:00
Aliaksandr Valialkin	1a00c9ef03	lib/promscrape/discovery/kubernetes: add __meta_kubernetes_pod_container_image label in the same way as Prometheus 2.38 does ... See https://github.com/prometheus/prometheus/pull/11034	2022-08-15 01:18:57 +03:00
Aliaksandr Valialkin	2fb63dda83	lib/promscrape/discovery/kubernetes: add __meta_kubernetes_service_port_number label to role: service in the same way as Prometheus 2.38 does ... See https://github.com/prometheus/prometheus/pull/11002	2022-08-15 01:07:19 +03:00
Aliaksandr Valialkin	198d8eeeaa	app/vmalert/templates: add toTime() template function in the same way as Prometheus 2.38 does ... See https://github.com/prometheus/prometheus/pull/10993	2022-08-15 00:49:52 +03:00
Aliaksandr Valialkin	2b58bd9876	lib/promscrape/discovery/dns: add support for resolving MX records ... See https://github.com/prometheus/prometheus/pull/10099	2022-08-15 00:33:06 +03:00
Aliaksandr Valialkin	78f584fb0b	docs/CHANGELOG.md: clarify the change at 28441711e6	2022-08-11 23:53:32 +03:00
Roman Khavronenko	36660bcfe2	vmalert: follow-up after 28441711e6 (#2972) ... Signed-off-by: hagen1778 <roman@victoriametrics.com> Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-11 23:52:18 +03:00
Aliaksandr Valialkin	ec3df0b913	app/vmselect/netstorage: improve scalability of blocks processing on systems with multiple CPU cores ... Previously a single syncwg.WaitGroup was used for tracking the lifetime of processBlock callbacks across all the per-vmstorage goroutines. This could be slow on systems with many CPU cores because of inter-CPU synchronization overhead. Use a separate per-vmstorage sync.WaitGroup instead in order to reduce inter-CPU synchronization overhead. This should imrpove performance for heavy queries over big number of blocks on multi-CPU systems.	2022-08-11 21:37:24 +03:00
Roman Khavronenko	f42853275f	lib/storage: prevent excessive loops when storage is in RO (#2962) ... * lib/storage: prevent excessive loops when storage is in RO Returning nil error when storage is in RO mode results into excessive loops and function calls which could result into CPU exhaustion. Returning an err instead will trigger delays in the for loop and save some resources. Signed-off-by: hagen1778 <roman@victoriametrics.com> * document the change Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-09 12:17:47 +03:00
Aliaksandr Valialkin	91d0b45537	docs/CHANGELOG.md: cut v1.80.0	2022-08-08 19:59:02 +03:00
Aliaksandr Valialkin	7e892d3322	docs/CHANGELOG.md: add changes for v1.79.2	2022-08-08 18:00:38 +03:00
Aliaksandr Valialkin	b8877da35b	docs/CHANGELOG.md: link to the issue related to vmselect panic in multi-level cluster setup ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2961	2022-08-08 15:09:39 +03:00
Aliaksandr Valialkin	ceb158c5bb	docs/vmagent.md: typo fix in __meta_kubernetes_annotation_prometheus_io_tenant label name ... It must be __meta_kubernetes_pod_annotation_prometheus_io_tenant	2022-08-08 14:53:28 +03:00
Aliaksandr Valialkin	310779d8b5	lib/promscrape: follow-up after 2c553d5a2f ... - fix broken tests - cosmetic code cleanup - document the change at https://docs.victoriametrics.com/vmagent.html#multitenancy - document the change at https://docs.victoriametrics.com/CHANGELOG.html	2022-08-08 14:49:16 +03:00
Aliaksandr Valialkin	69d62d5736	docs: sync -help output with the latest changes	2022-08-08 14:05:36 +03:00
Aliaksandr Valialkin	221dd3a224	all: bump the minimum supported version of Go from 1.17 to 1.18 ... This is needed because some dependencies uses generics, which have been appeared in Go1.18 This is a follow-up for caf3dd4fa2	2022-08-08 13:45:39 +03:00
Roman Khavronenko	6af40f6275	vmalert: remove notions of vmalert being compatible with VM only (#2954) ... vmalert can be successfully used with datasources compatible with Prometheus HTTP API. So we remove comments or notes in Readme which are saying opposite. Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-08-08 13:44:15 +03:00
Aliaksandr Valialkin	1996e36cf0	app/vmselect/netstorage: prevent from calling processBlocks callback after the exit from ProcessBlocks function ... This should prevent from panic at multi-level vmselect when the top-level vmselect is configured with -replicationFactor > 1	2022-08-08 13:32:44 +03:00
Aliaksandr Valialkin	12f4c89ff7	docs/CHANGELOG.md: link to the issue with improper handling of enpoint option at ec2_sd_configs ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2917	2022-08-08 03:33:17 +03:00
Aliaksandr Valialkin	9039f23bd1	lib/promrelabel: do not split regex into multiple lines if it contains groups ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2928	2022-08-08 03:16:15 +03:00
Aliaksandr Valialkin	23b7fa897a	docs/CHANGELOG.md: link to the issue regarding the increased load on Consul ... This is a follow-up for 68de1f4e4a Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2940	2022-08-08 02:23:01 +03:00
Aliaksandr Valialkin	b5a05f627c	docs/_includes/img.html: fix https://github.com/VictoriaMetrics/VictoriaMetrics/security/code-scanning/28	2022-08-08 01:04:20 +03:00
Yury Molodov	a2ecf311b8	vmui: graph action on moush hold and move (#2915) ... * fix: change event for graph panning * fix: change detect key * feat: add zoom in with mouse selection * - document the change - run `make vmui-update` Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-08-07 23:56:08 +03:00
Aliaksandr Valialkin	7a1a95fd3e	docs/sd_configs.md: mention that http client configs can contain headers and proxy_headers options	2022-08-07 22:41:02 +03:00
Aliaksandr Valialkin	573f6c8d6c	Makefile: remove redundant -mod=vendor option when running Go tools ... The `-mod=vendor` is automatically set when there is a `vendor` directory starting from Go1.14 - see https://go.dev/doc/go1.14#go-command Since the minimum supported Go version for VictoriaMetrics is Go1.17, then the `-mod=vendor` option is no longer needed.	2022-08-07 20:40:41 +03:00
Aliaksandr Valialkin	ed891049d5	docs/sd_configs.md: mention that http client options can be specified in scrape_configs section	2022-08-07 00:20:28 +03:00
Aliaksandr Valialkin	5e43145031	docs: add docs for scrape_configs section	2022-08-07 00:04:55 +03:00
Aliaksandr Valialkin	0596bae703	docs/sd_configs.md: add docs for static_configs	2022-08-06 23:17:28 +03:00
Aliaksandr Valialkin	d4c3702afe	docs/sd_configs.md: add docs for openstack_sd_configs	2022-08-06 23:07:11 +03:00
Aliaksandr Valialkin	659f093d87	docs/sd_configs.md: document kubernetes_sd_configs	2022-08-06 22:39:16 +03:00
Aliaksandr Valialkin	77bd4e37cc	lib/promscrape/discovery/kubernetes: add missing __meta_kubernetes_ingress_class_name label for role: ingress ... See 7e65ad3e43 and 7e1111ff14	2022-08-06 22:39:14 +03:00
Aliaksandr Valialkin	98deef04f5	docs/sd_configs.md: document http_sd_configs	2022-08-05 19:50:29 +03:00
Aliaksandr Valialkin	8d63e316a9	docs/sd_configs.md: document gce_sd_configs	2022-08-05 19:37:23 +03:00
Aliaksandr Valialkin	ecdd57e13b	docs/sd_configs.md: document file_sd_configs	2022-08-05 19:17:29 +03:00
Aliaksandr Valialkin	6d5c8f82cf	docs/sd_configs.md: document eureka_sd_configs	2022-08-05 19:05:33 +03:00
Aliaksandr Valialkin	091c654c92	docs/sd_configs.md: document ec2_sd_configs	2022-08-05 18:52:39 +03:00
Aliaksandr Valialkin	ecbe1ddf1b	lib/promscrape/discovery/ec2: properly handle custom endpoint option in ec2_sd_configs ... This option was ignored since d289ecded1 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287	2022-08-05 18:52:37 +03:00
Aliaksandr Valialkin	8d6ac974b2	docs/sd_configs.md: add docs for dockerswarm_sd_configs	2022-08-05 16:20:30 +03:00
Aliaksandr Valialkin	80ecfcf759	lib/promscrape/discovery/dockerswarm: properly set __meta_dockerswarm_container_label_* labels instead of __meta_dockerswarm_task_label_* labels ... See https://github.com/prometheus/prometheus/issues/9187	2022-08-05 16:20:29 +03:00
Aliaksandr Valialkin	d02ecc71bb	docs/sd_configs.md: document docker_sd_configs	2022-08-05 15:36:52 +03:00
Aliaksandr Valialkin	a931f75d51	docs/sd_configs.md: document dns_sd_configs	2022-08-05 15:27:07 +03:00
Aliaksandr Valialkin	81dc3a34ed	docs/sd_configs.md: document digitalocean_sd_configs	2022-08-05 15:17:09 +03:00
Aliaksandr Valialkin	c4e6973bc8	docs/sd_configs.md: document consul_sd_configs	2022-08-05 15:04:06 +03:00
Aliaksandr Valialkin	85b04732ed	lib/promscrape/discovery/consul: allow stale responses from Consul service discovery by default ... This aligns with Prometheus behaviour. See `allow_stale` option description at https://prometheus.io/docs/prometheus/latest/configuration/configuration/#consul_sd_config	2022-08-05 15:04:05 +03:00
Aliaksandr Valialkin	2c2a5ff553	docs/sd_configs.md: document azure_sd_configs	2022-08-05 14:16:10 +03:00
Aliaksandr Valialkin	df34f8c5b8	docs: fixes after 83a4abda3f	2022-08-05 10:15:28 +03:00
Aliaksandr Valialkin	8ddad31eef	lib/promscrape/discovery/yandexcloud: follow-up after 6e5ac32fba ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386	2022-08-04 22:28:21 +03:00
Igor Tiunov	0ba86fe87e	YC service discovery (#2923) ... * YC service discovery https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1386 * Fixed linter suggestions * fixed golint errors	2022-08-04 22:28:20 +03:00
Aliaksandr Valialkin	a07891cca6	docs: exporing -> exporting typo fix ... This is a follow-up after ccb6cb6501	2022-08-04 20:31:59 +03:00
kevinflynn387	6d909c87f9	Docs: Fix typo from "HA paris" to "HA pairs" (#2935) ... * Update README.md: fix typo to "HA pairs" Update README.md to fix typo from "HA paris" to "HA pairs" * Update docs/README.md : Fix of typo from "HA paris" Update docs/README.md : Fix of typo from "HA paris" to "HA pairs" * Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs" Update of Single-server-VictoriaMetrics.md to fix typo "HA paris" to "HA pairs"	2022-08-04 20:29:02 +03:00
Aliaksandr Valialkin	98caffcfc4	docs: fix the recommended url for -vmalert.proxyURL accroding to 8667307d73	2022-08-04 18:03:24 +03:00
Aliaksandr Valialkin	64183d4416	docs/CHANGELOG.md: document v1.79.1 security fix	2022-08-02 13:31:14 +03:00
Aliaksandr Valialkin	a1e49606ed	app/{vmselect,vmalert}: properly generate http redirects if -http.pathPrefix command-line flag is set ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2918	2022-08-02 13:01:13 +03:00
Aliaksandr Valialkin	f1a49fe779	docs/Release-Guide.md: document that feature docs must be updated with the release where the feature appeared	2022-07-30 00:16:34 +03:00
Aliaksandr Valialkin	962ed46583	lib/mergeset: optimize mergeInmemoryBlocks() function ... Do not spend CPU time on converting inmemoryBlock structs to inmemoryPart structs. Just merge inmemoryBlock structs directly. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2249	2022-07-28 00:05:45 +03:00
Aliaksandr Valialkin	8722342819	docs/CHANGELOG.md: clarify docs about the ability to configure multiple sections for vmauth with identical username and different password values	2022-07-26 19:39:00 +03:00
Aliaksandr Valialkin	86e0abe357	docs/Single-server-VictoriaMetrics.md: improve "Push metrics" docs	2022-07-26 19:34:29 +03:00
Aliaksandr Valialkin	9f1e558c58	all: rename -pushmetrics.extraLabels to -pushmetrics.extraLabel for the sake of consistency	2022-07-26 19:25:26 +03:00
Aliaksandr Valialkin	bf797ba4d9	all: push metrics to -pusmetrics.url in gzip-compressed form in order to reduce the needed network bandwidth	2022-07-25 10:54:54 +03:00
Aliaksandr Valialkin	3d4c312ba2	app/vmselect/netstorage: improve the speed of queries over big number of time series on multi-CPU system ... Reduce inter-CPU communications when processing the query over big number of time series. This should improve performance for queries over big number of time series on systems with many CPU cores. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2896 Based on b596ac3745 Thanks to @zqyzyq for the idea.	2022-07-25 09:22:28 +03:00
Aliaksandr Valialkin	1b5799f894	lib/promscrape: set up=0 for partially failed scrape in stream parsing mode ... This behaviour aligns with Prometheus behavior	2022-07-22 13:38:25 +03:00
Aliaksandr Valialkin	b1129fda0c	docs/vmgateway: typo fix in regexp filter: ~= is substituted with =~	2022-07-21 22:37:42 +03:00
Aliaksandr Valialkin	cfeb6138ae	docs/BestPractices.md: do not mention NFS ... Though VictoriaMetrics works OK on NFS-like filesystems, it is not a best practice	2022-07-21 21:31:14 +03:00
Aliaksandr Valialkin	aae522e501	docs/CHANGELOG.md: document bugfix for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2874 ... This is a follow-up for edecd2493c	2022-07-21 21:00:34 +03:00
Aliaksandr Valialkin	3cbe232186	docs/CHANGELOG.md: follow-up after 88edb3f6cf	2022-07-21 20:53:24 +03:00
Roman Khavronenko	d0abdc2b5b	vmalert: allow configuring custom headers per group (#2901) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:48:05 +03:00
Roman Khavronenko	356d8b99e0	vmalert: allow configuring custom headers for URLs (#2897) ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2860 Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-21 20:45:12 +03:00
Aliaksandr Valialkin	db96221cee	docs/Cluster-VictoriaMetrics.md: update after fe68bb3ba7	2022-07-21 20:21:39 +03:00
Aliaksandr Valialkin	fe68bb3ba7	all: follow-up after 46f803fa7a ... Add -pushmetrics.* command-line flags to all the VictoriaMetrics apps	2022-07-21 20:18:25 +03:00
Aliaksandr Valialkin	f00a6bf837	all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url	2022-07-21 20:15:29 +03:00
Aliaksandr Valialkin	7a06ee11fd	docs/vmauth.md: mention that multiple recrods for the same username are supported ... This is a follow-up for 88029c521c	2022-07-19 19:43:20 +03:00
Nikolay	0102eb3869	app/vmauth: allow duplicate usernames (#2888) ... Usernames could be duplicate if it has uniq password. vmauth makes routing based on auth token and username + password combination must be unique for this case.	2022-07-19 19:35:28 +03:00
Denys Holius	419f913bb9	docs: faq update (#2889) ... * docs: faq update add links for OpenBSD ports & pre built binaries * Update docs/FAQ.md Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-19 17:51:04 +03:00
Aliaksandr Valialkin	f992f96a88	app/vmselect/promql: execute q1 and q2 from q1 op q2 in parallel if labels pushdown cannot be applied ... This should improve query performance if VictoriaMetrics has enough resources for processing `q1` and `q2` in parallel. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2886	2022-07-19 14:29:41 +03:00
Aliaksandr Valialkin	69c1272d1b	docs/Articles.md: add a link to "How do We Keep Metrics for a Long Time in VictoriaMetrics" talk	2022-07-19 13:01:39 +03:00
Aliaksandr Valialkin	2d1366353c	lib/promscrape: reload all the scrape configs when the global section is changed inside -promscrape.config ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2884	2022-07-18 17:15:42 +03:00
Aliaksandr Valialkin	d920b0afec	app/vmselect/promql: properly return q1 series from q1 ifnot q2 when q2 returns nothing	2022-07-18 14:24:23 +03:00
Aliaksandr Valialkin	83fef7daf5	docs/CHANGELOG.md: document 2f9668eba5	2022-07-18 12:37:34 +03:00
Aliaksandr Valialkin	979444b4ed	all: fix other typos in the same way as 6f4d9b2a48 does	2022-07-18 12:10:41 +03:00
cui fliter	e0d30f6ec5	fix some typos (#2882) ... Signed-off-by: cui fliter <imcusg@gmail.com>	2022-07-18 12:10:40 +03:00
Aliaksandr Valialkin	b2d9379bd0	docs/CHANGELOG.md: mention that v1.79.0 changes binary names to $(APP_NAME)-$(GOOS)-$(GOARCH)... naming	2022-07-18 12:00:45 +03:00
Aliaksandr Valialkin	7669d34931	docs/Single-server-VictoriaMetrics.md: add a link on docs how to send signals to processes in Linux	2022-07-18 10:59:28 +03:00
Aliaksandr Valialkin	fae54e2e56	docs/Troubleshooting.md: clarify some texts there	2022-07-15 12:23:39 +03:00
Aliaksandr Valialkin	0237d987c0	docs/Troubleshooting.md: mention about -search.setLookbackToStep command-line flag in the section explaining why /api/v1/query_range returns calculated data	2022-07-15 11:55:34 +03:00
Aliaksandr Valialkin	0d4676f313	docs/Single-server-VictoriaMetrics.md: mention that the delete API doesnt delete the associated entries from inverted index	2022-07-14 21:29:28 +03:00
Aliaksandr Valialkin	a87f143e92	docs/CHANGELOG.md: cut v1.79.0	2022-07-14 16:15:35 +03:00
Roman Khavronenko	80de6face8	vmalert: drop support of deprecated extra_filter_labels param (#2870) ... Signed-off-by: hagen1778 <roman@victoriametrics.com>	2022-07-14 16:10:46 +03:00