359 Commits

Author	SHA1	Message	Date
Aliaksandr Valialkin	f9500abfe0	app: fix make publish-* after ed93330e66 ... Add missing `-linux` substring to built binary names for copying into Docker images	2022-07-14 10:59:11 +03:00
Aliaksandr Valialkin	9c435d7a9d	docs: update descriptions for command-line flags according to the latest changes	2022-07-14 00:57:07 +03:00
Nikolay	7301aa678c	lib/promscrape: adds azure service discovery (#2743) ... * lib/promscrape: adds azure service discovery Adds azure service discovery mechanism implements authorization with oauth and msi lists virtual machines and virtual machines managed by scaleSet https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1364 * makes linter happy * Apply suggestions from code review Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> * wip Co-authored-by: Roman Khavronenko <roman@victoriametrics.com> Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-07-13 23:43:18 +03:00
Aliaksandr Valialkin	ed93330e66	all: follow-up for d99ba3481b	2022-07-13 16:44:39 +03:00
Dmytro Kozlov	d99ba3481b	Rename release packages (#2810) ... * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md	2022-07-13 15:42:48 +03:00
Boris Petersen	41e9702698	fix typo introduced in pr #2604 (#2866) ... Signed-off-by: Boris Petersen <boris.petersen@idealo.de>	2022-07-13 15:40:47 +03:00
Aliaksandr Valialkin	8851cf68e1	docs: make more clear the relation between replication and deduplication ... This is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2852	2022-07-11 19:22:15 +03:00
Aliaksandr Valialkin	d3711e66fd	docs/vmagent.md: clarify that vmagent supports Prometheus-compatible service discovery	2022-07-07 21:21:28 +03:00
Aliaksandr Valialkin	ec4d39e893	docs/vmagent.md: typo fixes after ef2eeeb642	2022-07-07 21:16:37 +03:00
Aliaksandr Valialkin	ef2eeeb642	docs/vmagent.md: actualize docs	2022-07-07 20:35:47 +03:00
Aliaksandr Valialkin	10cb67adb5	app/{vmagent,vminsert}: follow-up after d19e46de55 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2839	2022-07-07 01:30:58 +03:00
Aliaksandr Valialkin	855436efd2	lib/promauth: refactor NewConfig in order to improve maintainability ... 1. Split NewConfig into smaller functions 2. Introduce Options struct for simplifying construction of the Config with various options This commit is based on https://github.com/VictoriaMetrics/VictoriaMetrics/pull/2684	2022-07-04 14:31:12 +03:00
Aliaksandr Valialkin	2a877a2a3c	app/vmagent/remotewrite: do not shadow headers global variable in getAuthConfig	2022-06-30 20:18:12 +03:00
Aliaksandr Valialkin	fcc4258404	app/vmagent/remotewrite: clarify descriptions for -remoteWrite.* options, which must be set per each -remoteWrite.url	2022-06-30 20:18:11 +03:00
Aliaksandr Valialkin	c392d6d173	app/vmagent/remotewrite: add -remoteWrite.header command-line flag for setting additional http headers to send to -remoteWrite.url ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2805	2022-06-30 20:00:23 +03:00
Aliaksandr Valialkin	e40b40afe6	Revert "lib/promscrape, vmagent: fix path to files (#2801)" ... This reverts commit 0a8e35835c. Reason for revert: it incorrectly fixes the https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799 See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2799#issuecomment-1171392005	2022-06-30 18:23:56 +03:00
Dmytro Kozlov	0a8e35835c	lib/promscrape, vmagent: fix path to files (#2801) ... vmagent: respect `-pathPrefix` flag for static files and links	2022-06-30 16:22:54 +02:00
Aliaksandr Valialkin	56622bff73	docs: add Troubleshooting doc ... This doc contains troubleshooting guides for typical problems with VictoriaMetrics.	2022-06-30 13:53:59 +03:00
Aliaksandr Valialkin	134751e43e	all: locate throttled loggers via logger.WithThrottler() only once and then use them ... This reduces the contention on logThrottlerRegistryMu mutex when logger.WithThrottler() is called frequently from concurrent goroutines.	2022-06-27 13:45:50 +03:00
Aliaksandr Valialkin	1c4f67c5d2	lib/promauth: add ability to send additional http headers in requests to scrape targets ... This solves https://stackoverflow.com/questions/66032498/prometheus-scrape-metric-with-custom-header	2022-06-22 20:39:43 +03:00
Aliaksandr Valialkin	e6ed92529b	all: remove explicit "xxhash" name when importing github.com/cespare/xxhash/v2 package ... This package already has the same name, so there is no need in explicit name	2022-06-21 20:23:32 +03:00
Aliaksandr Valialkin	cfc99e12da	docs: update docs after e4d6b750f6 ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2753	2022-06-21 14:01:12 +03:00
Aliaksandr Valialkin	afc26c57cc	all: replace bash with console blocks in all the *.md files ... This is a follow-up for 954a7a6fc6	2022-06-19 23:00:39 +03:00
Aliaksandr Valialkin	eabd2e2320	docs/vmagent.md: typo fix: configued -> configured	2022-06-16 20:30:30 +03:00
Aliaksandr Valialkin	c18f8cccfa	lib/promrelabel: support action: graphite relabeling ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2737	2022-06-16 20:24:22 +03:00
Aliaksandr Valialkin	7b3c9c50a8	docs: update command-line flags' descriptions according to recent changes	2022-06-14 13:28:00 +03:00
Aliaksandr Valialkin	1041f395cc	app/vmagent: follow-up after 4583ed23a8	2022-06-13 09:54:11 +03:00
Dmytro Kozlov	4583ed23a8	Added a stub for datadog endpoint (#2710) ... * Added a stub for datadog endpoint * Update app/vmagent/main.go Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-06-13 09:52:13 +03:00
Aliaksandr Valialkin	638ba4614a	docs/CHANGELOG.md: document e755d0ec3f	2022-06-07 15:16:48 +03:00
Aliaksandr Valialkin	8608dd093c	all: follow-up after 8edb390e21 ... - Remove unused js bloatware from /targets page. This strips down binary size by more than 100Kb - Add /service-discovery page for API compatibility with Prometheus - Properly load bootstrap.min.css from /prometheus/targets - Serve static contents for /targets page from app/vminsert instead of app/vmselect, because /targets page is served from there	2022-06-07 00:57:09 +03:00
Aliaksandr Valialkin	0922ed2b7e	lib/promscrape: add -promscrape.cluster.name command-line flag ... This flag is used for proper data de-duplication when the same target is scraped from multiple vmagent clusters. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2679	2022-06-04 00:37:01 +03:00
Dmytro Kozlov	8edb390e21	lib/promscrape: adds service discovery visualization for /targets page(#2675) ... * lib/promscrape: updated template * lib/promscrape: fixed click on unhealthy and all btns * app/vmselect: jquery scripts into static folder Co-authored-by: f41gh7 <nik@victoriametrics.com>	2022-06-03 15:38:45 +02:00
Aliaksandr Valialkin	89c0172778	docs/CHANGELOG.md: follow-up after 11f91532c5 ... See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 12:27:56 +03:00
Dmytro Kozlov	11f91532c5	issue-2594: use embedded for static files (#2650) ... embed static js and css files from CDN into vmalert, vmagent and vmsingle binaries. Co-authored-by: f41gh7 <nik@victoriametrics.com> https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2594	2022-05-31 01:55:28 +02:00
Aliaksandr Valialkin	7747708ca7	app: expose /api/v1/status/config endpoint in the same way as Prometheus does ... This endpoint is needed for third-party tools. See https://prometheus.io/docs/prometheus/latest/querying/api/#config	2022-05-25 09:57:13 +03:00
Aliaksandr Valialkin	1731fe2ada	docs: update the description for command-line flags according to recent changes	2022-05-20 15:09:43 +03:00
Boris Petersen	3df8caca15	Add ability to sign requests for all AWS services (#2604) ... This adds the ability to utilize sigv4 signing for all AWS services not just "aps". When the newly introduced property "service" is not set it will default to "aps". Signed-off-by: Boris Petersen <boris.petersen@idealo.de>	2022-05-18 14:58:31 +02:00
Aliaksandr Valialkin	ce47d18052	app/{vmagent,vminsert}: mention port 8089 instead of 8189 in the description for -influxListenAddr flag ... InfluxDB uses 8089 port for sending plain Influx line protocol data over TCP and UDP. See https://docs.influxdata.com/influxdb/v1.8/administration/ports/ This is a follow-up for 20cef877a1	2022-05-13 16:50:45 +03:00
Yurii Kravets	20cef877a1	Update docs (#2566) ... * deployment/docker: pass `-buildvs=false` to `go build` for production builds This should resolve the `error obtaining VCS status: exit status 128` error when the environment contains incorrect version of git or has incorrect access rights to the directory with VictoriaMetrics source code. See the following links for additional info: - https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2508#issuecomment-1117126702 , - https://github.com/google/ko/issues/672 - https://github.com/golang/go/issues/49004 * lib/netutil: limit the number of concurrently established connections when calling ConnPool.Get() This should reduce potential spikes in the number of established connections in the following cases: - when the connection establishing procedure becomes temporarily slow - after a temporary spike in the rate of ConnPool.Get() calls See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2552 * docs/CHANGELOG.md: document c8af625bcc See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1322#issuecomment-1120276146 * docs/Cluster-VictoriaMetrics.md: typo fix: `by by` -> `by` * docs: add `resource usage limits` docs, which describe fine-grained tuning for various resource usage limits * docs/Cluster-VictoriaMetrics.md: the `/api/v1/label/.../values` query can take CPU and ram at both vmstorage and vmselect * Update root Readme and root vmagent readme Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-12 19:22:13 +02:00
Aliaksandr Valialkin	a0727ab1b1	docs/vmagent.md: typo fix in the description for -promscrape.cluster.replicationFactor command-line flag	2022-05-12 18:50:29 +03:00
Aliaksandr Valialkin	8d81703635	app/vmagent: add missing _total suffix to vmagent_remotewrite_global_rows_pushed_before_relabel_total counter ... This is a follow up for c536139d0b	2022-05-06 15:50:57 +03:00
Aliaksandr Valialkin	c536139d0b	app/vmagent: expose vmagent_remotewrite_global_rows_pushed_before_relabel and vmagent_remotewrite_rows_pushed_after_relabel_total metrics	2022-05-06 15:28:59 +03:00
Aliaksandr Valialkin	51e36fd533	app/vmagent: rename vmagent_remote_write_rate_limit_reached_total to vmagent_remotewrite_rate_limit_reached_total for the sake of consistency with other vmagent_remotewrite_ metrics	2022-05-06 15:01:54 +03:00
Aliaksandr Valialkin	d285c2fea7	lib/awsapi: pass filtersQueryString arg to GetEC2APIResponse() function, so the caller could decide whether to use the filters during the AWS API query ... The filters shouldn't be passed to DescribeAvailabilityZones API call. See https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1626 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 Related commits: 0e09fdb8b0 d289ecded1	2022-05-05 10:29:34 +03:00
Aliaksandr Valialkin	e761d9449c	app/vmagent: rename -remoteWrite.useSigv4 command-line flag to -remoteWrite.aws.useSigv4, so its name is consistent with the other -remoteWrite.aws.* command-line flags	2022-05-04 20:41:17 +03:00
Nikolay	d289ecded1	{lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite (#2458) ... * {lib/promscrape,app/vmagent}: adds sigv4 support for vmagent remoteWrite moves aws related code into separate lib from lib/promscrape it allows to write data from vmagent to the AWS managed prometheus (cortex) https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1287 * Apply suggestions from code review * wip Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>	2022-05-04 20:24:19 +03:00
Gard Rimestad	d0706c8c95	app/vmagent add metric for rate limit (#2521) ... This adds a metric for the rate limit. The limit is present as a flag currently: `flag{name="remoteWrite.rateLimit", value="500000", is_set="true"} 1` We are running many instances of vmagent and when creating alerts it is harder than it needs to be when extracting the value from the flag. With this change it should be easier to monitor how close to the limit we are. `((100/vmagent_remotewrite_rate_limit{account="account"})*sum (rate(vmagent_remotewrite_conn_bytes_written_total{account="account"}))) and ON (account) flag{name="remoteWrite.rateLimit"} == 1`	2022-05-02 22:20:05 +03:00
Aliaksandr Valialkin	4176be38c4	app/vmagent: substitute hard-to-read 500000000 with 500MB in -remoteWrite.maxDiskUsagePerURL description	2022-04-26 15:48:20 +03:00
Aliaksandr Valialkin	f6d0e5e74a	all: typo fix: Kuberntes -> Kubernetes	2022-04-20 10:50:49 +03:00
Aliaksandr Valialkin	1097ebebe6	lib/httpserver: clarify that -tls flag enables TLS for http requests to -httpListenAddr	2022-04-16 16:59:26 +03:00