Commit Graph

382 Commits

Author SHA1 Message Date
Dmytro Kozlov
b75f1854c5
vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric) (#2982)
* vmselect/promql: add alphanumeric sort by label (sort_by_label_numeric)

* vmselect/promql: fix tests, add documentation

* vmselect/promql: update test

* vmselect/promql: update for alphanumeric sorting, fix tests

* vmselect/promql: remove comments

* vmselect/promql: cleanup

* vmselect/promql: avoid memory allocations, update functions descriptions

* vmselect/promql: make linter happy (remove ineffectual assigment)

* vmselect/promql: add test case, fix behavior when strings are equal

* vendor: update github.com/VictoriaMetrics/metricsql from v0.44.1 to v0.45.0

this adds support for sort_by_label_numeric and sort_by_label_numeric_desc functions

* wip

* lib/promscrape: read response body into memory in stream parsing mode before parsing it

This reduces scrape duration for targets returning big responses.

The response body was already read into memory in stream parsing mode before this change,
so this commit shouldn't increase memory usage.

* wip

Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>
2022-09-14 17:41:09 +03:00
Aliaksandr Valialkin
523ff25077
vendor: make vendor-update 2022-09-13 16:44:44 +03:00
Aliaksandr Valialkin
7c2fa1bc48
vendor: make vendor-update 2022-09-08 18:51:49 +03:00
Aliaksandr Valialkin
9a1ede0977
vendor: make vendor-update 2022-09-02 21:42:41 +03:00
Aliaksandr Valialkin
6ba93bf2dc
vendor: make vendor-update 2022-08-30 09:45:26 +03:00
Aliaksandr Valialkin
278481f71d
vendor: make vendor-update 2022-08-21 19:06:28 +03:00
Aliaksandr Valialkin
28a7a19a94
go.mod: update github.com/VictoriaMetrics/metrics from v1.22.1 to v1.22.2 2022-08-17 21:13:06 +03:00
Aliaksandr Valialkin
308f29f674
vendor: make vendor-update 2022-08-15 00:53:41 +03:00
Aliaksandr Valialkin
1a851b14c9
vendor: update github.com/VictoriaMetrics/metrics from v1.21.0 to v1.22.1 2022-08-08 17:18:42 +03:00
Aliaksandr Valialkin
ebd59e17df
vendor: make vendor-update 2022-08-07 22:38:01 +03:00
Aliaksandr Valialkin
b5b13e48a3
vendor: update github.com/VictoriaMetrics/metrics from v1.20.1 to v1.21.0
This adds the following push-related metrics when -pushmetrics.url is set:

- metrics_push_interval_seconds
- metrics_push_total
- metrics_push_errors_total
- metrics_push_bytes_pushed_total
- metrics_push_duration_seconds
- metrics_push_block_size_bytes

Updates https://github.com/VictoriaMetrics/metrics/issues/35
2022-08-04 18:15:50 +03:00
Aliaksandr Valialkin
bf65709540
vendor: make vendor-update 2022-08-02 09:19:38 +03:00
Aliaksandr Valialkin
f148cffc8a
vendor: make vendor-update 2022-07-25 10:49:33 +03:00
Aliaksandr Valialkin
7afcc42454
all: push metrics to -pusmetrics.url in gzip-compressed form in order to reduce the needed network bandwidth 2022-07-25 10:42:26 +03:00
Aliaksandr Valialkin
2a78975447
vendor: make vendor-update 2022-07-21 21:10:25 +03:00
Aliaksandr Valialkin
4ce5875fa8
all: add ability to push internal metrics to remote storage system specified via -pushmetrics.url 2022-07-21 20:36:27 +03:00
Aliaksandr Valialkin
87cdb58bc3
vendor: make vendor-update 2022-07-18 11:13:54 +03:00
Aliaksandr Valialkin
5f7b6bedce
vendor: make vendor-update 2022-07-13 16:43:53 +03:00
Aliaksandr Valialkin
4b67231097
vendor: make vendor-update 2022-07-11 18:13:38 +03:00
Aliaksandr Valialkin
9cb8838b30
vendor: make vendor-update 2022-07-07 20:47:17 +03:00
Aliaksandr Valialkin
611434ce81
vendor: make vendor-update 2022-07-04 12:00:27 +03:00
Aliaksandr Valialkin
32ac6b5ed8
vendor: update github.com/VictoriaMetrics/metricsql from v0.44.0 to v0.44.1 2022-06-30 18:20:33 +03:00
Aliaksandr Valialkin
eefa1e24f8
vendor: make vendor-update 2022-06-28 14:51:45 +03:00
Aliaksandr Valialkin
d2bbbf147c
all: limit the maximum memory usage for regexp cache, which stores parsed regular expressions in MetricsQL queries
Previously the cache could store 10K unique regexps. When every regexp is huge (e.g. hundreds of kilobytes),
then the total cache size could grow to multiples of gigabytes. Now the cache size is limited by the total length
of all cached regexps. So huge regexps won't result in high memory usage for the cache.
2022-06-24 17:57:43 +03:00
Aliaksandr Valialkin
418f40f7fa
vendor: make vendor-update 2022-06-20 14:30:23 +03:00
Aliaksandr Valialkin
c7555ab635
vendor: make vendor-update 2022-06-13 10:02:21 +03:00
Aliaksandr Valialkin
b3b6cf345a
vendor: make vendor-update 2022-06-06 13:19:34 +03:00
Aliaksandr Valialkin
b6af13ae94
vendor: make vendor-update 2022-05-31 12:57:04 +03:00
Aliaksandr Valialkin
31c6cfe3fb
vendor: make vendor-update 2022-05-25 21:49:12 +03:00
Aliaksandr Valialkin
d87733fe1c
vendor: make vendor-update 2022-05-20 14:45:24 +03:00
dependabot[bot]
baf1ec4639
build(deps): bump github.com/influxdata/influxdb from 1.9.6 to 1.9.7 (#2589)
Bumps [github.com/influxdata/influxdb](https://github.com/influxdata/influxdb) from 1.9.6 to 1.9.7.
- [Release notes](https://github.com/influxdata/influxdb/releases)
- [Changelog](https://github.com/influxdata/influxdb/blob/master/CHANGELOG_OLD.md)
- [Commits](https://github.com/influxdata/influxdb/commits)

---
updated-dependencies:
- dependency-name: github.com/influxdata/influxdb
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-05-17 13:14:30 +02:00
Dmytro Kozlov
c8af625bcc
vmctl: fix build for solaris os (#2555)
* vmctl: fix build for solaris os

* vmctl: updated dependency (using Syscall instead of Syscall6)

* vmctl: updated dependency

* vmctl: updated dependency
2022-05-09 21:36:18 +02:00
Aliaksandr Valialkin
043363750a
vendor: make vendor-update 2022-05-07 01:48:35 +03:00
Aliaksandr Valialkin
8be5c0ab16
vendor: make vendor-update 2022-05-04 23:50:38 +03:00
Aliaksandr Valialkin
67977e2b55
vendor: make vendor-update 2022-05-02 16:00:32 +03:00
Dmytro Kozlov
b2294d1cf1
vmctl/vm: added datapoints collection bar (#2486)
add progress bars to the VM importer

The new progress bars supposed to display the processing speed per each
VM importer worker. This info should help to identify if there is a bottleneck
on the VM side during the import process, without waiting for its finish.
The new progress bars can be disabled by passing `vm-disable-progress-bar` flag.

Plotting multiple progress bars requires using experimental progress bar pool
from github.com/cheggaaa/pb/v3. Switch to progress bar pool required changes
in all import modes.

The openTSDB mode wasn't changed due to its implementation, which implies individual progress
bars per each series. Because of this, using the pool wasn't possible.

Signed-off-by: dmitryk-dk <kozlovdmitriyy@gmail.com>

Co-authored-by: hagen1778 <roman@victoriametrics.com>
2022-05-02 09:06:34 +02:00
Aliaksandr Valialkin
0efeba13a7
vendor: update github.com/valyala/gozstd from v1.16.0 to v1.17.0 2022-04-29 19:30:41 +03:00
Aliaksandr Valialkin
cce1b6d7f9
app/vmselect/promql: add tlast_change_over_time(m[d]) function, which returns the timestamp for the last change of m on the given lookbehind window d 2022-04-27 10:59:03 +03:00
Aliaksandr Valialkin
e0195558c9
vendor: make vendor-update 2022-04-26 15:24:27 +03:00
Aliaksandr Valialkin
8d0fb4d69d
vendor: make vendor-update 2022-04-21 16:00:47 +03:00
Aliaksandr Valialkin
de892239a9
app/vmselect/promql: add drop_common_labels() function 2022-04-21 14:20:20 +03:00
Aliaksandr Valialkin
ea349660cf
vendor: make vendor-update 2022-04-19 11:40:41 +03:00
Aliaksandr Valialkin
a91c2a4377
vendor: make vendor-update 2022-04-12 12:51:54 +03:00
Aliaksandr Valialkin
d7bf0a7348
vendor: update github.com/VictoriaMetrics/metricsql from v0.40.0 to v0.41.0
This allows using built-in function names as with template names
2022-04-11 18:31:44 +03:00
Aliaksandr Valialkin
a95b96979c
vendor: make vendor-update 2022-04-07 15:28:27 +03:00
Aliaksandr Valialkin
cae61c85d4
vendor: update github.com/VictoriaMetrics/fastcache from v1.9.0 to v1.10.0 2022-04-05 20:32:50 +03:00
Aliaksandr Valialkin
d4f14f4879
vendor: make vendor-update 2022-04-04 13:05:04 +03:00
Aliaksandr Valialkin
2ea540a5aa
vendor: make vendor-update 2022-03-26 13:07:56 +02:00
Aliaksandr Valialkin
e1311409db
vendor: make vendor-update 2022-03-21 17:02:12 +02:00
Aliaksandr Valialkin
f30044cd5c
vendor: make vendor-update 2022-03-16 13:55:03 +02:00