Aliaksandr Valialkin
3edc548584
app/vlinsert/elasticsearch: allow empty lines in Elasticsearch bulk protocol
...
Empty lines may appear there during debugging and custom client implementation
2023-06-20 21:23:38 -07:00
Aliaksandr Valialkin
07bd118b1a
app/vlinsert/elasticsearch: optimize parsing command line
...
Just search for "create" or "index" substrings there instead of spending CPU time on its parsing
2023-06-20 21:18:12 -07:00
Aliaksandr Valialkin
4e56b4eb36
docs/url-examples.md: add missing Content-Type: application/json header in curl examples for json data ingestion
...
If the `Content-Type: application/json` request header isn't set,
then the server can improperly consume the request body when parsing request parameters
2023-06-20 21:04:28 -07:00
Aliaksandr Valialkin
e7bf36f0b6
app/vlstorage: log -storageDataPath and basic stats for the opened storage
2023-06-20 20:47:53 -07:00
Aliaksandr Valialkin
ed1e82b523
docs/Single-server-VictoriaMetrics.md: update link to JSON stream format, since the previous link became broken
2023-06-20 20:28:34 -07:00
Aliaksandr Valialkin
00c3dbd15d
app/victoria-logs: add ability to debug data ingestion by passing debug query arg to data ingestion API
2023-06-20 20:02:46 -07:00
Aliaksandr Valialkin
e1e48077cc
docs/VictoriaLogs: mention that VictoriaLogs supports multitenancy and out of order logs ingestion
2023-06-20 18:09:39 -07:00
Aliaksandr Valialkin
b9436d3b4e
docs/Single-server-VictoriaMetrics.md: refer to Slack chat at the top of the docs
2023-06-20 18:09:38 -07:00
Artem Navoiev
88993f3124
change title of the operator doc to match title frontmatter
...
Signed-off-by: Artem Navoiev <tenmozes@gmail.com>
2023-06-20 13:40:35 +02:00
Roman Khavronenko
79a5499cb2
vmalert: retry all errors except 4XX status codes ( #4461 )
...
vmalert: retry all errors except 4XX status codes
Retry all errors except 4XX status codes while pushing via remote-write
to the remote storage. Previously, errors like broken connection could
prevent vmalert from retrying the request.
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-20 13:24:45 +02:00
Yury Molodov
66b42a6772
vmui: memory leak fix ( #4455 )
...
* fix: optimize the preparation of data for the graph
* fix: optimize tooltip rendering
* fix: optimize re-rendering of the chart
* vmui: memory leak fix
2023-06-20 11:29:24 +02:00
Aliaksandr Valialkin
7b2748e7a1
docs/VictoriaLogs/LogsQL.md: typo fixes
2023-06-20 00:44:59 -07:00
Aliaksandr Valialkin
be9de2b43c
docs/VictoriaLogs/LogsQL.md: typo fixes
2023-06-20 00:42:51 -07:00
Aliaksandr Valialkin
008728e7b9
docs/VictoriaLogs/LogsQL.md: typo fix
2023-06-20 00:30:42 -07:00
Aliaksandr Valialkin
21226911e4
docs/VictoriaLogs/LogsQL.md: typo fix
2023-06-20 00:28:20 -07:00
Aliaksandr Valialkin
06fa70b612
docs/VictoriaLogs/LogsQL.md: typo fixes
2023-06-20 00:23:12 -07:00
Aliaksandr Valialkin
98d327182d
docs/VictoriaLogs/README.md: typo fixes
2023-06-19 23:46:35 -07:00
Aliaksandr Valialkin
d1448e6777
docs/VictoriaLogs/README.md: document how to run docker image for VictoriaLogs
2023-06-19 23:33:07 -07:00
Aliaksandr Valialkin
a638f5e2bf
app/vmctl/utils: properly use timezone in TestGetTime()
2023-06-19 23:16:50 -07:00
Aliaksandr Valialkin
87b66db47d
app/victoria-logs: initial code release
2023-06-19 22:55:12 -07:00
Aliaksandr Valialkin
aeac39cfd1
lib/storage: do not create flock.lock files at partition directories, since it is created at the Storage level
2023-06-19 22:48:37 -07:00
Aliaksandr Valialkin
0f01eea4e9
lib/netutil: ignore arificial timeout generated by net/http.Server
...
This prevents from the inflated vm_tcplistener_read_timeouts_total counter
2023-06-19 22:46:40 -07:00
Aliaksandr Valialkin
298aab3f54
lib/mergeset: do not create flock.lock file at mergeset table, since it is created at the lib/storage.Storage level
2023-06-19 22:45:31 -07:00
Aliaksandr Valialkin
371182f299
lib/fs: add ReaderAt.Path() function
...
This function is going to be used in VictoriaLogs
2023-06-19 22:42:27 -07:00
Aliaksandr Valialkin
497ec3f3e6
lib/encoding: add MarshalBool/UnmarshalBool and GetUint32s/PutUint32s functions
...
These functions are going to be used by VictoriaLogs
2023-06-19 22:40:55 -07:00
Aliaksandr Valialkin
3409317a67
lib/cgroup: add SetGOGC() function
...
This function is going to be used by VictoriaLogs
2023-06-19 22:39:00 -07:00
Aliaksandr Valialkin
c1bed35b39
lib/bytesutil: substitute parentheses with slashes in ByteBuffer.Path() output, so it can be passed to path manipulating functions
...
This is needed for the upcoming VictoriaLogs
2023-06-19 22:37:26 -07:00
Aliaksandr Valialkin
78eaa056c0
app/vmselect: move common http functionality from app/vmselect/searchutils to lib/httputils
...
While at it, move app/vmselect/bufferedwriter to lib/bufferedwriter, since it is going to be used in VictoriaLogs
2023-06-19 22:34:20 -07:00
Aliaksandr Valialkin
b49d04b3dc
lib/promutils.ParseTime(): add support for timestamps in milliseconds
...
See https://stackoverflow.com/questions/76437098/how-to-handle-time-unit-and-step-while-ingesting-or-querying-in-victoriametrics/76438405
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4459
2023-06-19 22:25:04 -07:00
Nikolay
5eb5df96e2
lib/storage: creates parts.json on start-up if it not exists. ( #4450 )
...
* lib/storage: creates parts.json on start-up if it not exists.
It fixes migrations from versions below v1.90.0.
Previously parts.json was created only after successful merge.
But if merge was interruped for some reason (OOM or shutdown), parts.json wasn't created and partitions left after interruped merge weren't properly deleted.
Since VM cannot check if it must be removed or not.
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4336
* Apply suggestions from code review
Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>
* Update lib/storage/partition.go
Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>
---------
Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>
2023-06-15 11:19:22 +02:00
Roman Khavronenko
f50f35a8e0
lib/storage: add comment for how mustBeDeleted field should be used ( #4454 )
...
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-15 11:17:45 +02:00
Roman Khavronenko
c8f9fab3cb
docs/ReleaseGuide: mention auth for Docker ( #4453 )
...
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-15 09:59:10 +02:00
Roman Khavronenko
063f1c269f
docs: mention errors processing for /api/v1/import API ( #4448 )
...
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4446
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-14 18:13:46 +02:00
Roman Khavronenko
f71cc99a8c
lib/mergeset: add comment for how mustBeDeleted field should be used ( #4449 )
...
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-14 18:13:16 +02:00
Dmytro Kozlov
7a92263459
vmctl: increase retry backoff policy delay ( #4447 )
...
vmctl: update backoff policy on retries to reduce probability of overloading for `source` or `destination` databases
2023-06-14 09:47:44 +02:00
Roman Khavronenko
28b23e7a4c
docs/vmalert: mention same labelset error in docs ( #4443 )
...
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-13 17:03:53 +02:00
Dmytro Kozlov
ddb3ae0f00
vmctl: finish retries if context canceled ( #4442 )
...
vmctl: interrupt backoff retries if import context is cancelled
Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>
2023-06-13 13:54:24 +02:00
Roman Khavronenko
1471641cbd
docs/release-guide: update instructions ( #4391 )
...
docs/release-guide: update instructions for MacOS users
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-13 10:37:51 +02:00
Alexander Marshalov
40d12be607
fixed service name detection for consulagent service discovery in case of a difference in service name and service id ( #4390 ) ( #4439 )
...
Signed-off-by: Alexander Marshalov <_@marshalov.org>
2023-06-12 16:16:43 +02:00
Roman Khavronenko
ccaa9571ef
Dashboard upd ( #4438 )
...
dashboards: update dashboard for single-node version
* add anonymous mem usage panel;
* add syscall rate panel;
* add location to logs panel;
* update legend for panels to reflect instance name;
* update queries to aggregate per instance.
dashboards: update dashboard for cluster version
* add syscall rate panel;
* add drilldown to logs panel.
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-12 15:58:47 +02:00
greynix
36bc1bb8ff
docs/oprator/api.md: corrected broken links to Kubernetes documentation ( #4433 )
2023-06-12 12:07:56 +02:00
Roman Khavronenko
6fa7c37e19
docs: make docs-sync ( #4430 )
...
docs: fix typo
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-09 13:48:32 +02:00
Roman Khavronenko
c4be49e21b
docs: mention stream aggregation as more efficient approach for aggregation ( #4429 )
...
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-09 13:47:54 +02:00
Roman Khavronenko
6d38aa7a72
docs/keyConcepts: explicitly specify time unit for API args ( #4428 )
...
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-09 10:45:11 +02:00
Dmytro Kozlov
24f34347f1
docs: clarify -retentionPeriod flag usage ( #4417 )
...
app/vmstorage: clarify the min value for `-retentionPeriod` flag
Co-authored-by: Roman Khavronenko <roman@victoriametrics.com>
2023-06-09 09:46:25 +02:00
Roman Khavronenko
476c7bdd6f
all: update Go builder from Go1.20.4 to Go1.20.5 ( #4427 )
...
See https://github.com/golang/go/issues?q=milestone%3AGo1.20.5+label%3ACherryPickApproved
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-09 09:42:55 +02:00
Roman Khavronenko
dfe53a36fc
lib/promscrape/discoveryutils: properly check for net.ErrClosed ( #4426 )
...
This error may be wrapped in another error, and should normally be tested using
`errors.Is(err, net.ErrClosed)`.
Signed-off-by: hagen1778 <roman@victoriametrics.com>
2023-06-09 09:26:33 +02:00
Roman Khavronenko
d4c314d628
docs/changelog: mention a6a7795b9e change ( #4425 )
...
docs/changelog: mention a6a7795b9ea6a7795b9e
2023-06-09 09:12:41 +02:00
Zakhar Bessarab
9a490d0b5c
doc: changelog followup for #4420 fix ( #4421 )
...
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
2023-06-07 16:16:23 +02:00
Zakhar Bessarab
ce7141383d
app/vmagent/remotewrite: fix vmagent panic on shutdown ( #4407 )
...
app/vmagent/remotewrite: fix vmagent panic on shutdown
Currently, when vmagent is stopping it first flushes pending series in remote write context and proceeds to stop streaming aggregation. This leads to streaming aggregation being unable to write results into pending timeseries (since it is already nil) and panic.
This can lead to losing some aggregation results being lost almost silently.
The fix is reordering flow to first stop streaming aggregation and flush all pending time series after that.
Signed-off-by: Zakhar Bessarab <z.bessarab@victoriametrics.com>
2023-06-07 15:45:43 +02:00
