247 Commits

Author	SHA1	Message	Date
Github Actions	8df41f37e6	Automatic update Grafana datasource docs from VictoriaMetrics/victorialogs-datasource@4ed20bd (#6578) ... (cherry picked from commit 11989db586)	2024-07-05 09:49:08 +02:00
Aliaksandr Valialkin	210e5b8957	docs/VictoriaLogs/CHANGELOG.md: cut v0.27.1-victorialogs	2024-07-05 01:22:50 +02:00
Aliaksandr Valialkin	6397c38a0a	lib/logstorage: use quicktemplate.AppendJSONString instead of strconv.AppendQuote for encoding JSON strings ... The strconv.AppendQuote improperly encodes special chars such as \x1b . They must be encoded as \u001b . See https://github.com/VictoriaMetrics/victorialogs-datasource/issues/24	2024-07-05 01:22:49 +02:00
Github Actions	730088caaf	Automatic update Grafana datasource docs from VictoriaMetrics/victorialogs-datasource@a04844a (#6571)	2024-07-03 15:22:50 +02:00
Github Actions	a72d0310c0	Automatic update Grafana datasource docs from VictoriaMetrics/victorialogs-datasource@a53ccd7 (#6570)	2024-07-03 14:20:56 +02:00
Artem Navoiev	f327eac81b	add file placeholder grafana logs datasource docs ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com>	2024-07-03 14:18:50 +02:00
Aliaksandr Valialkin	fed596b202	docs/VictoriaLogs/CHANGELOG.md: cut v0.27.0-victorialogs	2024-07-02 01:43:54 +02:00
Aliaksandr Valialkin	0912a652d5	app/vlinsert/insertutils: flush the ingested logs from in-memory buffer to storage every second ... Previously the in-memory buffer could remain unflushed for long periods of time under low ingestion rate. The ingested logs weren't visible for search during this time.	2024-07-02 01:39:45 +02:00
Aliaksandr Valialkin	ab28a1f93e	app/vlinsert/syslog: add an ability to use log ingestion time as the _time field	2024-07-02 01:39:45 +02:00
Aliaksandr Valialkin	f4dd9bd988	docs/VictoriaLogs/CHANGELOG.md: use new url https://docs.victoriametrics.com/victorialogs/querying/ instead of old one https://docs.victoriametrics.com/VictoriaLogs/querying/ ... (cherry picked from commit 387b3b7fb7)	2024-07-01 16:40:44 +02:00
Aliaksandr Valialkin	5143e93534	docs/VictoriaLogs/CHANGELOG.md: cut v0.26.1-victorialogs	2024-07-01 02:33:02 +02:00
Aliaksandr Valialkin	208a624d4d	lib/logstorage: properly search for the surrounding logs in stream_context pipe ... The set of log fields in the found logs may differ from the set of log fields present in the log stream. So compare only the log fields in the found logs when searching for the matching log entry in the log stream. While at it, return _stream field in the delimiter log entry, since this field is used by VictoriaLogs Web UI for grouping logs by log streams.	2024-07-01 02:33:00 +02:00
Aliaksandr Valialkin	516c7b2ca0	docs/VictoriaLogs: remove "preview" warning - VictoriaLogs is ready for prod	2024-07-01 01:52:40 +02:00
Aliaksandr Valialkin	0e6ee55a95	docs/VictoriaLogs/CHANGELOG.md: cut v0.26.0-victorialogs	2024-07-01 01:49:55 +02:00
Aliaksandr Valialkin	76a58ae08d	lib/logstorage: add ability to store sorted log position into a separate field with sort ... rank <fieldName> syntax	2024-07-01 01:46:03 +02:00
Aliaksandr Valialkin	d0dca7b8c5	lib/logstorage: add delimiter between log chunks returned from | stream_context pipe	2024-07-01 01:46:02 +02:00
Aliaksandr Valialkin	76053a0ef0	docs/VictoriaLogs: typo fixes	2024-06-28 19:26:32 +02:00
Aliaksandr Valialkin	75c7b2c07a	docs/VictoriaLogs/CHANGELOG.md: cut v0.25.0-victorialogs	2024-06-28 19:18:21 +02:00
Aliaksandr Valialkin	4b3477e62b	lib/logstorage: add stream_context pipe, which allows selecting surrounding logs for the matching logs	2024-06-28 19:15:19 +02:00
Aliaksandr Valialkin	c9fc8079c4	app/vlinsert/syslog: properly skip empty lines in Syslog protocol ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6548	2024-06-28 14:09:45 +02:00
Aliaksandr Valialkin	bb6424aeca	app/vlselect/logsql: add optional fields_limit query arg to /select/logsql/hits HTTP endpoint ... This query arg is needed for https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6545 in order to return top N groups with the biggest number of hits.	2024-06-28 03:10:05 +02:00
Aliaksandr Valialkin	3eecc3de8c	docs/VictoriaLogs: typo fixes	2024-06-28 03:10:05 +02:00
Aliaksandr Valialkin	5a24ea6cc3	docs/VictoriaLogs: document how to export logs from VictoriaLogs ... While at it, mention vmctl-like tool for migrating logs from other systems to VictoriaLogs at docs/VictoriaLogs/Roadmap.md Thanks to the question from Xavier Pestel at https://www.linkedin.com/feed/update/urn:li:activity:7212093021301927937?commentUrn=urn%3Ali%3Acomment%3A%28activity%3A7212093021301927937%2C7212171550651731969%29&dashCommentUrn=urn%3Ali%3Afsd_comment%3A%287212171550651731969%2Curn%3Ali%3Aactivity%3A7212093021301927937%29	2024-06-28 02:06:24 +02:00
Aliaksandr Valialkin	05365999ea	docs/VictoriaLogs/querying/README.md: clarify live tailing docs	2024-06-27 19:12:54 +02:00
Aliaksandr Valialkin	4391ef25e9	docs/VictoriaLogs/Roadmap.md: remove Web UI from roadmap, since it is already implemented ... See https://docs.victoriametrics.com/victorialogs/querying/#web-ui While at it, add DataDog protocol for logs into 'data ingestion protocols' roadmap.	2024-06-27 19:12:54 +02:00
Aliaksandr Valialkin	00899506f7	docs/VictoriaLogs/querying: remove unused and outdated vmui.webp image ... The image has been deleted from the docs/VictoriaLogs/querying/README.md file in the commit 87f1c8bd6c	2024-06-27 15:16:43 +02:00
Aliaksandr Valialkin	13df75a28b	docs/VictoriaLogs/querying/README.md: add a link to live tailing docs from querying log docs	2024-06-27 15:12:59 +02:00
Aliaksandr Valialkin	b26acec9a8	app/vlselect: properly return live tailing results	2024-06-27 15:06:15 +02:00
Aliaksandr Valialkin	dd62a2b9d6	lib/logstorage: work-in-progress	2024-06-27 14:21:03 +02:00
Aliaksandr Valialkin	75d45068a5	docs/VictoriaLogs/README.md: document the relation between -retention.maxDiskSpaceUsageBytes and -retentionPeriod command-line flags	2024-06-26 12:03:29 +02:00
Yury Molodov	6bde0196d8	vmui/logs: fix the update of the relative time range (#6517) ... ### Describe Your Changes - Fixed the update of the relative time range when `Execute Query` is clicked - Optimized server requests: now, if an error occurs in the `/query` request, the `/hits` request will not be executed. #6345 (duplicates: #6440, #6312) (cherry picked from commit 43342745ac)	2024-06-26 11:26:08 +02:00
Aliaksandr Valialkin	d5cbda3424	app/vlstorage: add -retention.maxDiskSpaceUsageBytes command-line flag for limiting the retention at VictoriaLogs by disk space usage	2024-06-25 17:30:46 +02:00
Aliaksandr Valialkin	252ff71a49	docs/VictoriaLogs/data-ingestion/README.md: document that Rsyslog and Syslog-ng can be used for ingesting logs into VictoriaLogs	2024-06-25 15:15:53 +02:00
Aliaksandr Valialkin	0a88a55ae0	docs/VictoriaLogs/CHANGELOG.md: cut v0.23.0-victorialogs release	2024-06-25 14:59:31 +02:00
Aliaksandr Valialkin	f24123a776	lib/logstorage: parse syslog structured data into separate fields in order to simplify further querying of this data	2024-06-25 14:54:25 +02:00
Aliaksandr Valialkin	1716c4e609	lib/logstorage: properly parse timezone offset at TryParseTimestampRFC3339Nano() ... The TryParseTimestampRFC3339Nano() must properly parse RFC3339 timestamps with timezone offsets. While at it, make tryParseTimestampISO8601 function private in order to prevent from improper usage of this function from outside the lib/logstorage package. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6508	2024-06-25 14:54:24 +02:00
Aliaksandr Valialkin	813a7aec6c	docs: return back spellcheck fixes from the commit 92b22581e6, which were accidentally reverted in 45cf83cd8f ... Updates https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6470	2024-06-25 02:33:59 +02:00
Aliaksandr Valialkin	7f2b491748	Revert "docs: Add spellcheck workflow (#6470)" ... This reverts commit 92b22581e6. Reason for revert: too complex and slow approach for spellchecking task. This approach may significantly slow down development pace. It also may take non-trivial amounts of additional time and resources at CI/CD because of all this npm shit at cspell directory. Note to @arkid15r : the idea with the ability to run spellchecker on all the VictoriaMetrics codebase is great. But this shouldn't be mandatory pre-commit check. It is enough to have a Makefile rule like `make spellcheck`, which could be run manually whenever spellcheck is needed (e.g. once per month or once per quarter).	2024-06-25 02:28:38 +02:00
Aliaksandr Valialkin	7de6f5b4ce	lib/logstorage: work-in-progress	2024-06-25 00:44:57 +02:00
Arkadii Yakovets	c454084eb1	docs: Add spellcheck workflow (#6470) ... ### Describe Your Changes This is a follow-up PR containing workflow related part of the initial [PR#6362](https://github.com/VictoriaMetrics/VictoriaMetrics/pull/6362). It adds spell checking control based on [cspell](https://github.com/streetsidesoftware/cspell). The related configs are consolidated under `cspell` directory. You can add VictoriaMetrics specific terms into `cspell/custom-dict.txt` (it contains ~30 items atm). All other absent commonly used terms should be added directly to respective [cspell-dicts](https://github.com/streetsidesoftware/cspell-dicts/blob/main/CONTRIBUTING.md). ### Checklist The following checks are **mandatory**: - [x] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). --------- Signed-off-by: Arkadii Yakovets <ark@victoriametrics.com> (cherry picked from commit 92b22581e6)	2024-06-24 12:50:13 +02:00
Aliaksandr Valialkin	d5224f3363	lib/logstorage: work-in-progress	2024-06-20 03:10:37 +02:00
Yury Molodov	88650abf97	vmui/logs: add bar chart (#6461) ... - Added a bar chart displaying the number of log entries over a time range. #6404 - When `_msg` is empty, all fields are displayed in a single line. - Added double quotes when copying pairs: `key: "value"`. - Minor style adjustments. (cherry picked from commit 32fbffedd9)	2024-06-18 15:28:56 +02:00
Aliaksandr Valialkin	0ee360b48c	docs/VictoriaLogs/CHANGELOG.md: typo fix in the release date for v0.20.2-victorialogs	2024-06-18 00:28:49 +02:00
Aliaksandr Valialkin	ee114ca59c	app/vlinsert: properly parse timestamps with nanosecond precision at /insert/jsonline HTTP endpoint ... This has been broken in 2b6a634ec0	2024-06-18 00:24:11 +02:00
Aliaksandr Valialkin	7658cc36a6	docs/VictoriaLogs/CHANGELOG.md: cut v0.20.1-victorialogs	2024-06-17 23:29:28 +02:00
Aliaksandr Valialkin	c10a646d19	app/vlinsert/syslog: allow accepting syslog messages with different configs at different ports	2024-06-17 23:16:58 +02:00
Aliaksandr Valialkin	f74e6b0674	app/vlinsert: properly parse length-delimited syslog messages sent over TCP according to RFC5425	2024-06-17 22:30:28 +02:00
Aliaksandr Valialkin	938862946c	docs/VictoriaLogs: mention which collectors support sending logs to VictoriaLogs in syslog format	2024-06-17 13:13:51 +02:00
Aliaksandr Valialkin	1750991119	lib/logstorage: work-in-progress	2024-06-17 12:13:25 +02:00
Artem Navoiev	6c587eefbf	docs: add more redirects ... Signed-off-by: Artem Navoiev <tenmozes@gmail.com> (cherry picked from commit d1baa41b6a)	2024-06-14 13:26:47 +02:00