Zhu Jiekun 3fa72b2c1b feature: [victorialogs] drop logs without non-empty _msg field (#7056) ... ### Describe Your Changes VictoriaLogs allows logs without `_msg` field or `_msg` field is empty. This lead to incorrect search result. See: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6785 This pull request search for non-empty `_msg` field before log entry is added to `LogRows`. New counter `vl_rows_dropped_total{reason="msg_not_exist"}` is introduced. Example log output: ``` 2024-09-23T02:33:19.719Z warn app/vlinsert/insertutils/common_params.go:189 dropping log line without _msg field; [{@timestamp 2024-09-18T13:42:16.600000000Z} {Attributes.array.attribute ["many","values"]} {Attributes.boolean.attribute true} {Attributes.double.attribute 637.704} {Attributes.int.attribute 10} {Attributes.map.attribute.some.map.key some value} {Attributes.string.attribute some string} {Body Example ddddddddddlog record} {Resource.service.name my.service} {Scope.my.scope.attribute some scope attribute} {Scope.name my.library} {Scope.version 1.0.0} {SeverityNumber 10} {SeverityText Information} {SpanId eee19b7ec3c1b174} {TraceFlags 0} {TraceId 5b8efff798038103d269b633813fc60c}] ``` ### Checklist The following checks are **mandatory**: - [x] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). - [ ] Benchmark for potential performance loss. --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>		2024-09-26 09:35:58 +02:00
..
common_params.go	feature: [victorialogs] drop logs without non-empty _msg field (#7056)	2024-09-26 09:35:58 +02:00
flags.go	app/vlinsert/insertutils: cosmetic changes after 8d3e574c31	2023-09-19 00:35:51 +02:00
testutils.go	app/vlinsert: properly parse length-delimited syslog messages sent over TCP according to RFC5425	2024-06-17 22:30:28 +02:00
timestamp_test.go	lib/logstorage: properly parse timezone offset at TryParseTimestampRFC3339Nano()	2024-06-25 14:54:24 +02:00
timestamp.go	lib/logstorage: properly parse timezone offset at TryParseTimestampRFC3339Nano()	2024-06-25 14:54:24 +02:00