Zhu Jiekun 3fa72b2c1b feature: [victorialogs] drop logs without non-empty _msg field (#7056) ... ### Describe Your Changes VictoriaLogs allows logs without `_msg` field or `_msg` field is empty. This lead to incorrect search result. See: https://github.com/VictoriaMetrics/VictoriaMetrics/issues/6785 This pull request search for non-empty `_msg` field before log entry is added to `LogRows`. New counter `vl_rows_dropped_total{reason="msg_not_exist"}` is introduced. Example log output: ``` 2024-09-23T02:33:19.719Z warn app/vlinsert/insertutils/common_params.go:189 dropping log line without _msg field; [{@timestamp 2024-09-18T13:42:16.600000000Z} {Attributes.array.attribute ["many","values"]} {Attributes.boolean.attribute true} {Attributes.double.attribute 637.704} {Attributes.int.attribute 10} {Attributes.map.attribute.some.map.key some value} {Attributes.string.attribute some string} {Body Example ddddddddddlog record} {Resource.service.name my.service} {Scope.my.scope.attribute some scope attribute} {Scope.name my.library} {Scope.version 1.0.0} {SeverityNumber 10} {SeverityText Information} {SpanId eee19b7ec3c1b174} {TraceFlags 0} {TraceId 5b8efff798038103d269b633813fc60c}] ``` ### Checklist The following checks are **mandatory**: - [x] My change adheres [VictoriaMetrics contributing guidelines](https://docs.victoriametrics.com/contributing/). - [ ] Benchmark for potential performance loss. --------- Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>		2024-09-26 09:35:58 +02:00
..
elasticsearch	app/vlinsert/elasticsearch: add fake response for logstash requests (#6742)	2024-08-06 16:30:11 +02:00
insertutils	feature: [victorialogs] drop logs without non-empty _msg field (#7056)	2024-09-26 09:35:58 +02:00
jsonline	app/vlinsert: properly parse timestamps with nanosecond precision at /insert/jsonline HTTP endpoint	2024-06-18 00:24:11 +02:00
loki	app/vlinsert/loki: use easyproto instead for parsing Loki protobuf messages	2024-07-10 03:05:55 +02:00
opentelemetry	follow-up after 01430a155c	2024-09-04 15:39:55 +02:00
syslog	app/vlinsert/syslog: add an ability to use log ingestion time as the _time field	2024-07-02 01:39:45 +02:00
main.go	vlinsert: added opentelemetry logs support	2024-09-03 20:24:01 +02:00