VictoriaMetrics/lib/protoparser
Roman Khavronenko 26242f526e
lib/protoparser: decrease import.maxLineLen from 100MB to 10MB (#5364)
Tests showed that importing a single line with 70MB size takes 5.3GiB
RSS memory for VictoriaMetrics single-node.
In the scenario when user exports and imports data from one VM to another,
it could possibly lead to OOM exception for destination VM.

Importing a single line with 16MB size taks 1.3GiB RSS memory.
Hence, the limit for `import.maxLineLen` was decreased from 100MB to 10MB
to improve reliability of VictoriaMetrics during imports.

Signed-off-by: hagen1778 <roman@victoriametrics.com>
Co-authored-by: Aliaksandr Valialkin <valyala@victoriametrics.com>
2023-11-24 13:13:33 +02:00
..
clusternative/stream Makefile: update golangci-lint from v1.51.2 to v1.54.2 2023-09-01 10:25:49 +02:00
common lib/protoparser: decrease import.maxLineLen from 100MB to 10MB (#5364) 2023-11-24 13:13:33 +02:00
csvimport lib/protoparser/csvimport: properly parse the last empty column in CSV line 2023-05-12 16:59:50 -07:00
datadog all: consistently use %w instead of %s in when error is passed to fmt.Errorf() 2023-10-26 09:44:40 +02:00
graphite lib/protoparser/graphite: extract stream parsing code into a separate stream package 2023-02-13 10:33:24 -08:00
influx lib/promauth: follow-up for e16d3f5639 2023-10-26 09:55:47 +02:00
native/stream lib/protoparser/native: extract stream parsing code into a separate stream package 2023-02-13 10:44:27 -08:00
newrelic all: consistently use %w instead of %s in when error is passed to fmt.Errorf() 2023-10-26 09:44:40 +02:00
opentelemetry all: consistently use %w instead of %s in when error is passed to fmt.Errorf() 2023-10-26 09:44:40 +02:00
opentsdb lib/protoparser/opentsdb: extract stream parsing code into a separate stream package 2023-02-13 10:04:14 -08:00
opentsdbhttp lib/opentsdbhttp: fix a typo preventing from using writeconcurrencylimiter (#4208) 2023-05-08 16:33:03 -07:00
prometheus lib/promscrape: make concurrency control optional (#5073) 2023-10-02 21:34:41 +02:00
promremotewrite/stream lib/protoparser/promremotewrite: fall back to zstd decoding if Snappy-decoding fails (#5344) 2023-11-17 15:53:18 +01:00
vmimport lib/protoparser: decrease import.maxLineLen from 100MB to 10MB (#5364) 2023-11-24 13:13:33 +02:00