Aliaksandr Valialkin
|
293617028d
|
lib/storage: move fixupTimestamps() call to Block.Init()
This is a follow-up for 0bf7921721
|
2024-02-06 22:44:09 +02:00 |
|
Aliaksandr Valialkin
|
af648279ce
|
lib/storage: validate timestamps in the block only if they use encoding, which needs validation
This reduces CPU usage when there is no sense in validating timestamps.
This is a follow-up for 5fa9525498
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011
|
2022-10-21 00:54:37 +03:00 |
|
Aliaksandr Valialkin
|
051e722112
|
lib/storage: verify that timestamps in block are in the range specified by blockHeader.{Min,Max}Timestamp when upacking the block
This should reduce chances of unnoticed on-disk data corruption.
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/2998
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3011
This change modifies the format for data exported via /api/v1/export/native -
now this data contains MaxTimestamp and PrecisionBits fields from blockHeader.
This is OK, since the native export format is undocumented.
|
2022-09-06 13:07:49 +03:00 |
|
Aliaksandr Valialkin
|
d36fdbe537
|
lib/storage: deduplicate samples more thoroughly
Previously some duplicate samples may be left on disk for time series with high churn rate.
This may result in higher disk space usage.
|
2021-12-15 16:00:30 +02:00 |
|
Aliaksandr Valialkin
|
cdfe854c9b
|
lib/storage: explicitly pass dedupInterval to DeduplicateSamples() and deduplicateSamplesDuringMerge()
This improves the code readability and debuggability, since the output of these functions
stops depending on global state.
|
2021-12-14 20:52:29 +02:00 |
|
Aliaksandr Valialkin
|
901514be88
|
lib/storage: drop more samples outside the given retention during background merge
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/17
|
2020-10-31 20:44:47 +02:00 |
|
Aliaksandr Valialkin
|
ef416c72c2
|
lib/storage: fix 32-bit builds for GOARH=386 or GOARCH=arm
|
2020-09-29 12:42:25 +03:00 |
|
Aliaksandr Valialkin
|
aadbd014ff
|
all: add native format for data export and import
The data can be exported via [/api/v1/export/native](https://victoriametrics.github.io/#how-to-export-data-in-native-format) handler
and imported via [/api/v1/import/native](https://victoriametrics.github.io/#how-to-import-data-in-native-format) handler.
|
2020-09-27 17:36:38 +03:00 |
|
Aliaksandr Valialkin
|
533bf76a12
|
lib/storage: correctly use maxBlockSize in various checks
Previously `maxBlockSize` has been multiplied by 8 in certain checks. This is unnecessary.
|
2020-09-24 18:13:15 +03:00 |
|
Aliaksandr Valialkin
|
cf9aee4ec3
|
all: properly split vm_deduplicated_samples_total among cluster components
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/345
|
2020-02-27 23:47:51 +02:00 |
|
Aliaksandr Valialkin
|
e3adc095bd
|
all: add -dedup.minScrapeInterval command-line flag for data de-duplication
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/86
Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/278
|
2020-01-31 01:18:54 +02:00 |
|
Aliaksandr Valialkin
|
a851c75703
|
lib/storage: skip recovering timestamps order for lossless compression (PrecisionBits=64)
|
2020-01-17 23:59:19 +02:00 |
|
Aliaksandr Valialkin
|
4fb635b0c9
|
lib/storage: do not change timestamps to constant rate if values are constant or have constant delta
This breaks the original timestamps, which results in issues like
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/120 and
https://github.com/VictoriaMetrics/VictoriaMetrics/issues/141 .
|
2019-08-06 15:40:17 +03:00 |
|
Aliaksandr Valialkin
|
1836c415e6
|
all: open-sourcing single-node version
|
2019-05-23 00:18:06 +03:00 |
|