Aliaksandr Valialkin 96dce63dbd lib/storage: tune the logic for pre-populating of the per-day inverted index for the next day ... - Postpone the pre-poulation to the last hour of the current day. This should reduce the number of useless entries in the next per-day index, which shouldn't be created there, when the corresponding time series are stopped to be pushed during the current day. - Make the pre-population more smooth in time by using the hash of MetricID instead of MetricID itself when calculating the need for for the given MetricID pre-population. - Sync the logic for pre-population of the next day inverted index with the logic of pre-populating tsid cache after indexdb rotation. This should improve code maintainability. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/430 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1401		2022-02-12 16:33:16 +02:00
..
block_header_test.go	lib/storage: typo fix: umarshal -> unmarshal	2021-03-02 20:47:59 +02:00
block_header.go	lib/storage: correctly use maxBlockSize in various checks	2020-09-24 18:12:56 +03:00
block_stream_merger.go	lib/storage: set bsm.Block to nil on error, so the previous block couldn't be used.	2022-01-20 20:13:14 +02:00
block_stream_reader_test.go	all: use %w instead of %s for wrapping errors in fmt.Errorf	2020-06-30 23:05:11 +03:00
block_stream_reader_timing_test.go	all: use %w instead of %s for wrapping errors in fmt.Errorf	2020-06-30 23:05:11 +03:00
block_stream_reader.go	lib/bytesutil: split Resize* funcs to MayOverallocate and NoOverallocate for more fine-grained control over memory allocations	2022-02-01 00:18:42 +02:00
block_stream_writer_timing_test.go	lib/storage: deduplicate samples more thoroughly	2021-12-15 15:59:58 +02:00
block_stream_writer.go	lib/storage: deduplicate samples more thoroughly	2021-12-15 15:59:58 +02:00
block_test.go	lib/storage: fix tests for 32-bit arches such as GOARCH=386 and GOARCH=arm	2020-09-29 13:10:22 +03:00
block.go	lib/storage: deduplicate samples more thoroughly	2021-12-15 15:59:58 +02:00
dedup_test.go	lib/storage: explicitly pass dedupInterval to DeduplicateSamples() and deduplicateSamplesDuringMerge()	2021-12-14 20:49:12 +02:00
dedup_timing_test.go	lib/storage: explicitly pass dedupInterval to DeduplicateSamples() and deduplicateSamplesDuringMerge()	2021-12-14 20:49:12 +02:00
dedup.go	lib/storage: deduplicate samples more thoroughly	2021-12-15 15:59:58 +02:00
index_db_test.go	lib/index: reduce read/write load after indexDB rotation (#2177)	2022-02-12 00:30:08 +02:00
index_db_timing_test.go	lib/index: reduce read/write load after indexDB rotation (#2177)	2022-02-12 00:30:08 +02:00
index_db.go	lib/storage: tune the logic for pre-populating of the per-day inverted index for the next day	2022-02-12 16:33:16 +02:00
inmemory_part_test.go	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
inmemory_part_timing_test.go	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
inmemory_part.go	lib/{mergeset,storage}: switch from sync.Pool to chan-based pool for inmemoryPart objects	2021-07-06 16:28:41 +03:00
merge_test.go	app/vmstorage: support for -retentionPeriod smaller than one month	2020-10-20 14:31:44 +03:00
merge_timing_test.go	app/vmstorage: support for -retentionPeriod smaller than one month	2020-10-20 14:31:44 +03:00
merge.go	lib/storage: deduplicate samples more thoroughly	2021-12-15 15:59:58 +02:00
metaindex_row_test.go	lib/storage: correctly use maxBlockSize in various checks	2020-09-24 18:12:56 +03:00
metaindex_row.go	lib/storage: correctly use maxBlockSize in various checks	2020-09-24 18:12:56 +03:00
metric_name_test.go	app/vminsert: add support for data ingestion via other vminsert nodes	2021-05-08 19:52:57 +03:00
metric_name.go	lib/bytesutil: split Resize* funcs to MayOverallocate and NoOverallocate for more fine-grained control over memory allocations	2022-02-01 00:18:42 +02:00
part_header_test.go	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
part_header.go	lib/promscrape: support prometheus-like duration in scrape configs (#2169)	2022-02-11 16:17:00 +02:00
part_search_test.go	Revert "lib/storage: remove unused fetchData arg from BlockRef.MustReadBlock"	2020-09-24 22:44:23 +03:00
part_search.go	lib/bytesutil: split Resize* funcs to MayOverallocate and NoOverallocate for more fine-grained control over memory allocations	2022-02-01 00:18:42 +02:00
part.go	lib/mergeset: tune caches size limits for indexdb/dataBlocks and indexdb/indexBlocks	2022-01-21 12:45:43 +02:00
partition_search_test.go	app/vmstorage: support for -retentionPeriod smaller than one month	2020-10-20 14:31:44 +03:00
partition_search.go	optimized code (#2103)	2022-01-28 14:15:41 +02:00
partition_test.go	lib/{mergeset,storage}: improve the detection of the needed free space for background merge	2021-08-25 09:35:44 +03:00
partition.go	lib/{mergeset,storage}: properly limit cache sizes for indexdb	2022-01-20 18:37:17 +02:00
raw_block.go	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
raw_row.go	lib/storage: deduplicate samples more thoroughly	2021-12-15 15:59:58 +02:00
search_test.go	app/vmstorage: add ability to limit series cardinality via -storage.maxHourlySeries and -storage.maxDailySeries command-line flags	2021-05-20 14:15:19 +03:00
search.go	lib/bytesutil: split Resize* funcs to MayOverallocate and NoOverallocate for more fine-grained control over memory allocations	2022-02-01 00:18:42 +02:00
storage_test.go	lib/index: reduce read/write load after indexDB rotation (#2177)	2022-02-12 00:30:08 +02:00
storage_timing_test.go	app/vmstorage: add ability to limit series cardinality via -storage.maxHourlySeries and -storage.maxDailySeries command-line flags	2021-05-20 14:15:19 +03:00
storage.go	lib/storage: tune the logic for pre-populating of the per-day inverted index for the next day	2022-02-12 16:33:16 +02:00
table_search_test.go	app/vmstorage: support for -retentionPeriod smaller than one month	2020-10-20 14:31:44 +03:00
table_search_timing_test.go	lib/storage: consistency renaming: getMaxRawRowsPerPartition -> getMaxRawRowsPerShard	2021-06-11 10:57:23 +03:00
table_search.go	optimized code (#2103)	2022-01-28 14:15:41 +02:00
table_test.go	app/vmstorage: support for -retentionPeriod smaller than one month	2020-10-20 14:31:44 +03:00
table_timing_test.go	all: properly handle CPU limits set on the host system/container	2020-12-08 21:07:29 +02:00
table.go	lib/storage/table.go: add missing tb.ptwsLock.Unlock() before the return	2022-01-28 14:15:42 +02:00
tag_filters_test.go	lib/storage: properly handle {__name__=~"prefix(suffix1|suffix2)",other_label="..."} queries	2021-09-23 21:48:51 +03:00
tag_filters_timing_test.go	lib/storage: small code adjustements after d2960a20e0	2020-10-17 01:16:54 +03:00
tag_filters.go	lib/storage: fix broken BenchmarkHeadPostingForMatchers for {i=~".*"} after f4dead529f	2022-02-12 00:27:10 +02:00
time_test.go	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
time.go	all: use %w instead of %s for wrapping errors in fmt.Errorf	2020-06-30 23:05:11 +03:00
tsid_test.go	all: open-sourcing single-node version	2019-05-23 00:18:06 +03:00
tsid.go	all: remove the remaining mentions of cluster version	2019-11-21 23:18:22 +02:00