VictoriaMetrics/lib/storage
Aliaksandr Valialkin 494ad0fdb3 lib/storage: remove inmemory index for recent hour, since it uses too much memory
Production workload shows that the index requires ~4Kb of RAM per active time series.
This is too much for high number of active time series, so let's delete this index.

Now the queries should fall back to the index for the current day instead of the index
for the recent hour. The query performance for the current day index should be good enough
given the 100M rows/sec scan speed per CPU core.
2019-11-13 18:08:58 +02:00
..
block_header_test.go all: open-sourcing cluster version 2019-05-23 00:25:38 +03:00
block_header.go lib/storage: pre-allocate memory for blockHeader slice in unmarshalBlockHeaders 2019-08-19 12:46:45 +03:00
block_stream_merger.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
block_stream_reader_test.go all: add support for GOARCH=386 and fix all the issues related to 32-bit architectures such as GOARCH=arm 2019-10-17 18:27:49 +03:00
block_stream_reader_timing_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
block_stream_reader.go lib/storage: remove interface conversion in hot path during block merging 2019-11-03 12:33:48 +02:00
block_stream_writer_timing_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
block_stream_writer.go lib/storage: remove interface conversion in hot path during block merging 2019-11-03 12:33:48 +02:00
block.go lib/storage: do not change timestamps to constant rate if values are constant or have constant delta 2019-08-06 15:40:17 +03:00
index_db_test.go lib/storage: remove inmemory index for recent hour, since it uses too much memory 2019-11-13 18:08:58 +02:00
index_db_timing_test.go lib/storage: add benchmarks for regexp filter match / mismatch 2019-08-22 16:37:19 +03:00
index_db.go lib/storage: remove inmemory index for recent hour, since it uses too much memory 2019-11-13 18:08:58 +02:00
inmemory_part_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
inmemory_part_timing_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
inmemory_part.go all: add vm_data_size_bytes metrics for easy monitoring of on-disk data size and on-disk inverted index size 2019-07-04 19:43:04 +03:00
merge_test.go all: add support for GOARCH=386 and fix all the issues related to 32-bit architectures such as GOARCH=arm 2019-10-17 18:27:49 +03:00
merge_timing_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
merge.go lib/storage: create and use lib/uint64set instead of map[uint64]struct{} 2019-09-24 21:18:04 +03:00
metaindex_row_test.go all: open-sourcing cluster version 2019-05-23 00:25:38 +03:00
metaindex_row.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
metric_name_test.go lib/storage: pass pointer to MetricName in Fatalf, so it is properly detected as an interface with String() method 2019-11-04 01:06:45 +02:00
metric_name.go lib/{storage,mergeset}: merge tag->metricID rows into tag->metricIDs rows for common tag values 2019-09-20 22:06:23 +03:00
part_header_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
part_header.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
part_search_test.go app/vmselect: optimize /api/v1/series by skipping storage data 2019-08-04 23:00:46 +03:00
part_search.go lib/storage: share tsids across all the partSearch instances 2019-09-23 22:36:16 +03:00
part.go all: add support for GOARCH=386 and fix all the issues related to 32-bit architectures such as GOARCH=arm 2019-10-17 18:27:49 +03:00
partition_search_test.go lib/storage: create and use lib/uint64set instead of map[uint64]struct{} 2019-09-24 21:18:04 +03:00
partition_search.go lib/storage: share tsids across all the partSearch instances 2019-09-23 22:36:16 +03:00
partition_test.go all: add support for GOARCH=386 and fix all the issues related to 32-bit architectures such as GOARCH=arm 2019-10-17 18:27:49 +03:00
partition.go lib/storage: return back finalPartsToMerge from 2 to 3 in order to prevent from excessive merges in old partitions 2019-11-05 17:28:57 +02:00
raw_block.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
raw_row.go lib/storage: optimize TSID comparison 2019-09-26 14:20:02 +03:00
search_test.go lib/storage: remove inmemory index for recent hour, since it uses too much memory 2019-11-13 18:08:58 +02:00
search.go app/vmselect: optimize /api/v1/series by skipping storage data 2019-08-04 23:00:46 +03:00
storage_test.go lib/storage: remove inmemory index for recent hour, since it uses too much memory 2019-11-13 18:08:58 +02:00
storage_timing_test.go all: open-sourcing cluster version 2019-05-23 00:25:38 +03:00
storage.go lib/storage: remove inmemory index for recent hour, since it uses too much memory 2019-11-13 18:08:58 +02:00
table_search_test.go app/vmselect: optimize /api/v1/series by skipping storage data 2019-08-04 23:00:46 +03:00
table_search_timing_test.go app/vmselect: optimize /api/v1/series by skipping storage data 2019-08-04 23:00:46 +03:00
table_search.go lib/storage: share tsids across all the partSearch instances 2019-09-23 22:36:16 +03:00
table_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
table_timing_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
table.go lib/storage: populate partition names from both small and big directories 2019-11-06 19:50:21 +02:00
tag_filters_test.go lib/storage: properly match labels against regexp with (?i) flag 2019-09-26 11:03:26 +03:00
tag_filters_timing_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
tag_filters.go lib/storage: properly match labels against regexp with (?i) flag 2019-09-26 11:03:26 +03:00
time_test.go all: open-sourcing single-node version 2019-05-23 00:18:06 +03:00
time.go lib/storage: remove unused code from getMetricIDsForTimeRange: it is expected that time range is always non-zero 2019-11-09 19:03:51 +02:00
tsid_test.go all: open-sourcing cluster version 2019-05-23 00:25:38 +03:00
tsid.go lib/storage: optimize TSID comparison 2019-09-26 14:20:02 +03:00