Kiu/VictoriaMetrics
Kiu/VictoriaMetrics
1
0
Fork 0
mirror of https://github.com/VictoriaMetrics/VictoriaMetrics.git synced 2024-12-15 08:23:34 +01:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
b46014c8ab
VictoriaMetrics/app/vmselect/Makefile

105 lines
2.9 KiB
Makefile
Raw Normal View History

all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
# All these commands must run from repository root.
run-vmselect:
mkdir -p vmselect-cache
all: remove `-p XXXX:XXXX` from `docker run` options, since it is unnesessary if `--net=host` is set
2019-05-24 11:53:12 +02:00
DOCKER_OPTS='-v $(shell pwd)/vmselect-cache:/cache' \
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
APP_NAME=vmselect \
app/{vminsert,vmselect}: automatically add missing port in `-storageNode` lists passed to `vminsert` and `vmselect` This should simplify manual setup of the cluster according to https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html#cluster-setup
2021-09-15 17:04:28 +02:00
ARGS='-storageNode=localhost -selectNode=localhost -cacheDataPath=/cache' \
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
$(MAKE) run-via-docker
vmselect:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect $(MAKE) app-local
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
vmselect-race:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect RACE=-race $(MAKE) app-local
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
vmselect-prod:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect $(MAKE) app-via-docker
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
all: publish Docker images for the following GOARCH: amd64, arm, arm64, ppc64le and 386 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/258
2019-12-11 22:06:53 +01:00
vmselect-pure-prod:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect $(MAKE) app-via-docker-pure
all: publish Docker images for the following GOARCH: amd64, arm, arm64, ppc64le and 386 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/258
2019-12-11 22:06:53 +01:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-amd64-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-linux-amd64
Makefile: prepare `arm64` and `amd64` release archives for cluster version on `make release` command
2021-04-05 22:01:45 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-arm-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-linux-arm
Makefile: prepare `arm64` and `amd64` release archives for cluster version on `make release` command
2021-04-05 22:01:45 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-arm64-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-linux-arm64
Makefile: prepare `arm64` and `amd64` release archives for cluster version on `make release` command
2021-04-05 22:01:45 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-ppc64le-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-linux-ppc64le
Makefile: prepare `arm64` and `amd64` release archives for cluster version on `make release` command
2021-04-05 22:01:45 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-386-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-linux-386
Makefile: prepare `arm64` and `amd64` release archives for cluster version on `make release` command
2021-04-05 22:01:45 +02:00
all: follow-up for d99ba3481b192d581bf6a153e40e5f99a7eb5edf
2022-07-13 15:44:39 +02:00
vmselect-freebsd-amd64-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-freebsd-amd64
vmselect-openbsd-amd64-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-openbsd-amd64
all: add Windows build for VictoriaMetrics This commit changes background merge algorithm, so it becomes compatible with Windows file semantics. The previous algorithm for background merge: 1. Merge source parts into a destination part inside tmp directory. 2. Create a file in txn directory with instructions on how to atomically swap source parts with the destination part. 3. Perform instructions from the file. 4. Delete the file with instructions. This algorithm guarantees that either source parts or destination part is visible in the partition after unclean shutdown at any step above, since the remaining files with instructions is replayed on the next restart, after that the remaining contents of the tmp directory is deleted. Unfortunately this algorithm doesn't work under Windows because it disallows removing and moving files, which are in use. So the new algorithm for background merge has been implemented: 1. Merge source parts into a destination part inside the partition directory itself. E.g. now the partition directory may contain both complete and incomplete parts. 2. Atomically update the parts.json file with the new list of parts after the merge, e.g. remove the source parts from the list and add the destination part to the list before storing it to parts.json file. 3. Remove the source parts from disk when they are no longer used. This algorithm guarantees that either source parts or destination part is visible in the partition after unclean shutdown at any step above, since incomplete partitions from step 1 or old source parts from step 3 are removed on the next startup by inspecting parts.json file. This algorithm should work under Windows, since it doesn't remove or move files in use. This algorithm has also the following benefits: - It should work better for NFS. - It fits object storage semantics. The new algorithm changes data storage format, so it is impossible to downgrade to the previous versions of VictoriaMetrics after upgrading to this algorithm. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3236 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3821 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/70
2023-03-19 09:36:05 +01:00
vmselect-windows-amd64-prod:
APP_NAME=vmselect $(MAKE) app-via-docker-windows-amd64
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
vmselect-prod-race:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect RACE=-race $(MAKE) app-via-docker
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
package-vmselect:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect $(MAKE) package-via-docker
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
package-vmselect-race:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect RACE=-race $(MAKE) package-via-docker
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
app/{vminsert,vmselect,vmstorage}: add `package-{vminsert,vmselect,vmstorage}-{goarch}` Makefile rules for building arch-specific docker images
2022-10-07 19:17:01 +02:00
package-vmselect-amd64:
APP_NAME=vmselect $(MAKE) package-via-docker-amd64
package-vmselect-arm:
APP_NAME=vmselect $(MAKE) package-via-docker-arm
package-vmselect-arm64:
APP_NAME=vmselect $(MAKE) package-via-docker-arm64
package-vmselect-ppc64le:
APP_NAME=vmselect $(MAKE) package-via-docker-ppc64le
package-vmselect-386:
APP_NAME=vmselect $(MAKE) package-via-docker-386
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
publish-vmselect:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect $(MAKE) publish-via-docker
all: open-sourcing cluster version
2019-05-22 23:23:23 +02:00
publish-vmselect-race:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect RACE=-race $(MAKE) publish-via-docker
all: add mssing APP_NAME to vm*-GOARCH builds
2020-07-31 12:42:09 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-amd64:
APP_NAME=vmselect CGO_ENABLED=1 GOOS=linux GOARCH=amd64 $(MAKE) app-local-goos-goarch
all: add mssing APP_NAME to vm*-GOARCH builds
2020-07-31 12:42:09 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-arm:
APP_NAME=vmselect CGO_ENABLED=0 GOOS=linux GOARCH=arm $(MAKE) app-local-goos-goarch
all: add mssing APP_NAME to vm*-GOARCH builds
2020-07-31 12:42:09 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-arm64:
APP_NAME=vmselect CGO_ENABLED=0 GOOS=linux GOARCH=arm64 $(MAKE) app-local-goos-goarch
all: add mssing APP_NAME to vm*-GOARCH builds
2020-07-31 12:42:09 +02:00
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-ppc64le:
APP_NAME=vmselect CGO_ENABLED=0 GOOS=linux GOARCH=ppc64le $(MAKE) app-local-goos-goarch
all: add mssing APP_NAME to vm*-GOARCH builds
2020-07-31 12:42:09 +02:00
all: add makefile rules for GOARCH=s390x for all the VictoriaMetrics components This is a follow-up for 007530f882392cf3844546f5caba4b37a0802dce
2023-02-26 21:36:44 +01:00
vmselect-linux-s390x:
APP_NAME=vmselect CGO_ENABLED=0 GOOS=linux GOARCH=s390x $(MAKE) app-local-goos-goarch
Rename release packages (#2810) * makefile: add os to each release file * makefile: update vmutils arm64 * makefile: update victoria-metrics release process * makefile: update publish with os * makefile: update publish with os * makefile: change tar library * update release logic * copy all releases * sort command by GOOS * rollback commands * rollback OSARCH * fix commands * cleanup * fix windows build * sort build by GOOS, update README.md
2022-07-13 14:42:48 +02:00
vmselect-linux-386:
APP_NAME=vmselect CGO_ENABLED=0 GOOS=linux GOARCH=386 $(MAKE) app-local-goos-goarch
all: add mssing APP_NAME to vm*-GOARCH builds
2020-07-31 12:42:09 +02:00
all: follow-up for d99ba3481b192d581bf6a153e40e5f99a7eb5edf
2022-07-13 15:44:39 +02:00
vmselect-freebsd-amd64:
APP_NAME=vmselect CGO_ENABLED=0 GOOS=freebsd GOARCH=amd64 $(MAKE) app-local-goos-goarch
vmselect-openbsd-amd64:
APP_NAME=vmselect CGO_ENABLED=0 GOOS=openbsd GOARCH=amd64 $(MAKE) app-local-goos-goarch
all: add Windows build for VictoriaMetrics This commit changes background merge algorithm, so it becomes compatible with Windows file semantics. The previous algorithm for background merge: 1. Merge source parts into a destination part inside tmp directory. 2. Create a file in txn directory with instructions on how to atomically swap source parts with the destination part. 3. Perform instructions from the file. 4. Delete the file with instructions. This algorithm guarantees that either source parts or destination part is visible in the partition after unclean shutdown at any step above, since the remaining files with instructions is replayed on the next restart, after that the remaining contents of the tmp directory is deleted. Unfortunately this algorithm doesn't work under Windows because it disallows removing and moving files, which are in use. So the new algorithm for background merge has been implemented: 1. Merge source parts into a destination part inside the partition directory itself. E.g. now the partition directory may contain both complete and incomplete parts. 2. Atomically update the parts.json file with the new list of parts after the merge, e.g. remove the source parts from the list and add the destination part to the list before storing it to parts.json file. 3. Remove the source parts from disk when they are no longer used. This algorithm guarantees that either source parts or destination part is visible in the partition after unclean shutdown at any step above, since incomplete partitions from step 1 or old source parts from step 3 are removed on the next startup by inspecting parts.json file. This algorithm should work under Windows, since it doesn't remove or move files in use. This algorithm has also the following benefits: - It should work better for NFS. - It fits object storage semantics. The new algorithm changes data storage format, so it is impossible to downgrade to the previous versions of VictoriaMetrics after upgrading to this algorithm. Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3236 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/3821 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/70
2023-03-19 09:36:05 +01:00
vmselect-windows-amd64:
GOARCH=amd64 APP_NAME=vmselect $(MAKE) app-local-windows-goarch
all: add mssing APP_NAME to vm*-GOARCH builds
2020-07-31 12:42:09 +02:00
vmselect-pure:
app/vmselect: follow-up after aa11ef6d3b9ff29c7dad917d2e617186ad417d15 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/1413 Updates https://github.com/VictoriaMetrics/VictoriaMetrics/issues/4
2021-07-07 16:28:06 +02:00
APP_NAME=vmselect $(MAKE) app-local-pure
Reference in New Issue Copy Permalink