README.md: hosts, deployment commands -> HOSTS.md
This commit is contained in:
zowoq
parent
b03c9fff19
commit
733947c05b
2 changed files with 100 additions and 97 deletions
99
HOSTS.md
Normal file
99
HOSTS.md
Normal file
|
|
@ -0,0 +1,99 @@
|
||||||
|
## Hosts
|
||||||
|
|
||||||
|
### `build01`
|
||||||
|
|
||||||
|
This machine is perfect for running heavy builds.
|
||||||
|
|
||||||
|
* Provider: Hetzner
|
||||||
|
* CPU: AMD Ryzen 7 1700X Eight-Core Processor
|
||||||
|
* RAM: 64GB
|
||||||
|
* Drives: 2 x 512 GB SATA SSD
|
||||||
|
|
||||||
|
### `build02`
|
||||||
|
|
||||||
|
This machine currently just runs r-ryantm/nixpkgs-update.
|
||||||
|
|
||||||
|
* Provider: Hetzner
|
||||||
|
* CPU: AMD Ryzen 7 3700X Eight-Core Processor
|
||||||
|
* RAM: 64GB DDR4 ECC
|
||||||
|
* Drives: 2 x 1 TB NVME in RAID 1
|
||||||
|
|
||||||
|
### `build03`
|
||||||
|
|
||||||
|
This machine is a replacement for build01.
|
||||||
|
|
||||||
|
* Provider: Hetzner
|
||||||
|
* CPU: AMD Ryzen 5 3600 6-Core Processor
|
||||||
|
* RAM: 64GB DDR4 ECC
|
||||||
|
* Drives: 2 x 512 GB NVME in RAID 1
|
||||||
|
|
||||||
|
### `build04`
|
||||||
|
|
||||||
|
This machine is meant as an aarch64 builder for our hydra instance running on build03.
|
||||||
|
|
||||||
|
* Provider: Oracle cloud
|
||||||
|
* Instance type: [Ampere A1 Compute](https://www.oracle.com/cloud/compute/arm/)
|
||||||
|
* CPU: 4 VCPUs on an Ampere Altra (arm64)
|
||||||
|
* RAM: 24GB
|
||||||
|
* Drives: 200 GB Block
|
||||||
|
|
||||||
|
## Deployment commands:
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ ./deploy
|
||||||
|
```
|
||||||
|
|
||||||
|
If you want to reboot a machine, use the following command to also deploy secrets afterwards:
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ inv deploy --hosts build02 reboot --hosts build02
|
||||||
|
```
|
||||||
|
|
||||||
|
## Install/Fix system from Hetzner recovery mode
|
||||||
|
|
||||||
|
1. Copy your ssh key to the recovery system so that the kexec image can re-use it.
|
||||||
|
|
||||||
|
``` console
|
||||||
|
yourmachine> ssh-copy-id root@build0X.nix-community.org
|
||||||
|
```
|
||||||
|
|
||||||
|
2. Download and boot into kexec-image:
|
||||||
|
|
||||||
|
``` console
|
||||||
|
$ curl -L https://github.com/nix-community/nixos-images/releases/download/nixos-unstable/nixos-kexec-installer-x86_64-linux.tar.gz | tar -xzf- -C /root
|
||||||
|
$ /root/kexec/run
|
||||||
|
```
|
||||||
|
|
||||||
|
3. Format and/or mount all filesystems to /mnt:
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ inv format-disks --hosts buildXX --disks /dev/nvme0n1,/dev/nvme1n1
|
||||||
|
```
|
||||||
|
|
||||||
|
4. Setup secrets
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ inv setup-secret --hosts buildXX
|
||||||
|
```
|
||||||
|
|
||||||
|
5. Generate configuration and download to the repo
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ nixos-generate-config --root /tmp
|
||||||
|
# optional, in most cases one can import roles/hetzner/amd.nix
|
||||||
|
$ scp buildXX.nix-community.org:/tmp/etc/nixos/hardware-configuration.nix buildXX/hardware-configuration.nix
|
||||||
|
```
|
||||||
|
|
||||||
|
6. Build and install
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ inv install-nixos --hosts buildXX
|
||||||
|
```
|
||||||
|
|
||||||
|
### Debug VM
|
||||||
|
|
||||||
|
You can start a vm from the rescue system in order to debug the boot:
|
||||||
|
|
||||||
|
```console
|
||||||
|
$ nix-shell -p qemu_kvm --run 'qemu-kvm -m 10G -hda /dev/sda -hdb /dev/sdb -curses -cpu host -enable-kvm'
|
||||||
|
```
|
||||||
98
README.md
98
README.md
|
|
@ -42,106 +42,10 @@ As PRs from forks don't have automatic CI checks, admins can test PRs by posting
|
||||||
|
|
||||||
## Hosts
|
## Hosts
|
||||||
|
|
||||||
### `build01`
|
See [HOSTS.md](HOSTS.md), this file also contains deployment details.
|
||||||
|
|
||||||
This machine is perfect for running heavy builds.
|
|
||||||
|
|
||||||
* Provider: Hetzner
|
|
||||||
* CPU: AMD Ryzen 7 1700X Eight-Core Processor
|
|
||||||
* RAM: 64GB
|
|
||||||
* Drives: 2 x 512 GB SATA SSD
|
|
||||||
|
|
||||||
### `build02`
|
|
||||||
|
|
||||||
This machine currently just runs r-ryantm/nixpkgs-update.
|
|
||||||
|
|
||||||
* Provider: Hetzner
|
|
||||||
* CPU: AMD Ryzen 7 3700X Eight-Core Processor
|
|
||||||
* RAM: 64GB DDR4 ECC
|
|
||||||
* Drives: 2 x 1 TB NVME in RAID 1
|
|
||||||
|
|
||||||
### `build03`
|
|
||||||
|
|
||||||
This machine is a replacement for build01.
|
|
||||||
|
|
||||||
* Provider: Hetzner
|
|
||||||
* CPU: AMD Ryzen 5 3600 6-Core Processor
|
|
||||||
* RAM: 64GB DDR4 ECC
|
|
||||||
* Drives: 2 x 512 GB NVME in RAID 1
|
|
||||||
|
|
||||||
### `build04`
|
|
||||||
|
|
||||||
This machine is meant as an aarch64 builder for our hydra instance running on build03.
|
|
||||||
|
|
||||||
* Provider: Oracle cloud
|
|
||||||
* Instance type: [Ampere A1 Compute](https://www.oracle.com/cloud/compute/arm/)
|
|
||||||
* CPU: 4 VCPUs on an Ampere Altra (arm64)
|
|
||||||
* RAM: 24GB
|
|
||||||
* Drives: 200 GB Block
|
|
||||||
|
|
||||||
## Cache
|
## Cache
|
||||||
|
|
||||||
All the builds on these machines are pushed to https://nix-community.cachix.org/
|
All the builds on these machines are pushed to https://nix-community.cachix.org/
|
||||||
|
|
||||||
Thanks to Cachix for sponsoring our binary cache!
|
Thanks to Cachix for sponsoring our binary cache!
|
||||||
|
|
||||||
## Deployment commands:
|
|
||||||
|
|
||||||
```console
|
|
||||||
$ ./deploy
|
|
||||||
```
|
|
||||||
|
|
||||||
If you want to reboot a machine, use the following command to also deploy secrets afterwards:
|
|
||||||
|
|
||||||
```console
|
|
||||||
$ inv deploy --hosts build02 reboot --hosts build02
|
|
||||||
```
|
|
||||||
|
|
||||||
## Install/Fix system from Hetzner recovery mode
|
|
||||||
|
|
||||||
1. Copy your ssh key to the recovery system so that the kexec image can re-use it.
|
|
||||||
|
|
||||||
``` console
|
|
||||||
yourmachine> ssh-copy-id root@build0X.nix-community.org
|
|
||||||
```
|
|
||||||
|
|
||||||
2. Download and boot into kexec-image:
|
|
||||||
|
|
||||||
``` console
|
|
||||||
$ curl -L https://github.com/nix-community/nixos-images/releases/download/nixos-unstable/nixos-kexec-installer-x86_64-linux.tar.gz | tar -xzf- -C /root
|
|
||||||
$ /root/kexec/run
|
|
||||||
```
|
|
||||||
|
|
||||||
3. Format and/or mount all filesystems to /mnt:
|
|
||||||
|
|
||||||
```console
|
|
||||||
$ inv format-disks --hosts buildXX --disks /dev/nvme0n1,/dev/nvme1n1
|
|
||||||
```
|
|
||||||
|
|
||||||
4. Setup secrets
|
|
||||||
|
|
||||||
```console
|
|
||||||
$ inv setup-secret --hosts buildXX
|
|
||||||
```
|
|
||||||
|
|
||||||
5. Generate configuration and download to the repo
|
|
||||||
|
|
||||||
```console
|
|
||||||
$ nixos-generate-config --root /tmp
|
|
||||||
# optional, in most cases one can import roles/hetzner/amd.nix
|
|
||||||
$ scp buildXX.nix-community.org:/tmp/etc/nixos/hardware-configuration.nix buildXX/hardware-configuration.nix
|
|
||||||
```
|
|
||||||
|
|
||||||
6. Build and install
|
|
||||||
|
|
||||||
```console
|
|
||||||
$ inv install-nixos --hosts buildXX
|
|
||||||
```
|
|
||||||
|
|
||||||
### Debug VM
|
|
||||||
|
|
||||||
You can start a vm from the rescue system in order to debug the boot:
|
|
||||||
|
|
||||||
```console
|
|
||||||
$ nix-shell -p qemu_kvm --run 'qemu-kvm -m 10G -hda /dev/sda -hdb /dev/sdb -curses -cpu host -enable-kvm'
|
|
||||||
```
|
|
||||||
|
|
|
||||||
Loading…
Add table
Reference in a new issue