Commit graph

68 commits

Author SHA1 Message Date
zowoq
632d80837c web02: move secrets to sops 2024-12-19 01:10:59 +00:00
zowoq
9795fb35a0 update network-online target
b2e99477cd
2024-12-18 23:04:03 +00:00
zowoq
b01db30564 modules/nixos/monitoring: switch to oauth-proxy for alertmanager 2024-11-24 23:41:34 +00:00
zowoq
3483677fcc modules/nixos/monitoring: switch back to separate subdomains
reverts d4343f7ebe
2024-11-24 23:41:34 +00:00
zowoq
8ce44ebf9a build03, web02: backup postgresql 2024-11-18 00:36:31 +00:00
zowoq
6ee4a1c4d5 use systemd unit name attribute 2024-11-14 03:56:00 +00:00
zowoq
06c99f6ef1 modules/nixos/monitoring: import hosts from knownHosts 2024-11-09 23:03:00 +00:00
zowoq
cf9f6100a9 nixpkgs-update: switch to hourly backups 2024-11-09 23:02:52 +00:00
zowoq
4eda852b6f modules/nixos/backup: add hourly 2024-11-09 23:02:52 +00:00
zowoq
5f28d26353 modules/nixos/monitoring/alert-rules: remove OfBorgEvalQueue
no point in keeping this when ofborg is in such a bad state that it fires continuously
2024-10-30 02:03:53 +00:00
zowoq
cf861eb4fb modules/nixos/monitoring: add grafana
This reverts commit b7d0c7a4c5.
2024-10-29 06:02:05 +00:00
zowoq
065e315647 modules/nixos/monitoring: move to agenix 2024-10-29 00:05:15 +00:00
zowoq
56d7deecd2 modules/nixos/monitoring/alert-rules: OfBorgEvalQueue: 2x -> 3x 2024-10-13 23:51:31 +00:00
zowoq
01c2beb7b4 modules/nixos: add nginx
- set worker_processes / worker_cpu_affinity to auto, enable pcre_jit

- enable ktls

- set a default virtualHost for a 404 and use it for reuseport

- set enableACME, forceSSL by default, disable for localhost

- set robots header and file
2024-10-08 23:48:11 +00:00
zowoq
db5fdfe682 modules/nixos/monitoring/alert-rules: remove comin rules 2024-09-13 01:35:59 +00:00
zowoq
a7dfa3d0ce modules/nixos/monitoring/alert-rules: bump filesystem full to 95% 2024-08-29 00:35:34 +00:00
zowoq
494e1c5532 modules/nixos/monitoring/prometheus: increase repeat_interval to 12h 2024-08-06 22:43:57 +00:00
zowoq
574cadf1fc modules/nixos/monitoring/alert-rules: reenable smart on build01 2024-07-30 05:56:08 +00:00
zowoq
92c55595d0 format tree 2024-07-24 10:27:26 +00:00
zowoq
5ce9567be2 darwin03: remove 2024-07-16 09:07:47 +00:00
zowoq
29ccc15750 serve logs on nixpkgs-update-logs.nix-community.org 2024-05-14 09:32:14 +00:00
zowoq
cdd225cc94 modules/nixos/monitoring/alert-rules: increase comin commit alert to 90m 2024-04-21 02:45:17 +00:00
zowoq
7172164bbe modules/nixos/monitoring/alert-rules: check comin deployments are on the same commit 2024-04-20 01:24:04 +00:00
zowoq
536c5e38be modules/nixos/monitoring/alert-rules: update comin 2024-04-09 00:12:52 +00:00
zowoq
e82b00eee9 Revert "modules/nixos/monitoring: ofborg: telegraf -> prometheus"
This reverts commit 2d3f246125.
2024-04-04 04:51:34 +00:00
zowoq
d100c8aac5 modules/nixos/monitoring/telegraf: reenable nixpkgs-update http check
also use `~supervisor` directory
2024-04-02 21:33:29 +00:00
zowoq
b7d0c7a4c5 modules/nixos/monitoring: remove grafana 2024-03-22 23:35:57 +00:00
zowoq
6bdb32d87d modules/nixos/monitoring/alert-rules: add comin 2024-03-22 06:10:00 +00:00
zowoq
2d3f246125 modules/nixos/monitoring: ofborg: telegraf -> prometheus
scraping this target with telegraf isn't working since 1.30.0
2024-03-14 23:52:55 +00:00
zowoq
1ff767bded darwin01: init 2024-03-08 07:38:14 +00:00
zowoq
9e026e0366 modules/nixos/monitoring: add ofborg prometheus and eval queue alert 2024-02-04 10:51:26 +00:00
zowoq
50fa6f0686 modules/nixos/monitoring/prometheus: set retention time to 30 days
default is 15 days
2024-01-23 22:56:05 +00:00
zowoq
c03246f531 add wants to services using network-online.target
c2853e2588
2024-01-22 03:39:59 +00:00
zowoq
4143922c6b build02: switch to new hardware 2023-12-13 05:53:33 +00:00
Jörg Thalheim
b01aa3a7e2 monitoring: build03 -> build01 for smart errors 2023-12-04 08:20:28 +00:00
zowoq
e55dafbe9d modules/nixos/monitoring/grafana: ensurePermissions -> ensureDBOwnership 2023-11-20 00:24:48 +00:00
zowoq
5f03801844 remove web01 and lemmy 2023-11-19 22:44:53 +00:00
zowoq
5c7bab039b modules/nixos/monitoring/alert-rules: alert at 90% disk usage 2023-11-14 23:20:22 +00:00
zowoq
a668626fcf Revert "nur-update: build03 -> web01"
This reverts commit 0fe327bce4.
2023-11-12 00:09:23 +00:00
zowoq
e24a3ac8cb modules/nixos/monitoring: switch to srvos alert rules 2023-11-11 07:48:49 +00:00
zowoq
8e1423592b modules/nixos/monitoring/alert-rules: drop localhost_reboot 2023-11-06 22:32:03 +00:00
zowoq
d90801d01f add buildbot 2023-11-04 08:05:37 +00:00
zowoq
ffe723781b modules/nixos/monitoring/telegraf: disable nixpkgs-update http check 2023-10-17 05:28:29 +00:00
zowoq
912a7b27c1 modules/nixos/monitoring: put alertmanager behind basic_auth 2023-09-26 21:38:24 +00:00
zowoq
4293c51090 modules/nixos/monitoring: add grafana 2023-09-26 21:31:58 +00:00
zowoq
f97526c4ee modules/nixos/monitoring/alert-rules: update filesystem_full rules 2023-09-26 21:19:34 +00:00
zowoq
0fe327bce4 nur-update: build03 -> web01 2023-09-15 06:44:04 +00:00
zowoq
6cbfb10f9a modules/nixos/monitoring/matrix-hook: use package from nixpkgs 2023-09-14 03:17:35 +00:00
zowoq
d4343f7ebe move alertmanager, prometheus under monitoring.nix-community.org 2023-09-06 05:26:57 +00:00
zowoq
ac4a067c2b Revert "move alertmanager, prometheus under monitoring.nix-community.org"
This reverts commit 2e480a6b62.
2023-09-05 00:12:43 +00:00