I’ve been slogging away on setting up a home k8s cluster made from raspberry Pis.
I have 5 PIs, each with a NVMe base and a power over ethernet. I’ve installed an OS on the NVMe drives and configured the PI to boot from them. Each Pi is configured the same and has access via tailscale. I put all the Pis on a VLAN.
I took one other PI, and set it up as a DNS and DHCP server for the VLAN. This Pi has a fixed IP, all the others are also fixed but allocated via DHCP. I have been playing around with net boot from this PI, more on that later.
I have a single control node. I set it up as per the
docs. I used flannel for networking, which needs a /24 per machine. I used a /20 total.
Currently I have three worker nodes. Each is set up the same.
The hared part about this was debugging it on the way. I ended up with
Many extra boot options for the Pi. I it this bug (running pods randomly terminated) which took a long time to fix.
I also hit a bug where containerd had its tools in the wrong location.