I’m thinking about starting a self hosting setup, and my first thought was to install k8s (k3s probably) and containerise everything.
But I see most people on here seem to recommend virtualizing everything with proxmox.
What are the benefits of using VMs/proxmox over containers/k8s?
Or really I’m more interested in the reverse, are there reasons not to just run everything with k8s as the base layer? Since it’s more relevant to my actual job, I’d lean towards ramping up on k8s unless there’s a compelling reason not to.
Note that proxmox also supports containers (LXCs), they are just different from Docker containers.
LXCs are closer to VMs than Docker containers are, but they are still different. One big difference: Docker containers are stateless/immutable, while LXCs are not. I prefer the mutability ;)
Proxmox is often recommended because it makes administering things easy (never used k8s, but I heard it makes it rather hard because it’s built for scale) when you use LXCs (though you can still use docker, I have a VM for docker-only apps), incremental backups with deduplication thanks to PBS, still efficient backups otherwise, everything with a nice web interface, but with nice command line tools available.
I am with you. So easy to use. I have Dietpi running as lightweight OS on my VMs for when i don’t want LXCs.