Home Server and Self Hosting General - Technological Self-Sufficiency

[22 Rimfire]

Proxmox is great if you know Debian already. Otherwise, especially coming from vSphere, it can feel a bit rough and clunky in the beginning.

Make sure to check out all the available plugins, though. I use Proxmenux for a number of tasks that otherwise would require a lot of clicking. It runs on the console, so you can just ssh into it instead of having to use a GUI with a web browser. An extremely handy timesaver.

Thank you, I had no idea plugins were even available. So far the only time I’ve had to dip into the console has been switching to the free update repository, otherwise I’ve been pleasantly surprised how much you can get done in-gui.
It’s not too bad coming from vsphere, but the acid test will be when something goes wrong. I’ve already noticed vi is ACTUAL vi on the host, not vim as I’ve become accustomed to on basically every Linux install ever. It’s the small details like that that end up befuddling me in a crisis.

 

[Almighty Space Duck]

@22 Rimfire If you haven’t found it already there’s - https://community-scripts.org/ . I found it really helpful for getting all my containers etc set up.

 

[False Emprah]

Thank you, I had no idea plugins were even available. So far the only time I’ve had to dip into the console has been switching to the free update repository, otherwise I’ve been pleasantly surprised how much you can get done in-gui.
It’s not too bad coming from vsphere, but the acid test will be when something goes wrong. I’ve already noticed vi is ACTUAL vi on the host, not vim as I’ve become accustomed to on basically every Linux install ever. It’s the small details like that that end up befuddling me in a crisis.

It being Debian underneath makes it easy to customize to fit your needs (I installed vim and set it the default for example). Of course with that flexibility you also get the ability to shotgun yourself in the foot if you're not careful but I always prefer the option vs being completely locked down.

 

[Dreamland]

@22 Rimfire If you haven’t found it already there’s - https://community-scripts.org/ . I found it really helpful for getting all my containers etc set up.

It does fuck up GPU setups a lot, had to do it manually for jellyfin and ollama, though strangely the immich one just werks.
I do recommend studying the command flow of the scripts and also doing some setups manually if only to pad out your knowledge.

 

[Dreamland]

@22 Rimfire If you haven’t found it already there’s - https://community-scripts.org/ . I found it really helpful for getting all my containers etc set up.

It does fuck up GPU setups a lot, had to do it manually for jellyfin and ollama, though strangely the immich one just werks.
I do recommend studying the command flow of the scripts and also doing some setups manually if only to pad out your knowledge.

 

[Jimjamflimflam]

Dumb question. I'm trying to run a home ai lab setup. My parts are pretty old except for my GPU (rtx 3060) and it does a good job with web ui. Trying to set up hermes agent and thinking my GPU is going to be limited on that.

Would just updating my GPU be enough or do I have to go through the whole process of selling my kids for ram? If I update my ram, I will likely have to update my cpu which means new motherboard etc. So ideally just have to bite the bullet for one part rather then an entire computer replacement.

 

[22 Rimfire]

Dumb question. I'm trying to run a home ai lab setup. My parts are pretty old except for my GPU (rtx 3060) and it does a good job with web ui. Trying to set up hermes agent and thinking my GPU is going to be limited on that.

Would just updating my GPU be enough or do I have to go through the whole process of selling my kids for ram? If I update my ram, I will likely have to update my cpu which means new motherboard etc. So ideally just have to bite the bullet for one part rather than an entire computer replacement.

The rtx 3060 should be plenty good enough to run a reasonable model with Hermes. Get it all running before you go crazy chasing upgrades, chances are you’re overthinking it.

 

[Almighty Space Duck]

It does fuck up GPU setups a lot, had to do it manually for jellyfin and ollama, though strangely the immich one just werks.
I do recommend studying the command flow of the scripts and also doing some setups manually if only to pad out your knowledge.

What problem did you have with your GPU? The jellyfin and tdarr scripts coped fine with my B50 with sriov_numvfs 2. Seriously, fuck intel for gimping the B50s SRIOV capabilities post launch.

 

[Dreamland]

What problem did you have with your GPU? The jellyfin and tdarr scripts coped fine with my B50 with sriov_numvfs 2. Seriously, fuck intel for gimping the B50s SRIOV capabilities post launch.

sriov works fine, but i prefer using LXCs because of the memory pool it's sharing. Ollama and jellyfin simply wouldn't recognise my B50 without serious tinkering with the mapping permissions. ComfyUI is a lost cause, it simply won't detect any card even if i install it on the host itself.

 

[Curry Teafag]

It being Debian underneath makes it easy to customize to fit your needs (I installed vim and set it the default for example). Of course with that flexibility you also get the ability to shotgun yourself in the foot if you're not careful but I always prefer the option vs being completely locked down.

Is there something supposed to go wrong? Proxmox is a very solid and stable distro. By default, it will induce a two-staged reboot to do an update, for maximum stability.

There's a recovery console it boots into if something fails, so you can always fix things.

 

[False Emprah]

Is there something supposed to go wrong? Proxmox is a very solid and stable distro. By default, it will induce a two-staged reboot to do an update, for maximum stability.

There's a recovery console it boots into if something fails, so you can always fix things.

I'm talking about if you go ham doing a bunch of goofy shit that would fuck over any Debian install if you're not careful; it's plenty stable in normal use. It just doesn't prevent you from doing those things unlike something like modern TrueNAS which is heavily (frankly to a ridiculous extent) locked down.

As an example (this was on a test box): when initially setting it up I only had a single drive so the boot/os wasn't redundant. I got an extra one after the fact and did some low level cli stuff to then mirror it. Worked the first time; second time I forgot a step and made it unbootable. I had to boot in with a recovery usb and chroot in/fix things.

Should you ever do something like that in first place in production? Absolutely not. Is it useful to be 'able' to if necessary? Hell yes.

 

[Curry Teafag]

I'm talking about if you go ham doing a bunch of goofy shit that would fuck over any Debian install if you're not careful; it's plenty stable in normal use. It just doesn't prevent you from doing those things unlike something like modern TrueNAS which is heavily (frankly to a ridiculous extent) locked down.

Well, TrueNAS is a NAS OS, Proxmox is a hypervisor OS. It is supposed to be open for experimentation because that is sometimes needed, depending on what exactly you use it for.

 

[False Emprah]

Proxmox is a hypervisor OS. It is supposed to be open for experimentation because that is sometimes needed, depending on what exactly you use it for.

So are ESXi and Nutanix but good luck being able to mung those to that degree (not that you should). I'm not really disagreeing with you but more praising Proxmox.

 

[22 Rimfire]

I'm a bit perplexed about the best way to bring my pile of docker containers over to the proxmox host. Looks like I have two options:
- Install docker in LXC on the host
- Install docker on a Linux guest VM

Searching around a bit seemed to suggest running docker direct on the proxmox host might be a bad idea, but the count of docker installs on https://community-scripts.org/ being so high suggests perhaps it's fine to do that.

I currently have them running in a hyper-v guest so importing that as a VM seems more straightforward than moving/reconfiguring all the containers onto the proxmox host.

Am I overthinking this?

 

[False Emprah]

I'm a bit perplexed about the best way to bring my pile of docker containers over to the proxmox host. Looks like I have two options:
- Install docker in LXC on the host
- Install docker on a Linux guest VM

Searching around a bit seemed to suggest running docker direct on the proxmox host might be a bad idea, but the count of docker installs on https://community-scripts.org/ being so high suggests perhaps it's fine to do that.

I currently have them running in a hyper-v guest so importing that as a VM seems more straightforward than moving/reconfiguring all the containers onto the proxmox host.

Am I overthinking this?

I wouldn't install Docker directly on the host as that could severely interfere with the network config/devices Proxmox does. You do have two options:

1. The simplest is just spin up a VM and install Docker in it.
2. You can run docker/container.io images directly as LXC but it can be a bit goofy (for one thing you might not have the container log output visible).

You can use the 'Pull from OCI Registry' and pull down Docker images and it will make an LXC template you can then create a container from. I have TvMosaic running for example:



LXC is still a container sharing the kernel of the host but it seems to be treated way more like a 'light VM' than Docker containers are. It took me a while to get comfortable with it and honestly I'm still not sure I like them. Most of my containers were done from a base OS image and then I went in and installed things just like it was a VM; this one is running a private WoW server for example.