• 0 Posts
  • 8 Comments
Joined 2 years ago
cake
Cake day: July 31st, 2023

help-circle
  • Zfs on Debian on bare metal with nfs server. Edit: and it hosts the worker vms

    Vlan for services with routed subnet

    Sriov connectx4 with 1 primary vm running freebsd and basically all my major services in their own jails. Won’t go into details, but it has like 20 jails and runs almost everything. (had full vnet jails for a while which was really cool but performance wasn’t great).

    1 vm for external nginx and bind on Debian vm on isolated subnet/Vlan and dmz for exposed services

    1 vm for mailinabox on dmz subnet/Vlan

    1 Debian vm on services vlan/net for apps that don’t play well with freebsd, mostly dockers, I do not like this vm, it’s basically unclean and mostly isolated.

    Few other vms for stuff.

    It’s a Dell r730 with 2 2697(or 2698? 20c/40t each) with 512gb. Edit: v4 so broadwell

    12x16tb hgst h530s with 2 nvme drives and 2 Sata ssds, somewhere in there is a zlog and l2arc.

    Can’t figure out how to fit a decent GPU in there so currently it’s living on my dual Rome workstation, this system is due for an upgrade, thinking about swapping the workstation to a much lighter one and push the work to the server, while moving the storage to a dedicated system, but not there yet.

    Love freebsd though, don’t use it as my daily driver, tried a bit, it worked but there was just enough trouble to not make it work, but freebsd has moved on and so have i, so it’s worth a shot again.

    Decent i/O, but nothing to write home about, think it saturates the 10g but only just, I have gear for full 100g (I do a LOT of chip startups, and worked at a major networking chip firm a while) but it takes a lot more power, and i have PGE so I can’t justify it till I can seriously saturate it.

    Also I’m in process of moving to Europe, built a weak network here and linked via wire guard, but shit is expensive here and I’m not sure how to finish the move just yet, so I’m basically 50/50 including time at work in the valley.






  • Good question.

    Debian doesn’t often require a reboot, but the longer you go, and if you need kernel modules (nvidia is the worst at this) you might need to reboot to keep everything in sync.

    My suggestion: raspberry pi, like 1st edition, keep the key very secure, give it a usb serial console. When the server reboots, enter the password that way. It’s your emergency console.



  • Sigh.

    Lemmy.world is the safe, gateway drug for lemmy, the Marijuana as it were, a way to recruit normies without scaring them.

    After people get comfortable they can move to instances that suit them better.

    But the defederation serves a purpose, it’s like saying ‘I believe in completely free speech!!!’ then spamming kids with animal torture porn.