:: Our servers
IBM X3650-M2 (2U)
CPU: 2x XEON X5570 @2.93GHz (4c, 8T), 8MB SmartCache
RAM: 64GB ECC DDR3
ZFS raidz1 with 3x HDD per raidz VDEV, SSD L2ARC Cache, SSD ZIL
FC: 4Gb Qlogic QLE2462 HBA
Host OS: XEN Hypervisor running a custom-build linux dom0 with driver domains for ZFS, Ceph and NW
Members: ProxmoxVE in LXC-only mode / coreos
Our host platform is
now exclusively running on XEN, with dedicated "driver" domUs for NW, ZFS and Ceph.
NW-wise we have a dedicated storage NW(running on its own FC/eth hw), an obscure host-only management lan and firewalled dmz, prod/dev/test networks for infrastructure components. Member-domU are connected to an unfirewalled wan bridge(PVE lets you specify your own firewall rules very easily, we advice you to do so). VPN client infrastructure is still in the testing phase.