Howto build virtualization home lab for VMware, KVM, GNS3 and ZFS: Part selection
219A useful video for people trying to build for themselves at home a cheap machine for virtualization. Most of the related feature sets are being discussed from the perspective of a home user vs. VM deployment in a company. The current hardware build is mainly for a Linux KVM and GNS3 home lab (ZFS on Linux is a future project), but it supports ESXi 6 as well.
The video processing gut cut after 56 minutes by Youtube, so the remaining 15 minutes are uploaded as Part2.
Here I shortly explain the VT-x and VT-d features, the PCI-e bypass to a VM, and also the number of PCI-e lanes vs. the number of ports is also covered, though I do not go into detail on the "PCI-e root complex", which makes motherboard selection even more tricky in Intel based systems. Furthermore, the ECC vs. non-ECC RAM is also being covered.
In this video I go over the criteria I have used to select the parts for an inexpensive an quiet machine which will serve as a KVM virtualization host, and a host running GNS3 for router emulation with breakout cards to real Cisco switches.
The build should function without problems for studying with VMware ESXi 6 U2 as well, because the hardware is supported.
Main selection criteria:
-inexpensive commodity PC hardware
-low noise during operation (server equipment is way too loud)
-low power usage (where I live, one KW of power costs 0.4$)
-support for Intel VT-x or the AMD equivalent AMD-v
-support for Intel VT-d, or the AMD equivalent IOMMU feature sets
-at least 5 PCI-e slots for IO expansion cards
-no PCI-e switches on the PCI-e "root complex", otherwise VM-bypass does not work
-high number of PCI-e lanes addressed by the CPU (because of the above criteria)
-at least 6 VMs should be running on the machine without issues
-native SATA ports for ZFS on Linux (ZoL)
Components I have used:
CPU: AMD FX8350
CPU cooler: Thermalright True Spirit 140BW (awesome for AMD CPUs)
MoBo: Gigabyte 990FXA-UD5 (Asus lacks VT-d/IOMMU support)
RAM: 2* 8GB of Crucial Ballistix Sport DDR3 (no ECC)
Video temporarily: Geforce GTX8500GT
Video for longterm: S3 Trio with 2MB into the 32-bit PCI slot
Network: 3* Quad Gigabit HP NC364T + onboard Realtek GbE LAN
Cheap network card option for GNS3: Dlink DFE 570TX vs DFE 580TX
Storage: SanDisk 128GB SSD for the system disk + 256GB Crucial SSD for VMs
Case: Fractal Design Define XL R2 Black Pearl (full EATX with good noise dampening)
PSU: Be Quiet! Dark power Pro 500W (will be raplaced soon)
Keyboard: IBM Model M Clicky keyboard (best keyboard ever made)
PRICES FOR THE HARDWARE, INCLUDING SHIPPING
Your prices/mileage will wary, depending on the region you live.
========================
CPU: 135Euros (used, Ebay)
Mobo: 132Euros (used, Ebay)
RAM: 2*31Euros (new, Mindfactory.de)
Cooler: 43Euros (new from Mindfactory.de)
Quad Gigabit HP NC364T: 3*45Euros (used, Ebay)
DFE 570TX: 12Euros (used, Ebay)
Storage: had the two old SSDs laying around from old PCs
Case: 128Euro (new from Mindfactory.de, used it myself for an other build before)
PSU: old PSU, had it laying around
Costs could have been saved by buying a cheaper FX8320 CPU, or even an FX6xxx series CPU. Lots of money could have been saved on the case and CPU cooler, but I wanted a really quiet machine.