Hardware Workstation HP EliteDesk 800 G4 DM 35W Data science + MLOps Workstation NVIDIA RTX 4000 SFF Ada External GPU Workstation Western Digital My Passport 6 TB Network attached storage Edge AI Jetson Orin Nano Super Local inference Spark cluster Beelink MINI S Spark master + Kafka Spark cluster 2 × Beelink MINI S Spark workers Network Raspberry Pi 4 Model B Core network services Network YuLinca 10-port Mini Gigabit PoE Switch Router + network + PoE
System overview
AI/ML Workbench Software environment A single launcher for development, data, AI, orchestration, and operations services across the rack.
Hosted at workbench.relativelyobjective.com
Shared design principles
Headless Linux Ubuntu or Debian on every node
Containerized Services separated by workload
Private ingress Centralized DNS, authentication, and proxying Workstation
HP EliteDesk 800 G4 Desktop Mini 35W Runs development, data engineering, experimentation, and MLOps workloads.
Specifications
SKU 4CB16UT#ABA
CPU i7-8700T, 12 threads
Memory 2 × 16 GB
Internal storage 512 GB SAMSUNG MZVLB512HAJQ-000H7 2.0 TB WD_BLACK SN770 2TB
OS Ubuntu 24.04.4 LTS kernel 7.0.0-28-generic on x86_64 Fitted accessory Thunderbolt 3, in the Flex IO slot
Links the workstation and external GPU.
Thunderbolt 3 Flex IO port sourced by Nico Leonard
Software stack 11 services Workstation
NVIDIA RTX 4000 SFF Ada Specifications
GPU RTX 4000 SFF Ada
Video memory 20 GB
Host link Thunderbolt 3 Fitted accessories TH3P4G3 Thunderbolt 3 dock
Connects and houses the external graphics card.
Cooler Master V750 SFX Gold
Supplies 750 W to the dock and graphics card.
Workstation
Western Digital My Passport 6 TB Provides one shared NFS working set while active work remains on workstation NVMe.
Specifications
Capacity 6 TB
Interface USB 3.0 Micro-B
Shared over NFS from the workstation Network
Raspberry Pi 4 Model B Runs DNS, lab ingress, authentication, reverse proxying, and rack observability.
Specifications
CPU Cortex A72, 4 threads
Memory 4 GB
Storage 64 GB
OS Debian GNU/Linux 12 (bookworm) kernel 6.12.75+rpt-rpi-v8 on aarch64 Fitted accessories Official Raspberry Pi PoE+ HAT
Carries network data and power over one cable.
UGREEN USB 3.0 Gigabit Ethernet Adapter
Adds the second gigabit interface for lab ingress.
DeskPi KL-P24 Micro HDMI to HDMI Adapter Board
Brings HDMI and USB-C connections to the front.
Software stack 10 services Edge AI
NVIDIA Jetson Orin Nano Super Runs local AI inference on dedicated edge hardware.
Specifications
CPU Cortex A78AE, 6 threads
Memory 7 GB
GPU Orin (nvgpu) sharing the board’s memory
Storage 64 GB 500 GB SanDisk SSD Plus 500GB A3N
OS Ubuntu 22.04.5 LTS kernel 5.15.148-tegra on aarch64 Fitted accessory Waveshare Jetson Orin PoE Module
Carries network data and power over one cable.
Software stack 1 services Service Category Ollama LLM Services
Spark cluster master
Beelink MINI S Specifications
CPU N95, 4 threads
Memory 1 × 8 GB
Storage 256 GB 256GB SSD
OS Ubuntu 24.04.4 LTS kernel 6.8.0-101-generic on x86_64 Fitted accessory Savage Raven USB 3.0 Ethernet Adapter
Connects each Beelink to the rack network.
Spark cluster workers
2 × Beelink MINI S Specifications
CPU N100, 4 threads
Memory 1 × 16 GB
Storage 512 GB 512GB SSD
OS Ubuntu 24.04.4 LTS kernel 6.8.0-136-generic on x86_64 Fitted accessory Savage Raven USB 3.0 Ethernet Adapter
Connects each Beelink to the rack network.
Network
YuLinca G1002G 10-Port PoE Switch Specifications
Ports 8 × PoE+, 2 × gigabit uplink
PoE budget 120 W
Standards IEEE 802.3af/at
Management unmanaged PoE budget Device Maximum load Raspberry Pi 4 Model B 20 W Jetson Orin Nano Super 25.2 W Total 45.2 W of 120 W
Power
Tupavco TP1713 10" Mini Rack PDU Specifications
AC outlets 4 × NEMA 5-15
Input rating 110 V, 15 A
Maximum load 1,650 W
Power cord 6 ft Power budget Device Maximum load Data science workstation 65 W External GPU 750 W PoE switch 120 W Spark power strip 108 W Total 1043 W
Power
HANYCONY HN93T Flat Plug Power Strip Specifications
AC outlets 3 × NEMA 5-15
USB power 1 × USB-A, 2 × USB-C
Input rating 125 V, 15 A
Maximum load 1,875 W
Power cord 6 ft Connected load Device Maximum load Spark master 36 W Spark worker 1 36 W Spark worker 2 36 W Total 108 W
Relatively Objective by Jonathan Hart