Hardigg 3090

Two NVLinked RTX 3090s squeezed into a 25-liter case so the rig can travel between an offline workplace and home for updates. With each GPU power-limited to 300W, it runs at about 37 to 40 dB.

Why this build

The main reason for the portability is that the workplace of the coworker I built this for is truly offline, with no possibility of LAN or Wi-Fi. To download new models and update the system periodically, I need to go pick it up from him and take it home.

Everything except the case, CPU cooler, and PSU was bought used on Facebook Marketplace.

Notes and caveats

Warning: these components don’t fit if you try to copy this build.

• The bottom GPU rests on the Arctic P12 Slim fans at the bottom of the case, which push up on the card.
• The top Arctic P14 Max fans don’t have mounting points for half of their screw holes. They stay in place by being wedged very tightly against the motherboard, case, and PSU.
• There’s probably way too much pressure on the PCIe cables coming off the GPUs when you close the glass.

All that being said, with a 300W power limit applied to both GPUs and a silent fan profile, this rig has surprisingly good temperatures and noise levels considering how compact it is. It runs at about 37 to 40 decibels from 1 meter away. During prompt processing and inference, the GPUs run at about 63°C, the CPU at 55°C, and noise sits at 34 decibels.

Source

Originally shared on r/LocalLLaMA: 25L portable NV-linked dual 3090 LLM rig.