GPU hardware

7 posts tagged with this topic.

Infrastructure12 min read

Vessel GPU Racks: Power, Cooling, Security

The unglamorous realities of deploying GPU compute on a vessel. Power budgets, thermal management, vibration isolation, and physical access control.

James Calder·May 17, 2026

Edge AI6 min read

Kimi K2.6: 1T Parameters, 8 H200s Required

Moonshot AI's Kimi K2.6 ships natively in INT4 at 1T parameters. Open weights, world-class agent benchmarks, and a hardware bill that starts at 8 H200s.

Ethan Marsh·April 21, 2026

Edge AI12 min read

Deploying a 70B LLM Offline at Sea

Hardware, quantization, and serving stack for running Llama 3.1 70B on a vessel with no cloud fallback. Real specs and real benchmarks.

Ethan Marsh·April 19, 2026

Infrastructure18 min read

On-Vessel GPU Selection Guide

Blackwell B200, H200, H100, L40S, and A100 compared for vessel deployments. When each is the right call and the power realities.

James Calder·April 11, 2026

Edge AI17 min read

KV Cache Quantization at Sea (3/3)

Google's TurboQuant compresses the KV cache to 3 bits with no accuracy loss. Here is what that means for a vessel GPU rack.

Ethan Marsh·April 10, 2026

Infrastructure15 min read

Unified Memory for Vessel AI

AMD Strix Halo and NVIDIA DGX Spark bring 128 GB of unified memory to a shelf-sized box for under $4,000. When to buy one.

James Calder·April 10, 2026

Infrastructure14 min read

1M Context: The GPU Math (2/3)

VRAM and KV cache math for models from 7B to 405B at 1M tokens. Per-user scaling for crew and guests. The numbers are ugly.

James Calder·April 7, 2026