VRAM
256 GB
Bandwidth
1228 GB/s
70B Speed
21.8 tok/s
Verdict, Specs & Watch-outs
256GB unified pool at 1,228 GB/s loads 70B Q8 and 120B+ MoE checkpoints with room for long context windows.
Watch out: High entry cost and Metal-only execution, so CUDA-specific FP8 or bitsandbytes training pipelines are not supported.
Accelerator: Apple M5 Ultra 80-Core GPU (Unified Memory) • 215W TDP