#moe

NVIDIA's Nemotron 3 Super: 120B Parameters, 12B Active. Why That Matters.

NVIDIA dropped Nemotron 3 Super at GTC last week and the spec sheet looks like a typo. 120 billion total parameters. 12 billion active at inference ti