POPA ReconSemiAnalysis: GB300 generates approximately 400 times more tokens than A100 (this is a rough estimate: H100 generates approximately 8 times…
SemiAnalysis: GB300 generates approximately 400 times more tokens than A100 (this is a rough estimate: H100 generates approximately 8 times more tokens than A100, and GB300 generates approximately 50 times more tokens than H100). The A100's TDP is given as 400W, while the GB300's is given as 1400W. This means that, assuming constant electricity costs, the GB300 is approximately 115 times more efficient than the A100. The A100 rents for about $1-1.20 per hour, while the GB300 rents for $4-5 per hour. If a GB300 costs about $40k, assuming the chip amortizes over 5 years, the chip costs about $…
The excerpt is quoted from a public Telegram channel, which owns its text.