Azure GPU Training Cost — A100 vs H100 Pricing Comparison

The ND96asr_v4 (8× A100 80GB) costs ~$27–32/hr on-demand. The NC80adis_H100_v5 (8× H100) costs ~$32–38/hr. Spot pricing reduces costs 60–80% when available. A 4-node training cluster costs $80K–110K/month on-demand, or $16K–30K with spot instances. H100 offers ~2× training throughput vs A100, making cost-per-training-step often comparable.