> Nvidia demonstrated this back in 2021. Because Nvidia created a supercomputer ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		YetAnotherNick on May 26, 2023 \| parent \| context \| favorite \| on: AI Is Catapulting Nvidia Toward the $1 Trillion Cl... > Nvidia demonstrated this back in 2021. Because Nvidia created a supercomputer with A100, with lot of focus for networking. Cloud providers don't give that option.

haldujai on May 26, 2023 [–]

Azure and AWS have both offered high-bandwidth cluster options that allow scaling beyond a single server for several months now.

Pretty sure MosaicML also does this but I haven't used their offering.

https://www.amazon.science/blog/scaling-to-trillion-paramete...

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact