Hey Presto! Nvidia pulls software hack out of AI hat and doubles performance of H100 GPU for free

Nvidia is banding together with a list of tech partners on a game-changing piece of software that’s set to double the performance of its flagship H100 Tensor Core GPUs. 

The open source TensorRT-LLM update, which is set for release in the coming weeks, sees an up-to-date system outperform the A100 by eightfold, whereas H100s would previously outperform the A100 by just fourfold. This was tested on the GPT-J 6B, a model that’s used to summarise articles from CNN and Daily Mail.

Related Posts

Leave a Reply

Your email address will not be published. Required fields are marked *