加载中…
2025-02-23
Speed and Conversational Large Language Models: Not All Is About Tokens per Second
Javier CondeMiguel GonzálezPedro ReviriegoZhen GaoShanshan LiuFabrizio Lombardi
文献摘要
The speed of open-weights large language models (LLMs) and its dependency on the task at hand, when run on GPUs, is studied to present a comparative analysis of the speed of the most popular open LLMs.
讨论
0讲解博客
生成讲解博客的中文版本
AI智能校验
生成AI智能校验的中文版本