US artificial intelligence startup Groq launches new AI chip

2024-12-26 17:50
 57
Groq, an American artificial intelligence startup, recently launched a new cloud-based large-model inference chip. This chip uses the innovative Tensor Streaming Architecture (TSA) architecture and high-speed SRAM, which increases the speed of large-model inference by more than 10 times, even exceeding Nvidia's GPU.