New Atlas

Next-level AI engine comes top in LLM speed showdown

Responses to AI chat prompts not snappy enough? California-based generative AI company Groq has a super quick solution in its LPU Inference Engine, which has recently outperformed all contenders in ...
Business Wire

Untether AI Dramatically Expands AI Model Support and Speeds Developer Velocity with New Generative Compiler Technology

TORONTO--(BUSINESS WIRE)--Untether AI ®, a leader in energy-centric AI inference acceleration today introduced a breakthrough in AI model support and developer velocity for users of the imAIgine ® ...
Electronic Design

InferX X1 Coprocessor Takes on Inference at the Edge

1. Flex Logix’s nnMAX 1K inference tile delivers INT8 Winograd acceleration that improves accuracy while reducing the necessary computations. The InferX X1 chip includes multiple nnMax clusters. It ...
Semiconductor Engineering

Software Is At Least As Important As Hardware For Inference Accelerators

In articles and conference presentations on Inference Accelerators, the focus is primarily on TOPS (frequency times number of MACs), a little bit on memory (DRAM interfaces and on chip SRAM), very ...