News

Ken Lau, CEO of Neuchips, shared his views on the AI chip sector in a recent interview with DIGITIMES. He said while Nvidia seemsto be the main supplier of general-purpose GPUs, which are mostly used for AI training, there are more chip choices for AI inference.

Taiwanese startup Neuchips showed off Nvidia-beating recommendation (DLRM) power scores. Neuchips’ first chip, RecAccel 3000, is specially designed to accelerate recommendation workloads. 

Taiwanese startup Neuchips has taped out its AI accelerator designed specifically for data center recommendation models. Emulation of the chip suggests it will be the only solution on the market to achieve one million DLRM inferences per Joule of energy (or 20 million inferences per second per 20–Watt chip). The company has already demonstrated that its software can achieve world–beating INT8 DLRM accuracy at 99.97% of FP32 accuracy.