News
- Apr 18, 2024
“There are a lot of opportunities in the AI space,” says Ken Lau, CEO of AI chip startup Neuchips. “If you look at any public data, you will see that AI, in particular, generative AI [GenAI], could be a trillion-dollar market by 2030 timeframe. A lot of money is actually being spent on training today, but the later part of the decade will see investments going to inferencing.”
- Oct 24, 2023
Ken Lau, CEO of Neuchips, shared his views on the AI chip sector in a recent interview with DIGITIMES. He said while Nvidia seemsto be the main supplier of general-purpose GPUs, which are mostly used for AI training, there are more chip choices for AI inference.
- Apr 05, 2023
Taiwanese startup Neuchips showed off Nvidia-beating recommendation (DLRM) power scores. Neuchips’ first chip, RecAccel 3000, is specially designed to accelerate recommendation workloads.
The MLPerf Inference benchmarks primarily focus on datacenter and edge systems and submitters include Alibaba, ASUSTeK, Azure, Deci.ai, Dell, Fujitsu, FuriosaAI, Gigabyte, H3C, Inspur, Intel, Krai, Lenovo, Nettrix, Neuchips, NVIDIA, Qualcomm Technologies, Inc., Supermicro, and ZhejiangLab. This round set new records with over 3,900 performance results and 2,200 power measurements, respectively 2X and 6X more than the prior round, demonstrating the momentum of the community.
Latest round Includes over 1,800 performance and 350 power results for leading ML inference systems
Today, MLCommons, an open engineering consortium, released new results for MLPerf Inference v1.1, the organization's machine learning inference performance benchmark suite. MLPerf Inference measures the performance of applying a trained machine learning model to new data for a wide variety of applications and form factors, and optionally includes system power measurement.