Geekbench has an AI benchmark now

The popular benchmarking utility Geekbench has launched a new cross-platform tool to evaluate the performance of devices under AI-heavy workloads. Geekbench AI measures a device’s CPU, GPU, and NPU (neural processing unit) to determine how well it can handle machine learning applications.

Geekbench developer Primate Labs has been working on the software using the name Geekbench ML, which launched in preview in 2021 but shifted the name to AI for reasons that seem obvious. To explore how different hardware responds to different AI-related tasks, it evaluates performance based on both accuracy and speed, with support for different frameworks, including ONNX, CoreML, TensorFlow Lite, and OpenVINO.

It delivers three scores, full precision, half precision, and quantized. Primate Labs says the scores also have an accuracy measurement to evaluate how close a workload’s outputs are to the truth, “or how accurately that model can do what it’s supposed to do.”

We’ll need more time with devices running on-device AI such as Copilot Plus PCs and all of the new phones to see how performance in real-world tasks correlates with Geekbench AI’s numbers. Checking framerates or loading times is one thing — now we might be checking the accuracy of predictive text, or what generative AI-enabled image editor comes up with.

You can download the tool now to try it yourself on Windows, macOS, Linux, Android, and iOS.

Source: The Verge

Leave a Reply

Your email address will not be published. Required fields are marked *

DON’T MISS OUT!
Subscribe To Newsletter
Be the first to get latest updates and exclusive content straight to your email inbox.
Stay Updated
Give it a try, you can unsubscribe anytime.
close-link