NobodyWho vs Cactus: On-Device Inference Engine Comparison
On NobodyWho's own blog, Pierre Bresson compares NobodyWho with Cactus, two engines for running models on the user's device, so this is a vendor's comparison. NobodyWho runs any GGUF model through llama.cpp, uses the GPU through Vulkan and Metal, and has Python, Flutter, React Native, Kotlin, Swift and Godot bindings over one Rust core, under the EUPL-1.2 licence. Cactus is a from-scratch engine with its own CQ quantisation, hand-written ARM NEON kernels, a small tool-calling model called Needle and an optional cloud handoff, under a source-available licence that is free only to individuals, students, non-profits and organisations below $2M in funding and in revenue. Cactus's NPU support for Qualcomm, MediaTek and Exynos is still on its roadmap, and neither engine targets the browser.
Was this useful?