Cloud-led Future · Intelligence-driven Hotline +86 21 6228 0217 中文 | EN

Edge AI and Open Models Race Ahead, Loosening the Compute Power Structure

Overview

Edge AI is upgrading from “complement” to “mainstream route.” This week, laptops built on Nvidia’s RTX Spark superchip (internal N1X) debuted in Beijing; Apple confirmed China-bound Apple Intelligence will test this month and launch in December, integrated with Alibaba’s Qwen. Most notable, Meta released the 816-billion-parameter open model Muse Spark Open, runnable on two Apple M5 Ultra Mac Studios via MLX—seen as a direct challenge to Nvidia’s CUDA ecosystem.

China’s edge compute is also active: Axera launched the AX8860 at CIIF 2026—16-core Arm CPU, proprietary NPU, 256 TOPS mixed-precision, native FP4, 6nm—positioned as an edge/terminal base for large models; Houmo’s M50, in mass production under a year, has secured 150+ design wins across Agent Computer, embodied robots and edge inference.

Background & Interpretation

1. Technology Evolution Context

For two years AI power concentrated in cloud clusters, but high cost, latency and privacy limits persisted. As model efficiency rises (knowledge density doubling ~every 100 days) and terminal chips leap, edge-cloud synergy becomes viable. Huang Renxun likens agents to giving models an “exoskeleton”—memory and tools give AI “limbs,” demanding edge compute near users.

2. Core Drivers and Underlying Mechanisms

With models large enough and hardware strong enough, cloud inference is no longer the only option. Muse Spark Open (816B params, 42B active, 1M-token context) proves frontier capability on local hardware; Apple uses open models to fill local intelligence, Meta binds Apple hardware as its ecosystem carrier. Edge chips race on efficiency: Intel targets +9% per-watt and −18% power; Axera’s 256 TOPS pushes models to the edge.

3. Market Structure and Industry Chain Impact

Edge AI reshapes compute power: Nvidia enters PC processors via RTX Spark; Apple locks in ecosystem via local AI; Meta pries at CUDA with openness; Chinese chips (Axera, Houmo) stake edge inference and embodied robots. Gartner sees 2026 AI-PC shipments >143M (≈55% penetration), yet real agent usage stays <5%—huge headroom.

Implications & Outlook

Near-term, edge AI lands in AI PCs, terminals and embodied robots, boosting low-power NPUs and edge frameworks. Medium-term, cloud-edge-end synergy becomes standard. Watch real agent penetration, Apple’s China AI rollout, and Chinese edge-chip volume in embodied scenarios.

Takeaways for Industry Participants

Device makers should make AI a differentiator via local, low-latency, privacy-preserving design. Chip firms must build moats on efficiency and software (not raw TOPS), adapting mainstream open models. Developers can explore offline, data-never-leaves-device agent scenarios (industrial inspection, medical aids).

This column compiles industry information and shares technical perspectives; it does not constitute investment advice.