Over Time
AI is splitting by delivery mode while control and infrastructure harden around it
Generative AI is no longer settling on one way to be used. It is spreading into distinct delivery modes - local PCs, regulated cloud enclaves, specialised decision models and device-bound consumer interfaces - because cost, latency and trust do not line up in one place. Microsoft’s Azure Enclave reached general availability for regulated workloads, while Hugging Face released Llama Windows, a Windows 11 app that runs quantized models locally and exposes them to other software through a local interface, and Microsoft put its own small decision model into Foundry. Microsoft Foundry is the shop where Microsoft keeps models side by side, its own and other people's. Apple added Siri AI and a full-screen AI discovery layer to Apple TV 4K, and Meta put one frontier model behind its API and another behind a subscription product. This appears to sharpen the line from earlier local-first agents and selective feature retirements: the market is segmenting by what must stay local, what must be governed in cloud isolation, and what is packaged as a device feature rather than a general assistant.
Competition is also moving away from the model as a standalone release and toward the full stack that lets agents and workloads run. Microsoft said Azure Maia will become the primary inference system for its own products and services and plans multi-gigawatt deployments from 2027, while Google made Gemini 4 Argon generally available in Google Cloud and tied it into its enterprise agent platform. AMD, Intel and NVIDIA each used the Open Compute Project summit to publish rack designs, optics or infrastructure specifications built around agentic AI workloads. This likely widens an older shift from model launches alone to integrated systems of chips, compilers, schedulers, cloud services and workflow tooling, because the contest now reaches from the model catalogue down to power delivery and cooling. For anyone buying or building with generative AI, that suggests the practical choice is increasingly between stacks that arrive as an operating environment, not between isolated models.
Local AI on personal devices is moving past the old privacy niche into a real execution path for capable agents and specialised models. NVIDIA detailed the RTX Spark PC platform with up to 128GB of unified memory and associated agent apps ahead of launch, AMD introduced a Ryzen AI Halo developer platform for hosting very large locally run models, LiquidAI released both a local reasoning model for private agentic workflows and open-weight edge decision models, and Microsoft had already opened preorders for a Surface Laptop Ultra built to run large models locally. This appears to strengthen the new line rather than merely repeat it: local execution now has hardware, runtimes and task-specific models arriving together. The effect reaches beyond Microsoft because ordinary Windows and PC estates start to look less like thin clients for cloud AI and more like places where part of the workload can stay on the machine.
Evidence
- huggingface.coLiquidAI unveils LFM2.5-24B-A2B reasoning model for on-device agents
- huggingface.coLightOn AI releases ColGrep-Agent-2B local code-search agent model
- blogs.nvidia.comNVIDIA details RTX Spark PC superchip and software ecosystem ahead of Oct. 16 launch
- heise.deMicrosoft-Decision-1 model highlighted as fast, structured AI for decision tasks
- apple.comApple unveils new Apple TV 4K with Siri AI
- huggingface.coHugging Face releases Llama Windows app for local models on Windows
- techcrunch.comMeta releases Muse Wonder, its first frontier AI model
- commandline.microsoft.comMicrosoft releases Microsoft-Decision-1, a fast decision model in Foundry
- aboutamazon.comAmazon launches new Alexa Tablets with Alexa+ built in
- cnbc.comMicrosoft starts preorders for AI-focused Surface Laptop Ultra
- openai.comOpenAI rolls out GPT‑6 and Intelligent UI across ChatGPT
- 2026-07-16 LM Studio launched Bionic, a local-first AI agent for open models that supports running models on-device or via LM Studio’s cloud, provides local voice transcription with Mistral’s Voxtral model, and offers project-based agents operating on local files with controls over AI spend and data privacy. lmstudio.ai
- 2026-07-21 Microsoft updated Copilot support documentation to announce that the consumer Deep Research and Podcasts features will be retired on August 18, 2026, with Deep Research capabilities continuing only for Microsoft 365 Premium subscribers and existing podcasts becoming inaccessible. support.microsoft.com
- 2026-08-06 OpenAI updated ChatGPT by improving the GPT-5.6 Sol model for Plus and Pro users with controls over reasoning effort, and making GPT-5.6 Luna the default model for free users with unlimited text chats and a new Think button for high-effort questions. openai.com
- 2026-08-05 Amazon announced that its generative AI assistant Alexa+ will launch in Australia on August 6 as part of an Early Access program, with the service free during Early Access and later free for Prime members or AU$29.99 per month for non‑Prime customers. aboutamazon.com
- microsoft.comAzure Enclave reaches general availability for sensitive and regulated workloads
- 2026-07-21 OpenAI launched the ChatGPT for small business program, offering training, guides, workflow templates, and curated agents with integrations to tools such as Dropbox, Shopify, Intuit, Slack, Atlassian and Wix to help small firms adopt ChatGPT Work for productivity and scaling. openai.com
- blogs.microsoft.comMicrosoft unveils Maia 300 AI chip and plans multi-gigawatt Azure Maia deployments
- cloud.google.comGoogle makes Gemini 4 Argon generally available on Google Cloud
- theregister.comAMD unveils Helion rack-scale AI reference design for agentic workloads at OCP Summit
- markets.ft.comIntel presents GPU D-series and high-density Xeon rack designs for agentic AI at OCP
- investor.nvidia.comNVIDIA and Cisco announce USFP 400Gb/s optics standard for scaling AI factories
- blogs.nvidia.comNVIDIA opens Vera Rubin rack designs and contributes MGX specs to OCP for AI factories
- 2026-07-17 AMD announced that the FastFlowLM team has joined the company to advance its AI inference stack built on the IRON NPU compiler and Lemonade initiative for large language and multimodal model inference on AMD-powered PCs and workstations. amd.com
- 2026-07-21 AMD and Moonshot AI detailed an end-to-end agentic AI serving stack rebuilt on AMD Instinct MI355X GPUs, using Kimi K2.6 and a scheduler-aware KV cache with Unified Memory & Bandwidth Pool and ROCm to reduce latency and increase token throughput for long multi-turn workloads. amd.com
- 2026-07-20 Alibaba Cloud announced an Agent-Native Cloud suite with new AgentLoop and AgentTeams services for multi-agent workflows, TokenWorks for large-model inference routing and cost control, the planned open-sourcing of the T-Head SAIL AI software stack, and Qwen-powered wearable devices including Qwen Clip earbuds, highlighted at WAIC 2026. alibabacloud.com
- 2026-08-13 Databricks reported surpassing a $7 billion revenue run‑rate with over 80% year‑over‑year growth and announced closing a $5 billion strategic funding round at a $190 billion valuation to accelerate development of its AI products including Lakebase, Genie and Unity AI Gateway. databricks.com
- huggingface.coLiquidAI releases open d1-3B and d1-omni-600M decision models for edge inference
- amd.comAMD introduces next Ryzen AI Halo developer platform for large local LLMs
Our forecast
We expect Microsoft, Apple or Google to extend their operating system by the end of January so that any app can use an AI model directly on the device.
what we hold ourselves toDue 2027-01-31
By 2027-01-31, at least one of Microsoft, Apple or Google must have announced or released a first-party desktop or device operating-system feature that lets third-party applications call a locally running generative AI model through a documented on-device interface.