AI News HubLIVE

Chips updates

Where Your AI Lives Matters More Than How Smart It Is – Especially in the UAE

In the UAE, enterprise AI decisions hinge not just on model capability but on where data is processed, operational costs, and regulatory compliance. The gap between frontier and open-weight models is narrowing, but self-hosting costs are high. UAE regulations mandate data localization, driving sovereign cloud and hybrid architectures. Companies should adopt a traffic-light routing system based on data sensitivity and validate demand before investing in hardware.

  • Frontier models offer high capability but weak data control; local models offer control but high costs and maintenance.
  • The capability gap has shrunk: open-weight models like MiniMax M2.5 and Kimi K3 now rival frontier models on many tasks.
In-site article

Run the Mythos Enhanced Coding Model Locally with llama.cpp and Pi

Learn how to run the Qwythos-9B-Claude-Mythos-5-1M model locally using llama.cpp, connect it to the Pi coding agent, and build local coding workflows with MTP speculative decoding and an OpenAI-compatible API.

  • Install llama.cpp and run the Qwythos MTP model locally with GPU acceleration and speculative decoding.
  • Connect the local server to Pi coding agent using the pi-llama plugin for agentic development.
In-site article

Contra George Hotz on "AI 2040 and the Cult of Intelligence"

Matthew Tromp critiques George Hotz's dismissal of AI 2040 scenarios, arguing that Hotz underestimates the feasibility of fast AI takeoff, the need for regulation, and the risks of unaligned AI. He defends Plan A's regulatory approach and questions Hotz's 'Plan L' of open-source AI.

  • Hotz is skeptical of hard takeoff but AI 2027 shows a plausible path without magic.
  • Physical constraints like supply chains are manageable; floating datacenters are feasible.
In-site article

Show HN: Neverbell, an AI agent that analyzes markets and executes trades

Neverbell is an AI agent skill providing direct market access for trading stocks, ETFs, commodities and crypto with leverage, enabling 24/7 automated trading via natural language instructions.

  • Grants AI agents access to 300+ assets (stocks, ETFs, commodities, crypto) with long/short and leverage.
  • Users interact via natural language to monitor markets, set strategies, and execute trades autonomously within defined limits.
In-site article

Headaches for Silicon Valley as China chips away at the US’s lead in the AI race

Google’s AI struggles highlight trouble as new Chinese models again challenge US tech dominance. Silicon Valley workers also take action to protect jobs from AI. Other news includes New York’s datacenter pause, Trump’s criticism, IBM’s stock plunge, AWS billing glitch, and more.

  • Chinese AI models again challenge US leadership
  • Google’s AI struggles raise concerns
In-site article

5 Free Courses to Go From AI Beginner to Practitioner

This article outlines a five-course free roadmap from basic AI algorithms to building LLMs from scratch, ideal for those with Python basics.

  • Harvard's CS50 AI builds logical foundation
  • Google's ML Crash Course covers math and TensorFlow
In-site article

“Second only to Fable 5:” Alibaba talks the talk with Qwen3.8 without providing any real data

Alibaba announced Qwen3.8, claiming it is second only to Anthropic's Fable 5, but provided no benchmarks or model card. The announcement comes on the heels of rival Moonshot's Kimi K3 launch with full technical details. Alibaba's lack of transparency raises questions about timing and motivation.

  • Alibaba claims Qwen3.8 is second only to Fable 5 but provides no supporting data.
  • The announcement follows Moonshot's Kimi K3 debut with complete benchmarks and technical details.
In-site article

Last Week in AI #251 - Mythos Back, Sonnet 5, Etched, LongCat

Trump lifts restrictions on Anthropic, Anthropic launches Claude Sonnet 5, Google's NotebookLM updates, chips stories from Etched and Baidu, and more!

  • Anthropic redeploys Claude Fable 5 with new cybersecurity classifiers
  • Anthropic launches cheaper Claude Sonnet 5 for agentic tasks
In-site article

Show HN: Enlarger • A local upscaler that keeps detail instead of smoothing it

Enlarger is a local image upscaler that preserves detail without generative AI. It reconstructs existing details and applies automatic post-processing to maintain texture and natural look. Features batch processing, offline operation, and a one-time payment. Suitable for photographers, designers, and print professionals.

  • Non-generative AI upscaling: reconstructs detail rather than inventing it, avoiding over-smoothing or hallucinations.
  • Runs locally offline: no uploads, protecting privacy.
In-site article

Last Week in AI #250 - Mythos Mess, GPT 5.6-Sol, GLM 5.2

Anthropic's AI treaty discussions, US government's influence on AI model releases, OpenAI's processor development, memory market impacts, and more!

  • US government expands frontier AI gating; Anthropic allowed to release Mythos-5, OpenAI rolls out GPT-5.6 Sol with restricted access.
  • Model capability and safety signals remain murky with limited benchmark disclosure.
In-site article

LWiAI Podcast #249 - Fable 5 ban, SpaceX Cursor + IPO, OSS Aplenty

Exploring the Fable 5 ban, SpaceX’s strategic acquisition, and a burst of open source advancements

  • Anthropic cuts off Fable 5 and Mythos 5 following US government order, sparking debate over policy and jailbreaks.
  • SpaceX completes IPO at ~$1.75T valuation, then acquires AI coding startup Cursor for $60B.
In-site article

LWiAI Podcast #248 - Claude Fable 5, Siri AI, Anthropic IPO, and More

This episode covers Anthropic's Claude Fable 5 and its safety controversies, Apple's Siri AI announcement at WWDC, Google's Gemini 3.5 Live Translate and pricing changes, the IPO race among OpenAI, Anthropic, and SpaceX, Prometheus raising $12B, DeepSeek's funding, Huawei's post-training of DeepSeek models, Google paying SpaceX for GPUs, open-source releases Gemma 4 and DiffusionGemma, AI safety policy developments, and more.

  • Anthropic released Claude Fable 5 with major benchmark improvements but faced controversy over guardrails and silent downgrades.
  • Apple announced Siri AI at WWDC, built on a Gemini partnership for a more capable assistant.
In-site article

Bristol Myers Squibb buys Nvidia AI system for drug discovery

Bristol Myers Squibb is purchasing an Nvidia DGX SuperPOD built on the Vera Rubin architecture to support AI across drug discovery and development. It will be the first life sciences company to acquire this system, which offers 10x performance per megawatt. The system will be used for model training, predictions, and shared across global research sites.

  • BMS buys Nvidia DGX SuperPOD with Vera Rubin architecture for AI-driven drug discovery
  • System includes 8 DGX Vera Rubin NVL72 racks, delivering 10x performance per watt
In-site article

LWiAI Podcast #247 - Opus 4.8, MAI, Anthropic IPO, Minimax-M3

This episode covers Anthropic's Claude Opus 4.8, Microsoft's MAI models, Anthropic's IPO filing, and the impressive Minimax-M3 model among other AI news.

  • Anthropic releases Claude Opus 4.8 with Dynamic Workflows and improved benchmarks
  • Microsoft unveils Scout assistant and MAI model family including MAI Thinking 1
In-site article

Private Inference for Coding Agents

Zro is a private inference endpoint for coding agents, serving open-weight models from EU infrastructure with zero data retention and no training on customer data. It integrates with tools like Claude Code and Codex, and supports long-context, multi-turn coding sessions.

  • Runs on EU infrastructure with zero request retention and no training on customer data.
  • Supports open coding models such as MiniMax M3 and GLM-5.2.
In-site article

Chinese open-weight models are cheap. Washington is deciding what that costs.

US policymakers are debating whether to create regulatory risk around Chinese open-weight models. The release of Moonshot AI's Kimi K3 reignited the argument. Enterprises face not just performance questions but whether these models will remain easily accessible in a year.

  • Moonshot AI's Kimi K3, the largest open-weight model to date, rekindled a dormant policy debate in Washington.
  • Potential mechanisms include procurement rules, export blacklists, and security advisories that ripple through global cloud providers.
In-site article

NVIDIA Releases Cosmos 3 Edge: A 4B-Parameter Open World Model That Reasons and Generates Robot Actions On-Device

NVIDIA has released Cosmos 3 Edge, a 4-billion-parameter open world model built to run on-device. It helps robots and vision AI agents understand surroundings, reason in real time, and generate robot actions locally. The Cosmos 3 family included Cosmos 3 Nano (16B) and Cosmos 3 Super (64B) shipped on May 31, 2026 at GTC Taipei. Edge is the third and smallest tier, at roughly one-sixteenth the size of Super. The problem is specific. Machines operate at the edge in factories, warehouses, and hospitals. They need data center–level performance on memory-constrained systems. Cosmos 3 Edge targets that gap. What does world model do here? A world model learns how an environment changes over time. It represents objects, motion, spatial relationships, and the effects of actions. Consider a robot reaching for an object. Recognizing the object is only the first step. The robot must also track where the object is, how its gripper moves, and what happens on contact. A world model reasons about these relationships. It can predict the visual result of an action, infer the action that caused a change, or generate an action to reach a goal. Cosmos 3 Edge brings these capabilities into one on-device model. Its shared representation lets a system understand the current world state, simulate possible futures, and connect those futures to actions. Two transformer towers, one shared representation. Cosmos 3 uses a Mixture-of-Transformers architecture with two towers, described in NVIDIA's technical report. The autoregressive tower processes vision and text tokens for understanding and reasoning. The diffusion tower processes vision, audio, and action tokens for prediction, generation, and neural simulation. The two towers keep separate normalization layers and multilayer perceptrons. They share multimodal attention layers, which align information across language, video, audio, and action. This lets the model reason about a scene before it generates an output. The attention pattern adapts to each modality. Language uses causal attention, where each token attends to earlier tokens. Diffusion tokens attend more broadly to the available context, supporting coherent prediction and generation. Depending on the task, the model emits reasoning tokens from the autoregressive tower, or denoised video and action tokens from the diffusion tower. Cosmos 3 Edge uses a 2B dense transformer for its reasoner, and follows Qwen3-VL-compatible message conventions for image and video inputs, per the Cosmos GitHub repository. One action representation across embodiments. Physical systems describe actions differently. A vehicle uses ego pose and movement. A camera uses camera motion. A robot arm uses the pose of its end effector, and a gripper adds grasp state. Cosmos 3 maps these embodiments into a common action representation. Actions are encoded as compact geometric vectors that capture translation, rotation, and manipulation state. This connects control to the visual structure of the world. The model associates pixel changes with physical motion and control inputs. Generated video then becomes more than a prediction. It represents how the world should change in response to an action. Supported action dimensions depend on the embodiment. The Cosmos GitHub repository lists camera motion (9D), autonomous vehicle (9D), egocentric motion (57D), single-arm robot (10D), dual-arm robot (20D), and humanoid robot (29D). Policy mode runs in both directions. As a policy, Cosmos 3 Edge predicts an action together with its expected visual consequence. Current state goes in; an action and its likely visual outcome come out. Action flows in both directions. The model can predict the effect of an action, or infer the action from its effect. This connects world modeling directly to robot policy training and evaluation. NVIDIA also released Cosmos 3 Edge Policy (DROID). It is a robot manipulation policy post-trained on the DROID dataset for pick-and-place tasks, with post-training scripts included. Developers can fine-tune on a small H100 cluster or an NVIDIA DGX Station before deployment. Is it Deployable? Cosmos 3 Edge delivers memory-efficient inference across NVIDIA edge computers. Targets include NVIDIA RTX PRO GPUs, NVIDIA DGX, GeForce RTX GPUs, and NVIDIA Jetson, including the newly announced Jetson T2000 and T3000 modules. As a post-trained world action model (WAM), the model operates at robot-control resolution of 640×360 observations. On NVIDIA Jetson Thor it generates 32 actions per inference, while achieving real-time control at 15 Hz. For generation, the Edge tier supports 256p and 480p resolutions, 12–30 fps, and 50–150 frames. Using the open Cosmos framework, developers can post-train Cosmos 3 Edge for a specific embodiment and sensor set in about a day. NVIDIA positions a GeForce RTX 3070 or better as a local on-ramp for prototyping. Key Takeaways: Cosmos 3 Edge is a 4B open world model (2B dense reasoner) that runs on-device, released July 20 on Hugging Face. A Mixture-of-Transformers design pairs an autoregressive reasoner tower with a diffusion generator tower through shared multimodal attention. It hits 640×360 control resolution, 32 actions per inference, and 15 Hz real-time control on NVIDIA Jetson Thor. Actions map to a common translation/rotation/manipulation representation, spanning camera, vehicle, single-arm, dual-arm, and humanoid embodiments. Benchmarks (#1 on VANTAGE-Bench at 4B) are internally claimed; the model ships under Linux Foundation OpenMDW-1.1. Sources: Hugging Face launch post, Cosmos3-Edge model card, Cosmos 3 collection, NVIDIA technical report (PDF), Cosmos GitHub, NVIDIA developer blog, Jetson Thor blog and NVIDIA Newsroom: Japan coalition. The post NVIDIA Releases Cosmos 3 Edge: A 4B-Parameter Open World Model That Reasons and Generates Robot Actions On-Device appeared first on MarkTechPost.

  • Cosmos 3 Edge is a 4B open world model that runs on-device, released July 20 on Hugging Face.
  • Mixture-of-Transformers design pairs autoregressive reasoner tower with diffusion generator tower via shared multimodal attention.
In-site article

China's AI models have Trump's AI world at war with itself

The release of Chinese open-source AI model Kimi has triggered a public feud within Trump's AI advisor circle. Kimi rivals the intelligence of paid models from OpenAI and Anthropic but is free, creating economic and political problems for the president. Factions disagree on whether to embrace open source or impose tighter controls.

  • Chinese company Moonshot released Kimi, a free open-source model matching top paid models.
  • Former Trump AI advisor David Sacks and Pentagon official Emil Michael publicly criticized US AI companies.
In-site article

France's edge in the AI race is cheap energy

France's abundant nuclear power provides low-cost electricity, giving it a competitive advantage in AI, but American tech giants may snap up that capacity first.

  • France has cheap electricity from nuclear power, beneficial for AI computing.
  • U.S. tech companies like Google and Microsoft are also seeking clean energy, potentially competing for France's supply.
In-site article

What Becomes Scarce After Intelligence?

The AI industry faces two opposing strategies: spending billions on nuclear power to support larger models, and releasing free open-source models. The article argues these are two sides of the same bet on whether intelligence has a ceiling. Biology offers a precedent: the human brain under energy constraints achieved efficiency through architecture innovations like sparsity and in-memory computing. Current open models apply these tricks but only cover mid-level tasks, while frontier models maintain an edge. The outcome depends on where the ceiling sits.

  • AI is split between massive nuclear investment for scaling and open-source models that make intelligence cheap. Both are bets on whether intelligence has a ceiling.
  • Biology's 4-billion-year experiment shows that under a fixed energy ceiling, architecture beats brute force.
In-site article

SpecLA: Efficient Speculative Decoding for Linear-Attention Models

This paper presents SpecLA, a speculative decoding runtime for stateful linear-attention models. It verifies chains and trees with topology-aware kernels, stores compact factors to recover accepted states, and uses confidence pruning plus a target-aligned EAGLE-style drafter. On an NVIDIA H100 with a GDN-1.3B target, SpecLA achieves up to 1.70x end-to-end speedup over autoregressive decoding.

  • Linear-attention models replace KV cache with recurrent states, but decoding remains sequential.
  • Existing speculative decoders assume Transformer KV caches.
In-site article

OpenLanguageModel: Readable and Composable Small-Language-Model Pretraining for Education and Research

OpenLanguageModel (OLM) is an open-source PyTorch library for building and pretraining small language models with visible internals. Model code mirrors architecture using components like Block, Residual, Repeat, and Parallel. It integrates tokenizers, datasets, optimization, mixed precision, callbacks, checkpoints, and hardware-aware execution, enabling seamless transition from teaching notebooks to full pretraining. The library includes 27 presets across nine model families and documentation from fundamentals to research. Validation shows close agreement with reference implementations, 90.6% weak-scaling efficiency on four GPUs for a 348M-parameter model, and positive usability feedback. OLM is MIT-licensed and available on PyPI, GitHub, and its documentation site.

  • OLM provides readable model code that directly reflects architecture components for education and research.
  • It enables seamless movement from teaching notebooks to full pretraining runs with a complete pipeline.
In-site article

Operator-Aware Mixed-Precision Tolerance Calibration for Tensor Kernels

This paper proposes an operator-aware mixed-precision tolerance calibration method that mines accumulated cloud GPU run data to automatically determine optimal absolute tolerances for tensor kernel correctness tests, achieving much tighter tolerances than hand-picked ones and significantly improving bug-detection recall.

  • Current tensor-kernel tests use fixed hand-picked tolerances that are rarely updated.
  • Proposed method mines error distributions from cloud GPU runs to calibrate per-operator tolerances.
In-site article

Fully-sensorized smart-eyewear platform for on-device Machine Learning

This paper presents ARGO, a smart eyewear platform leveraging the STM32N6 microcontroller and its integrated NPU for on-device machine learning, minimizing latency and preserving privacy. Through holistic co-design of hardware, firmware, and AI, an optimized YOLOv11 model is deployed for real-time urban obstacle recognition, introducing Head-wise Parallel Attention (HPA) for efficient NPU execution. The model achieves mAP50-95 of 24 with only 2.483 MB memory footprint. The platform integrates multimodal sensors, runs at 10 FPS, and provides ~113 minutes of autonomy on a 200 mAh battery, demonstrating the feasibility of high-performance, privacy-preserving assistive devices.

  • ARGO smart eyewear uses STM32N6 MCU and NPU for on-device ML, avoiding cloud dependency
  • Head-wise Parallel Attention (HPA) optimizes YOLOv11 model for NPU, achieving mAP50-95 24 under tight memory
In-site article

[AINews] not much happened today

A quiet day on the surface, but packed with developments: US policy targets Chinese open models, Kimi K3 and Qwen 3.8 advance, agent-centric generalization gains traction, and models show superhuman math abilities.

  • US considers de facto ban on cutting-edge Chinese open models like Kimi, drawing technical backlash.
  • Kimi K3 ranks #1 on DesignArena; Alibaba confirms Qwen 3.8 Max will be open-weight.
In-site article

Gary Marcus: US won't "win" AI war with China. What we should do instead.

Gary Marcus argues that China's Kimi K3 model has caught up with US top models, disrupting American AI business models. He recounts his warnings since 2025 that the US focus on LLMs would lead to a tie, not victory. Marcus proposes seven strategic options, ranging from inaction to making AI a global public good via an international 'CERN for AI' initiative.

  • China's Moonshot.AI released Kimi K3, an open-weight model matching US leaders, causing US stock drop.
  • Marcus says OpenAI and Anthropic's business models are now in question, IPOs threatened.
In-site article

Turning robot video into training-ready data

daft-physical-ai is a new open-source Python library built on Daft that provides ready-made operations for turning raw robot recordings into training-ready data. It currently supports hand tracking and reward scoring, with lazy batch execution and distributed processing.

  • daft-physical-ai is an open-source Python library for transforming robot video into model-ready data.
  • Current use cases include hand tracking (MediaPipe or WiLoR) and reward scoring (Robometer-4B).
In-site article

Is Open Weight AI Decelerationist?

Dean Ball, OpenAI's chief of strategic futures, argues that open-weight models are inherently decelerationist because they deter capital expenditure. This article examines the economic logic behind the claim, considering China's capacity to build AI infrastructure, shifting training paradigms, and where value accrues in the AI stack. It concludes that open-weight models may actually be accelerationist by lowering costs and broadening participation, even if they disrupt current business models.

  • Dean Ball claims open-weight models are decelerationist as they reduce capital investment.
  • China may exacerbate this by subsidizing capacity and compressing margins.
In-site article

Colibrì proof-of-concept gains frontier-level 1.5-TB AI model

Italian engineer Vincenzo (JustVugg) created Colibrì, a proof-of-concept that runs the 744-billion-parameter GLM-5.2 model (1.5TB) on a modest CPU with only 25GB RAM and 1GB/s NVMe. Despite extremely slow speeds (0.05-0.1 tokens per second), it leverages the Mixture-of-Experts architecture to load experts per token, achieving frontier-level answer quality. The project is open-source and aims to explore running large models on consumer hardware.

  • Colibrì runs a 1.5TB AI model on minimal hardware at 0.05-0.1 tokens/sec.
  • It uses MoE architecture to load/unload experts per token, enabling operation within tight memory.
In-site article

SpaceX in Your Index Fund: Explained

This article explores the implications of SpaceX's fast-track inclusion into the Nasdaq-100 index for index fund investors. It discusses the mechanics of index funds, concerns about Elon Musk's governance, and whether investors should worry about AI concentration in the market.

  • SpaceX was added to the Nasdaq-100 index shortly after its IPO, forcing index funds to buy its shares.
  • The article explains how index funds work and why they are considered safe despite including risky stocks like SpaceX.
In-site article

GraphRAG is overkill. This is what we do instead for knowledge graphs

Standard RAG excels at simple fact retrieval but fails on portfolio and counting questions. GraphRAG promised to solve this with knowledge graphs but is expensive and complex. The author presents a 'graph-like RAG' approach that uses ordinary databases, lazy summarization, and a fixed ontology, achieving similar benefits at a fraction of the cost and operational burden.

  • Standard RAG fails on portfolio and counting questions, which are critical for enterprise use
  • GraphRAG indexing costs 1000x more than plain vector search and its benefits are narrow
In-site article

Startup Launches Foundry to Develop Materials for Chips

Founding members -- including Nvidia, Meta and Samsung -- aim to reduce their reliance on rare materials used in chips.

  • Nvidia, Meta, and Samsung join as founding members of a chip materials foundry startup.
  • The foundry aims to reduce dependence on rare materials in chip manufacturing.
In-site article

Stoke – Kill switch for runaway AI agents (Rust, budget caps)

Stoke is a lightweight Rust gateway that enforces hard budget caps, loop detection, and rate limits on AI agent API calls before they reach the provider, preventing runaway spending. It also offers local-first routing across multiple machines, auto-routing with cost/speed optimization, and a fail-closed architecture.

  • Hard USD budget caps per API key enforced before any provider call, with real-time per-key spend tracking.
  • Loop kill switch using exact-hash and semantic similarity detection to block repetitive requests within seconds.
In-site article

Build specialized agent workflows for your business with Amazon Quick and NVIDIA NeMo Agent Toolkit

This post shows how Amazon Quick can serve as the business-user front door for specialized agent workflows, using the NVIDIA NeMo Agent Toolkit to build a supply-chain risk example that helps planners move from dashboard and knowledge context to guided mitigation recommendations.

  • Amazon Quick provides a conversational workspace for structured data and enterprise knowledge, with over 100 pre-built action connectors.
  • NVIDIA NeMo Agent Toolkit is an open-source, framework-agnostic library for building and optimizing agentic workflows.
In-site article

San Francisco restaurant gets angry backlash for AI menu images

A newly opened San Francisco restaurant faced intense community backlash and vandalism after using AI-generated images on its menu display. The owners removed the images and are now planning community events to rebuild their reputation.

  • Grind & Unwind, a new restaurant on Haight Street, faced backlash over AI-generated menu images.
  • A Reddit post criticized the images, leading to vandalism and negative comments.
In-site article

Kimi K3: The open-weights escalation

Moonshot AI released Kimi K3, a 2.8T parameter MoE model with open weights, ranking high on benchmarks. The article discusses the narrowing gap between Chinese and US AI models, China's commitment to open source, economic impacts of open models, and China's efficiency advantages.

  • Kimi K3 is a 2.8T parameter MoE open-weights model, approaching frontier performance.
  • Chinese AI labs demonstrate independent innovation, not just fast following.
In-site article

The three ways AI unlocks transformation in Retail, Travel, and Consumer Goods

The article argues that AI, deployed as a system rather than a collection of pilots, is the first technology to simultaneously address the three taxes of trust, time, and cost that prevent enterprises from acting on their data. It outlines three movements: turning dark data into signal, expanding the question space with probabilistic reasoning, and decoupling human capability from headcount. Governance is highlighted as the true competitive moat.

  • 60-73% of enterprise data goes unused; AI attacks the three taxes of trust, time, and cost.
  • Three movements: dark data to signal, probabilistic reasoning, and human capability decoupling.
In-site article

At SIGGRAPH, NVIDIA Advances Graphics and Simulation With Agentic and Physical AI

NVIDIA unveils major advancements at SIGGRAPH 2026, including MCP-connected AI agents for creative tools, a synthetic video detector NIM microservice, and the open-source Cosmos 3 Edge world model for edge physical AI. These innovations span content creation, media verification, and robotics.

  • Creative apps like Adobe, Affinity, and Blender adopt MCP to enable AI agents for automated tasks.
  • New Synthetic Video Detector NIM microservice analyzes video frame-by-frame with up to 92% accuracy.
In-site article

American AI is locked down and proprietary. It's losing

The article analyzes how American AI companies' closed and proprietary model is losing ground to China's open strategy. AI models have little moat, and China's open release turns compute disadvantage into distribution advantage, closing the performance gap.

  • AI models themselves have no moat; users can easily switch between them.
  • US export controls on GPUs limit China's global services, but China leverages open models for distribution advantage.
In-site article

Import AI 465: Open vs closed gaps; Kimi K3; Demis' big policy plan

UK's AISI finds the gap between open and closed models on cybersecurity is shrinking. Chinese company Moonshot AI releases Kimi K3, a frontier-level model with some brittleness. Demis Hassabis proposes a FINRA-like standards body for AGI. Research shows LLMs can smuggle side channel tasks, evading monitors.

  • Open-weight models' cyber capability gap with closed models narrowed from 6-10 months to 4-7 months.
  • Kimi K3, a 2.8 trillion parameter model, matches or trails Claude Fable 5 and GPT 5.6 Sol but may be over-optimized for benchmarks.
In-site article

Understanding Go AI Inference: What Is Inference?

This article introduces a new series on running LLMs locally from Go. It explains inference as next-token prediction using frozen weights, the autoregressive loop, tokenization, the GGUF file format, and memory mapping for efficient loading.

  • Inference is a pure function that uses frozen weights to predict the next token without learning.
  • The autoregressive loop generates tokens one by one, appending each prediction to the sequence.
In-site article

Bristol Myers Squibb Building Life Science Industry’s Most Advanced AI Factory on NVIDIA Vera Rubin

Bristol Myers Squibb (BMS) is deploying its second NVIDIA DGX SuperPOD, built on eight DGX Vera Rubin NVL72 systems, making it the most powerful and energy-efficient AI cluster in life sciences. The new system will be accessible to every scientist, removing wait times and limits, and supporting AI applications across the drug discovery pipeline. BMS is also integrating the new cluster with its existing one to create a unified environment with AI-native tooling.

  • BMS deploys second NVIDIA DGX SuperPOD with Vera CPUs and Rubin GPUs, delivering 10x performance per megawatt.
  • Open access to all scientists enables 'Limitless Compute', accelerating drug discovery.
In-site article

China delivers a one-two punch to America’s AI dominance

Chinese AI leaders Moonshot and Alibaba released models that claim to match top US systems at lower cost. Their open-source approach challenges US dominance and raises questions about the effectiveness of export controls and massive spending.

  • Moonshot unveiled Kimi K3, Alibaba previewed Qwen3.8, both claiming near-top performance.
  • Models are open-source or open-weight, contrasting with US labs' proprietary approach.
In-site article

Airbus Takes Flight from AWS: A Critical Move for Digital Sovereignty

Airbus plans to migrate around 900 applications from AWS to French cloud provider Scaleway to assert digital sovereignty. Concerns over US data protection drive the move, but supply chain and AI remain challenges.

  • Airbus moves 900 apps from AWS to Scaleway, with 70 prioritized. Digital sovereignty is now a commercial driver.
  • Supply chain management (18,000 suppliers) remains a thorny issue due to Microsoft dominance.
In-site article

Kimi K3 open-weight model: China’s biggest AI is a bet on memory, not compute

Moonshot AI’s Kimi K3, a 2.8-trillion-parameter open-weight model, uses mixture-of-experts, quantization, and attention caching to trade compute for memory, circumventing US chip restrictions. While it tops benchmarks in coding, deployment requires data-center infrastructure, pricing is high, and software support is incomplete.

  • Kimi K3 has 2.8 trillion parameters, making it the largest open-weight model released.
  • It employs mixture-of-experts, quantisation-aware training, and Kimi Delta Attention to reduce compute and memory demands.
In-site article

AI Data Center Power Constraints Are the Real 2026 Bottleneck

The article argues that by 2026, the main constraint for AI infrastructure will shift from GPU supply to power grid capacity. It projects 40% of AI data centers will be power-constrained by 2027, with approval timelines for new grid connections lasting 24-36 months. It provides detailed analysis of power demands, inference driving the power curve, and strategies like efficiency improvements, scheduling, and geographic distribution. It promotes Spheron's distributed GPU network as a workaround.

  • GPU availability has improved, but grid capacity for powering them is now the main bottleneck for AI data centers.
  • Inference workloads, which run continuously, are driving the majority of energy consumption and require power-aware planning.
In-site article

Kimi K3 Why Washington Is Watching

Moonshot AI's Kimi K3 tops the Frontend Code Arena benchmark, sparking debate on US AI regulation. While strong on frontend coding, it lags behind Claude Fable 5 overall. The release intensifies the policy fight over AI regulation and open-weight models, with implications for stocks like NVIDIA and Anthropic.

  • Kimi K3 scores 1679 on Frontend Code Arena, beating Claude Fable 5 and GPT-5.6 Sol, but Fable 5 still leads in 8 of 14 benchmarks.
  • White House advisor David Sacks cites K3 as evidence that US AI regulation harms competitiveness, fueling policy debate.
In-site article

Complete Guide to Thinking Machines Inkling

Thinking Machines Lab has released Inkling, its first general-purpose open-weights foundation model. It is a multimodal MoE model with 975B parameters, 41B active parameters, and a 1M-token context window. Designed for customization, Inkling excels in reasoning, coding, agentic workflows, and multimodal tasks. This guide covers its architecture, training, benchmarks, deployment, and fine-tuning workflow.

  • Inkling is a 975B-parameter sparse MoE model with 41B active parameters and up to 1M token context. It supports text, image, and audio input.
  • Its architecture includes hybrid attention, relative positional embeddings, short convolutions, and multi-token prediction. It was trained on 45 trillion tokens.
In-site article

What Is Agentic AI?

Agentic AI systems can autonomously plan, decide, and act to achieve goals, marking a shift from reactive chatbots to proactive digital teammates. This article covers its definition, driving factors, use cases, challenges, and infrastructure needs.

  • Agentic AI autonomously plans, executes, and adapts strategies to reach goals, going beyond simple prompt-response.
  • Advances in language models, tool integration, and long context windows are making agentic AI practical for complex workflows.
In-site article

Topics

Chips AI News | AI News Hub