Chips

Wistron opened its first U.S. manufacturing facility in Fort Worth, Texas, producing NVIDIA GB300 Grace Blackwell Ultra and Vera Rubin superchips. The $700 million plant creates over 500 jobs and uses digital twin technology for virtual simulation.

The System76 Thelio Mira Custom is a whisper-quiet 'boutique' Linux workstation that actually feels practical.

After commercial frontier AI models blocked defensive analysis due to safety guardrails, Hugging Face turned to open-weights GLM 5.2 to counter an autonomous AI agent attack. The incident highlights tensions between open and closed AI models and the growing role of Chinese open models.

Big Tech companies are using off-balance-sheet vehicles like VIEs to finance AI infrastructure, potentially masking true debt levels. Experts warn of risks reminiscent of the Enron scandal.

In this part, we enhance the AI agent's security with Docker sandboxing, prompt injection defenses, and input validation. The Docker sandbox isolates tool execution, preventing damage to the host machine. Prompt injection defenses use delimiters and explicit instructions to treat tool outputs as data. Input validation ensures all tool inputs conform to schema before execution.

This tutorial explores NVIDIA's srt-slurm framework, learning how to use srtctl to convert declarative YAML configurations into reproducible SLURM benchmark workflows for distributed LLM serving. We set up the project in Google Colab, inspect its internal architecture, define a cluster configuration, dry-run built-in and custom recipes, and model a disaggregated prefill-and-decode deployment for DeepSeek-R1. We also generate parameter sweeps, interact with the typed Python API, validate expanded configurations, and analyze simulated benchmark results through a throughput-versus-latency Pareto frontier.

Google has released Gemini 3.6 Flash and 3.5 Flash-Lite as new workhorses designed to cut latency and token costs for enterprise AI agents. The new models offer significant performance improvements, targeted pricing, and integrated computer-use tools, with enterprise partners already deploying them in production.

NVIDIA Vera Rubin NVL72 production is ramping up with partners CoreWeave, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure. The platform delivers highest performance per watt and lowest token cost, with 10x more throughput per megawatt than Grace Blackwell NVL72 in benchmarks. It also powers Europe's open-model era through a partnership between Microsoft and Mistral.

AI has entered the gigascale era. The world’s most advanced AI factories are bringing together hundreds of thousands of GPUs and CPUs to train frontier models, power agentic AI and generate intelligence at unprecedented scale. At this level, networking becomes a critical computing power multiplier in driving token generation. Marking a networking milestone, NVIDIA Spectrum-6 — a 102.4-terabit-per-second Ethernet switch system delivering 2x the capacity of previous-generation systems and built as part of the NVIDIA Vera Rubin platform — is arriving across the world’s gigascale AI factories.

In the UAE, enterprise AI decisions hinge not just on model capability but on where data is processed, operational costs, and regulatory compliance. The gap between frontier and open-weight models is narrowing, but self-hosting costs are high. UAE regulations mandate data localization, driving sovereign cloud and hybrid architectures. Companies should adopt a traffic-light routing system based on data sensitivity and validate demand before investing in hardware.

Learn how to run the Qwythos-9B-Claude-Mythos-5-1M model locally using llama.cpp, connect it to the Pi coding agent, and build local coding workflows with MTP speculative decoding and an OpenAI-compatible API.

Matthew Tromp critiques George Hotz's dismissal of AI 2040 scenarios, arguing that Hotz underestimates the feasibility of fast AI takeoff, the need for regulation, and the risks of unaligned AI. He defends Plan A's regulatory approach and questions Hotz's 'Plan L' of open-source AI.

Neverbell is an AI agent skill providing direct market access for trading stocks, ETFs, commodities and crypto with leverage, enabling 24/7 automated trading via natural language instructions.

Google’s AI struggles highlight trouble as new Chinese models again challenge US tech dominance. Silicon Valley workers also take action to protect jobs from AI. Other news includes New York’s datacenter pause, Trump’s criticism, IBM’s stock plunge, AWS billing glitch, and more.

This article outlines a five-course free roadmap from basic AI algorithms to building LLMs from scratch, ideal for those with Python basics.

Alibaba announced Qwen3.8, claiming it is second only to Anthropic's Fable 5, but provided no benchmarks or model card. The announcement comes on the heels of rival Moonshot's Kimi K3 launch with full technical details. Alibaba's lack of transparency raises questions about timing and motivation.

Trump lifts restrictions on Anthropic, Anthropic launches Claude Sonnet 5, Google's NotebookLM updates, chips stories from Etched and Baidu, and more!

Enlarger is a local image upscaler that preserves detail without generative AI. It reconstructs existing details and applies automatic post-processing to maintain texture and natural look. Features batch processing, offline operation, and a one-time payment. Suitable for photographers, designers, and print professionals.

Anthropic's AI treaty discussions, US government's influence on AI model releases, OpenAI's processor development, memory market impacts, and more!

Exploring the Fable 5 ban, SpaceX’s strategic acquisition, and a burst of open source advancements

This episode covers Anthropic's Claude Fable 5 and its safety controversies, Apple's Siri AI announcement at WWDC, Google's Gemini 3.5 Live Translate and pricing changes, the IPO race among OpenAI, Anthropic, and SpaceX, Prometheus raising $12B, DeepSeek's funding, Huawei's post-training of DeepSeek models, Google paying SpaceX for GPUs, open-source releases Gemma 4 and DiffusionGemma, AI safety policy developments, and more.

Bristol Myers Squibb is purchasing an Nvidia DGX SuperPOD built on the Vera Rubin architecture to support AI across drug discovery and development. It will be the first life sciences company to acquire this system, which offers 10x performance per megawatt. The system will be used for model training, predictions, and shared across global research sites.

This episode covers Anthropic's Claude Opus 4.8, Microsoft's MAI models, Anthropic's IPO filing, and the impressive Minimax-M3 model among other AI news.

Zro is a private inference endpoint for coding agents, serving open-weight models from EU infrastructure with zero data retention and no training on customer data. It integrates with tools like Claude Code and Codex, and supports long-context, multi-turn coding sessions.

US policymakers are debating whether to create regulatory risk around Chinese open-weight models. The release of Moonshot AI's Kimi K3 reignited the argument. Enterprises face not just performance questions but whether these models will remain easily accessible in a year.

NVIDIA has released Cosmos 3 Edge, a 4-billion-parameter open world model built to run on-device. It helps robots and vision AI agents understand surroundings, reason in real time, and generate robot actions locally. The Cosmos 3 family included Cosmos 3 Nano (16B) and Cosmos 3 Super (64B) shipped on May 31, 2026 at GTC Taipei. Edge is the third and smallest tier, at roughly one-sixteenth the size of Super. The problem is specific. Machines operate at the edge in factories, warehouses, and hospitals. They need data center–level performance on memory-constrained systems. Cosmos 3 Edge targets that gap. What does world model do here? A world model learns how an environment changes over time. It represents objects, motion, spatial relationships, and the effects of actions. Consider a robot reaching for an object. Recognizing the object is only the first step. The robot must also track where the object is, how its gripper moves, and what happens on contact. A world model reasons about these relationships. It can predict the visual result of an action, infer the action that caused a change, or generate an action to reach a goal. Cosmos 3 Edge brings these capabilities into one on-device model. Its shared representation lets a system understand the current world state, simulate possible futures, and connect those futures to actions. Two transformer towers, one shared representation. Cosmos 3 uses a Mixture-of-Transformers architecture with two towers, described in NVIDIA's technical report. The autoregressive tower processes vision and text tokens for understanding and reasoning. The diffusion tower processes vision, audio, and action tokens for prediction, generation, and neural simulation. The two towers keep separate normalization layers and multilayer perceptrons. They share multimodal attention layers, which align information across language, video, audio, and action. This lets the model reason about a scene before it generates an output. The attention pattern adapts to each modality. Language uses causal attention, where each token attends to earlier tokens. Diffusion tokens attend more broadly to the available context, supporting coherent prediction and generation. Depending on the task, the model emits reasoning tokens from the autoregressive tower, or denoised video and action tokens from the diffusion tower. Cosmos 3 Edge uses a 2B dense transformer for its reasoner, and follows Qwen3-VL-compatible message conventions for image and video inputs, per the Cosmos GitHub repository. One action representation across embodiments. Physical systems describe actions differently. A vehicle uses ego pose and movement. A camera uses camera motion. A robot arm uses the pose of its end effector, and a gripper adds grasp state. Cosmos 3 maps these embodiments into a common action representation. Actions are encoded as compact geometric vectors that capture translation, rotation, and manipulation state. This connects control to the visual structure of the world. The model associates pixel changes with physical motion and control inputs. Generated video then becomes more than a prediction. It represents how the world should change in response to an action. Supported action dimensions depend on the embodiment. The Cosmos GitHub repository lists camera motion (9D), autonomous vehicle (9D), egocentric motion (57D), single-arm robot (10D), dual-arm robot (20D), and humanoid robot (29D). Policy mode runs in both directions. As a policy, Cosmos 3 Edge predicts an action together with its expected visual consequence. Current state goes in; an action and its likely visual outcome come out. Action flows in both directions. The model can predict the effect of an action, or infer the action from its effect. This connects world modeling directly to robot policy training and evaluation. NVIDIA also released Cosmos 3 Edge Policy (DROID). It is a robot manipulation policy post-trained on the DROID dataset for pick-and-place tasks, with post-training scripts included. Developers can fine-tune on a small H100 cluster or an NVIDIA DGX Station before deployment. Is it Deployable? Cosmos 3 Edge delivers memory-efficient inference across NVIDIA edge computers. Targets include NVIDIA RTX PRO GPUs, NVIDIA DGX, GeForce RTX GPUs, and NVIDIA Jetson, including the newly announced Jetson T2000 and T3000 modules. As a post-trained world action model (WAM), the model operates at robot-control resolution of 640×360 observations. On NVIDIA Jetson Thor it generates 32 actions per inference, while achieving real-time control at 15 Hz. For generation, the Edge tier supports 256p and 480p resolutions, 12–30 fps, and 50–150 frames. Using the open Cosmos framework, developers can post-train Cosmos 3 Edge for a specific embodiment and sensor set in about a day. NVIDIA positions a GeForce RTX 3070 or better as a local on-ramp for prototyping. Key Takeaways: Cosmos 3 Edge is a 4B open world model (2B dense reasoner) that runs on-device, released July 20 on Hugging Face. A Mixture-of-Transformers design pairs an autoregressive reasoner tower with a diffusion generator tower through shared multimodal attention. It hits 640×360 control resolution, 32 actions per inference, and 15 Hz real-time control on NVIDIA Jetson Thor. Actions map to a common translation/rotation/manipulation representation, spanning camera, vehicle, single-arm, dual-arm, and humanoid embodiments. Benchmarks (#1 on VANTAGE-Bench at 4B) are internally claimed; the model ships under Linux Foundation OpenMDW-1.1. Sources: Hugging Face launch post, Cosmos3-Edge model card, Cosmos 3 collection, NVIDIA technical report (PDF), Cosmos GitHub, NVIDIA developer blog, Jetson Thor blog and NVIDIA Newsroom: Japan coalition. The post NVIDIA Releases Cosmos 3 Edge: A 4B-Parameter Open World Model That Reasons and Generates Robot Actions On-Device appeared first on MarkTechPost.

The release of Chinese open-source AI model Kimi has triggered a public feud within Trump's AI advisor circle. Kimi rivals the intelligence of paid models from OpenAI and Anthropic but is free, creating economic and political problems for the president. Factions disagree on whether to embrace open source or impose tighter controls.

France's abundant nuclear power provides low-cost electricity, giving it a competitive advantage in AI, but American tech giants may snap up that capacity first.

The AI industry faces two opposing strategies: spending billions on nuclear power to support larger models, and releasing free open-source models. The article argues these are two sides of the same bet on whether intelligence has a ceiling. Biology offers a precedent: the human brain under energy constraints achieved efficiency through architecture innovations like sparsity and in-memory computing. Current open models apply these tricks but only cover mid-level tasks, while frontier models maintain an edge. The outcome depends on where the ceiling sits.

This paper presents SpecLA, a speculative decoding runtime for stateful linear-attention models. It verifies chains and trees with topology-aware kernels, stores compact factors to recover accepted states, and uses confidence pruning plus a target-aligned EAGLE-style drafter. On an NVIDIA H100 with a GDN-1.3B target, SpecLA achieves up to 1.70x end-to-end speedup over autoregressive decoding.

OpenLanguageModel (OLM) is an open-source PyTorch library for building and pretraining small language models with visible internals. Model code mirrors architecture using components like Block, Residual, Repeat, and Parallel. It integrates tokenizers, datasets, optimization, mixed precision, callbacks, checkpoints, and hardware-aware execution, enabling seamless transition from teaching notebooks to full pretraining. The library includes 27 presets across nine model families and documentation from fundamentals to research. Validation shows close agreement with reference implementations, 90.6% weak-scaling efficiency on four GPUs for a 348M-parameter model, and positive usability feedback. OLM is MIT-licensed and available on PyPI, GitHub, and its documentation site.

This paper proposes an operator-aware mixed-precision tolerance calibration method that mines accumulated cloud GPU run data to automatically determine optimal absolute tolerances for tensor kernel correctness tests, achieving much tighter tolerances than hand-picked ones and significantly improving bug-detection recall.

This paper presents ARGO, a smart eyewear platform leveraging the STM32N6 microcontroller and its integrated NPU for on-device machine learning, minimizing latency and preserving privacy. Through holistic co-design of hardware, firmware, and AI, an optimized YOLOv11 model is deployed for real-time urban obstacle recognition, introducing Head-wise Parallel Attention (HPA) for efficient NPU execution. The model achieves mAP50-95 of 24 with only 2.483 MB memory footprint. The platform integrates multimodal sensors, runs at 10 FPS, and provides ~113 minutes of autonomy on a 200 mAh battery, demonstrating the feasibility of high-performance, privacy-preserving assistive devices.

A quiet day on the surface, but packed with developments: US policy targets Chinese open models, Kimi K3 and Qwen 3.8 advance, agent-centric generalization gains traction, and models show superhuman math abilities.

Gary Marcus argues that China's Kimi K3 model has caught up with US top models, disrupting American AI business models. He recounts his warnings since 2025 that the US focus on LLMs would lead to a tie, not victory. Marcus proposes seven strategic options, ranging from inaction to making AI a global public good via an international 'CERN for AI' initiative.

daft-physical-ai is a new open-source Python library built on Daft that provides ready-made operations for turning raw robot recordings into training-ready data. It currently supports hand tracking and reward scoring, with lazy batch execution and distributed processing.

Cognition's Devin, an AI software engineer, can now run in Modal sandboxes via Devin Outposts, enabling customized environments with GPU support and fast cold-starts.

Dean Ball, OpenAI's chief of strategic futures, argues that open-weight models are inherently decelerationist because they deter capital expenditure. This article examines the economic logic behind the claim, considering China's capacity to build AI infrastructure, shifting training paradigms, and where value accrues in the AI stack. It concludes that open-weight models may actually be accelerationist by lowering costs and broadening participation, even if they disrupt current business models.

Italian engineer Vincenzo (JustVugg) created Colibrì, a proof-of-concept that runs the 744-billion-parameter GLM-5.2 model (1.5TB) on a modest CPU with only 25GB RAM and 1GB/s NVMe. Despite extremely slow speeds (0.05-0.1 tokens per second), it leverages the Mixture-of-Experts architecture to load experts per token, achieving frontier-level answer quality. The project is open-source and aims to explore running large models on consumer hardware.

This article explores the implications of SpaceX's fast-track inclusion into the Nasdaq-100 index for index fund investors. It discusses the mechanics of index funds, concerns about Elon Musk's governance, and whether investors should worry about AI concentration in the market.

Standard RAG excels at simple fact retrieval but fails on portfolio and counting questions. GraphRAG promised to solve this with knowledge graphs but is expensive and complex. The author presents a 'graph-like RAG' approach that uses ordinary databases, lazy summarization, and a fixed ontology, achieving similar benefits at a fraction of the cost and operational burden.

Founding members -- including Nvidia, Meta and Samsung -- aim to reduce their reliance on rare materials used in chips.

Stoke is a lightweight Rust gateway that enforces hard budget caps, loop detection, and rate limits on AI agent API calls before they reach the provider, preventing runaway spending. It also offers local-first routing across multiple machines, auto-routing with cost/speed optimization, and a fail-closed architecture.

This post shows how Amazon Quick can serve as the business-user front door for specialized agent workflows, using the NVIDIA NeMo Agent Toolkit to build a supply-chain risk example that helps planners move from dashboard and knowledge context to guided mitigation recommendations.

A newly opened San Francisco restaurant faced intense community backlash and vandalism after using AI-generated images on its menu display. The owners removed the images and are now planning community events to rebuild their reputation.

Moonshot AI released Kimi K3, a 2.8T parameter MoE model with open weights, ranking high on benchmarks. The article discusses the narrowing gap between Chinese and US AI models, China's commitment to open source, economic impacts of open models, and China's efficiency advantages.

The article argues that AI, deployed as a system rather than a collection of pilots, is the first technology to simultaneously address the three taxes of trust, time, and cost that prevent enterprises from acting on their data. It outlines three movements: turning dark data into signal, expanding the question space with probabilistic reasoning, and decoupling human capability from headcount. Governance is highlighted as the true competitive moat.

NVIDIA unveils major advancements at SIGGRAPH 2026, including MCP-connected AI agents for creative tools, a synthetic video detector NIM microservice, and the open-source Cosmos 3 Edge world model for edge physical AI. These innovations span content creation, media verification, and robotics.

The article analyzes how American AI companies' closed and proprietary model is losing ground to China's open strategy. AI models have little moat, and China's open release turns compute disadvantage into distribution advantage, closing the performance gap.

UK's AISI finds the gap between open and closed models on cybersecurity is shrinking. Chinese company Moonshot AI releases Kimi K3, a frontier-level model with some brittleness. Demis Hassabis proposes a FINRA-like standards body for AGI. Research shows LLMs can smuggle side channel tasks, evading monitors.