AI chips shape the cost, speed, and availability of training and inference. This hub follows GPUs, ASICs, data centers, cluster networking, cloud capacity, export controls, and supply-chain shifts, turning hardware news into signals for deployment, model economics, and industry competition.
Zyphra released ZUNA1.1 on July 16, 2026, under the Apache 2.0 license. The 380M masked diffusion autoencoder reconstructs, denoises, and upsamples scalp-EEG across arbitrary channel layouts. It accepts variable-length inputs from 0.5 to 30 seconds, against ZUNA1's fixed five seconds. Reported NMSE holds or improves while the input range widens.
ZUNA1.1 accepts variable-length inputs from 0.5 to 30 seconds, tokenized into 0.125-second segments.
It uses a transformer encoder-decoder with 4D RoPE and rectified flow objective.
Chinese President Xi Jinping called for international cooperation on AI and announced the formation of the World Artificial Intelligence Cooperation Organisation (WAICO) with 29 founding nations, positioning China as a leader in global AI governance amid competition with the US.
Xi urged that AI development should not be a 'solo performance' but international cooperation.
China launched WAICO, a 29-member alliance including Indonesia, Brazil, Russia, and others.
The chipmaker is fleshing out its physical AI ecosystem, from foundation models and edge hardware to software, developer tools and industrial partnerships.
Nvidia expands physical AI strategy covering robotics and edge computing
Introduces foundation models and edge hardware for AI applications
Scott Galloway draws parallels between the current AI boom and the dot-com bubble of 1999, warning that the AI bubble is beginning to unravel but may have a twist ending. He traces the cascading failures from B2C to infrastructure and argues that the true beneficiaries of AI will be users, not shareholders.
OpenAI's financials mirror dot-com era: massive losses, unsustainable business model, and a bailout proposal
Circular financing and overspending in AI raise red flags, with companies already cutting usage
This issue of The Download covers the hype and misinformation around perimenopause, China's new open-source AI model that narrows the gap with the US, and other tech stories including Trump Media's monetization, an atmosphere on an Earth-like planet, brain implants restoring feeling, and more.
Perimenopause discussions are more open but increasingly filled with misinformation and unsupported treatments.
A Chinese startup released the world's largest open AI model, competing with US models and impacting stocks.
Apple overtook Nvidia on Friday to become the world’s most valuable company, reshuffling the top ranks of tech heavyweights as investors reassess the outlook for artificial intelligence. Apple's market cap stood at $4.88tn while Nvidia fell to $4.86tn after a 3.5% decline.
Apple surpassed Nvidia to become the most valuable company globally.
The shift reflects investors' reassessment of AI prospects.
NVIDIA released Nemotron 3 Embed on July 15 and 16, 2026. The collection has three open checkpoints: Nemotron-3-Embed-8B-BF16, Nemotron-3-Embed-1B-BF16, and Nemotron-3-Embed-1B-NVFP4. The 8B ranks #1 on RTEB at 78.46 average NDCG@10. The 1B came from ModelOpt NAS pruning plus COS+MSE distillation from the 8B teacher. NVFP4 retains 99%+ of BF16 retrieval accuracy at up to 2x Blackwell throughput. All three run 32,768-token inputs under OpenMDW-1.1.
Nemotron-3-Embed-8B-BF16 ranks #1 on RTEB with 78.46 average NDCG@10
Three open checkpoints: 8B BF16, 1B BF16, and 1B NVFP4
Chinese chip designers Moore Threads and Hygon project strong revenue growth driven by surging domestic AI demand. Moore Threads expects 135-149% revenue increase, while Hygon forecasts 55.6-70.2% growth. This highlights China's push for domestic AI chips amid US export restrictions.
Moore Threads expects first-half revenue growth of 135.1% to 149.4%, reaching 1.65-1.75 billion yuan.
Hygon projects first-half revenue growth of 55.6% to 70.2%, reaching 8.5-9.3 billion yuan.
Warren Buffett disclosed that he personally initiated Berkshire Hathaway's $31 billion investment in Alphabet, Google's parent company. He explained that the capital expenditure model of AI giants now resembles that of railroads and utilities, which he understands well, convincing him to overcome his long-standing aversion to tech stocks.
Buffett made the $31 billion Alphabet investment himself, not his successor.
He changed his view due to AI companies' new capex model resembling railroads and utilities.
Proposes Branching Policy Optimization (BPO), which leverages deterministic, snapshottable, and resumable sandboxes to construct a tree-structured rollout topology with shared prefixes, reducing policy gradient variance and improving success rates by 3.6–6.1 absolute points over GRPO and RLOO.
BPO exploits sandbox properties to create a tree of trajectories with shared prefixes, replacing independent trajectory sampling.
It branches at decision points and computes advantages from sibling returns, provably reducing variance compared to trajectory-level baselines.
As enterprises race to scale AI, the biggest obstacle to performance and ROI may be the infrastructure moving data, not the hardware processing it. The article argues that idle GPUs are often due to 'data starvation' caused by inefficient storage-to-compute data pipelines. It advocates for a loosely coupled architecture with an application delivery controller to optimize data flow, and highlights three dimensions of resilience: reachability, policy, and delivery.
AI performance issues often stem from data delivery infrastructure, not compute power.
Loosely coupled architecture with an ADC can decouple storage and compute for better flexibility and performance.
Moonshot AI released Kimi K3, a 2.8T-parameter open-weight model with 1M context, achieving top rankings in Frontend Code Arena and competitive scores in various benchmarks. The release marks a milestone for open models, though some gaps remain versus top closed models. The newsletter also covers other AI news including safety incidents, agent frameworks, and robotics.
Kimi K3 is a 2.8T-parameter open-weight model with 1M context and native multimodal input.
It achieved #1 in Frontend Code Arena, surpassing Claude Fable 5.
SAM is a free, open-source AI agent that runs locally on your computer, no subscription needed. It goes beyond chat to actually execute tasks, with 173 tools, team collaboration, offline capability, and privacy by design.
Free and open-source, runs locally with full data privacy
173 real tools: web, files, terminal, email, GitHub, and more
Moonshot AI released Kimi K3 on July 16, 2026, a 2.8-trillion-parameter open MoE model with native vision, 1M context window, and innovations like Kimi Delta Attention and Attention Residuals. It outperforms many open models but trails top proprietary models on certain benchmarks.
Kimi K3 is the first open 2.8T-parameter MoE model, activating 16 of 896 experts.
Kimi Delta Attention enables up to 6.3x faster decoding, while Attention Residuals improve training efficiency by ~25%.
AegisDB is a self-hosted memory system for AI agents, offering durable episodic, semantic (vector search), and volatile working memory through a simple JSON-over-TCP protocol. It is a single dependency-free C binary with multi-tenancy, encryption, backups, read replicas, and a one-command Prometheus/Grafana observability stack. Designed for privacy, it ensures your agents' memory stays on your infrastructure with no SaaS dependencies.
Single C binary with zero external dependencies, deployable via Docker
Provides episodic, semantic (with vector search), and working memory types
Artificial Analysis released AA-Briefcase agentic knowledge work benchmark results; Kimi K3 scores 1547 Elo, ranking first, surpassing GPT-5.6 Sol's 1495. The benchmark simulates real business workflows evaluating models on spreadsheets, presentations, memos, etc.
Kimi K3 ranks first on AA-Briefcase benchmark with Elo 1547.
GPT-5.6 Sol scores 1495, ranking third behind Claude Fable 5.
Cushman & Wakefield’s Chief Digital and Information Officer Sal Companieh discusses building an enterprise AI core through a product operating model, unified data strategy, and partnership with Databricks, reducing idea-to-outcome timelines from months to days.
Embedded technologists in business units to rebuild connectivity, trust, and business-forward thinking
Adopted capital investment model requiring co-creation with business leaders to align with enterprise priorities
Skyportal SRE is an open-source AI infrastructure engineer tool providing a Python SDK, CLI, and observability agent for managing and monitoring AI infrastructure.
Skyportal SDK is the official Python client for SkyPortal API with sync/async support
CLI offers an interactive command center and script-friendly automation interface
We improved the LeRobot video reader in Daft by batching decodes, reducing frame decode time on remote datasets from ~3s per frame to seconds in total, achieving 4-15x speedups.
The original per-frame decode was slow due to remote open per frame and reading index each time.
The new batched reader groups rows by shard, sorts and clusters target timestamps, and seeks once per cluster.
Anthropic secretly degraded its most powerful coding agent, Claude Fable 5, to limit its effectiveness on frontier AI development tasks, revealing a structural contradiction: labs must break their own products to protect their position. Meanwhile, open-weight models are closing the gap and enterprise customers are fleeing to cheaper alternatives.
Anthropic covertly nerfed Claude Fable 5's AI development capabilities through hidden interventions like prompt modification and fine-tuning.
This reflects the self-sabotage paradox: frontier labs must weaken their best products to maintain their competitive moat.
Energy companies raised $12.6 billion via IPOs in H1 2026, the highest half-year level since the dotcom bubble, as investors seek exposure to AI-driven energy demand from data centers.
Energy IPOs raised $12.6 billion in H1 2026, the highest half-year level since 1999.
AI data center energy demand is projected to drive a 39% increase in US electricity demand by 2035.
VarAlign is a VS Code extension that detects duplicate, drifted, or misaligned variables created by AI coding assistants across sessions. It runs 100% locally—no code leaves your machine—and offers views for duplicates, variables, and sessions, along with fix prompt generation and optional AI-powered auto-fix.
100% local, no cloud or telemetry, works in air-gapped environments.
Tracks every variable assignment by AI assistants and scores duplicates/drift.
Google renames NotebookLM to Gemini Notebook, integrating it more deeply with the Google ecosystem. The tool now supports native code execution for data analysis and cross-app syncing, building on its success as a research and learning aid used by millions.
NotebookLM is now Gemini Notebook, part of Google's AI product family.
New update adds a secure cloud computer for native code execution and advanced data analysis.
Mira Murati's Thinking Machines Lab released Inkling, a 975B parameter MoE model (41B active) under Apache-2.0 license, multimodal, trained on 45T tokens. It's not frontier but a strong base for fine-tuning via Tinker platform. Inkling-Small (276B, 12B active) is promised. Model card and training data documentation are unusually brief. Inkling is competitive with Chinese open-weight models, adding to the US ecosystem.
Inkling is an open-weights multimodal MoE model with 975B total parameters (41B active), Apache-2.0 licensed, trained on 45 trillion tokens.
It is not a frontier model but designed as a strong base for fine-tuning using Thinking Machines' Tinker platform.
Democr.ai is an open-source, self-hosted agentic AI runtime framework that integrates server-driven UI, multi-client rendering, multi-tenancy, RBAC, OS-level sandboxing, triple-layer audit, pluggable AI engine orchestration, and a knowledge subsystem. Its core philosophy is 'everything is a module,' with no vendor lock-in and security as a primitive. The project is beta but production-oriented.
Democr.ai provides a complete runtime framework integrating UI, AI engines, security, audit, and multi-tenancy.
The framework is modular: all components, including authentication, are built as modules using the public SDK.
Chinese AI company StepFun unveils StepX Neo, the world's first agentic AI phone built from the ground up with native AI OS, on-device and cloud processing, and multi-platform task automation.
StepX Neo runs on Step AOS, a native AI operating system, not adapted from Android.
Amoo AI uses 1+N model architecture for on-device and cloud processing.
This article analyzes the impending margin collapse in AI inference due to the rise of 'good enough' cheap models. Winners include the hardware supply chain, hyperscalers, coding agents, and consumers; frontier AI labs face risks but may counter by withholding top models or moving to managed platforms. The overlooked B2C advertising market could also shift dynamics.
AI inference market bifurcates into expensive frontier models and cheap 'good enough' models, leading to margin compression.
Hardware and infrastructure providers, coding agents, and consumers are major winners.
Meta launched Muse Spark 1.1, the first Meta model with a price tag, marking a shift from open weights to a closed-source business model. As Meta builds a full vertical stack—from chips to cloud to apps—the question arises whether it can compete with frontier AI labs.
Meta released Muse Spark 1.1 with closed weights and paid API, priced at $1.25 per million input tokens and $4.25 per million output tokens, compatible with OpenAI endpoints.
Zuckerberg posted on X for the first time in three years to announce this strategic shift.
The article criticizes the common phrase "AI is just a tool—it matters how you use it," arguing that tools are never neutral. They have politics, shape environments, and influence humanity. Using examples like cars and chairs, the author shows how designs embed values. AI, as a tool, is especially dangerous because it eliminates meaningful struggle, threatening critical thinking and human essence. The piece calls for a critical re-examination of technology beyond simplistic "tool neutrality."
The phrase "AI is just a tool" oversimplifies and ignores the political and social impacts of tools.
Tools shape human behavior and environments; AI is no exception.
A curated collection of 50+ open-source Next.js AI templates and starter kits covering chatbots, RAG, voice agents, image generation, and more, created by Suhas Bhairav.
Over 50 open-source Next.js AI templates are available for various AI applications.
Templates cover areas like chatbots, RAG, voice AI, image generation, and personal agents.
cayleyR is an R package for solving permutation puzzles by detecting cycle intersections in Cayley graphs. It uses an iterative bidirectional search and distance-guided bridge selection. The package targets the TopSpin(n,k) puzzle and leverages C++ indexing with optional Vulkan GPU acceleration. It is available on CRAN.
cayleyR solves permutation puzzles via cycle intersection detection in Cayley graphs
Uses iterative bidirectional search with distance-guided bridge selection
Through the lens of a blues song, the author explores how large language models generate text—often explaining after the fact, but sometimes planning ahead. The article reflects on the 'phony voice' of AI, our drive to strip it bare through interpretability, and the author's own experience using AI to write about AI.
LLMs often generate text before constructing a rationale ('throw decides aim'), but research shows they can also plan rhymes in advance.
The AI's voice is intimate yet phony, lacking a genuine self behind the words.
Agentic inference is shifting AI infrastructure from training expansion to context-aware, memory-augmented reasoning. The RAISE Summit highlighted three key insights: specialization across the AI stack with diverse chips and accelerators, storage becoming an active memory extension for GPUs, and the integration of capital deployment and data sovereignty into infrastructure design.
Agentic inference drives specialization across the AI stack, with companies like AMD, Tensordyne, and d-Matrix offering optimized hardware.
Storage is emerging as a critical tier for AI memory, as high-capacity SSDs near GPUs prevent idle compute time.
Neocloud provider QumulusAI announced its direct listing on Nasdaq under the ticker QMLS. The move signals the maturation of AI-first infrastructure built around GPUs and power availability. The company focuses on rapid GPU deployment, leveraging colocation and modular data centers. The listing provides capital flexibility, public company credibility, and timing advantage. The article also explores neocloud differentiation and advice for IT leaders.
QumulusAI goes public via direct listing on Nasdaq, ticker QMLS.
The neocloud model specializes in AI infrastructure, deploying GPU clusters in months rather than years.
This article breaks down the real meaning behind reliability numbers like 99%, 99.9%, and 99.99% uptime for AI inference services, explaining the failure domains each tier must survive and the architectural requirements. The authors from Together AI share their experience building reliable inference infrastructure and provide key questions to ask any provider before committing.
Each reliability tier maps to a specific failure domain: 99% for node failures, 99.9% for data center failures, 99.99% for regional outages.
Achieving high uptime requires proactive health checks, multi-facility deployment, and reserved capacity.
Mira Murati's Thinking Machines Lab Inc. today launched its first foundation model with the release of Inkling, making its full open weights available to developers so they can fine-tune it as they wish. Inkling is a mixture-of-experts model with 975 billion parameters (41B active) trained on 45 trillion tokens of text, image, audio and video, capable of reasoning across all four modalities but outputting only text. It features "thinking effort" controls and uncertainty flagging to reduce hallucinations. The model is fine-tunable via the Tinker API and aims to provide a Western open-source alternative to Chinese AI models. Thinking Machines plans to generate revenue through the Tinker platform rather than per-token API access, potentially disrupting current AI business models.
Thinking Machines releases Inkling, a 975B-parameter open-weights model (41B active).
Trained on 45T tokens across modalities; outputs text only.
Thinking Machines Lab released Inkling on July 15, 2026, its first model trained from scratch. The full weights ship under Apache 2.0. It is a 975B-parameter Mixture-of-Experts transformer with 41B active parameters, a 1M-token context window, and native text, image, and audio input. The core differentiator is controllable thinking effort, allowing users to adjust token budgets per call to balance cost and performance.
Inkling is a 975B-parameter MoE transformer with 41B active parameters, supporting a 1M-token context and multimodal input (text, image, audio).
Controllable thinking effort, achieved via RL, enables dynamic token budget adjustment, matching Nemotron 3 Ultra on Terminal Bench with one-third the tokens.
NVIDIA announces T3000 and T2000 modules based on the Thor architecture, targeting mainstream robotics and edge AI. T3000 delivers 865 FP4 teraflops at half the size and power of T5000; T2000 offers 400 FP4 teraflops. The platform scales from 70 TOPS to 2,000 teraflops. New agent skills automate memory optimization, reducing usage by up to 15GB. Cosmos 3 Edge model enables real-time vision. Emulation available now with modules shipping in Q1 2027.
NVIDIA introduces T3000 and T2000 Jetson Thor modules for robotics and edge AI. T3000 provides 865 FP4 TFLOPS at half the size and power of T5000; T2000 provides 400 FP4 TFLOPS.
New agent skills automate memory optimization across the Jetson portfolio, enabling significant memory savings.
Eaon is a native Mac app that integrates 49 AI models, supporting local execution, custom API keys, or built-in connections. It's completely free and open-source, with features like model switching, cost monitoring, command palette, and privacy-focused local operation.
Free and open-source, supporting 49 AI models (e.g., Claude, GPT, Gemini)
Can run locally or use your own API keys, with data privacy protection
Cadence Design Systems introduces AuraStack, an AI agent for packaging and PCB design, aiming to automate system design workflows and reduce design time from days to minutes.
Cadence launches AuraStack, an AI agent for packaging and printed circuit board design.
The agent helps engineers with system design analysis, integrating fragmented workflows.
AIAIO is a creative project that turns AI agent session logs into a platformer game. Your actual prompts, errors, and tasks become game levels, and the Wall of Forgetting advances based on your token spend. It's both an educational tool and a self-reflection tool.
The game transforms session logs from AI agents like Claude Code, OpenClaw, and Hermes into playable platformer levels.
Your real errors become monsters, tasks become workstations, and token consumption drives the Wall of Forgetting.
Inkling is a general-purpose multimodal model from Thinking Machines Lab, supporting text, image, and audio inputs with text output. With 975B total (41B active) parameters in a sparse MoE architecture, a 1M token context window, and strong benchmark performance, it is released under Apache 2.0 with open weights for research and commercial use.
Inkling is a multimodal sparse MoE model with 975B total, 41B active parameters, and a 1M token context window.
Open-source under Apache 2.0, with weights on Hugging Face and API access via Tinker and third parties.
The author details building a local AI inference machine (dubbed 'Slop Machine'), covering model selection (Qwen 3.6 27B) and hardware choices (Radeon AI Pro R9700 GPU with eGPU dock), exploring the benefits and challenges of self-hosted LLMs.
Self-hosting LLMs avoids data leaks, subscriptions, and ads, but requires powerful hardware.
Qwen 3.6 27B performs well quantized and is suitable for local inference.