Higher-Order Pruning of Experts in Mixture-of-Experts Language Models Introduction Mixture-of-Experts (MoE) models have enabled state-of-the-art LLMs to be scaled to hundreds of billions of parameters, but they come with a fundamental and costly caveat: every expert MLP must occupy memory at inference time, even though the vast majority are idle for any…
Latest 25 news items
Filter by day, tag, source, or full-text query. Results are sorted by newest ingested item first.
Timeline
Last 90 days← AI News AI News Anthropic IPO: Whither Now? November 6, 2026 — ARC Prize tests Inkling 2 Small, and Thinking Machines explains how it caught early checkpoints bypassing guardrails.
← AI News AI News Inkling 2 Small: 17A-594B trained in 68 hours on 12T tokens, beating Muse Spark November 5, 2026 — Inside Inkling 2 Small’s training run and METR’s study of AI research at Anthropic. Build AI systems with context graphs and agentic memory.
← AI News AI News It's Swapping Season November 4, 2026 — OpenAI’s Linux kernel security work, Kimi K3.1 Pro’s open weights, and Ricursive’s Ripple-65B. As much as there are headlines about changing sides all over the timeline today, there have been major moves in AI as well: OpenAI's Autonomous Cyber Pipeline Patches 948 Linux Kernel Privilege-Escalation…
← AI News AI News Behind Latent Space: Kill My SaaS, Jev & AI in 2026 | AIEi Shanghai November 3, 2026 — A quiet day lets us share some behind the senes. There’s a lot of dispute to yesterday’s title story on “ Weight Space Programming ” — and we agree that some of the claims are presented in overly favorable light and overall took away from the impact of…
← AI News AI News LLMs can read & write neural network weights: "Weight Space Programming" cuts Autoresearch out of the RSI loop Editing Qwen’s weights to reduce reasoning loops, DeepSeek’s super-agent prototype, and the GDPx benchmark. Abstractly, the demonstration is that you can take a sufficiently smart model and through running a series of experiments…
We continue our series about recursive self-improvement. We discuss another robotics company.
← AI News AI News Google admits AI Mode hurts Search revenue; -15% $500B drop worst since 2004 IPO. AI Bear Market coming?
Apple will launch Apple Intelligence in China with iOS 27.3, the company announced on its Chinese newsroom website , as reported by MacRumors . The Apple Intelligence features will be available first in an iOS 27.3 beta that’s set to launch on November 4th, with a full iOS 27.3 release scheduled for December.
Building a Haunted House with NVIDIA Nemotron Open Models Or rather… Boo! Now Get Off My Lawn!
← AI News AI News Building AIE CODE: The top Coding Agent Conference Mistral’s open-weight release, frontier monitoring, and the day’s AI Twitter and Reddit recaps. CODE is the last flagship AIE of the year (there are also 2 partner conferences coming up - AIEi Shanghai takes place next week, and AIEi Sydney is a side event of NeurIPS in December).
Language models can do a lot. They write, summarize, translate, and call tools.
← AI News AI News Gemini 4 Carbon tops leaderboards, launches for cyber defenders Google’s new frontier model leads independent evals, with access initially limited to trusted defenders. It’s a good thing we published our Opus 5.5 podcast calling it the world’s best model before today’s launch.
← AI News AI News Anthropic ends Coding Interviews: "Hunger beats tenure" Since coding is solved, why code for the job? This month, I laid the traditional coding interview to rest.
When we talk about working remotely , we take a lot of things for granted, especially reliable internet and power. But sometimes, working remotely means trying to get something done on a flight, during a long train ride, or somewhere with little or no network.
With significant operating leverage causing the first profitable quarter in Anthropic history (adjusted for $1B/quarter of SBC): The incredible efficiency story is told in two loops, and of course you know, we love loop: The pitch going forward is “virtual collaborators” (don’t say agent!) for over a billion knowledge workers by 2028: We believe we have…
Canadian AI company Cohere said on Monday that it found one of Alibaba’s newest AI models, Qwen3.8-Flash-Next, trying to upload a file to a server in Beijing during a routine cybersecurity test, even though the model had said in its own notes that it wouldn’t use any tools. The incident initially raised fears that the model had undermined a fundamental…
Almost 2 months ago, OpenAI introduced Daybreak for Frontline Defenders , a $1B subsidy for access to Daybreak cyber models and products. That funding came into use almost immediately, as major vulnerabilities in PHP were independently discovered by two parties: Ryan Austin, a researcher at the security firm Calif, as part of the OpenAI “ Patch the Planet…
← AI News AI News Black October the Cyber onslaught continues. If you are reading this, you’re receiving this from our new provider, Beehiiv!
In a previous post , we introduced TorchNeuron, the native PyTorch backend for AWS Trainium (the torch-neuronx package). With it, Transformers runs its own modeling code on Trainium, as it does on any other device, so any Transformers model on the Hub may run.
AI is being tested on doing AI research Top models could not reinvent a recent AI method Epoch AI tested whether AI agents can come up with a new machine learning technique on their own . The agents had to improve a small open model and match a training method published by human researchers that the agents had not seen.
This is the follow up to our first blog post, The Agent Said It Was Done. The Database Disagreed.
Almost 2 months ago, OpenAI introduced Daybreak for Frontline Defenders , a $1B subsidy for access to Daybreak cyber models and products. That funding came into use almost immediately, as major vulnerabilities in PHP were independently discovered by two parties: Ryan Austin, a researcher at the security firm Calif, as part of the OpenAI “ Patch the Planet…
Models specialized for a domain or a task by fine-tuning general open-source models, such as Qwen and Gemma, inherit a vocabulary built for many domains and general applications. In an essay grader we run in production, that vocabulary split the text the model writes most into many tokens.
Artificial Domain Intelligence Artificial Domain Intelligence is an approach to making physical machines intelligent and capable within the thing they are built to do (their domain). A machine measures what it just produced, determines what was wrong with it, corrects itself, and accepts spoken instruction from the person using it.