Native-speed vLLM transformers modeling backend TL;DR : The transformers vLLM backend is now as fast (or faster) than custom vLLM implementations for many LLM architectures. Model authors can automatically leverage their transformers implementations to get ultra fast vLLM inference, for free.
Latest 25 news items
Filter by day, tag, source, or full-text query. Results are sorted by newest ingested item first.
Timeline
Last 44 daysCongrats to Meta Superintelligence on having the top 2/3 image/video models in the world! This would’ve been a candidate for a title story, but unfortunately that is pretty much all the detail we have about Muse Image/Video - no paper, no technical detail whatsoever.
Run AI workloads on any cloud, store on Hugging Face: zero-egress storage with SkyPilot For most teams, models and datasets live in a bucket in one region of one cloud. The GPUs you can get, whether for development, training, or serving, increasingly sit on a different cloud than your data.
Hugging Face Models on Foundry Managed Compute At Microsoft Build 2026, we announced Foundry Managed Compute and Hugging Face models on Foundry — a curated catalog of open-weight models from the Hugging Face ecosystem, refreshed weekly, deployable in one click onto Foundry Managed Compute. Weights are pre-staged in Azure, runtimes are built and scanned by…
While we congratulate (friend of the show!) General Intuition on their new model and (friend of the show!) Shunyu Yao on their new model , and the world awaits the release of GPT-5.6 Sol Ultra , people are racing to find the limits of Fable 5 before the subscription subsidy ends tomorrow . Thariq had been working on a “ Field Guide to Fable ” blog series,…
LeRobot v0.6.0: Imagine, Evaluate, Improve This new release is about closing the robot learning loop: policies that imagine the future before acting, reward models that tell you when your robot succeeds, a deployment CLI that turns failures into training data, and six new simulation benchmarks to measure it all. It also brings depth sensing, VLM-powered…
Hugging Face and Cerebras bring Gemma 4 to real-time voice AI For voice AI, latency is a critical parameter. Developers have made tremendous progress in model quality, but the user experience is still often limited by response times.
Ahmad Osman at the AI Engineer World’s Fair today. Ahmad Osman has been advocating for local AI — running models on your own computer, workstation or dedicated hardware — long before it became a major theme at this year’s AI Engineer World’s Fair .
It’s an odd thing to say “not much happened” while running AIEWF workshops, but objectively, that is true - vibes were good but the wider world collectively took a breather to process that shock Germany loss today. In the meantime you can think though how to build better Skills, which is emerging as a top theme of the conference throughout the week.
We continue our series about distillation. In the AI of the week, we discuss Meta’s amazing AutoData paper.
Against the backdrop of ongoing Anthropic-Fable negotiations and a relaxation of Mythos controls, GPT-5.6 was announced today, but with limited access to trusted partners. It is Mythos-beating at a subset of coding agent tasks: But OpenAI took strong pains to explain that this model both Mythos-beating and also not as capable at Cyber as Mythos: GPT‑5.6…
Only 200 AI Engineer tickets left - on track to sell out in the next 24 hours. Grab now for over $60k in sponsor credits!
Run a vLLM Server on HF Jobs in One Command You can spin up a private, OpenAI-compatible LLM endpoint on Hugging Face infrastructure with a single command — no servers to provision, no Kubernetes, pay-per-second. Once it's up, you can query it from your laptop, a notebook, or anywhere else.
For about three years now, the Qwen family has lived inside a rectangle. It reads your code, looks at your screenshots, answers your questions, and the whole time it has been doing this behind glass .
The brief history of Meta-Harnesses is a little undocumented, but it roughly goes: at first there was Conductor and Zed’s ACP , then there came OpenInspect , Cloudflare’s Flue , and then Vercel’s Eve and HarnessAgent , and Heypi . It should not go unnoticed that today’s podcast guest Matei Zaharia, CTO of the enormously successful (for a pre LLM era…
We have covered the Age of Async Agents on the podcast: There has been a wave of companies building their own background agents from Shopify to Stripe to Paradigm to Razorpay , and even Cognition’s friends Ramp have built their own coding agent with other friend Modal . And today it is time for Anthropic’s take on the situation with Claude Tag :…
We start a new series about distillation where we are going to cover all the cool techniques in the space. In the AI of the week, we are going to cover Alibaba’s new models for robotics.
A fun, personal note to start the week — about AI evaluations, and why we made the best models in the world fight over a virtual ball. Before we start, watch this 12 seconds video: Cool right?
Building Pakistan Notice Helper: A Small AI Tool for a Very Local Safety Problem For the Hugging Face Build Small Hackathon , I wanted to build something practical, local, and useful beyond a demo. The result is Pakistan Notice Helper , a safety-focused AI tool that helps people in Pakistan understand suspicious messages before they click a link, call a…
We continue our series about alternatives to transformers. Our opinion section discusses an intriguing thesis: systems of action vs.
Five labs, five minds: building a multi-model finance drama on small models A second Build Small Hackathon field report: what happens when each agent in an emergent economy runs on a different lab's small model, and the player becomes the financier pulling the strings. The first version of Thousand Token Wood was a weather-god sandbox: five woodland…
Anthropic is seeing Sparks of RSI , OpenAI’s ChatGPT has finally crossed 1B MAU ~5 months behind schedule and improved memory , and SpaceXAI is explaining its IPO to people who might not know they will be forced into buying it . None of which are as important as getting your AIEWF tickets and hotels and tuning in to the latest pod with Andon Labs !
The new AIEWF website is live! Get your tickets booked ASAP as they -will- sell out.
Nemotron 3.5 Content Safety: Customizable Multimodal Safety for Global Enterprise AI The last two years have seen NVIDIA's content safety stack grow from a focused English text classifier into a family of specialized models—each extending coverage to new modalities, languages, and inference modes. Nemotron 3 Content Safety , released in March 2026,…
Designing the hf CLI as an agent-optimized way to work with the Hub hf is the official command-line entrypoint to the Hugging Face Hub. Anything you can do on the Hub from the Python SDK, you can do from your terminal: download and upload models, datasets and Spaces; create and manage repos, branches, tags and pull requests; run Jobs on HF infrastructure;…