Friday, 30 October 2026
This dated roundup collects the most interesting AI and technology developments found for Friday, 30 October 2026.
Policy & Ethics
Release: Swift 1.5 Flash Next - Heretic v2 - ReverseEngineer
This model was made in collaboration with u/jeffpeng3 (on huggingface) who developed the v2 heretic weights for this quant. He managed to preserve both reasoning ability and output length. Great work, and a big step up from his v1 weights. I made the quantization recipe and the imatrix recipe, and created the actual quants. Comes pre-packed with strata build artifacts - zip file in repo. GGUF File Format for the quant. I released my own heretic version of his v1 weights in here a while ago - the heretic calibration was a bit broken, and my quant wasn't amazing. This is a huge step up on...
Read moreUkisAI Swift GLM5.3 + GSQ-RCO, Swift Ornith 9B / -57.7% Token Usage with <1% accuracy loss on max reasoning
Hi everyone, Jovan from UkisAI here, Today we are expanding our Swift model series with two models requested by the community. We made Swift GLM-5.3-Flash and Swift Ornith 9B more efficient by figuring out which tokens were linked to pathological overthinking and penalizing them without "attacking" the reasoning length directly then regained the accuracy with further post-training, leading to "compressed" token usage while maintaining accuracy by making the model adapt to less reasoning via RL and on-policy distillation. You can find our dataset here (albeit we re-sample it per model) and...
Read moreGit for Global Law: Global Law querable in Git
This hit #1 on HN yesterday (you can read lots of discussion at https://news.ycombinator.com/item?id=50268380 ). Why would I want to do this? The idea is make all law semantic, versioned, easily attributable and query able by agents. I also believe this information should be freely available so CC0 license (do whatever you want with it). If interested, repo linked below, I'd welcome all comments and advice. Thanks! I've been posting to locallama specifically about KGs for huge legal datasets for months, this is a practical culmination of that. https://github.com/lexifina/global-law...
Read moreResearch & Products
Sam Altman: “Local inference is a terrible allocation of scarce resources”
Sam Altman: “ Local inference is a terrible allocation of scarce resources. A lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre but from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time you want maximum utilisation in the cloud if you're...
Read moreServiceNow-AI/Apriel-Voice-27B-preview · Hugging Face
from Service Now AI: Apriel Voice 27B Preview An open model for speech, reasoning, and tool use from ServiceNow Apriel Voice 27B Preview understands spoken requests, reasons over conversational context, and generates text responses and tool calls through a shared Gemma 4 backbone. It adds a speech interface while retaining text and image input capabilities. Pair it with an external speech synthesizer to build interactive voice assistants, customer support workflows, and spoken tool use. Try Apriel Live · Read the blog · Technical report Model capabilities Capability What it supports...
Read moreAnyone tried Magnitude? Claims to be 2x faster than Ollama/llama.cpp, but it wasn't for me (3060 Laptop GPU + RPi 5 CPU-only).
I stumbled on an open source local inference app called Magnitude . I couldn't find any earlier posts about it on r/LocalLLaMA , although there is one post with almost no comments on r/LocalLLM . It claims to be significantly faster (2x) than Ollama and llama.cpp because it "tunes its kernels on your hardware to find the fastest way to run each model". The install includes both a desktop app and CLI tools. I got curious so I tried it on two of my machines: a laptop with a RTX 3060 Mobile (6GB VRAM) GPU + 24GB RAM running Linux Mint, and on a headless Raspberry Pi 8 8GB running Raspberry...
Read moreRaon-1-mini-preview (28.8B/4.3B MoE) on hipfire, 7900 XT: runs natively, but ~200× slower prefill / ~10× slower decode than llama.cpp
I made a hipfire-native MQ4 of KRAFTON's Raon-1-mini-preview and measured it on a 20 GB 7900 XT (ROCm 7.1). If you just want to use this model, use KRAFTON's llama.cpp branch with the official GGUF. This build is much slower (bummer!) Maybe the hipfire team can optimize for it in the future. `` pp512 pp8192 decode llama.cpp (Q4KM) 2,055 t/s 1,477 t/s 47.4 t/s hipfire MQ4 12.6 t/s 6.3 t/s 4.6 t/s `` hipfire numbers are single runs. The likely cause is that hipfire's Raon path handles recurrent state token by token, with no batched prefill kernel. Other architectures in hipfire run at...
Read moreAPI credits benefit for eligible ChatGPT subscriptions
API credits benefit for eligible ChatGPT subscriptions Earlier this month Anthropic announced a generous new benefit for their Max and Team subscriptions: $100, $200, and $500 per month subscribers would get the equivalent quantity of (expiring) credits to use with the Anthropic API. OpenAI have now launched pretty much exactly the same deal: if you have a $100, $200, or $500 subscription plan with them you now get that same quantity of credits to apply to one of your API organizations. I maintain subscriptions with both companies, so this is great news for me! I may even ship some...
Read moreEpoch AI says an open model built exploits for six Firefox releases from public fixes
The controlled attacks needed an additional unpublished vulnerability, now patched. Mozilla is changing how it releases security fixes to make similar chains harder to assemble.
Read moreswapped 5600x to 5600g and got 4x slower inference on vulkan
- qwen/qwen3.8-27b fully in main GPU VRAM - rx 7900 xtx 24gb - ddr4 32gb 3200 - installed 5600g instead of 5600x to free some VRAM on main gpu - disabled iGPU in LM Studio got 15-20t\s instead of 65-75. iGPU show 0% load. Main GPU - 100% load. ROCm performance didn't changed. What is wrong with Vulkan? submitted by /u/Jebbyk1 [link] [comments]
Read moreMistral releases weights for its trillion-parameter AI model, targeting cybersecurity
Mistral says its new model can afford organizations a kind of control over its cyber defenses that closed models can't.
Read moreV100 FHHL - could we power limit a normal V100 to achieve the same performance/watt?
https://preview.redd.it/g9co7mbbhfyh1.png?width=1768&format=png&auto=webp&s=0ff5b193b092528d335f383da41d2ae8db75ab08 I came across the FHHL version of this card recently, it has a TDP of 150W which is half the SXM2 version. From the limited information available it seems that this is the same GPU core, just with a lower TDP and lower core clock, therefore lower compute. Has anyone tried power limiting their V100 and tested the performance? It only seems like a small penalty in performance compared to the power savings submitted by /u/pseudobacon [link] [comments]
Read moreTags: ai_agents, opinion
What is it like to work when your co-workers are AI agents?
Using AI for roles from executive assistants to chiefs of staff, companies are boasting about doing more with less, creating tension with their human workers On an average workday, Dhruv Amin chats with dozens of colleagues to get things done at his AI startup Anything. He might ask Gwen, his executive assistant, to schedule a meeting, then troubleshoot a technical problem with Cody, his coding partner. Then he might check in with Betsy for search engine optimization, or Juno for onboarding customers. If the office runs out of snacks, he sends a Slack message to Justin, the office manager...
Read more