Manual CPU affinity configuration for multi-socket deep learning servers

“Show HN: I made open source, zero power PCB hackathon badges I love getting cool swag from hackathons and I also love designing PCB's, so when my friend asked me if I would design hackathon badges for a large game jam in singapore, I was absolutely down! The theme of overglade was a The game jam within a game , pretty cool concept right! High schoolers from around the world were flown out to the event by hackclub after they spent about 70 hours designing their own game. These badges needed ”

“Show HN: Running PrismML's Bonsai inside DRAM by breaking DDR4 timing rules The excitement surrounding PrismML’s 1-bit/ternary Bonsai models has the industry closely watching how smartphone giants, particularly Apple, will implement LLMs on edge devices. Moving AI on-device is a brilliant and necessary strategy. It ensures absolute user privacy in alignment with EU regulations, fundamentally shifts the economics away from costly cloud inference, and paves the way for a significant hardware ”

“Show HN: Druids – Build your own software factory Hi HN! Druids ( https://github.com/fulcrumresearch/druids ) is an open-source library for structuring and running multi-agent coding workflows. Druids makes it easy to do this by abstracting away all the VM infrastructure, agent provisioning, and communication. You can watch our demo video here ( https://www.youtube.com/watch?v=EVJqW-tvSy4 ) to see what it looks like. At a high level: - Users can write Python pr”

“Show HN: Orate – On-device neural text-to-speech queue for Mac Hey friends! Brad here - long time HN user, founder, engineer (Coinbase, Soothe, Jeevz, Release, Hired, GrowthX, etc)... I have been struggling recently with too many tabs, emails, articles, etc sitting unread while I swap between Claude code sessions all day. So I decided to build Orate to help me work through the backlog by listening to it all like I would a podcast. Orate allows you to select any text on your screen and keyboard s”

“Show HN: A Multi User Multi Task Board MCP Server I built a simple multi user, multi board, Task/Kanban MCP server. I have been looking for something like this to manage development agents, but I wasn't seeing anything that felt like what I wanted. So I set down and decided to vibe code an alternative. While it was an experiment at first I have been using it daily for my personal development projects and I really think there are others who might be looking for exactly this. It's 1”

“Show HN: We built a So, our team decided to build our own. After months of grinding, using RustVMM and KVM, we built a blazing-fast, ultra-lightweight secure sandbox service from the ground up: CubeSandbox. Today, we are officially open-sourcing it. To balance security and performance, we stripped the underlying OS to the absolute extreme. Here’s what it can do right now: 1. 60ms blazing-fast cold start: End-to-end latency is under 60ms, making it 2.5x to 50x faster than traditional secure sandb”

“Show HN: An Interactive Guide for Castlevania II: Simon's Quest I'll start by copying the comment I left on the Reddit post where I originally shared this project and then go into some more detail for this audience. ( https://www.reddit.com/r/nes/comments/1umrnd5/i_made_an_inte... ) Castlevania II has always held a special place in my heart. I didn’t own it myself as a kid but I had a family member who did. This meant that I only got a few chances to actua”

“Ask HN: HotPin – lossless 120B MoE inference on 24GB RAM (CPU, 50 loc) I'm a mechatronics designer with a background in control systems, robotics, PCB design, and embedded hardware. I design physical systems: motors, sensors, microcontrollers, and real-time control loops. I applied this design thinking to LLM memory management – and it worked. HotPin is a set of patches for llama.cpp that runs 30B–120B Mixture of Experts (MoE) models on far less RAM than their disk footprint, with bit-ident”

“Improving performance with CPU affinity I have a server with 2 CPUs(EPYC 9754) on a motherboard(Gigabyte MZ73-LM1), and a GPU(nVidia RTX A6000) attached on PCIE0(of CPU0), and a RAID(HighPoint SSD7505) attached on PCIE1(of CPU1), and each CPU has 64G local memory respectively and a dedicated PCIE bus. This server is being used for deep learnning, so the main working processes are an Postgresql(13) server instance and a few of Python. I'm planning to: configue OS(Debian 12) to bind all interrupt ”