Apple Foundation Models: The On-Device LLM Framework, Explained
Apple's Foundation Models framework: LanguageModelSession, @Generable guided generation, tool calling, availability, and when to leave the on-device model.
AI & TechnologyThoughts on design, development, AI infrastructure, and building products.
Apple's Foundation Models framework: LanguageModelSession, @Generable guided generation, tool calling, availability, and when to leave the on-device model.
AI & TechnologyApple's Translation framework: free on-device translation via translationPresentation and TranslationSession, plus the offline-download edges demos skip.
AI & TechnologySwift 6.2 inverts concurrency: default your module to MainActor (SE-0466), run nonisolated async on the caller (SE-0461), escape with @concurrent.
AI & TechnologyRaj Reddy pioneered machines you can talk to -- speech recognition, the blackboard model -- then aimed the most advanced AI at the world's poorest, not its richest.
Engineering & CraftSatoru Iwata was a programmer who became Nintendo's president without ever stopping being a gamer -- technical mastery in service of the player's joy.
Engineering & CraftSalvatore Sanfilippo built Redis around one principle -- do less. A small, single-threaded, in-memory store you can hold in your head, written in C for humans to read.
Engineering & CraftDemis Hassabis built general intelligence from first principles -- games as the proving ground, neuroscience as inspiration -- then pointed it at protein folding and won a Nobel.
Engineering & CraftRadia Perlman invented the Spanning Tree Protocol and built networks that heal themselves -- loop-free, self-stabilizing, and correct even when nodes lie. Robustness as a first principle.
Engineering & CraftiOS 26 widgets, Control Center controls, and Live Activities are all App Intents surfaces. One intent powers buttons, controls, and Live Activity actions.
AI & TechnologySophie Wilson designed the ARM instruction set -- now in nearly every phone on Earth -- with a tiny team and a ruthless RISC efficiency that made low power almost an accident.
Engineering & CraftThompson and Ritchie built Unix and C from small sharp tools composed through one universal interface: text streams and pipes. Simplicity over features.
Engineering & CraftAlan Kay invented the future by changing the point of view: computing as a medium for thought, with systems built from objects communicating by messages.
Engineering & CraftTechnical writing published at Introl
Comprehensive hardware recommendations and cost analysis for running large language models locally.
GPU selection guide comparing NVIDIA's latest datacenter accelerators for different AI workloads.
Deep technical dive into Google's Tensor Processing Unit evolution from TPUv1 to TPUv5.
Resource sharing strategies for GPU clusters in containerized environments.
Guide to building and managing distributed AI computing with Ray framework.
Analysis of open source LLM economics and DeepSeek's competitive positioning.
Future datacenter power requirements and NVIDIA's next-generation GPU roadmap.
Small modular reactor solutions for powering next-generation AI infrastructure.
Technical analysis of DeepSeek's Multi-Head Compression architecture innovations.