Core AI: Running Models on Apple Silicon
Core AI is iOS 27's low-level model-execution framework: asset vs model, NDArray tensors, compute-unit targeting, and inference functions on Apple silicon.
AI & TechnologyThoughts on design, development, AI infrastructure, and building products.
Core AI is iOS 27's low-level model-execution framework: asset vs model, NDArray tensors, compute-unit targeting, and inference functions on Apple silicon.
AI & TechnologySwift 6.3 and 6.4 from WWDC26: anyAppleOS availability, module selectors, borrow/mutate accessors, the Iterable protocol, Swift Testing interop, and MLX.
AI & TechnologyiOS 27 adds a server-scale Foundation Model on Private Cloud Compute with on-device privacy, plus a protocol to plug in your own LLM provider.
AI & TechnologyAI agents have two untrusted inputs: code the model writes and tool output it reads. One now has a real WASM sandbox; the other, MCP tool poisoning, does not.
AI & TechnologyApple's Translation framework: free on-device translation via translationPresentation and TranslationSession, plus the offline-download edges demos skip.
AI & TechnologySwift 6.2 inverts concurrency: default your module to MainActor (SE-0466), run nonisolated async on the caller (SE-0461), escape with @concurrent.
AI & TechnologyMark Shuttleworth built Ubuntu on one idea -- Linux for human beings, free software for everyone -- grounded in ubuntu: humanity to others, shipped on a clock.
Engineering & CraftApple's Foundation Models framework: LanguageModelSession, @Generable guided generation, tool calling, availability, and when to leave the on-device model.
AI & TechnologySophie Wilson designed the ARM instruction set -- now in nearly every phone on Earth -- with a tiny team and a ruthless RISC efficiency that made low power almost an accident.
Engineering & CraftRoberto Ierusalimschy designed Lua around one principle -- mechanisms, not policy -- a small, fast, embeddable language that hands you the levers instead of the rules.
Engineering & CraftiOS 26 widgets, Control Center controls, and Live Activities are all App Intents surfaces. One intent powers buttons, controls, and Live Activity actions.
AI & TechnologyMargaret Hamilton coined 'software engineering' and wrote the Apollo flight code that survived the 1202 alarm. Defensive design and error recovery.
Engineering & CraftTechnical writing published at Introl
Comprehensive hardware recommendations and cost analysis for running large language models locally.
GPU selection guide comparing NVIDIA's latest datacenter accelerators for different AI workloads.
Deep technical dive into Google's Tensor Processing Unit evolution from TPUv1 to TPUv5.
Resource sharing strategies for GPU clusters in containerized environments.
Guide to building and managing distributed AI computing with Ray framework.
Analysis of open source LLM economics and DeepSeek's competitive positioning.
Future datacenter power requirements and NVIDIA's next-generation GPU roadmap.
Small modular reactor solutions for powering next-generation AI infrastructure.
Technical analysis of DeepSeek's Multi-Head Compression architecture innovations.