On-Device AI Across iOS 27: Spotlight and Media
iOS 27 threads the on-device model through the system: SpotlightSearchTool makes Core Spotlight LLM-grounded, and AVFoundation generates subtitles on device.
AI & TechnologyThoughts on design, development, AI infrastructure, and building products.
iOS 27 threads the on-device model through the system: SpotlightSearchTool makes Core Spotlight LLM-grounded, and AVFoundation generates subtitles on device.
AI & TechnologyiOS 27 cuts camera launch in half with Deferred Start, adds Pro Video Storage for ProRes writes, and brings the Center Stage square front camera to your app.
AI & TechnologyAI agents have two untrusted inputs: code the model writes and tool output it reads. One now has a real WASM sandbox; the other, MCP tool poisoning, does not.
AI & TechnologyMark Shuttleworth built Ubuntu on one idea -- Linux for human beings, free software for everyone -- grounded in ubuntu: humanity to others, shipped on a clock.
Engineering & CraftJim Keller architected the chips behind AMD's comeback, the iPhone, Tesla's Autopilot and more -- by spending silicon to remove bottlenecks and rethinking from first principles.
Engineering & CraftFoundation Models gives you Apple's sealed on-device LLM. MLX runs your own: quantized open-weight models and LoRA fine-tunes on Apple Silicon.
AI & TechnologyWerner Vogels, Amazon's CTO, built the cloud on one assumption: everything fails all the time. Design for failure, minimize blast radius, and stay available through it.
Engineering & CraftDemis Hassabis built general intelligence from first principles -- games as the proving ground, neuroscience as inspiration -- then pointed it at protein folding and won a Nobel.
Engineering & CraftApple's Foundation Models framework: LanguageModelSession, @Generable guided generation, tool calling, availability, and when to leave the on-device model.
AI & TechnologyFei-Fei Li gave AI its eyes by building ImageNet -- betting that data at scale, not a cleverer model, was the missing ingredient, and that AI must stay human-centered.
Engineering & CraftSatoru Iwata was a programmer who became Nintendo's president without ever stopping being a gamer -- technical mastery in service of the player's joy.
Engineering & CraftSophie Wilson designed the ARM instruction set -- now in nearly every phone on Earth -- with a tiny team and a ruthless RISC efficiency that made low power almost an accident.
Engineering & CraftTechnical writing published at Introl
Comprehensive hardware recommendations and cost analysis for running large language models locally.
GPU selection guide comparing NVIDIA's latest datacenter accelerators for different AI workloads.
Deep technical dive into Google's Tensor Processing Unit evolution from TPUv1 to TPUv5.
Resource sharing strategies for GPU clusters in containerized environments.
Guide to building and managing distributed AI computing with Ray framework.
Analysis of open source LLM economics and DeepSeek's competitive positioning.
Future datacenter power requirements and NVIDIA's next-generation GPU roadmap.
Small modular reactor solutions for powering next-generation AI infrastructure.
Technical analysis of DeepSeek's Multi-Head Compression architecture innovations.