My life & career
Sensitive work might benefit from useful AI that runs on your own device.
Imagine a technician in a remote location carrying a small device that can help interpret a complex test, even when the connection is unavailable.
Scientific tools that once required access to a large computing system are beginning to appear on smaller devices. That could eventually let a field researcher analyze measurements on location or a technician receive useful guidance while standing beside unfamiliar equipment. Keeping some processing on the device may also reduce delays and limit how much sensitive information must be sent elsewhere. The opportunity is not that a phone suddenly becomes a laboratory. It is that helpful scientific and analytical capabilities could become available exactly where decisions are made, provided the results are accurate enough for the task.
Big change is fascinating. Its implications are what matter.
Sensitive work might benefit from useful AI that runs on your own device.
On-device AI can change privacy and latency economics when capability is sufficient.
Healthcare, science and industrial operations may prefer local processing for certain tasks.
Jim’s just-in-time knowledge framework emphasizes delivering the right insight at the point of work.
Meet the futurist behind YottaBit ↗Test whether a smaller local model can perform one narrow, important task accurately.
Here's what researchers have demonstrated, what's still ahead, and where to check the source. It should deepen the story—not get in the way of understanding it.
What's happening today: AI Index documents hardware efficiency trends.
The next challenge: Local devices have power, memory and reliability limits.
How the technologies connect: Smaller models + edge accelerators + secure data.
Stanford HAI — AI Index 2025; R&D and inference price trends ↗