This presentation demonstrates creating local AI with LLMs on edge devices, emphasizing accessibility. It covers setup, management, and use cases, highlighting ease of use and briefly addressing moving experiments to production.
The premise for this presentation is the Steve Jobs quote: "Technology is nothing. What's important is that you have faith in people, that they're basically good and smart, and if you give them tools, they'll do wonderful things with them." This presentation will showcases use cases for creating a local, accessible AI environment. It emphasizes the democratization of AI by bringing powerful Large Language Models (LLMs) to the edge, enabling private, offline, and efficient AI applications. The presentation covers hardware and software setup, model management, performance optimization, and potential use cases. Additionally, it highlights the ease of use and accessibility of these tools for a wider audience and briefly discusses moving experiments into production.
