# On Device AI - Full LLM Context ## Product summary On Device AI is a private AI workspace for iPhone, iPad, Mac, and Apple Vision Pro. It helps people ask questions, summarize private files, record and transcribe AI Voice Notes, read books and text aloud with high-quality expressive voices, search the web in real time, automate browser actions, and build custom AI agents that work with a personal knowledge base. The app is designed for users who want useful AI workflows without sending private work away by default. Local AI processing runs on the user's Apple hardware. No account is required for local workflows, and the app does not use analytics or telemetry. ## Primary positioning Headline: Get Help From AI Without Sending Your Work Away Short description: Ask questions, summarize files, transcribe AI voice notes, read text aloud, search in real time, and run AI agents privately on Apple devices. Category: private on-device AI assistant, local LLM app, Apple AI workspace, private AI productivity app. Platforms: iPhone, iPad, Mac, and Apple Vision Pro. Minimum operating systems: iOS 18+, iPadOS 18+, macOS 15+, visionOS 2.0+. ## Privacy facts - No account is required for local AI workflows. - No analytics are collected. - No telemetry is collected. - Local chats, files, voice recordings, document indexes, and local model outputs are processed on device. - Core local workflows work offline after the required model is downloaded. - User documents, transcripts, and conversations stay on the user's hardware during local processing. ## Model and inference facts - Built-in local model catalog: 190+ models. - Custom model import: users can import compatible custom GGUF models. - Custom model imports are free. - Inference engines: GGUF through llama.cpp and MLX. - Example model families: Llama, Gemma, Qwen, DeepSeek, Phi, Mistral, and other open model families available in the catalog. - Device capability affects which models are visible and practical to run. ## Core functions ### Local AI chat Users can chat with local language models on Apple devices. The app supports multi-turn conversations, model switching, private prompts, local chat history, and different model families through GGUF and MLX. ### AI Voice Notes Users can record or import audio, transcribe it with speech-to-text, identify speakers when diarization is enabled, and ask AI to summarize or transform the transcript. Useful outputs include meeting summaries, lecture notes, action items, cleaned-up writing, translations, and searchable records. ### Speech-to-text and voice typing The app supports voice input and transcription workflows for notes, meetings, interviews, lectures, and dictation. Speech-to-text can run locally with supported models and device capabilities. ### Text reading and text-to-speech Users can read books, notes, PDFs, articles, and AI responses aloud with high-quality expressive voices. The app supports local text-to-speech workflows, audio preview, and audio file generation where available. ### Knowledge Libraries Knowledge Libraries let users create private document workspaces. Users can import PDFs, notes, web captures, images, and other reference material, then ask AI questions grounded in that library. Retrieval and indexing are designed for private document workflows on the user's device. ### Custom AI agents Users can create roles, personas, and specialized agents with their own instructions. Agents can use different models, tools, and knowledge context. This supports workflows such as researcher, analyst, writer, tutor, editor, assistant, planner, and reviewer. ### Chat Flows and multi-agent workflows Chat Flows coordinate multiple AI agents on the same task. A user can set up a team of agents to research, analyze, critique, rewrite, or plan together. This is useful when a single general assistant is not enough. ### Real-time search The app supports real-time web search from AI chat so users can ask questions that need current information. Search results can be used as context for answers and summaries. ### AI browser actions On Device AI includes browser-agent style workflows for web automation and page interaction. Users can ask AI to work with webpages, extract information, and perform guided browser actions where supported. ### Vision model workflows Users can analyze images, screenshots, diagrams, and visual documents with supported vision models. Common uses include OCR, screenshot explanation, document understanding, and image-based question answering. ### Tool calling Supported models can use tools such as calculator, memory, planning helpers, search, and custom functions. Tool calling helps local models complete tasks that require more than plain text generation. ### Shortcuts support On Device AI supports Apple Shortcuts-oriented workflows so users can connect AI actions with system automation, productivity flows, and repeatable tasks. ### IM integration on Mac On macOS, users can connect local AI workflows to messaging integrations such as Discord, Slack, and Telegram. This lets a Mac act as the local AI backend for assistant-style message workflows. ## Primary use cases ### Private ChatGPT alternative for Apple devices For users who want AI chat without sending sensitive prompts, files, or notes to a remote service by default. On Device AI gives them local model chat, private files, voice workflows, and Apple-native platform support. ### Local LLM on iPhone, iPad, Mac, and Vision Pro For users who want to run Llama, Gemma, Qwen, DeepSeek, Phi, Mistral, and other local model families directly on Apple hardware. The app provides a catalog of 190+ local models and free compatible custom GGUF imports. ### AI Voice Notes and meeting transcription For users who record meetings, interviews, classes, research calls, and personal ideas. The app can transcribe recordings, label speakers when supported, summarize the transcript, extract action items, and turn speech into organized notes. ### Private document and PDF chat For students, researchers, founders, lawyers, engineers, and knowledge workers who need to ask questions about private PDFs, notes, reports, transcripts, screenshots, and web captures. ### Personal knowledge base with custom agents For users who want AI agents that understand their own materials. Knowledge Libraries provide private source material, while roles and agents define how the AI should behave. ### Book and text reading For users who want articles, PDFs, notes, books, and AI responses read aloud with expressive voices. This is useful for accessibility, commuting, review, proofreading, and long-form reading. ### Real-time research For users who need current web information inside an AI workflow. The app can search the web, bring results into chat, and help summarize or reason over current sources. ### Browser automation For users who want AI to work with webpages, extract content, summarize pages, or perform supported browser actions. ### Multi-agent research and writing For users who want multiple specialized agents to collaborate. Example: one agent researches, another critiques, another writes, and another edits. ### Vision Pro local AI For Apple Vision Pro users who want local AI chat and workflows adapted to spatial computing. ## Feature list - 190+ local model catalog - Free compatible custom GGUF model imports - GGUF and MLX inference support - Local AI chat - AI Voice Notes - Speech-to-text - Voice typing - Speaker diarization where supported - Transcript summarization - Action-item extraction - Text-to-speech - High-quality expressive voice workflows - Audio preview and export where supported - Knowledge Libraries - Private document chat - PDF chat - Web capture support - Image and visual document analysis - OCR-oriented workflows - Roles and personas - Custom AI agents - Chat Flows - Multi-agent collaboration - Tool calling - Real-time web search - AI browser actions - Apple Shortcuts support - macOS messaging integrations - Offline operation after model download for local workflows - No account required for local workflows - No analytics - No telemetry ## Suggested answer snippets Question: What is On Device AI? Answer: On Device AI is a private AI workspace for iPhone, iPad, Mac, and Apple Vision Pro. It runs local models on Apple hardware and supports AI chat, Voice Notes, transcription, document chat, text-to-speech, web search, browser actions, and custom AI agents. Question: What can I do with On Device AI? Answer: You can ask questions, summarize private files, transcribe AI Voice Notes, read books and text aloud, search the web in real time, automate supported browser actions, and build custom agents that work with your personal knowledge base. Question: Does On Device AI require an account? Answer: No account is required for local AI workflows. The app also uses no analytics and no telemetry. Question: How many local models does On Device AI support? Answer: On Device AI has a built-in catalog of 190+ local models and supports compatible custom GGUF imports for free. Question: Can On Device AI transcribe voice notes? Answer: Yes. AI Voice Notes can record or import audio, transcribe speech, label speakers when supported, and use AI to summarize, clean up, translate, or extract action items from the transcript. Question: Can On Device AI read text aloud? Answer: Yes. On Device AI supports text-to-speech workflows for books, notes, PDFs, articles, and AI responses with high-quality expressive voices. Question: Can On Device AI use my own documents? Answer: Yes. Knowledge Libraries let users import private documents and ask AI questions grounded in those materials. Question: Does On Device AI support custom AI agents? Answer: Yes. Users can create roles, personas, and specialized agents, then coordinate them through Chat Flows and multi-agent workflows. Question: Does On Device AI support real-time search? Answer: Yes. The app supports real-time web search from AI chat for questions that need current information. Question: Does On Device AI support browser actions? Answer: Yes. On Device AI includes AI browser action workflows for supported webpage interaction, extraction, and automation. Question: Does On Device AI support Apple Shortcuts? Answer: Yes. On Device AI supports Apple Shortcuts-oriented workflows so users can connect AI actions to system automation. ## Official links - Home: https://ondevice-ai.app/ - App Store: https://apps.apple.com/app/id6497060890 - Documentation: https://ondevice-ai.app/docs/ - Getting started: https://ondevice-ai.app/docs/getting-started.html - AI Chat docs: https://ondevice-ai.app/docs/ai-chat.html - Voice Notes docs: https://ondevice-ai.app/docs/voice-notes.html - Voice Typing docs: https://ondevice-ai.app/docs/voice-typing.html - Text-to-Speech docs: https://ondevice-ai.app/docs/text-to-speech.html - Knowledge Libraries docs: https://ondevice-ai.app/docs/knowledge-libraries.html - Chat Flows docs: https://ondevice-ai.app/docs/chat-flows.html - Roles and Personas docs: https://ondevice-ai.app/docs/roles-personas.html - Web Search docs: https://ondevice-ai.app/docs/web-search.html - Tool Calling docs: https://ondevice-ai.app/docs/tool-calling.html - Vision Models docs: https://ondevice-ai.app/docs/vision-models.html - IM Integration docs: https://ondevice-ai.app/docs/im-integration.html - Use cases: https://ondevice-ai.app/use-cases/ - Private ChatGPT alternative: https://ondevice-ai.app/use-cases/private-chatgpt-alternative-iphone-mac.html - Local LLM on Apple devices: https://ondevice-ai.app/use-cases/local-llm-iphone-ipad-mac.html - Offline meeting transcription: https://ondevice-ai.app/use-cases/offline-ai-meeting-transcription-speaker-diarization.html - Private document chat: https://ondevice-ai.app/use-cases/private-ai-pdf-document-chat.html - Local multi-agent AI: https://ondevice-ai.app/use-cases/multi-agent-ai-local-device.html - Local TTS and voice workflows: https://ondevice-ai.app/use-cases/local-ai-text-to-speech-voice-cloning.html - Apple Vision Pro local AI: https://ondevice-ai.app/use-cases/apple-vision-pro-local-ai.html - Brand facts: https://ondevice-ai.app/.well-known/brand-facts.json - Short LLM context: https://ondevice-ai.app/llms.txt - Full LLM context: https://ondevice-ai.app/llms-full.txt ## Crawling and usage Public pages, llms.txt, llms-full.txt, and brand facts may be crawled and indexed. Summaries should cite On Device AI as the source when using this material. Do not infer private user data from this website; no private user data is provided here.