Alphaavatar 100/100 — SaferSkills

Is Alphaavatar safe to install?

SaferSkills independently audited Alphaavatar (Agent Skill) and scored it 100/100 (green). The audit ran 55 deterministic rules across Security, Supply Chain, Maintenance, Transparency, and Community; it found 0 high-severity and 0 lower-severity findings. The full rule-by-rule trace and per-finding evidence are below. Free, methodology-open.

CategoryWeightCategory scoreContribution

Securityprompt, exec, net, exfil, eval

35%

100

35.0 pts

Supply chainhash, typosquat, maintainer, lockfile

20%

100

20.0 pts

Maintenancestaleness, pinning, CI

15%

100

15.0 pts

TransparencySKILL.md, perms, README

15%

100

15.0 pts

Communityinstalls, verify, response

15%

100

15.0 pts

Findings & checks · 0 flagged

Securityscore 100 · 0 findings

✓—All security checks passedNo findings in this category for the latest scan.pass

Supply chainscore 100 · 0 findings

✓—All supply chain checks passedNo findings in this category for the latest scan.pass

Maintenancescore 100 · 0 findings

✓—All maintenance checks passedNo findings in this category for the latest scan.pass

Transparencyscore 100 · 0 findings

✓—All transparency checks passedNo findings in this category for the latest scan.pass

Communityscore 100 · 0 findings

✓—All community checks passedNo findings in this category for the latest scan.pass

The primary manifest — the file an agent reads to learn what this artifact does.

README.md · 1 file

README.md17.6 KB · Markdown

<br />

<h3 align="center"> Learnable, configurable, and pluggable Omni Personal Assistant for everyone </h3>

</div>

<h2>AlphaAvatar Introduction</h2>

AlphaAvatar is a self-hostable Omni Personal Assistant framework designed to evolve into an intelligent personal butler — a continuous, personalized, and proactive assistant that can remember, understand, plan, and act on behalf of the user.

It is built around a plugin-based real-time Agent architecture, combining:

🧠 Memory for long-term user, assistant, and tool interaction history
🧬 Persona for user understanding, identity continuity, and personalization
💡 Reflection for self-improvement and long-term behavioral adaptation
📅 Planning for task decomposition, reminders, and future-oriented actions
⚙️ Behavior for response style, workflow policy, and proactive assistance
🧰 Tools through MCP, RAG, DeepResearch, and external integrations
😊 Virtual Character for real-time voice/avatar interaction

✨ Fully self-hostable and privacy-first — AlphaAvatar can run locally or on your own infrastructure, giving you control over your data, memory, tools, and behavior.

<h2>Runtime Architecture 🧠</h2>

AlphaAvatar is built around a realtime multimodal runtime that connects:

User inputs: voice, text, camera, and external channels
Runtime context: memory state, persona state, user identity, modality state, and task/status state
Composable plugins: Memory, Persona, MCP, RAG, DeepResearch, Character, and Channel plugins
Model layer: LLM/VLM, STT, TTS, speaker detection, and face detection
Storage layer: vector DB, personal server storage, knowledge base, and external tool APIs

<h3>What AlphaAvatar Is Designed For</h3>

<h4>1️⃣ Personal Data & Life Metrics Management</h4>

📊 Track and analyze personal metrics such as health, fitness, sleep, and study progress
📈 Provide long-term insights and trend analysis
🎯 Suggest improvements based on historical patterns

</td> <td width="50%">

<h4>2️⃣ Knowledge & Notes Management</h4>

📖 Organize personal notes, documents, and knowledge
🔍 Retrieve relevant information through RAG
🧠 Build a personal knowledge base over time

</td> </tr>

<h4>3️⃣ Task & Event Management</h4>

📅 Schedule tasks and reminders
⏰ Proactively notify based on context and priority
🔄 Break down long-term goals into actionable steps

</td> <td width="50%">

<h4>4️⃣ Autonomous Planning & Execution</h4>

🧠 Plan multi-step workflows such as learning plans, projects, and research
🔧 Call tools automatically to complete tasks
📌 Maintain consistency across long time horizons

</td> </tr>

<h4>5️⃣ Personalized Companion & Context Awareness</h4>

🧬 Understand user preferences, habits, and personality
💬 Provide highly personalized responses
🤝 Maintain continuity across conversations and modalities

</td> <td width="50%">

<h4>6️⃣ External World Interaction</h4>

🌐 Search, research, and summarize real-world information
🧰 Integrate with tools such as email, databases, APIs, and messaging apps
🔗 Act as a bridge between user intent and external systems

</td> </tr> </table>

💡 AlphaAvatar is not just a chatbot. It is a foundation for building stateful, proactive, multimodal, and self-evolving personal AI assistants.

<h2>AlphaAvatar Plugins</h2>

<table> <tr> <td width="50%"> <h3>🟢 Status</h3> <p> <img src="https://img.shields.io/badge/In_Progress-28a745?style=flat" /> </p> <p>Intermediate status system for reducing perceived latency during thinking, tool calls, and multi-step workflows.</p> <p> <a href="https://github.com/AlphaAvatar/AlphaAvatar/blob/main/avatar-plugins/avatar-plugins-status/README.md">README↗</a> </p> </td> <td width="50%"> <h3>🎯 Interaction Router</h3> <p> <img src="https://img.shields.io/badge/Planned-6c757d?style=flat" alt="Planned" /> </p> <p>Omni interaction routing module that decides whether the Avatar should respond, how the request should be handled, and which status feedback should be emitted.</p> <p> <a href="#">README↗</a> </p> </td> </tr>

<tr> <td width="50%"> <h3>🧠 Memory</h3> <p> <img src="https://img.shields.io/badge/In_Progress-28a745?style=flat" /> </p> <p>Self-improving memory module for Omni-Avatar.</p> <p> <a href="https://github.com/AlphaAvatar/AlphaAvatar/blob/main/avatar-plugins/avatar-plugins-memory/README.md">README↗</a> </p> </td> <td width="50%"> <h3>🧬 Persona</h3> <p> <img src="https://img.shields.io/badge/In_Progress-28a745?style=flat" /> </p> <p>Automatic extraction and real-time matching of multimodal user persona.</p> <p> <a href="https://github.com/AlphaAvatar/AlphaAvatar/blob/main/avatar-plugins/avatar-plugins-persona/README.md">README↗</a> </p> </td> </tr>

<tr> <td width="50%"> <h3>💡 Reflection</h3> <p> <img src="https://img.shields.io/badge/Planned-6c757d?style=flat" alt="Planned" /> </p> <p>A self-improvement module that reflects on memory, behavior, and interaction history.</p> <p> <a href="#">README↗</a> </p> </td> <td width="50%"> <h3>📅 Planning</h3> <p> <img src="https://img.shields.io/badge/Planned-6c757d?style=flat" alt="Planned" /> </p> <p>Long-horizon planning module for tasks, reminders, goals, and multi-step workflows.</p> <p> <a href="#">README↗</a> </p> </td> </tr>

<tr> <td width="50%"> <h3>🤖 Behavior</h3> <p> <img src="https://img.shields.io/badge/Planned-6c757d?style=flat" alt="Planned" /> </p> <p>Controls response style, workflow policy, tool-use behavior, and proactive assistance rules.</p> <p> <a href="#">README↗</a> </p> </td> <td width="50%"> <h3>😊 Virtual Character</h3> <p> <img src="https://img.shields.io/badge/In_Progress-28a745?style=flat" /> </p> <p>The real-time generated <b>virtual character</b> that visually represents the Avatar during interactions.</p> <p> <a href="https://github.com/AlphaAvatar/AlphaAvatar/blob/main/avatar-plugins/avatar-plugins-character/README.md">README↗</a> </p> </td> </tr> </table>

<h2>Tools Plugins</h2>

<table> <tr> <td width="50%"> <h3>🔍 DeepResearch</h3> <p> <img src="https://img.shields.io/badge/In_Progress-28a745?style=flat" /> </p> <p>Allow AlphaAvatar to <strong>access the network</strong> and perform single-step/multi-step inference through a separate Agent service to search for more accurate content.</p> <p> <a href="https://github.com/AlphaAvatar/AlphaAvatar/blob/main/avatar-plugins/avatar-plugins-deepresearch/README.md">README↗</a> </p> </td> <td width="50%"> <h3>📖 RAG</h3> <p> <img src="https://img.shields.io/badge/In_Progress-28a745?style=flat" /> </p> <p>Allow AlphaAvatar to access <strong>Documents/Skills</strong> (user-uploaded/generated by the Reflection module/URL access) to obtain document-related information.</p> <p> <a href="https://github.com/AlphaAvatar/AlphaAvatar/blob/main/avatar-plugins/avatar-plugins-rag/README.md">README↗</a> </p> </td> </tr>

<tr> <td width="50%"> <h3>🧰 MCP</h3> <p> <img src="https://img.shields.io/badge/In_Progress-28a745?style=flat" /> </p> <p>Allows AlphaAvatar to discover and call real-world external tools such as databases, email, calendars, APIs, and productivity apps.</p> <p> <a href="https://github.com/AlphaAvatar/AlphaAvatar/blob/main/avatar-plugins/avatar-plugins-mcp/README.md">README↗</a> </p> </td> <td width="50%"> <h3>🌍 Sandbox</h3> <p> <img src="https://img.shields.io/badge/Planned-6c757d?style=flat" alt="Planned" /> </p> <p>Provide AlphaAvatar with a sandbox environment to interact with the <strong>external world or with other agents</strong>, thereby enabling multi-agent interaction and exploration.</p> <p> <a href="#">README↗</a> </p> </td> </tr> </table>

<h2>Latest News 🔥</h2>

[2026/06] Released AlphaAvatar version 0.6.0: Added the Status plugin, sampled visual input support, and status-aware DeepResearch / RAG / MCP tool feedback.
Released AlphaAvatar version 0.6.1: Added visual identity support for Persona, including face detection, face vector matching, speaker-face identity fusion, and several bug fixes.
Released AlphaAvatar version 0.6.2: introduced the unified provider layer, nested configuration, provider tracing, and a cleaner session/runtime foundation for future multi-user multimodal memory.

[2026/05] Released AlphaAvatar version 0.5.4:
Added LanceDB-backed MCP tool retrieval, enabling AlphaAvatar to semantically search relevant MCP tools from Agent queries.
Refactored system prompt and runtime prompt composition, improved Persona runtime state tracking, added temporary-user to real-user identity merging, and improved RAG runtime behavior.
Released AlphaAvatar version 0.5.5: Fixed the inference runner registration lifecycle for production start mode, ensuring plugins runners are registered after config parsing and before LiveKit creates the inference executor.

[2026/04] Released AlphaAvatar version 0.5.3:
Added localized Markdown backup for the Memory plugin.
Added LanceDB as the default local VDB option when Qdrant credentials are not provided.

[2026/03] Released AlphaAvatar version 0.5.0:
Added the MCP plugin, enabling retrieval and concurrent invocation of MCP tools.
Released AlphaAvatar version 0.5.1: Added WhatsApp channel support via Baileys.
Released AlphaAvatar version 0.5.2: Added the AlphaAvatar Voice plugin with Voice.ai TTS support.

[2026/02] Released AlphaAvatar version 0.4.0:
Added RAG support through RAG-Anything.
Optimized the Memory and DeepResearch modules.
Released AlphaAvatar version 0.4.1: Fixed Persona plugin bugs and added a new MCP plugin.

[2026/01] Released AlphaAvatar version 0.3.0:
Added DeepResearch support through the Tavily API.
Released AlphaAvatar version 0.3.1: Added tool-call memory extraction during user–assistant interactions.

<details> <summary>2025 Release History</summary>

[2025/12] Released AlphaAvatar version 0.2.0:
Added AIRI Live2D-based virtual character display.

[2025/11] Released AlphaAvatar version 0.1.0:
Added automatic memory extraction.
Added automatic user persona extraction and matching.

</details>

<br/>

<h2>Installation ⚙️</h2>

Install stable AlphaAvatar version from PyPI:

uv venv .my-env --python 3.11
source .my-env/bin/activate
pip install alpha-avatar-agents

Install latest AlphaAvatar version from GitHub:

git clone --recurse-submodules https://github.com/AlphaAvatar/AlphaAvatar.git
cd AlphaAvatar

uv venv .venv --python 3.11
source .venv/bin/activate
uv sync --all-packages

<h2>Quick Start ⚡️</h2>

Start your agent in dev mode to connect it to LiveKit and make it available from anywhere on the internet.

🧩 Step 1. Configure Environment Variables

cd AlphaAvatar

# Copy template
cp .env.template .env.dev

Edit .env.dev and set required environment variables.

📦 Step 2. Download Required Files

alphaavatar download-files

✅ Step 3. Run the Agent

ENV_FILE=.env.dev alphaavatar dev examples/agent_configs/voice/pipeline_openai_tools.yaml
# or
ENV_FILE=.env.dev alphaavatar dev examples/agent_configs/mm/pipeline_openai_tools.yaml

To see more supported modes, please refer to the LiveKit doc.

To see more examples, please refer to the Examples README

<h2>Usage 🚀</h2>

AlphaAvatar supports multiple Access Channels, allowing different types of users — from end users to developers — to interact with the system.

<h3>🌐 Web Access</h3>

AlphaAvatar now provides a browser-based realtime demo interface built on LiveKit.

👉 Try the Web Demo: https://www.alphaavatar.ai/demo

The Web Demo supports:

🎙️ Real-time voice interaction
💬 Text chat with the Avatar
📷 Camera preview and video-ready interaction
🔊 Agent audio playback
😊 Virtual character / avatar stage
🧠 Full plugin support, including Memory, Persona, RAG, MCP, and DeepResearch
🌍 Browser timezone metadata, enabling AlphaAvatar to understand local login time

The Web Demo is the recommended way to try AlphaAvatar with a full realtime multimodal experience.

<h3>💬 Social & Messaging Platforms</h3>

Interact with AlphaAvatar directly inside messaging platforms.

Capabilities:

💬 Text-based conversation
🎤 Voice message interaction
🧰 Tool invocation via chat interface

<h4>WhatsApp</h4>

📦 Channel introduction: README

▶️ Start WhatsApp Channel

Make sure AlphaAvatar Agent is already running (see Quick Start above).

ENV_FILE=.env.dev sh examples/channels/start_whatsapp.sh

💡 The WhatsApp channel runs as an independent bridge process and connects to the Agent runtime.

<h4>WeChat</h4>

<h4>Slack</h4>

<h3>📲 Native Mobile App</h3>

A dedicated AlphaAvatar mobile application providing:

🎙️ Real-time voice communication
😊 Live2D / Virtual character visualization
🧠 Persistent memory & persona

<h3>🧪 Developer Playground</h3>

Developers can immediately access AlphaAvatar via the LiveKit Playground.

👉 https://agents-playground.livekit.io/

After starting your AlphaAvatar server:

Connect to your LiveKit instance
Configure the Agent name in the Playground (must match avatar_name, default: Assistant) to enable Explicit Dispatch.
Connect to the agent room
Start testing real-time interaction

Supported capabilities:

🎙️ Voice interaction
🧠 Memory extraction
🔍 RAG retrieval
🧰 MCP tool invocation
😊 Virtual character display

playground airi screenshot

💡 AlphaAvatar is currently developer-first, with a Web Demo available for realtime interaction.

More user-facing web and mobile experiences are under active development.

Alphaavatar— agent skill

Is Alphaavatar safe to install?

Audit the pieces. Scan the whole. Decide.