Yi-Ting Chiu

This is a substantial update, packed with major features including Letta-based long-term memory, MCP support, Live2D Cubism 5 support, Chinese support for the frontend, an improved update system, a Bilibili Danmaku client, and numerous bug fixes.

First, we'd like to apologize for the extended release cycle. We will do our best to avoid such long intervals between updates in the future.

Additionally, please note a licensing change for the project's frontend (the Open-LLM-VTuber-Web repository, which powers the built-in web and Electron clients). Effective with this release (v1.2.0), the frontend will transition from unspecified license (all rights reserved) to the Open-LLM-VTuber License 1.0.

The backend will remain under the MIT License for v1.2.0 but is expected to be unified under the Open-LLM-VTuber License 1.0 around v1.3 or v1.4. We are still discussing the specifics and will provide a clear announcement in the GitHub Release when the change occurs. Please be aware that Live2D models have their own licenses, which you should check separately.

⚠️ Notice: Potential Breaking Changes​

In this version, we have refactored the Live2D implementation to add support for Live2D 5.0 models and fix display issues with many existing models. As part of this change, support for Live2D 2.1 models has been removed. While this should increase compatibility with modern models, if you encounter any issues with your Live2D model not displaying after updating, please let us know and consider rolling back to the previous version.

✨ Highlights​

• (MCP) The AI can now call tools that support the Model-Context Protocol (MCP). Built-in support is included for time and ddg-search. The frontend now displays the status of tool calls. (See the Appendix for a demo).
• (MCP) Added support for BrowserBase's Browser Use MCP with a Live View in the frontend.
• (Live2D) The frontend Live2D SDK has been migrated from pixi-live2d-display-lipsync to the official Live2D Web SDK. This adds support for Cubism 5 but removes support for Cubism 2. Models now have improved feedback on click interactions.
• The default Live2D model has been changed to mao_pro, as the expressions for the shizuku model were removed by the official creators in the Live2D 5 version.
• (Frontend) Added Chinese language support.
• Implemented an interface for live streaming platforms and added a client for receiving Bilibili Danmaku (live comments).
• (Memory) Implemented Letta-based long-term memory.
• (LLM) Added support for LM Studio.
• (TTS) Added support for OpenAI-Compatible TTS, SparkTTS, and SiliconFlow TTS.
• Added a requirements.txt file for users who are not familiar with pip commands or prefer not to use uv.
• Numerous bug fixes.
• Updated the documentation, which now includes an "Ask AI" feature.

What's Changed​

Major Features​

• Implemented group chat functionality (@ylxmf2005)
• Added Silero-VAD voice activity detection (@AnyaCoder)
• Added CosyVoice2 text-to-speech support (@Warma10032)
• Added frontend ASR/TTS tools accessible at http://localhost:web-tool
  • Users can now directly use the project's speech recognition and text-to-speech engines
• Introduced one-click CUDA-ready setup using pixi (@mokurin000)
• Improved configuration management and update mechanism:
  • conf.yaml is no longer tracked in git
  • New config template system for generating and updating conf.yaml during upgrades

This release marks a significant milestone for Open-LLM-VTuber, featuring a complete rewrite of the backend and frontend with over 240+ new commits, along with numerous enhancements and new features. If you were using a version before this, version v1.0.0 is basically a new app.

⚠️ Direct upgrades from older versions are impossible due to architectural changes. Please refer to our new documentation site for installation.

(v1.0.0 had a bug after the release, so let's just ignore that and have the v1.0.1)