ChatdollKit

Visit Tool

ChatdollKit is an AI Agents & Automation tool that transforms 3D models into voice-enabled chatbots. It supports multiple LLMs, speech-to-text, text-to-speech, and advanced dialog control for interactive virtual assistants.

Claim this tool

No Views Yet

At a glance

Pricing

Open Source

Free tier

Yes

API

Yes

Skill level

Technical

About

What is ChatdollKit?

ChatdollKit is a 3D virtual assistant SDK designed to turn your 3D models into voice-enabled chatbots. It offers extensive features including native support for various Large Language Models (LLMs) like ChatGPT, Anthropic Claude, and Google Gemini Pro, complete with function calling and multimodal capabilities. The SDK provides sophisticated 3D model expression, synchronizing speech with motion, controlling facial expressions and animations, and supporting blinking and lip-sync. For dialog control, it integrates multiple Speech-to-Text and Text-to-Speech services, manages dialog states, extracts intents, and supports wakeword detection. ChatdollKit is highly versatile, compatible with Windows, Mac, Linux, iOS, Android, and other Unity-supported platforms, including VR, AR, and WebGL environments.

Best used for

Ideal for developers and content creators who need to build interactive 3D virtual assistants, integrate advanced LLMs, and manage complex dialog flows. Especially valuable for creating engaging, voice-enabled characters across various platforms including web, mobile, and VR/AR.

Common actions

create virtual assistants

integrate LLMs

control 3D models

manage dialog states

enable voice interaction

github copilot"AI Agents"face swappingautomated workflowdeepfakeopen-sourcecollaborationworkflowslow-code/no-code

Capabilities

Key features

Generative AI Native
3D model expression
Dialog control
Multi-platform compatibility
WebSocket Streaming STT
Barge-in Support
Dynamic Multi-Language

Target Audience

developercontent creator

Integrations

chatgptanthropic-claudegoogle-geminidifyopenaiazuregooglevoicevox+ 6 more

Pricing & Plans

Open Source

Free

FAQs

What LLMs does ChatdollKit support?

ChatdollKit natively supports multiple LLMs including ChatGPT, Anthropic Claude, Google Gemini Pro, and Dify. It also offers function calling for ChatGPT/Gemini and multimodal capabilities, allowing for flexible integration with various AI models.

Can I use ChatdollKit with my own 3D models?

Yes, ChatdollKit is designed to work with your own 3D models, particularly those in VRM format. It provides tools to synchronize speech and motion, control facial expressions, and manage animations to bring your character to life.

What platforms are compatible with ChatdollKit?

ChatdollKit is highly versatile and compatible with a wide range of platforms supported by Unity, including Windows, Mac, Linux, iOS, Android, VR, AR, and WebGL. This allows for broad deployment of your virtual assistants.

Trending

Subcategories trending in AI Agents & Automation

AI Frameworks & Infra Chatbots & Conversational AI General-Purpose Agents Workflow Agents Personal Assistants RAG & Document AI

Trending

Also listed in

This tool also appears in

Content & Design › 3D & Animation

Explore

Browse AI tools by category

Content & Design Productivity & Business Coding & Development AI Agents & Automation Research & Education Wellness & Lifestyle Career Development Marketing & Growth Data & Analytics Customer Support & CX Finance E-commerce