GitHub

RealChar - Your Realtime AI Character

What is the project about?

RealChar is a project that allows users to create, customize, and interact with AI characters in real-time. It enables voice and text conversations with these AI personalities.

What problem does it solve?

It provides a platform for engaging, real-time interactions with AI, moving beyond static chatbots to dynamic, customizable characters. It bridges the gap between humans and AI, offering a more personalized and immersive conversational experience.

What are the features of the project?

  • Easy to use: Creation of AI characters without requiring coding.
  • Customizable: Adjustable character personalities, backgrounds, and voices.
  • Realtime: Supports real-time conversations (voice and text).
  • Multi-Platform: Accessible via web, terminal, and mobile (iOS app open-sourced).
  • Most up-to-date AI: Integrates with leading AI technologies (OpenAI, Anthropic Claude 2, Chroma, Whisper, ElevenLabs, etc.).
  • Modular: Allows swapping of different modules for customized interaction flows.

What are the technologies used in the project?

  • Web: React JS, Vanilla JS, WebSockets
  • Mobile: Swift, WebSockets
  • Backend: FastAPI, SQLite, Docker
  • Data Ingestion: LlamaIndex, Chroma
  • LLM Orchestration: LangChain, Chroma
  • LLMs: ReByte, OpenAI GPT-3.5/4, Anthropic Claude 2, Anyscale Llama2
  • Speech to Text: Local WhisperX, Local Whisper, OpenAI Whisper API, Google Speech to Text
  • Text to Speech: ElevenLabs, Edge TTS, Google Text to Speech
  • Voice Cloning: ElevenLabs

What are the benefits of the project?

  • Provides a more engaging and personalized way to interact with AI.
  • Offers a flexible and customizable platform for creating unique AI companions.
  • Leverages cutting-edge AI technologies for high-quality interactions.
  • Supports multiple platforms, making it widely accessible.
  • Open-source nature encourages community contributions and extensions.
  • Good starting point for learning AI Engineering.

What are the use cases of the project?

  • Creating AI companions for entertainment or personal use.
  • Developing interactive AI characters for games or virtual worlds.
  • Building AI-powered customer service agents with distinct personalities.
  • Prototyping and experimenting with conversational AI interfaces.
  • Educational tool for learning about and interacting with AI.
  • Role-playing with AI characters.
RealChar screenshot