Customer Support Voice Agent

🎓 FREE Step-by-Step Tutorial

👉 Click here to follow our complete step-by-step tutorial and learn how to build this from scratch with detailed code walkthroughs, explanations, and best practices.

An OpenAI SDK powered customer support agent application that delivers voice-powered responses to questions about your knowledge base using OpenAI's GPT-4o and TTS capabilities. The system crawls through documentation websites with Firecrawl, processes the content into a searchable knowledge base with Qdrant, and provides both text and voice responses to user queries.

Features

• Knowledge Base Creation

• Crawls documentation websites using Firecrawl
• Stores and indexes content using Qdrant vector database
• Generates embeddings for semantic search capabilities using FastEmbed
• AI Agent Team
• Documentation Processor: Analyzes documentation content and generates clear, concise responses to user queries
• TTS Agent: Converts text responses into natural-sounding speech with appropriate pacing and emphasis
• Voice Customization: Supports multiple OpenAI TTS voices:
• alloy, ash, ballad, coral, echo, fable, onyx, nova, sage, shimmer, verse

• Interactive Interface
• Clean Streamlit UI with sidebar configuration
• Real-time documentation search and response generation
• Built-in audio player with download capability
• Progress indicators for system initialization and query processing

How to Run

1. Setup Environment

# Clone the repository
git clone https://github.com/Shubhamsaboo/awesome-llm-apps.git
cd awesome-llm-apps/voice_ai_agents/customer_support_voice_agent

# Install dependencies
pip install -r requirements.txt

2. Configure API Keys

• Get OpenAI API key from OpenAI Platform
• Get Qdrant API key and URL from Qdrant Cloud
• Get Firecrawl API key for documentation crawling

3. Run the Application

streamlit run customer_support_voice_agent.py

4. Use the Interface

• Enter API credentials in the sidebar
• Input the documentation URL you want to learn about
• Select your preferred voice from the dropdown
• Click "Initialize System" to process the documentation
• Ask questions and receive both text and voice responses

Features in Detail

• Knowledge Base Creation
• Builds a searchable knowledge base from your documentation
• Preserves document structure and metadata
• Supports multiple page crawling (limited to 5 pages per default configuration)

• Vector Search
• Uses FastEmbed for generating embeddings
• Semantic search capabilities for finding relevant content
• Efficient document retrieval using Qdrant

• Voice Generation
• High-quality text-to-speech using OpenAI's TTS models
• Multiple voice options for customization
• Natural speech patterns with proper pacing and emphasis