20 Commits

Author SHA1 Message Date
8caef2c3de Minimal bot 2025-09-16 14:32:29 -07:00
110430d22a Improved transcription to current message 2025-09-14 15:48:17 -07:00
eb5416c4f0 Working on whisper 2025-09-13 18:53:13 -07:00
afdf856f2b Maybe working? 2025-09-08 16:03:53 -07:00
08f2583ebc Mid way 2025-09-08 13:02:57 -07:00
1074eb48dc Fix WebRTC connection for receive-only bots (whisper bot)
- Add receive-only transceivers for bots with no local media tracks
- Resolves ICE gathering timeout issues for whisper bot
- Enables proper SDP negotiation for audio/video reception
- Whisper bot can now establish WebRTC connections successfully

The whisper bot is receive-only (transcribes audio, doesn't send media)
but WebRTC negotiation failed without proper transceivers. This fix
automatically adds recvonly audio/video transceivers when a bot has
no local tracks, allowing proper connection establishment.
2025-09-07 22:18:52 -07:00
795e9b1d67 Snapshot 2025-09-07 21:56:08 -07:00
9089edaeea Multi-user transcription 2025-09-05 16:50:19 -07:00
215926de88 Fix status_response handling 2025-09-05 12:28:55 -07:00
4d218864d8 Fixed WebRTC in bots 2025-09-05 12:00:00 -07:00
6857dd66fa Whisper streaming in works 2025-09-03 19:42:13 -07:00
2a2aa5a6c3 Fixing reload and other issues 2025-09-03 18:21:11 -07:00
bd5e5e4d8f Fixed WebSocket message validation by ensuring all messages include data field
- Updated server to send status_ok messages with data field instead of direct timestamp
- Modified voicebot _send_message to always include data field (empty dict if no data)
- Fixed all error message formats in server to use proper {type, data: {error}} structure
- Updated client join message to include empty data field for consistency
- All WebSocket messages now comply with WebSocketMessageModel requiring data field
- Resolved Pydantic validation errors for status_ok and error messages
2025-09-03 18:14:59 -07:00
a3b9e7fa39 Fixed blocking ice gathering 2025-09-03 18:06:02 -07:00
eb12d95bc5 Race conditions 2025-09-03 17:33:52 -07:00
9ce3d1b670 Implement comprehensive chat integration for voicebot system
Features added:
- WebSocket chat message handling in WebRTC signaling client
- Bot chat handler discovery and automatic setup
- Chat message sending/receiving capabilities
- Example chatbot with conversation features
- Enhanced whisper bot with chat commands
- Comprehensive error handling and logging
- Full integration with existing WebRTC infrastructure

Bots can now:
- Receive chat messages from lobby participants
- Send responses back through WebSocket
- Process commands and keywords
- Integrate seamlessly with voice/video functionality

Files modified:
- voicebot/webrtc_signaling.py: Added chat message handling
- voicebot/bot_orchestrator.py: Enhanced bot discovery for chat
- voicebot/bots/whisper.py: Added chat command processing
- voicebot/bots/chatbot.py: New conversational bot
- voicebot/bots/__init__.py: Added chatbot module
- CHAT_INTEGRATION.md: Comprehensive documentation
- README.md: Updated with chat functionality info
2025-09-03 16:28:32 -07:00
1bd0a5ab71 Improv leave / part for bots 2025-09-03 16:07:55 -07:00
8ef309d4f1 Bots can now leave 2025-09-03 16:05:51 -07:00
b5614b9d99 Bots now join on demand 2025-09-03 15:51:47 -07:00
b916db243b Refactored voicebot/main.py 2025-09-03 14:33:15 -07:00