63 Commits

Author SHA1 Message Date
4b33b40637 Lots of tweaks; in progress is_bot => bot_instance_id 2025-09-04 20:45:09 -07:00
71555c5230 Lots of tweaks 2025-09-04 19:36:57 -07:00
36548171d6 Fixed status_check 2025-09-04 18:33:01 -07:00
095cca785d Improving bot configability 2025-09-04 18:27:57 -07:00
15641aa542 Improved bot capabilities 2025-09-04 17:53:26 -07:00
3a0d54ce0f Monitoring implemented 2025-09-04 17:37:04 -07:00
00d86254a6 Error handling improvements 2025-09-04 17:14:44 -07:00
2ff25e43b6 WebRTC refactored 2025-09-04 17:01:48 -07:00
6b47704723 WebRTC now working 2025-09-04 16:54:38 -07:00
728293ea2e Refactoring working 2025-09-04 16:28:52 -07:00
66c2d2e524 Fix runtime imports 2025-09-04 16:23:42 -07:00
b5d2605d99 Starting phase 2 2025-09-04 16:12:07 -07:00
65c1954db5 Getting working again 2025-09-04 16:02:20 -07:00
8f8cfa7039 Midflight refactoring 2025-09-04 15:50:33 -07:00
cc9a7caa78 Fix linting errors 2025-09-04 14:34:22 -07:00
6857dd66fa Whisper streaming in works 2025-09-03 19:42:13 -07:00
2a2aa5a6c3 Fixing reload and other issues 2025-09-03 18:21:11 -07:00
bd5e5e4d8f Fixed WebSocket message validation by ensuring all messages include data field
- Updated server to send status_ok messages with data field instead of direct timestamp
- Modified voicebot _send_message to always include data field (empty dict if no data)
- Fixed all error message formats in server to use proper {type, data: {error}} structure
- Updated client join message to include empty data field for consistency
- All WebSocket messages now comply with WebSocketMessageModel requiring data field
- Resolved Pydantic validation errors for status_ok and error messages
2025-09-03 18:14:59 -07:00
a3b9e7fa39 Fixed blocking ice gathering 2025-09-03 18:06:02 -07:00
dd8efe4a02 Fixed all linting errors 2025-09-03 17:39:34 -07:00
eb12d95bc5 Race conditions 2025-09-03 17:33:52 -07:00
25b14d7928 Working better 2025-09-03 17:16:51 -07:00
7042a76d19 Refactoring 2025-09-03 17:04:31 -07:00
9ce3d1b670 Implement comprehensive chat integration for voicebot system
Features added:
- WebSocket chat message handling in WebRTC signaling client
- Bot chat handler discovery and automatic setup
- Chat message sending/receiving capabilities
- Example chatbot with conversation features
- Enhanced whisper bot with chat commands
- Comprehensive error handling and logging
- Full integration with existing WebRTC infrastructure

Bots can now:
- Receive chat messages from lobby participants
- Send responses back through WebSocket
- Process commands and keywords
- Integrate seamlessly with voice/video functionality

Files modified:
- voicebot/webrtc_signaling.py: Added chat message handling
- voicebot/bot_orchestrator.py: Enhanced bot discovery for chat
- voicebot/bots/whisper.py: Added chat command processing
- voicebot/bots/chatbot.py: New conversational bot
- voicebot/bots/__init__.py: Added chatbot module
- CHAT_INTEGRATION.md: Comprehensive documentation
- README.md: Updated with chat functionality info
2025-09-03 16:28:32 -07:00
1bd0a5ab71 Improv leave / part for bots 2025-09-03 16:07:55 -07:00
8ef309d4f1 Bots can now leave 2025-09-03 16:05:51 -07:00
b5614b9d99 Bots now join on demand 2025-09-03 15:51:47 -07:00
b916db243b Refactored voicebot/main.py 2025-09-03 14:33:15 -07:00
2e91a4eadb Add server reconnect logic 2025-09-03 14:10:47 -07:00
39666eddbe Almost working 2025-09-03 14:04:25 -07:00
d940c2cbef Type generation 2025-09-03 13:54:29 -07:00
3a72f6097e Cleaning up 2025-09-03 13:31:09 -07:00
b7e5963597 Lots of changes/refactorings 2025-09-03 13:11:18 -07:00
3674d57b0a Adding orchestration 2025-09-03 11:51:18 -07:00
93025d22fc About to restructure voicebot to support dynamic agent loading 2025-09-03 11:19:59 -07:00
1ba48bdc79 Adding whisper 2025-09-02 14:47:31 -07:00
1e30df046c Fix login issue 2025-09-01 20:34:01 -07:00
bb74d0bc9d Reduce volume
Signed-off-by: James Ketrenos <james_git@ketrenos.com>
2025-09-01 20:33:56 -07:00
2ad9871ea4 Added session cleanup 2025-09-01 20:09:49 -07:00
a292b14028 Added chat 2025-09-01 20:00:42 -07:00
d69037ff41 Messing with audio 2025-09-01 19:43:03 -07:00
bf46a45f89 Messing with audio 2025-09-01 19:32:57 -07:00
fb0ce3f203 Added more effects to test things out. 2025-09-01 18:55:35 -07:00
35dd49e4ac Added bouncing 2025-09-01 16:16:59 -07:00
e64edf92ca Reload working 2025-09-01 15:59:16 -07:00
a313209768 Refactored to use shared/models 2025-09-01 15:20:21 -07:00
7c5616fbd9 Refactoring synthetic audio/video to its own file 2025-09-01 15:13:28 -07:00
2910789c86 Auto-reconnect on server loss 2025-09-01 15:08:52 -07:00
450357db79 Moved aioice monkeypatch into a separate file for debug usage 2025-09-01 15:06:17 -07:00
fd58ee2a91 Fix watch directories
Signed-off-by: James Ketrenos <james_git@ketrenos.com>
2025-09-01 15:05:25 -07:00