6857dd66fa
Whisper streaming in works
2025-09-03 19:42:13 -07:00
2a2aa5a6c3
Fixing reload and other issues
2025-09-03 18:21:11 -07:00
bd5e5e4d8f
Fixed WebSocket message validation by ensuring all messages include data field
...
- Updated server to send status_ok messages with data field instead of direct timestamp
- Modified voicebot _send_message to always include data field (empty dict if no data)
- Fixed all error message formats in server to use proper {type, data: {error}} structure
- Updated client join message to include empty data field for consistency
- All WebSocket messages now comply with WebSocketMessageModel requiring data field
- Resolved Pydantic validation errors for status_ok and error messages
2025-09-03 18:14:59 -07:00
a3b9e7fa39
Fixed blocking ice gathering
2025-09-03 18:06:02 -07:00
eb12d95bc5
Race conditions
2025-09-03 17:33:52 -07:00
7042a76d19
Refactoring
2025-09-03 17:04:31 -07:00
9ce3d1b670
Implement comprehensive chat integration for voicebot system
...
Features added:
- WebSocket chat message handling in WebRTC signaling client
- Bot chat handler discovery and automatic setup
- Chat message sending/receiving capabilities
- Example chatbot with conversation features
- Enhanced whisper bot with chat commands
- Comprehensive error handling and logging
- Full integration with existing WebRTC infrastructure
Bots can now:
- Receive chat messages from lobby participants
- Send responses back through WebSocket
- Process commands and keywords
- Integrate seamlessly with voice/video functionality
Files modified:
- voicebot/webrtc_signaling.py: Added chat message handling
- voicebot/bot_orchestrator.py: Enhanced bot discovery for chat
- voicebot/bots/whisper.py: Added chat command processing
- voicebot/bots/chatbot.py: New conversational bot
- voicebot/bots/__init__.py: Added chatbot module
- CHAT_INTEGRATION.md: Comprehensive documentation
- README.md: Updated with chat functionality info
2025-09-03 16:28:32 -07:00
1bd0a5ab71
Improv leave / part for bots
2025-09-03 16:07:55 -07:00
8ef309d4f1
Bots can now leave
2025-09-03 16:05:51 -07:00
b5614b9d99
Bots now join on demand
2025-09-03 15:51:47 -07:00
b916db243b
Refactored voicebot/main.py
2025-09-03 14:33:15 -07:00
2e91a4eadb
Add server reconnect logic
2025-09-03 14:10:47 -07:00
b7e5963597
Lots of changes/refactorings
2025-09-03 13:11:18 -07:00
3674d57b0a
Adding orchestration
2025-09-03 11:51:18 -07:00
93025d22fc
About to restructure voicebot to support dynamic agent loading
2025-09-03 11:19:59 -07:00
1ba48bdc79
Adding whisper
2025-09-02 14:47:31 -07:00
bb74d0bc9d
Reduce volume
...
Signed-off-by: James Ketrenos <james_git@ketrenos.com>
2025-09-01 20:33:56 -07:00
d69037ff41
Messing with audio
2025-09-01 19:43:03 -07:00
bf46a45f89
Messing with audio
2025-09-01 19:32:57 -07:00
fb0ce3f203
Added more effects to test things out.
2025-09-01 18:55:35 -07:00
35dd49e4ac
Added bouncing
2025-09-01 16:16:59 -07:00
e64edf92ca
Reload working
2025-09-01 15:59:16 -07:00
a313209768
Refactored to use shared/models
2025-09-01 15:20:21 -07:00
7c5616fbd9
Refactoring synthetic audio/video to its own file
2025-09-01 15:13:28 -07:00
450357db79
Moved aioice monkeypatch into a separate file for debug usage
2025-09-01 15:06:17 -07:00
fd58ee2a91
Fix watch directories
...
Signed-off-by: James Ketrenos <james_git@ketrenos.com>
2025-09-01 15:05:25 -07:00
75b0417ad3
Fix s16 assertion (media was being provided as flt)
...
Signed-off-by: James Ketrenos <james_git@ketrenos.com>
2025-09-01 15:05:05 -07:00
ba6aa697a4
Type conversion completed
2025-09-01 14:48:37 -07:00
3cb49c70ef
Pydantic -> Typescript conversion work
2025-09-01 14:29:49 -07:00
2908fe1ee7
Refactor: Create shared Pydantic models for API communication
...
- Created shared/models.py with all common Pydantic models
- Updated voicebot/main.py to use shared models and remove dd.get() calls
- Updated server/main.py to use shared models
- Fixed lobby_state message handling with proper validation
- Updated Dockerfiles to include shared/ directory
- Added comprehensive documentation and migration guide
Benefits:
- Type safety across both components
- Consistent data validation
- Eliminated unsafe dictionary access patterns
- Centralized model definitions for easier maintenance
2025-09-01 13:36:24 -07:00
d4fdd917d1
Fixed pydantic models
2025-09-01 13:24:09 -07:00
282c0ffa9c
Worked once
2025-09-01 13:18:17 -07:00
c2c7bcf650
Initial AI agent scaffolding
2025-08-30 12:23:59 -07:00
