Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

user_transcript missed in opening ~5 seconds #652

Open
patricktargun opened this issue Jan 23, 2025 · 0 comments
Open

user_transcript missed in opening ~5 seconds #652

patricktargun opened this issue Jan 23, 2025 · 0 comments

Comments

@patricktargun
Copy link

patricktargun commented Jan 23, 2025

I'm establishing a WebSocket connection to the ElevenLabs Conversational AI endpoint, sending Twilio audio in real time (user_audio_chunk in base64). The agent_response come through almost immediately, but within the first 5-10 seconds the user_transcript is consistently missed. After that, transcripts arrive as expected.

It was working great last week, and I haven't made any changes to my code.

I then converted audio format to PCM 8000 Hz to "Test AI agent" on the ElevenLabs dashboard, and it is having the same issue. First ~5 seconds is ignored.

Finally, I went to the API Reference and started a chat with ElevenLabs "Need help?" assistant widget, and had the same issue there.

Is anyone else experiencing this delay?

Logs:

2025-01-22 14:54:44.846 [INFO] [Twilio] Twilio connected to media stream.
2025-01-22 14:54:45.698 [INFO] [11Labs] Connection fully established and ready for audio
2025-01-22 14:54:45.872 [INFO] [11Labs] Received agent response
// MISSING FIRST USER TRANSCRIPT HERE
// BUT GET THE NEXT ONE 12 SECONDS LATER
2025-01-22 14:54:58.053 [INFO] [11Labs] Received user transcript
2025-01-22 14:54:58.212 [INFO] [11Labs] Received agent response
2025-01-22 14:55:02.855 [INFO] [11Labs] Disconnected from Conversational AI.
2025-01-22 14:55:03.828 [INFO] [Twilio] Client disconnected.
@patricktargun patricktargun changed the title First user transcript delayed by ~5 seconds using real-time WebSocket API user_transcript missed in opening ~5 seconds with WebSocket API Jan 23, 2025
@patricktargun patricktargun reopened this Jan 23, 2025
@patricktargun patricktargun changed the title user_transcript missed in opening ~5 seconds with WebSocket API user_transcript missed in opening ~5 seconds Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant