Realtime API

[riekusr]

Hi, is streaming API going to be supported?
These new voice realtime API will be great to create voice agents (in combination with twilio)
https://www.youtube.com/watch?v=AZ0WziqO_QA

[allanbunch]

@riekusr Absolutely. Excited to get the Realtime API implemented. I'm going to spend some time on this toward the end of the week. Stay tuned for an update.

[riekusr]

Awesome, can't wait!

[allanbunch]

I spent some time getting familiar with the Realtime API and I'm absolutely impressed. I'm torn as to whether it makes sense to drop a Realtime API method into my OpenAI API node. OpenAI's implementation with this is very different from their standard API--websockets, etc. And I found the flexibility of using standard Node-RED nodes for this very intriguing. Got me thinking about lots of innovative things we can do with this in Node-RED. Stay tuned while I give this some thought.

In the meantime, check out the demo Node-RED flow I created, putting the Realtime API into action inside of Node-RED! This version's a base implementation, though I did stub out a flow path for function call responses. Give the flow a run and let me know how it goes.