Skip to content
This repository has been archived by the owner on Nov 1, 2024. It is now read-only.

Forward Audio -> Transcribe With Whisper -> Create Tasks #27

Open
0x4007 opened this issue Sep 21, 2023 · 11 comments
Open

Forward Audio -> Transcribe With Whisper -> Create Tasks #27

0x4007 opened this issue Sep 21, 2023 · 11 comments

Comments

@0x4007
Copy link
Member

0x4007 commented Sep 21, 2023

  • Telegram allows group voice/video calls to be recorded.
  • When the call is finished, Telegram saves the recording in "saved messages"
  • It is VERY fast to forward that content to the bot.
  • The bot should automatically create a transcription using the OpenAI Whisper API.
  • Once the transcription is complete, the bot should interpret the transcript in a similar way to how it currently parses Telegram group chat messages, and create separate tasks.
  • We should be able to set a special "meetings" repository (configurable) that the bot will automatically file all the issues to.

Remarks

  1. Technically this means that if you send a direct voice message to the bot, it should do the same thing.
  2. In the future, we can experiment with confirming the repository that the user wants to file the issues to right after they forward the media. That way, if the call was related to research or business-development then we can file them all in the correct repo.
  3. Whisper can not tell the difference between each speaker, but I've seen open source projects that do handle this. It would be interesting to identify the speaker when creating the issue.
  4. When the issue is posted, it would be epic to trim and post the audio (and its transcription) as the issue description.

Tooling

Use diarization https://twitter.com/reach_vb/status/1729251580371689821

@0x4007
Copy link
Member Author

0x4007 commented Dec 21, 2023

/start

Copy link

ubiquibot bot commented Dec 21, 2023

Warning! This task was created over 91 days ago. Please confirm that this issue specification is accurate before starting.
DeadlineFri, Dec 22, 12:37 PM UTC
Registered Wallet 0x4007CE2083c7F3E18097aeB3A39bb8eC149a341d
Tips:
  • Use /wallet 0x0000...0000 if you want to update your registered payment wallet address.
  • Be sure to open a draft pull request as soon as possible to communicate updates on your progress.
  • Be sure to provide timely updates to us when requested, or you will be automatically unassigned from the task.

@0x4007
Copy link
Member Author

0x4007 commented Dec 21, 2023

/wallet ubq.eth

Copy link

ubiquibot bot commented Dec 21, 2023

+ Successfully registered wallet address

@0x4007
Copy link
Member Author

0x4007 commented Dec 21, 2023

/query @pavlovcik

Copy link

ubiquibot bot commented Dec 21, 2023

Property Value
Wallet 0xefC0e701A824943b469a694aC564Aa1efF7Ab7dd

@0x4007
Copy link
Member Author

0x4007 commented Dec 21, 2023

/wallet pavlovcik.eth

Copy link

ubiquibot bot commented Dec 21, 2023

+ Successfully registered wallet address

@0x4007
Copy link
Member Author

0x4007 commented Dec 21, 2023

this is a test comment about apples

@0x4007 0x4007 closed this as completed Dec 21, 2023
Copy link

ubiquibot bot commented Dec 21, 2023

! action has an uncaught error

@0x4007 0x4007 reopened this Dec 22, 2023
@PhantomCracker
Copy link
Contributor

@seprintour can you please help on connecting to the bot? I see that you are making the configurations file but I have some issues with that.
I receive the following error message when I am running key setup:
Screenshot 2024-01-16 at 14 01 56

Or do you think that you can help @pavlovcik ?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants