Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OBS is crashing when attempting to create LocalVocal filter on MacBook Pro M1 #67

Closed
chadwpry opened this issue Feb 11, 2024 · 18 comments
Closed

Comments

@chadwpry
Copy link

This is my first time useing the Local Vocal plugin and have not yet seen it work correctly. I'll describe my process and a crash report in hopes that may help provide clarity.

Steps to create issue:

  1. Found release of obs-localvocal on github releases page. Used version 0.1.0 macos-universal.pkg
  2. Installed package with default installer settings
  3. Open OBS
  4. Create new scene for testing
  5. Create new Audio Input Capture within new scene with MacBook Pro Microphone as the device (not system default) -- attempted to use default device as well later as a test, no difference
  6. Select Audio Input from Sources
  7. Open filters -- note: no audio filter are setup
  8. Add LocalVocal Transcription
  9. Provide default name for filter
  10. Click ok to the dialog
  11. OBS crashes

local-vocal-crash-report.txt

@chadwpry chadwpry changed the title OBS is crashing when attempting to create LocalVocal filter OBS is crashing when attempting to create LocalVocal filter on MacBook Pro M1 Feb 11, 2024
@chadwpry
Copy link
Author

Just a note. I would have added the crash report inline, but the size was larger than allowable.

@royshil
Copy link
Collaborator

royshil commented Feb 11, 2024

Seems to fail when trying to load the model and init ggml.. strange.
I'm unable to try it on my hardware because I have an old Intel Mac.
Try to see the model files exist in the right location.
Although I doubt it is the reason it fails.
Again - hard for me to verify and debug.
You can reach out on Discord and let's see if anyone else with Apple Silicone Mac is running into problems.

@chadwpry
Copy link
Author

chadwpry commented Feb 12, 2024

Appreciate the response Roy!

Not sure if the plugin is the right tool for my usecase, so I may just hold off on continuing to troubleshoot. It seems like a push to talk mechanism, with a hotkey or streamdeck button, may work better at the operating system or another application level. I did however look into openai/whisper, whisper.cpp, and go-emotion for sentiment analysis. All of which are local installations which was perfect. Thank you for the pointer to openai/whisper and whisper.ccp in your README. Think I may just go down the route of attempting to control the microphone external of OBS at this point and interopt to the other tools

Would you like to keep the issue open? I can close the issue if it is preferred.

Cheers!

@CR0CKER
Copy link

CR0CKER commented Mar 20, 2024

I can confirm this. Crashes every time I'm trying clicking OK after the filter name dialogue. No workarounds so far.

Edit: Tried it on an intel Mac just now and it also crashed there.

@royshil
Copy link
Collaborator

royshil commented Mar 20, 2024

@CR0CKER can you provide logs please? from Intel and M1

@CR0CKER
Copy link

CR0CKER commented Mar 20, 2024

Thanks for the quick response, @royshil! Here are the logs. The Intel Mac seems to crash after briefly showing the config options, while the M1 crashes immediately after clicking OK in the filter naming dialogue.

Sounds like an amazing plugin, so I hope we can get it to work.

2024-03-20 13-53-29.txt
2024-03-20 13-30-24.txt

@royshil
Copy link
Collaborator

royshil commented Mar 20, 2024

@CR0CKER the Intel logs doesn't show LV trying to open the model, while the M1 does and apparently crashes on the model load part - which aligns with @chadwpry above
i'm hesitant to conclude that LV causes the crash on Intel during model loading since it doesn't log anything.
i've tested the plugin to work on Intel Mac machines.
can you verify the crash by removing the plugin and adding it again?

for the M1 it's hard for me to catch the bug since i don't have the machine to dev and test, i'll have to rely on you all for testing, e.g. from a PR with potential fix

@CR0CKER
Copy link

CR0CKER commented Mar 20, 2024

Thanks, @royshil -- I'll try getting it to work on the intel machine first. For the M1 fix, I'm happy to test any beta versions you have, but I'm not a developer so I can't help with coding.

@royshil
Copy link
Collaborator

royshil commented Mar 20, 2024

@CR0CKER can you plz try the artifacts from #76 e.g. https://github.com/occ-ai/obs-localvocal/actions/runs/8354294570?pr=76
download the macos version from there and install
lmk if it help in any way

@CR0CKER
Copy link

CR0CKER commented Mar 20, 2024

Thanks -- still crashing, unfortunately. I also tried reinstalling on the Intel Mac and it keps crashing. Other filters install fine, so I'm pretty certain the Intel crash is also caused by LocalVocal.

@royshil
Copy link
Collaborator

royshil commented Mar 20, 2024

im now going to build separately for M1 and x86
this will not only bring performance boost but also resolve the crash on arm64 for unsupported instructions.

@royshil
Copy link
Collaborator

royshil commented Mar 20, 2024

@chadwpry @CR0CKER are you able to try the M1 artifcats on https://github.com/occ-ai/obs-localvocal/actions/runs/8359597687 ?

@CR0CKER
Copy link

CR0CKER commented Mar 21, 2024

Thanks, @royshil -- I've tried it but after replacing the default installation file with the artifact you linked to (arm64), the plugin doesn't appear as an option in the filter dialogue in OBS. Odd.

@royshil
Copy link
Collaborator

royshil commented Mar 21, 2024

@CR0CKER Thanks for trying it
Can you upload your obs log please?

@CR0CKER
Copy link

CR0CKER commented Mar 22, 2024

Here you go, @royshil !
2024-03-21 09-34-24.txt

@royshil
Copy link
Collaborator

royshil commented Mar 22, 2024

@CR0CKER this is very strange
Your arm computer is looking for x86_64 binaries
This leads me to believe OBS is running on Rosetta 2 and emulating x86_64 rathe than native arm64

Will you be able to test the x86_64 version for Mac?

@CR0CKER
Copy link

CR0CKER commented Mar 27, 2024

@royshil you're right! I've reinstalled the Apple silicon version from the OBS website and it's working now with the artefacts you shared! Great.

@royshil
Copy link
Collaborator

royshil commented Mar 27, 2024

@CR0CKER I've released now an official version so you can use that instead of the artifact

Thanks for verifying

@royshil royshil closed this as completed Mar 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants