You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Following on the previous issue we now need to generate a nice mermaid chart to supplement the output summary to enhance the user's understanding of the summary.
We are building the chart in two steps:
Generating it.
Displaying it.
The problem is in generating it, check the generate_chart(transcript), it calls ChatGPT to generate it. The problem is that the result is not always accurate (tested on GPT-4) sometime it is a correct chart, sometimes it is not.
To test the chart, run the output on Mermaid's live editor.
Observation: GPT seems to work better with very short videos.
What needs to be done:
Prompting: Play with the prompt a bit to see if you can reach consistent working charts.
Different models: Test against different LLM models.
Finetuning: Can you get hands on a dataset that consists of blocks of texts and their equivalent mermaid charts? Then either provide us with this dataset or finetune any LLM model and share your code if the results are better than GPT.
The chart is then displayed via st_mermaid(mermaid_code), no issues with that.
The text was updated successfully, but these errors were encountered:
Following on the previous issue we now need to generate a nice mermaid chart to supplement the output summary to enhance the user's understanding of the summary.
We are building the chart in two steps:
The problem is in generating it, check the generate_chart(transcript), it calls ChatGPT to generate it. The problem is that the result is not always accurate (tested on GPT-4) sometime it is a correct chart, sometimes it is not.
To test the chart, run the output on Mermaid's live editor.
Observation: GPT seems to work better with very short videos.
What needs to be done:
The chart is then displayed via st_mermaid(mermaid_code), no issues with that.
The text was updated successfully, but these errors were encountered: