How to collect prompt/response feedback?!

[luebken]

Hey llm community. I'd like to share a little plugin that I started: https://github.com/luebken/llm-logs-feedback. The idea is to quickly annotate a prompt/response tuple with feedback. At a later stage, I'd like to learn from the feedback I've stored and possibly adjust my prompts.

WDYT?

This is a preview version to gain feedback (pun intended) on the idea, the CLI design and the database schema. More things to come.