add support for run-bug-run runbugrun #39 WIP#166

Open

cadddr wants to merge 19 commits intoASSERT-KTH:masterfrom cadddr:master

+672-14

Commits on Dec 28, 2024

initial run bug run

cadddr
authored and
andre15silva
committed
run bug run tests and prompts

cadddr
authored and
andre15silva
committed
skip running tests if error

cadddr
authored and
andre15silva
committed
clean up prompt tests format

cadddr
authored and
andre15silva
committed
cache test results on first run

cadddr
authored and
andre15silva
committed
fix parsing of multiline test inputs/outputs

cadddr
authored and
andre15silva
committed
prompt tests for run bug run

cadddr
authored and
andre15silva
committed
upload cached test outputs; remove submodule; uncomment setup;

cadddr
authored and
andre15silva
committed
hardcode buggy subdir

cadddr
authored and
andre15silva
committed
run black; fix tgz

cadddr
authored and
andre15silva
committed
wrap filename into stream for pd.read_json

cadddr
authored and
andre15silva
committed
update setup.sh
andre15silva
committed
update setup.sh
andre15silva
committed
remove run-bug-run dir
andre15silva
committed
add run-bug-run as submodule
andre15silva
committed
fix setup?
andre15silva
committed
fix setup?
andre15silva
committed
sort bugs for test reproducibility

cadddr
authored and
andre15silva
committed
remove list() from get_bugs()
andre15silva
committed