Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Factor out BenchmarkGroup #390

Open
LilithHafner opened this issue Jan 9, 2025 · 0 comments
Open

Factor out BenchmarkGroup #390

LilithHafner opened this issue Jan 9, 2025 · 0 comments

Comments

@LilithHafner
Copy link
Contributor

BenchmarkGroup is a useful datastructure for organizing hierarchical data that need not be BenchmarkTools.jl specific. It is similarly well-suited to storing benchmark results, test results, statistical conformity results (e.g. for random samplers), performance figures for ML algorithms, etc. For example, if folks are using Chairmarks with AirspeedVelocity, they may want this type without the rest of BenchmarkTools.

Additionally, I suspect that this conceptual and technical separation between benchmarking and handling nested data would make it easier for folks to wrap their heads around how to use BenchmarkGroups. Is this something you're open to & do you think it's a good idea, @willow-ahrens?

I'd imagine the type would be a NestedDict, BenchmarkGroup would be an alias for NestedDict, NestedDicts.jl would live in the JuliaCI or the JuliaCollections organization (or maybe NestedDict would live in DataStructures.jl, but BenchmarkTools doesn't already depend on DataStructures, and I wouldn't want to add a new big dependency). This would not be a breaking change.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant