You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
BenchmarkGroup is a useful datastructure for organizing hierarchical data that need not be BenchmarkTools.jl specific. It is similarly well-suited to storing benchmark results, test results, statistical conformity results (e.g. for random samplers), performance figures for ML algorithms, etc. For example, if folks are using Chairmarks with AirspeedVelocity, they may want this type without the rest of BenchmarkTools.
Additionally, I suspect that this conceptual and technical separation between benchmarking and handling nested data would make it easier for folks to wrap their heads around how to use BenchmarkGroups. Is this something you're open to & do you think it's a good idea, @willow-ahrens?
I'd imagine the type would be a NestedDict, BenchmarkGroup would be an alias for NestedDict, NestedDicts.jl would live in the JuliaCI or the JuliaCollections organization (or maybe NestedDict would live in DataStructures.jl, but BenchmarkTools doesn't already depend on DataStructures, and I wouldn't want to add a new big dependency). This would not be a breaking change.
The text was updated successfully, but these errors were encountered:
BenchmarkGroup is a useful datastructure for organizing hierarchical data that need not be BenchmarkTools.jl specific. It is similarly well-suited to storing benchmark results, test results, statistical conformity results (e.g. for random samplers), performance figures for ML algorithms, etc. For example, if folks are using Chairmarks with AirspeedVelocity, they may want this type without the rest of BenchmarkTools.
Additionally, I suspect that this conceptual and technical separation between benchmarking and handling nested data would make it easier for folks to wrap their heads around how to use
BenchmarkGroup
s. Is this something you're open to & do you think it's a good idea, @willow-ahrens?I'd imagine the type would be a
NestedDict
,BenchmarkGroup
would be an alias forNestedDict
, NestedDicts.jl would live in the JuliaCI or the JuliaCollections organization (or maybeNestedDict
would live in DataStructures.jl, but BenchmarkTools doesn't already depend on DataStructures, and I wouldn't want to add a new big dependency). This would not be a breaking change.The text was updated successfully, but these errors were encountered: