FAIRmetrics score on the profile of each published dataset?

[xgmachina]

I have a naive idea about a rose diagram of FAIRmetrics on the profile of each published dataset. The idea is derived from the Altermetrics that is widely used for scientific publications now.

A rose diagram with a overall data quality value can be very transparent and attractive on the profile of a dataset. The challenge, as already mentioned by a few colleagues, is methods to do the quantitative estimation of the four elements in FAIR. Altermetrics uses datasets from social media to estimate the impact of a publication. For the elements of findability, accessibility, interoperability and reusability, there could be some automated ways to get records if the dataset has a unique identifier such as DOI or URI. Still, we need to carefully design a model and a mechanism to evaluate each item in FAIR, and then generate a overall score.

[band]

Marshall, this is a good idea. I think there is a straightforward way to define measurable properties for each principle, treating each as a system requirement. The work will be in agreeing on measurements that are practicable for both data contributions and data repository operations. Much of the high-level context conversation re FAIR-ness seems to be settled (for now). See my comment on Issue 5: https://github.com/FAIR-Data-EG/consultation/issues

…

On Jun 12, 2017, at 4:47 PM, Marshall.Ma ***@***.***> wrote: I have a naive idea about a rose diagram of FAIRmetrics on the profile of each published dataset. The idea is derived from the Altermetrics that is widely used for scientific publications now. A rose diagram with a overall data quality value can be very transparent and attractive on the profile of a dataset. The challenge, as already mentioned by a few colleagues, is methods to do the quantitative estimation of the four elements in FAIR. Altermetrics uses datasets from social media to estimate the impact of a publication. For the elements of findability, accessibility, interoperability and reusability, there could be some automated ways to get records if the dataset has a unique identifier such as DOI or URI. Still, we need to carefully design a model and a mechanism to evaluate each item in FAIR, and then generate a overall score. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

[Daniel-Mietchen]

Thanks — needs sync with #5.

[xgmachina]

@band Yes, the issue I raised here is a concise and visualized output of the properties you mentioned in #5. The guidelines under each FAIR item offered some clues to an initial prototype. https://www.force11.org/group/fairgroup/fairprinciples

[xgmachina]

@Daniel-Mietchen perhaps 'visualization' can be added as a label.

[sjDCC]

I've added visualisation as a label.

It's also worth looking at the DANS work on assessing the FAIRness of datasets. They've proposed some ways to show this on metadata records. See for example this recent presentation and blog post

[dr-shorthair]

Also see https://confluence.csiro.au/display/OZNOME/Rating+systems+and+maturity+models+for+data+publication+and+sharing#Ratingsystemsandmaturitymodelsfordatapublicationandsharing-OFLWtestcases