@DORAssessment

Show your support for DORA with one of our spiffing badges 📛: https://sfdora.org/resource/dora-badges/

Now includes a 🆕 badge for those of you who have contributed to our Resource Library!

Interested in how research assessment can support better diversity, equity, and inclusion?

We have a specific tag for "Equity and inclusion" in #Reformscape, our tool compiling responsible research assessment policies and practices: https://sfdora.org/reformscape/source-materials/?_tara_assessment_topic=equity-and-inclusion

We have made our biggest update to #Reformscape yet!

We recently added fifteen 1️⃣5️⃣ new institutions and thirty-five 3️⃣5️⃣ new examples of responsible research assessment practices and polices.

(And we fixed a bug 🐜.)

https://sfdora.org/reformscape/

DORA’s guidance on responsible use of quantitative indicators suggests 5 principles, like:

Be specific: How well does the indicator refer to the qualities of the person or the piece of work being assessed? Be mindful of aggregate metrics.

https://bit.ly/DORAindicators (PDF)

We made a little improvement to our map 🗺 of DORA signatories on https://sfdora.org/signers/.

Here's why. 🧵 1/4

Duncan E. Wright argues that problems of getting peer reviewers, research fraud, paper mills, predatory journals, and trivial papers are all symptoms of research culture emphasizing quantity over quality.

https://doi.org/10.1002/1873-3468.15018

"Open science arose in response to scientists churning out junk, but junk seems to be what the 'market' that interests scientists still demands."

– Opinion from Nicholas JL Brown on academic "gaming" (quote lightly edited)

https://doi.org/10.1371/journal.pbio.3002816

DORA’s guidance on responsible use of quantitative indicators prompts users to follow 5 principles, like:

Be fair ⚖: How will you avoid biases inherent in quantitative indicators? Be proactive and transparent in efforts to address this challenge.

https://zenodo.org/doi/10.5281/zenodo.10979643

Individual anecdotes, like getting a well-known grant, can skew what we prioritize when assessing research. Institutions can use structured interview protocols to keep decision-makers focused on agreed-upon qualities, rather than on reputation.

https://sfdora.org/resource/rethinking-research-assessment-unintended-cognitive-and-systems-biases/

DORA is hiring a new Program Manager: https://www.ascb.org/program-manager-for-the-declaration-on-research-assessment-dora/

🆕 Blog post on LSE Impact Blog: "The role of #scientometrics in the pursuit of responsible research assessment."

https://blogs.lse.ac.uk/impactofsocialsciences/2024/09/04/the-role-of-scientometrics-in-the-pursuit-of-responsible-research-assessment/

The Dimensions of Responsible Research Assessment (RRA) is a framework for research funders to implement and frame discussions on RRA.

The report and one-pager were created by the
Global Research Council RRA Working Group. They include guiding principles and more:

https://doi.org/10.6084/m9.figshare.26064223.v3

🆕 #PrePrint shows that MANY discoveries (here: new fungus species) are published in journals with NO Impact Factor or a lower than average Impact Factor.

https://gupea.ub.gu.se/bitstream/handle/2077/83290/Nilsson_bibliometrics_mycology_2024_submitted.pdf

🆕 Research forthcoming will examine how using narrative CVs affects applications from individuals in underrepresented groups:

https://edicaucus.ac.uk/flexible-fund-project-5/

DORA’s guidance on responsible use of quantitative indicators prompts users to follow five 5️⃣ principles, like:

Be transparent 👓: Rules for the use of quantitative indicators should published so that those being evaluated understand your criteria.

https://zenodo.org/doi/10.5281/zenodo.10979643

Today is the last day at DORA for our Program Manager, Haley Hazlett!

We thank Haley for her contributions to DORA, which cannot fit in a tweet, or even a thread. There are too many, and they are substantial.

We wish Haley all the success in the world 🌎 at her new position!