Transformations in academic staff evaluation

a study on CoARA in the context of brazilian universities

Authors

DOI:

https://doi.org/10.5195/biblios.2025.1254

Keywords:

Faculty Evaluation, CoARA, Brazilian universities, Evaluation reform

Abstract

Objective. This article analyzes the evaluation instruments for researchers/teachers at five Brazilian public universities in the light of the Coalition for Advancing Research Assessment – CoARA agreement, aimed at the systemic reform of scientific evaluation. Method. The categories set out in the documents were compared with the CoARA principles. Results. There is a predominance of quantitative criteria in the universities analyzed. However, the University of São Paulo shows progress towards more flexible models aligned with Open Science. There are variations in the criteria of the universities, but all show some degree of convergence with the CoARA guidelines. Conclusions. Adopting CoARA principles may foster a more inclusive, transparent, and socially impactful evaluation culture, contributing to a research environment that is more ethical, collaborative, and responsive to societal needs.

Author Biographies

Marcia Regina da Silva, Universidade de São Paulo

Lecturer in Library and Information Science, specializing in Metric Studies in Information Science, University of São Paulo (USP), 2024. Post-doctorate from the University of Brasilia, Graduate Program in Information Science. PhD in Education from the Federal University of São Carlos (2008). Associate Professor in the Department of Education, Information and Communication, Ribeirão Preto School of Philosophy, Sciences and Letters, University of São Paulo (USP); Professor in the Graduate Program in Information Science at UFSCar (PPGCI/UFSCar) and collaborator in the Graduate Program in Science, Technology and Society at UFSCar (PPGCTS/UFSCar).

Laura Vilela Rodrigues Rezende, Universidade Federal de Goiás

Associate Professor at the Federal University of Goiás (UFG) in the Faculty of Information and Communication. Professor in the Graduate Program in Communication and Information (PPGCOM). Visiting researcher at Harvard University with the Digital Curation team of the Dataverse Project at the Institute for Quantitative Social Science (IQSS). Post-doctoral internship at the University of Barcelona in research projects on Open Science and Digital Preservation in the European and Brazilian contexts; PhD and Master's in Information Science from the University of Brasília (UnB); Specialist in Organizational and Competitive Intelligence from the University of Brasília (UnB); Specialist in Computer Networks from the Catholic University of Goiás (UCG); Graduated in Computer Science from the Catholic University of Goiás (UCG).

Geisa Muller de Campos Ribeiro, Universidade Federal de Goiás

Professor with exclusive dedication to the Librarianship course (technological axis) at the Federal University of Goiás. PhD in Communication, Media and Culture from the Graduate Program in Communication at UFG. Master in Communication. BA in Library Science from the Faculty of Information and Communication at the Federal University of Goiás. Professor in the permanent staff of the Postgraduate Program (Master's) in Information Science (PPGCI/FIC). Researcher at the Information Management, Policy and Technology Research Center (NGP/TI-UFG). Researcher in international cooperation with Heriott-Watt University (Scotland) to develop gamification for vulnerable groups and understand access to information and decision-making. She is a member of the UFG Open Science Center implementation group and the “Open science and management of traditional and scientific knowledge” project.

Larissa Bárbara Borges Drumond, Universidade Federal de Goiás

PhD student in Communication, Media and Information line, at PPGCOM/UFG. She has a master's degree from the same program (2023), a bachelor's degree in Information Systems from UEG (2011), and a specialist in Didactics and Methodology of Higher Education from Faculdade Anhanguera de Anápolis (2013). She is also currently studying for a second degree in Library Science at FIC/UFG.

Fabiano Couto Corrêa da Silva, Universidade Federal do Rio Grande do Sul

Adjunct Professor and Head of the Department of Information Science at the School of Library Science and Communication of the Federal University of Rio Grande do Sul (UFRGS). He teaches undergraduate courses in Library Science (face-to-face and distance learning) and is a permanent professor in the Graduate Program in Information Science at UFRGS (PGCIN/UFRGS), as well as collaborating with the Graduate Program in Information Science at the Federal University of Santa Catarina (PGCIN/UFSC). He has a degree in Library Science from UFRGS (2002), a master's degree in Information Science from UFSC (2008) with a CAPES scholarship, and a PhD from the Universitat de Barcelona (2017) with a CNPq scholarship, receiving the distinction Sobresaliente Cum Laude. The title was revalidated in Brazil by PPGCI/UFMG.

Sonia Aguiar Cruz Riascos, Universidade Federal de Pernambuco

Post-doctorate, PhD and Masters in Information Science (UnB). Specialist in Competitive Intelligence (UNB) and Specialist in Administration (UFBA). Bachelor of Library Science (UNB). Experience in Information Management and Librarianship in various areas: industry and commerce, health, agriculture and education. Worked in archives at the SaraH Hospital SAME. Experience in recruitment and selection, training and people development. Lecturer, researcher and extension worker on Information Management and Librarianship courses at UFG and UFPE.

References

Abramo, G. (2024). The forced battle between peer-review and scientometric research assessment: Why the CoARA initiative is unsound. Research Evaluation, rvae021. https://doi.org/10.1093/reseval/rvae021

Aguillo, I. F. (2023). CoARA: algunas reflexiones personales. Anuario ThinkEPI, 17, e17a29. https://doi.org/10.3145/thinkepi.2023.e17a29

Angelova-Stanimirova, A. (2023). Critical criteria for evaluation of scientific research activity in Science Direct. Knowledge: International Journal, 58(1), 171. https://openurl.ebsco.com/EPDB%3Agcd%3A2%3A26525858/detailv2?sid=ebsco%3Aplink%3Ascholar&id=ebsco%3Agcd%3A164439208&crl=c

Baccini, A. (2024). COARA will not save science from the tyranny of administrative evaluation. arXiv preprint arXiv:2408.05587. https://doi.org/10.48550/arXiv.2408.05587

CAPES (2020, 19 de Setembro). Sobre a CAPES. CAPES. https://www.gov.br/capes/pt-br/acesso-a-informacao/perguntas-frequentes/sobre-a-cap

CNPq. (2020, 29 de setembro). CNPq - Conselho Nacional de Desenvolvimento Científico e Tecnológico. Ministério da Ciência, Tecnologia e Inovação. https://www.gov.br/mcti/pt-br/composicao/rede-mcti/conselho-nacional-de-desenvolvimento-cientifico-e-tecnologico

CoARA. (2022, July 2020). Agreement on Reforming Research Assessment. CoARA. https://coara.eu/app/uploads/2022/09/2022_07_19_rra_agreement_final.pdf

Decisão No. 331/2017, UFRGS (2017). https://www.ufrgs.br/consun/legislacao/decisao-n-331-2017/

DORA. (2012). Declaração de São Francisco sobre Avaliação da Pesquisa. (G. N. Flaquer, M. P. Gomes, L. Silveira, P. E. Michels, I. Vidal, Trad.). DORA. https://sfdora.org/read/read-the-declaration-portugues-brasileiro/

Escola de Comunicações e Artes – Universidade de São Paulo. (n.d.). Projeto acadêmico escola de comunicações e artes quinquênio 2018-2022. Escola de Comunicações e Artes - Universidade de São Paulo. https://www.eca.usp.br/sites/default/files/inline-files/Projeto%20Acade%CC%82mico%20ECA%202018%2030.11.2018.pdf

European Commission. (2021). Horizon Europe, open science – Early knowledge and data sharing, and open collaboration. Directorate-General for Research and Innovation, Publications Office of the European Union. https://data.europa.eu/doi/10.2777/18252

European Science Foundation. (n.d.). Principles and Implementation - Plan S. Plan S. https://www.coalition-s.org/addendum-to-the-coalition-s-guidance-on-the-implementation-of-plan-s/principles-and-implementation/

GYA-IAP-ISC Scoping Group. (2024). The future of research evaluation: A synthesis of current debates and developments. The InterAcademic Partnership. https://doi.org/10.24948/2023.06/ https://council.science/wp-content/uploads/2024/05/2023-05-11Evaluation-WEB.pdf

HELSINKI Initiative. (n.d.). Iniciativa de Helsínquia sobre o multilinguismo na comunicação científica. Helsinki Initiative on Multilingualism. https://www.helsinki-initiative.org/pt/read

Hicks, D. (2012). Performance-based university research funding systems. Research Policy, 41(2), 251-261. https://doi.org/10.1016/j.respol.2011.09.007

Holanda, T. (2019). Pesquisa produzida no Brasil está concentrada nas universidades públicas. UFMG. https://ufmg.br/comunicacao/noticias/pesquisa-produzida-no-brasil-esta-concentrada-nas-universidades-publicas

Lampert, E. (2015). O professor de educação superior no MERCOSUL: desafios e perspectivas. Revista Universidade e Sociedade, 25(55), 76–85. Recuperado de https://www.andes.org.br/img/midias/7642a1db844d305c70e26b4ee0b1a732_1548264588.pdf

Marques, M., Powell, J. J. W., Zapp, M., & Biesta, G. (2017) How does research evaluation impact educational research? Exploring intended and unintended consequences of research assessment in the United Kingdom, 1986-2014. European Educational Research Journal, 16(6), 820-842. https://doi.org/10.1177/1474904117730159

Medeiros, C. M. B., & Laender, A. H. F. (2023). Open Science: Overview and general recommendations. Academia Brasileira de Ciências. https://www.abc.org.br/wp content/uploads/2023/11/Open-Science-Overview-and-General-Recommendations.pdf

Müller, S. P. M. (2008). Métricas para a ciência e tecnologia e o financiamento da pesquisa: Algumas reflexões. Encontros Bibli: Revista eletrônica de Biblioteconomia e Ciência da informação, 13(1), 24–35. https://doi.org/10.5007/1518-2924.2008v13nesp1p24

Neves, F., & Callai, M. (2019). Avaliando a avaliação da Capes ontem e hoje. Sempre é hora de reavaliar: a CAPES avaliando a Ciência. In L. P. Rodrigues, G. B. Coelho, & J. Almeira (Orgs.), Ciência, interdisciplinaridade e avaliação Capes (p. ). Paco Editorial.

Paula, M. F. C. de. (2012). Políticas de avaliação da educação superior e trabalho docente: A autonomia universitária em questão. Revista Universidade e Sociedade, 21(49), 51–61. https://www.andes.org.br/img/midias/3231647f3b716ba8a720740b75b864e7_1548264091.pdf

Resolução – CONSUNI No. 18/2017, UFG (2017). https://files.cercomp.ufg.br/weby/up/175/o/Resolucao_CONSUNI_2017_0018.pdf

Resolução nº 323, de 30 de julho de 2021, UFRA (2021). https://novo.ufra.edu.br/images/Conselhos_Superiores/CONSUN/2021/resolu%C3%A7%C3%A3o_n%C2%BA_323_de_30_de_julho_de_2021.pdf

Resolução No. 02/2017, UFPE (2017). https://www.ufpe.br/documents/2357602/0/Res+2017+02+CONSUNIV.pdf/b57c556a-fe2c-47c0-ade6-0c1ea9e37d0f

Resolução No. 7272, de 23 de novembro de 2016, USP (2016). https://leginf.usp.br/?resolucao=resolucao-no-7272-de-23-de-novembro-de-2016

Robinson-Garcia, N., Costas, R., Nane, G. F., & Van Leeuwen, T. N. (2023). Valuation regimes in academia: Researchers’ attitudes towards their diversity of activities and academic performance. Research Evaluation, 32(2), 496–514. https://doi.org/10.1093/reseval/rvac049

Rocha, F. M., Melo, S. D. G., & Silva, R. C. D. (2022). (Des)estruturação da carreira docente nas universidades federais. Arquivos Analíticos de Políticas Educativas, 30(35). https://doi.org/10.14507/epaa.30.6595

Rodrigues, L. P., Coelho, G. B., & Almeida, J. (2019). Sempre é hora de reavaliar: a CAPES avaliando a Ciência. In L. P. Rodrigues, G. B. Coelho, & J. Almeira (Orgs.), Ciência, interdisciplinaridade e avaliação Capes (pp. 125-134). Paco Editorial.

Trigueiro, M. G. S. (2021). A comunidade científica, o Estado e as universidades, no atual estágio de desenvolvimento científico tecnológico. Sociologias, 3(6), 30-50. https://doi.org/10.1590/S1517-45222001000200003

UKRI. (2015). The metric tide: Executive summary. Recuperado de https://www.ukri.org/wp-content/uploads/2021/12/RE-151221-TheMetricTideFullReportExecSummary.pdf

UNESCO. (2022). Recomendações da UNESCO para Ciência Aberta. Escritório da UNESCO Brasília. https://unesdoc.unesco.org/ark:/48223/pf0000379949_por/PDF/379949por.pdf.multi

Velho, L. (2011). Conceitos de ciência e a política científica, tecnológica e de inovação. Sociologias, 13(26), 128-156. https://seer.ufrgs.br/sociologias/article/view/20008/11612

Whitley, R., Gläser, J. (Ed.). (2007). The changing governance of the sciences: The advent of Research Evaluation Systems. Springer.

Downloads

Published

2025-10-29

How to Cite

Silva, M. R. da, Rezende, L. V. R., Ribeiro, G. M. de C., Drumond, L. B. B., Silva, F. C. C. da, & Riascos, S. A. C. (2025). Transformations in academic staff evaluation: a study on CoARA in the context of brazilian universities. Biblios Journal of Librarianship and Information Science, (esp.), e003. https://doi.org/10.5195/biblios.2025.1254

Issue

No. esp. (2025)

Section

Original

License

Copyright (c) 2025 Marcia Regina da Silva, Laura Vilela Rodrigues Rezende, Geisa Muller de Campos Ribeiro, Larissa Bárbara Borges Drumond, Fabiano Couto Corrêa da Silva, Sonia Aguiar Cruz Riascos

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

  1. The Author retains copyright in the Work, where the term “Work” shall include all digital objects that may result in subsequent electronic publication or distribution.
  2. Upon acceptance of the Work, the author shall grant to the Publisher the right of first publication of the Work.
  3. The Author shall grant to the Publisher and its agents the nonexclusive perpetual right and license to publish, archive, and make accessible the Work in whole or in part in all forms of media now or hereafter known under a Creative Commons Attribution 4.0 International License or its equivalent, which, for the avoidance of doubt, allows others to copy, distribute, and transmit the Work under the following conditions:
    1. Attribution—other users must attribute the Work in the manner specified by the author as indicated on the journal Web site;
    with the understanding that the above condition can be waived with permission from the Author and that where the Work or any of its elements is in the public domain under applicable law, that status is in no way affected by the license.
  4. The Author is able to enter into separate, additional contractual arrangements for the nonexclusive distribution of the journal's published version of the Work (e.g., post it to an institutional repository or publish it in a book), as long as there is provided in the document an acknowledgement of its initial publication in this journal.
  5. Authors are permitted and encouraged to post online a prepublication manuscript (but not the Publisher’s final formatted PDF version of the Work) in institutional repositories or on their Websites prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work. Any such posting made before acceptance and publication of the Work shall be updated upon publication to include a reference to the Publisher-assigned DOI (Digital Object Identifier) and a link to the online abstract for the final published Work in the Journal.
  6. Upon Publisher’s request, the Author agrees to furnish promptly to Publisher, at the Author’s own expense, written evidence of the permissions, licenses, and consents for use of third-party material included within the Work, except as determined by Publisher to be covered by the principles of Fair Use.
  7. The Author represents and warrants that:
    1. the Work is the Author’s original work;
    2. the Author has not transferred, and will not transfer, exclusive rights in the Work to any third party;
    3. the Work is not pending review or under consideration by another publisher;
    4. the Work has not previously been published;
    5. the Work contains no misrepresentation or infringement of the Work or property of other authors or third parties; and
    6. the Work contains no libel, invasion of privacy, or other unlawful matter.
  8. The Author agrees to indemnify and hold Publisher harmless from Author’s breach of the representations and warranties contained in Paragraph 6 above, as well as any claim or proceeding relating to Publisher’s use and publication of any content contained in the Work, including third-party content.

Revised 7/16/2018. Revision Description: Removed outdated link.