Challenges in building scholarly knowledge graphs for research assessment in open science
Проблемы построения научных графов знаний для оценки исследований в условиях открытой науки
2024-01-01
SCID: 54.1/ascbgkrf
Discuss with AI
OpenAIRE Graphmetadata qualityopen scienceresearch assessmentscholarly knowledge graphs
Figures from the paper
Abstract (AI)
Abstract Open science has revolutionized scholarly communication and research assessment by introducing research data and software as first-class citizens. Scholarly knowledge graphs (SKGs) are expected to play a crucial role in generating research assessment indicators being able to aggregate bibliographic metadata records and semantic relationships describing all research products and their links (e.g., citations, affiliations, funding). However, the rapid advance of open science has led to publication workflows that do not adequately support and guarantee the authenticity of products and metadata quality required for research assessment. Additionally, the heterogeneity of research communities and the multitude of data sources and exchange formats complicate the provision of consistent and stable SKGs. This work builds upon the experience gained from pioneering and addressing these challenges in the OpenAIRE Graph SKG. The aim is twofold and broader. First, we identify obstacles to the creation of SKGs for research assessment caused by the state-of-the-art publishing workflows for publications, software, and data. Second, we describe repurposing SKGs as tools to monitor such workflows to identify and heal their shortcomings, taking advantage of tools, techniques, and practices that support the actors involved, namely research communities, scientists, organizations, data source providers, and SKG providers, to improve the Open Science scholarly publishing ecosystem.
Key Findings
1
Current publishing workflows do not reliably ensure product authenticity or metadata quality, limiting the use of knowledge graphs for research assessment.
2
Experience with the OpenAIRE Graph shows that scholarly knowledge graphs can also monitor publishing workflows and help identify and correct their shortcomings.
3
Heterogeneous research communities, diverse data sources, and multiple exchange formats hinder the creation of consistent and stable scholarly knowledge graphs.
4
Open science makes research data and software first-class scholarly outputs, requiring knowledge graphs to represent products and relationships beyond publications.
5
Scholarly knowledge graphs can generate research-assessment indicators by aggregating bibliographic metadata and semantic links, including citations, affiliations, and funding.
Research Object
scholarly knowledge graphs for research assessment in open science, particularly the OpenAIRE Graph SKG
Research Subject
obstacles to creating reliable, consistent, and stable SKGs from heterogeneous scholarly publishing workflows, and repurposing SKGs to monitor and improve those workflows
Publication Details
Publication Date
2024-01-01
Journal
Publisher
ISSN
Open access PDF
Access Type
Author Information
Download PDF
Subscribe to digest