Challenges in building scholarly knowledge graphs for research assessment in open science

Проблемы построения научных графов знаний для оценки исследований в условиях открытой науки
Paolo Manghi
2024-01-01

OpenAIRE Graphmetadata qualityopen scienceresearch assessmentscholarly knowledge graphs
Abstract Open science has revolutionized scholarly communication and research assessment by introducing research data and software as first-class citizens. Scholarly knowledge graphs (SKGs) are expected to play a crucial role in generating research assessment indicators being able to aggregate bibliographic metadata records and semantic relationships describing all research products and their links (e.g., citations, affiliations, funding). However, the rapid advance of open science has led to publication workflows that do not adequately support and guarantee the authenticity of products and metadata quality required for research assessment. Additionally, the heterogeneity of research communities and the multitude of data sources and exchange formats complicate the provision of consistent and stable SKGs. This work builds upon the experience gained from pioneering and addressing these challenges in the OpenAIRE Graph SKG. The aim is twofold and broader. First, we identify obstacles to the creation of SKGs for research assessment caused by the state-of-the-art publishing workflows for publications, software, and data. Second, we describe repurposing SKGs as tools to monitor such workflows to identify and heal their shortcomings, taking advantage of tools, techniques, and practices that support the actors involved, namely research communities, scientists, organizations, data source providers, and SKG providers, to improve the Open Science scholarly publishing ecosystem.
1
Current publishing workflows do not reliably ensure product authenticity or metadata quality, limiting the use of knowledge graphs for research assessment.
2
Experience with the OpenAIRE Graph shows that scholarly knowledge graphs can also monitor publishing workflows and help identify and correct their shortcomings.
3
Heterogeneous research communities, diverse data sources, and multiple exchange formats hinder the creation of consistent and stable scholarly knowledge graphs.
4
Open science makes research data and software first-class scholarly outputs, requiring knowledge graphs to represent products and relationships beyond publications.
5
Scholarly knowledge graphs can generate research-assessment indicators by aggregating bibliographic metadata and semantic links, including citations, affiliations, and funding.

scholarly knowledge graphs for research assessment in open science, particularly the OpenAIRE Graph SKG

obstacles to creating reliable, consistent, and stable SKGs from heterogeneous scholarly publishing workflows, and repurposing SKGs to monitor and improve those workflows

Publication Details
Publication Date
2024-01-01
Journal
Publisher
ISSN
Access Type
Author Information
Authors
Paolo Manghi
Explore further
Open the scid.ai AI chat with a ready-made request: it will find papers on a similar topic and help build a literature review.
Find similar papers in the chat →
Make a presentation
100%