Paul Donner
Research Interests
Make your next move.
Prepare your application
Review drafts before you send them.
Explore related searches
Articles (16)
As citation context information has entered the Web of Science (Clarivate) in recent years, one wonders whether the legitimacy and soundness of citation analyses for measuring research quality of publications can be improved by considering this information. The legitimacy and soundness of citation analysis can be established by assessing its construct validity. This can be done by studying how citation impact variables relate to generally accepted external validation data, like human expert assessments of research quality. In this study, we investigated the statistical associations of information extracted from structured citation context data—such as the position of citations in certain sections—with postpublication peer quality ratings from Faculty Opinions (H1 Connect) as external validity criterion data for publications in medicine and life sciences. We found that quantitative variables derived from citation contexts are correlated with human expert assessments over and above ordinary citation counts. Hence, the construct validity of citation analyses can be improved by incorporating citation context data into measurement models. The legitimacy and soundness of citation analyses for measuring research quality can be improved by considering this information.
Year:
2025
Academic data infrastructures facilitate bibliometric research and reporting, as they link bibliometric data with research interests. In Germany, the Kompetenznetzwerk Bibliometrie (KB), a national consortium of 22 institutions, serves this purpose by hosting, probing, and curating large-scale bibliometric raw data from commercial and open providers. Users at partner institutions regularly apply the data infrastructure in workflows. Due to its former focus on commercial data, the KB’s infrastructure has not been detailed transparently to date. However, as an increasing number of bibliometric publications and reports rely upon it, this article provides comprehensive documentation of the KB’s infrastructure specifically designed for bibliometric applications. It explains the conceptual considerations employed to define the infrastructure’s technical characteristics and procedures. Descriptions are provided regarding the technical infrastructure; the KB’s own database schema consistently applied across several bibliometric databases; processing bibliometric raw data; multidimensional quality assurance processes; and additional data curation. By making these procedures transparent and open to scrutiny, we aim to bolster the reliability of our infrastructure and facilitate reproducible research while contributing to the broader discourse on transparency in the field of bibliometrics and providing input to other organizations developing similar infrastructures.
Year:
2025
In this study we investigate the relative contributions of co-authors to publications in mathematics. Mathematics is an interesting case for such research because it is one of only a few scientific disciplines in which alphabetical order of names of co-authors on publications is still the prevailing convention rather than contribution-based order. The study is based on unique data of publicly available author-provided quantitative contribution statements for co-authored papers from applications for habilitation degrees in Poland. This data allows us to investigate if alphabetical name order goes hand in hand with equally large contributions of co-authors or hides differences in contribution sizes. We find that the empirical contributions by co-authors are usually close to the equal contributions suggested by alphabetical order but in a substantial proportion of observations the equality assumption would be misleading about actual contributions. This has implications for bibliometric methodology. In mathematics, equal fractional counting of author contributions is close to the contributions declared by the authors themselves. We further find that authors who are habilitation applicants claim slightly more credit, ceteris paribus, than their non-applicant co-authors.
Year:
2025
Author self-citations are a somewhat controversial phenomenon. Some scholars maintain they are a normal, even indispensable, part of scientific referencing practice, while others claim they are frequently an expression of vanity and self-promotion. Citations are the basic data for citation network clustering, an important approach to creating bottom-up, data-driven, global taxonomic systems of research publications. Thus, the topical information content of self-citations is of particular interest in this context. Because it is not yet known how author self-citations affect such systems, we study the question of their influence on cluster solution topic quality in a citation network by experimentally reweighting self-citation edges by increasing and decreasing their link weights according to self-citation status and strength. As a case study, we investigate data in the field of astronomy and astrophysics. We assess the effects of self-citation manipulations by evaluating the quality of the resulting clustering solutions using diverse external data containing meaningful topic-structural information, namely topical journal special issues, cousage data from scientific literature database search logs, grant funding data, and intellectual paper-level classification assignments. We find that we can reliably improve clustering solution quality by emphasizing self-citation link weights.
Year:
2025
OpenAlex is a promising open source of scholarly metadata, and competitor to established proprietary sources, such as the Web of Science and Scopus. As OpenAlex provides its data freely and openly, it permits researchers to perform bibliometric studies that can be reproduced in the community without licensing barriers. However, as OpenAlex is a rapidly evolving source and the data contained within is expanding and also quickly changing, the question naturally arises as to the trustworthiness of its data. In this report, we will study the reference coverage and selected metadata within each database and compare them with each other to help address this open question in bibliometrics. In our large-scale study, we demonstrate that, when restricted to a cleaned dataset of 16.8 million recent publications shared by all three databases, OpenAlex has average source reference numbers and internal coverage rates comparable to both Web of Science and Scopus. We further analyse the metadata in OpenAlex, the Web of Science and Scopus by journal, finding a similarity in the distribution of source reference counts in the Web of Science and Scopus as compared to OpenAlex. We also demonstrate that the comparison of other core metadata covered by OpenAlex shows mixed results when broken down by journal, where OpenAlex captures more ORCID identifiers, fewer abstracts and a similar number of Open Access status indicators per article when compared to both the Web of Science and Scopus.
Year:
2025
Scientific work has become increasingly organized as teamwork and most research publications are now joint work of several co-authors. While of utmost importance for fair and valid research evaluation, the quantitative patterns of relative work contribution by team members to co-authored publications have remained opaque. Here we present an empirical study of contribution patterns. We analyze a large data set of author-provided percent contribution claims for co-authored scientific publications submitted as part of applications to scholarship programs. We find that the distribution of work input in co-authored publications is overwhelmingly unequal. This is in direct contrast to extant assumptions in research evaluation practice and professional science studies which presuppose equal contributions and do not adjust or weight publication and citation counts differentially by contribution. Such flawed methodology should be discontinued, as it unfairly disadvantages major contributors.
Year:
2025
In this study, we investigated whether citation context information is able to increase the validity of citation impact analyses to measure research quality compared to simple citation counts. We analyzed the statistical relationships of information extracted from structured citation context data in the Web of Science (Clarivate) such as the placement of citations within specific sections of an article with post-publication peer review quality ratings from Faculty Opinions (H1 connect), used as an external validity criterion for research quality. The study is based on publications in medicine and life sciences. Our findings reveal that quantitative metrics derived from citation contexts, particularly in-text citation counts, exhibit stronger correlations with expert evaluations compared to traditional citation counts. Consequently, integrating citation context data appears to improve the legitimacy and reliability of citation analyses as tools for assessing research quality.
Year:
2025
Year:
2024
This study introduces an approach to estimate the uncertainty in bibliometric indicator values that is caused by data errors. This approach utilizes Bayesian regression models, estimated from empirical data samples, which are used to predict error-free data. Through direct Monte Carlo simulation—drawing many replicates of predicted data from the estimated regression models for the same input data—probability distributions for indicator values can be obtained which provide the information on their uncertainty due to data errors. It is demonstrated how uncertainty in base quantities, such as the number of publications of certain document types of a unit of analysis and the number of citations of a publication, can be propagated along a measurement model into final indicator values. Synthetic examples are used to illustrate the method and real bibliometric research evaluation data is used to show its application in practice. Though in this contribution we just use two out of a larger number of known bibliometric error categories and therefore can account for only some part of the total uncertainty due to inaccuracies, the latter example reveals that average values of citation impact scores of publications of research groups need to be used very cautiously as they often have large margins of error resulting from data inaccuracies.
Year:
2024
Year:
2022
Year:
2021
Year:
2021
Year:
2021
Year:
2020
Year:
2020
Year:
2020
Collaborators (3)
Robin Haunschild
Senior Researcher
Max Planck Institute for Solid State Research
Christine Rimmert
FIZ Karlsruhe – Leibniz Institute for Information Infrastructure
Przemyslaw Korytkowski
Associate professor
National Information Processing Institute
Make your next move.
Prepare your application
Review drafts before you send them.