forked from eth-library/naif
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathindex.qmd
More file actions
209 lines (183 loc) · 13 KB
/
index.qmd
File metadata and controls
209 lines (183 loc) · 13 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
---
title: "NAIF at the Research on Research Event 2026"
subtitle: "Track 1 presented findings on quantitative scientometric indicators in Swiss Higher Education Institutions at the RoR Event 2026 in Zurich."
date: "2026-02-27"
author:
- name: "Dr Moritz Mähr"
orcid: "0000-0002-1367-1618"
affiliation: "ETH Zurich"
description: "From 29 to 30 January 2026, the Center for Reproducible Science and Research Synthesis (CRS) at the University of Zurich hosted the Research on Research (RoR) Event 2026. NAIF Track 1 contributed a poster on the responsible use of quantitative scientometric indicators (QSI) in Swiss Higher Education Institutions (HEIs)."
doi: "10.5281/zenodo.18656169"
other-links:
- text: "Related event: Research on Research Event 2026"
href: "../../events/2026-01-29-ror-event-2026/"
categories:
- "Track 1"
tags:
- "research assessment"
- "scientometrics"
- "poster"
proofread: true
image: "images/poster.png"
image-alt: 'Poster summarising findings on the use of quantitative scientometric indicators in Swiss Higher Education Institutions.'
image-caption: 'Poster summarising findings on the use of quantitative scientometric indicators in Swiss Higher Education Institutions. Rights: Authors, used with permission.'
toc: true
draft: false
---
<!--
Checklist (manual):
- Title <= 70 characters ✓ (50)
- Text 500-6000 characters (guideline x2)
- Teaser <= 280 characters ✓ (139)
- Exactly 1 category: Track 1-4 or General ✓
- Exactly 3 tags ✓
- 1-3 images, each with alt text + caption + rights attribution
- Proofread true/false is set ✓
- Optional: max. 3 literature references
-->
## Why it matters
Swiss HEIs are increasingly aligning with international frameworks for responsible research assessment, including [DORA](https://sfdora.org/) and [CoARA](https://www.coara.org/). However, translating these commitments into everyday practice remains a challenge. The relationship is reciprocal: the indicators institutions choose shape the metadata they collect and curate, while the quality of that underlying data determines which indicators can be computed responsibly. Getting either side wrong --- adopting metrics without adequate data infrastructure, or maintaining rich metadata that nobody acts on --- undermines research visibility and the interoperability goals at the heart of NAIF.
## What we did
We presented a poster titled [*On the Current and Future Uses of Quantitative Scientometric Indicators (QSI) in Swiss Higher Education Institutions*](https://zenodo.org/records/18656169) ([DOI: 10.5281/zenodo.18656169](https://doi.org/10.5281/zenodo.18656169)) during the poster flash talks and the dedicated poster session on Day 1 of the event. The poster was authored by [Dr Moritz Mähr](https://orcid.org/0000-0002-1367-1618) (ETH Library, ETH Zurich), Dr Martin Jaekel (ZHAW), Dr David Johann (ETH Library, ETH Zurich), Dr Rüdiger Mutz (CHESS, University of Zurich), and Elena Šimukovič (ZHAW).
The poster synthesised results from the 6th Swiss Year of Scientometrics (SYoS) workshop, held on 11 September 2025, with 27 stakeholders from Swiss HEIs, policy bodies, and international initiatives. It also outlined a planned qualitative survey targeting Swiss HEIs and other stakeholders such as the Swiss National Science Foundation (SNSF) and the State Secretariat for Education, Research and Innovation (SERI).
::: {.callout-note}
## Explore the NAIF dashboard
View the interactive NAIF dashboard here: [DORA & CoARA in Swiss Higher Education](../../dashboards/naif/).
:::
## What we found
The poster addressed four topics. First, QSI adoption is growing --- 24 Swiss institutions have signed DORA and 16 are CoARA signatories --- but stakeholders struggle to translate these declarations into appropriate practices. Second, indicator use is concentrated at the organisational level (research profiles, collaboration networks, the share of open access publications, and citation patterns). In the ETH Zurich case study, metrics serve primarily to monitor institutional profiles and collaboration structures rather than to evaluate individual researchers. This development can be understood as a move toward more responsible and context-sensitive research assessment. Third, data quality emerged as a non-negotiable prerequisite: metrics are often flawed or misapplied, and meaningful analyses require multiple sources and rigorous data cleaning. Fourth, the future of responsible QSI lies in deeper expert collaboration, dialogue-based approaches, context-first design, and a broader scope that includes research data, open science, and media visibility.
```{python}
#| echo: false
#| label: fig-dora-map
#| fig-cap: "DORA signatories among Swiss Higher Education Institutions (24 of 46)."
import folium
TYPE_COLOURS = {
"University": "#F97B22",
"UAS": "#FEE8B0",
"UTE": "#9CA777",
"Univ. Inst.": "#7C9070",
}
LEGEND_CONTAINER_STYLE = (
"position: fixed; top: 10px; left: 50px; background: #ffffff; padding: 10px; "
"border-radius: 5px; font-family: sans-serif; font-size: 12px; z-index: 9999;"
)
LEGEND_DOT_STYLE = "width:12px;height:12px;display:inline-block;border-radius:50%;margin-right:5px;"
LEGEND_NOTE_STYLE = "margin-top: 5px;"
def make_legend_html(items: list[tuple[str, str]], note: str | None = None) -> str:
rows = [f'<div style="{LEGEND_CONTAINER_STYLE}">']
for label, colour in items:
rows.append(
f'<div><span style="{LEGEND_DOT_STYLE}background:{colour};"></span>{label}</div>'
)
if note:
rows.append(f'<div style="{LEGEND_NOTE_STYLE}">{note}</div>')
rows.append("</div>")
return "".join(rows)
dora = [
{"s": "UNIBAS", "n": "University of Basel", "t": "University", "la": 47.5584, "lo": 7.5834, "c": "Basel"},
{"s": "UniBE", "n": "University of Bern", "t": "University", "la": 46.9505, "lo": 7.4381, "c": "Bern"},
{"s": "UniFr", "n": "University of Fribourg", "t": "University", "la": 46.8065, "lo": 7.1523, "c": "Fribourg"},
{"s": "UNIGE", "n": "University of Geneva", "t": "University", "la": 46.2017, "lo": 6.1430, "c": "Geneva"},
{"s": "UNIL", "n": "University of Lausanne", "t": "University", "la": 46.5213, "lo": 6.5743, "c": "Lausanne"},
{"s": "UniLu", "n": "University of Lucerne", "t": "University", "la": 47.0494, "lo": 8.3105, "c": "Lucerne"},
{"s": "UniNE", "n": "University of Neuchâtel", "t": "University", "la": 46.9936, "lo": 6.9387, "c": "Neuchâtel"},
{"s": "UZH", "n": "University of Zurich", "t": "University", "la": 47.3743, "lo": 8.5484, "c": "Zurich"},
{"s": "USI", "n": "Università della Svizzera italiana", "t": "University", "la": 46.0104, "lo": 8.9582, "c": "Lugano"},
{"s": "EPFL", "n": "Swiss Federal Institute of Technology Lausanne", "t": "University", "la": 46.5191, "lo": 6.5668, "c": "Lausanne"},
{"s": "ETHZ", "n": "Swiss Federal Institute of Technology Zurich", "t": "University", "la": 47.3763, "lo": 8.5477, "c": "Zurich"},
{"s": "FernUni", "n": "Distance Learning University Switzerland", "t": "Univ. Inst.", "la": 46.3196, "lo": 7.9889, "c": "Brig"},
{"s": "BFH", "n": "Bern University of Applied Sciences", "t": "UAS", "la": 46.9530, "lo": 7.4347, "c": "Bern"},
{"s": "FHNW", "n": "University of Applied Sciences and Arts Northwestern Switzerland", "t": "UAS", "la": 47.4812, "lo": 8.2127, "c": "Windisch"},
{"s": "HES-SO", "n": "HES-SO University of Applied Sciences and Arts Western Switzerland", "t": "UAS", "la": 47.3653, "lo": 7.3575, "c": "Delémont"},
{"s": "HSLU", "n": "Lucerne University of Applied Sciences and Arts", "t": "UAS", "la": 47.0468, "lo": 8.3106, "c": "Lucerne"},
{"s": "ZHAW", "n": "Zurich University of Applied Sciences", "t": "UAS", "la": 47.5005, "lo": 8.7247, "c": "Winterthur"},
{"s": "HEP | PH FR", "n": "University of Teacher Education Fribourg", "t": "UTE", "la": 46.8093, "lo": 7.1528, "c": "Fribourg"},
{"s": "HEP Vaud", "n": "University of Teacher Education Vaud", "t": "UTE", "la": 46.5160, "lo": 6.6231, "c": "Lausanne"},
{"s": "HfH", "n": "University of Teacher Education in Special Needs", "t": "UTE", "la": 47.4114, "lo": 8.5463, "c": "Zurich"},
{"s": "PHBern", "n": "University of Teacher Education Bern", "t": "UTE", "la": 46.9556, "lo": 7.4191, "c": "Bern"},
{"s": "PHSZ", "n": "University of Teacher Education Schwyz", "t": "UTE", "la": 47.0493, "lo": 8.5478, "c": "Goldau"},
{"s": "HEP-VS", "n": "University of Teacher Education Valais", "t": "UTE", "la": 46.2201, "lo": 7.0033, "c": "Brig"},
{"s": "PH Zurich", "n": "University of Teacher Education Zurich", "t": "UTE", "la": 47.3792, "lo": 8.5323, "c": "Zurich"},
]
m = folium.Map(location=[46.8, 8.3], zoom_start=8, control_scale=True, tiles="cartodbpositron")
for r in dora:
folium.CircleMarker(
location=[r["la"], r["lo"]],
radius=8,
color="#333333",
weight=1,
fill=True,
fill_color=TYPE_COLOURS.get(r["t"], "#7C9070"),
fill_opacity=1.0,
tooltip=r["s"],
popup=f"<b>{r['n']}</b><br>Type: {r['t']}<br>{r['c']}",
).add_to(m)
legend_html = make_legend_html(
[
("Universities", "#F97B22"),
("Universities of Applied Sciences", "#FEE8B0"),
("Universities of Teacher Education", "#9CA777"),
("University Institutes", "#7C9070"),
]
)
m.get_root().html.add_child(folium.Element(legend_html))
m
```
```{python}
#| echo: false
#| label: fig-coara-map
#| fig-cap: "CoARA signatories among Swiss Higher Education Institutions (16 of 46). Asterisk (*) indicates CoARA members."
TYPE_COLOURS = {
"University": "#F97B22",
"UAS": "#FEE8B0",
"UTE": "#9CA777",
"Univ. Inst.": "#7C9070",
}
coara = [
{"s": "UniFr", "n": "University of Fribourg", "t": "University", "la": 46.8065, "lo": 7.1523, "c": "Fribourg", "m": True},
{"s": "UNIGE", "n": "University of Geneva", "t": "University", "la": 46.2017, "lo": 6.1430, "c": "Geneva", "m": False},
{"s": "UNIL", "n": "University of Lausanne", "t": "University", "la": 46.5213, "lo": 6.5743, "c": "Lausanne", "m": False},
{"s": "UZH", "n": "University of Zurich", "t": "University", "la": 47.3743, "lo": 8.5484, "c": "Zurich", "m": False},
{"s": "EPFL", "n": "Swiss Federal Institute of Technology Lausanne", "t": "University", "la": 46.5191, "lo": 6.5668, "c": "Lausanne", "m": False},
{"s": "ETHZ", "n": "Swiss Federal Institute of Technology Zurich", "t": "University", "la": 47.3763, "lo": 8.5477, "c": "Zurich", "m": True},
{"s": "BFH", "n": "Bern University of Applied Sciences", "t": "UAS", "la": 46.9530, "lo": 7.4347, "c": "Bern", "m": True},
{"s": "FHNW", "n": "University of Applied Sciences and Arts Northwestern Switzerland", "t": "UAS", "la": 47.4812, "lo": 8.2127, "c": "Windisch", "m": True},
{"s": "HES-SO", "n": "HES-SO University of Applied Sciences and Arts Western Switzerland", "t": "UAS", "la": 47.3653, "lo": 7.3575, "c": "Delémont", "m": True},
{"s": "HSLU", "n": "Lucerne University of Applied Sciences and Arts", "t": "UAS", "la": 47.0468, "lo": 8.3106, "c": "Lucerne", "m": True},
{"s": "ZHdK", "n": "Zurich University of the Arts", "t": "UAS", "la": 47.3923, "lo": 8.5118, "c": "Zurich", "m": True},
{"s": "ZHAW", "n": "Zurich University of Applied Sciences", "t": "UAS", "la": 47.5005, "lo": 8.7247, "c": "Winterthur", "m": True},
{"s": "HEP Vaud", "n": "University of Teacher Education Vaud", "t": "UTE", "la": 46.5160, "lo": 6.6231, "c": "Lausanne", "m": True},
{"s": "PHSZ", "n": "University of Teacher Education Schwyz", "t": "UTE", "la": 47.0493, "lo": 8.5478, "c": "Goldau", "m": False},
{"s": "PHSG", "n": "St.Gallen University of Teacher Education", "t": "UTE", "la": 47.4304, "lo": 9.3855, "c": "Saint Gallen", "m": False},
{"s": "PH Zurich", "n": "University of Teacher Education Zurich", "t": "UTE", "la": 47.3792, "lo": 8.5323, "c": "Zurich", "m": True},
]
m = folium.Map(location=[46.8, 8.3], zoom_start=8, control_scale=True, tiles="cartodbpositron")
for r in coara:
label = r["s"] + ("*" if r["m"] else "")
member_text = "Yes" if r["m"] else "No"
folium.CircleMarker(
location=[r["la"], r["lo"]],
radius=8,
color="#333333",
weight=1,
fill=True,
fill_color=TYPE_COLOURS.get(r["t"], "#7C9070"),
fill_opacity=1.0,
tooltip=label,
popup=f"<b>{r['n']}</b><br>Type: {r['t']}<br>{r['c']}<br>CoARA Member: {member_text}",
).add_to(m)
legend_html = make_legend_html(
[
("Universities", "#F97B22"),
("Universities of Applied Sciences", "#FEE8B0"),
("Universities of Teacher Education", "#9CA777"),
],
note="* CoARA Member",
)
m.get_root().html.add_child(folium.Element(legend_html))
m
```
## What's next
Based on this work, NAIF will develop practical guidelines for Swiss HEIs to support transparent, context-specific research assessment aligned with international best practices by the end of 2026. A qualitative survey of Swiss HEIs is planned to complement the workshop findings.
## What to reuse
The poster and further information about the project are available on the [NAIF website](https://eth-library.github.io/naif/). All NAIF deliverables are archived on [Zenodo](https://zenodo.org/communities/naif).