Skip to content

Commit 9a6a1a9

Browse files
committed
Merge branch '2026-03-arctic' of github.com:NCEAS/nceas-training into 2026-03-arctic
2 parents 8e7c1b4 + d685311 commit 9a6a1a9

5 files changed

Lines changed: 84 additions & 40 deletions

File tree

123 KB
Loading

materials/sections/adc-creating-data-portals.qmd

Lines changed: 40 additions & 37 deletions
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ To see an example of a portal, please view the [Toolik Field Station's portal](h
2020

2121
## Portal Features
2222

23-
Published portals vary in their design according to the needs and preferences of the individual or group. However, when constructing a portal there are three core elements: a data page, a metrics page, and customizable free-form pages.
23+
Published portals vary in their design according to the needs and preferences of the individual or group. However, when constructing a portal there are three core elements: a data page, a metrics page, and customizable free-form pages.
2424

2525
### Flexible Content Creation {.unnumbered}
2626

@@ -32,7 +32,7 @@ Portals can be constructed as a website providing information about the research
3232

3333
### Curated Collections of Data {.unnumbered}
3434

35-
The data page is arguably the most important component of the Arctic Data Center portal system. This is where users will display the data packages of their choice. Whether these data reflect research products from your research group (collated based on contributor IDs), or thematic areas of research interest (collated based on keyword and search terms), will depend upon the intended use of the portal but in all cases, you are refining the suite of data viewed by your audience. The data page looks and performs just like the main Arctic Data Center catalog - with some added bonuses, see below.
35+
The data page is arguably the most important component of the Arctic Data Center portal system. This is where users will display the data packages of their choice. Whether these data reflect research products from your research group (collated based on contributor IDs), or thematic areas of research interest (collated based on keyword and search terms), will depend upon the intended use of the portal but in all cases, you are refining the suite of data viewed by your audience. The data page looks and performs just like the main Arctic Data Center catalog - with some added bonuses, see below.
3636

3737
![](images/arctic-data-center/ADC_Toolik_portal_data.png)
3838

@@ -44,29 +44,34 @@ You can also build more precise search capabilities into your portal, leveraging
4444

4545
![](images/arctic-data-center/ADC_SASAP_portal_data2.png)
4646

47+
### Custom Portal Features {.unnumbered}
48+
49+
The Arctic Data Center has also developed custom features for data portals. For example, [this video](https://drive.google.com/file/d/1cwStXzB4ZMaTJqh3U-sI5nOSVJtrjkNH/view?usp=sharing) demonstrates a custom portal map page on the Permafrost Discovery Gateway, showing how datasets, like retrogressive thaw slump measurements, can be explored interactively. Users can zoom, pan, and filter visible data layers.
50+
51+
This [example](https://drive.google.com/file/d/1ID4HflHeKSUZ8JuQcYNYUQBifiHTALIS/view?usp=sharing) from the Salmon Knowledge Portal highlights how Shiny Apps can make data portals interactive and user-friendly. By embedding Shiny Apps directly within a portal page, users can explore datasets in real-time, filter information, and visualize patterns.
52+
53+
Interested in adding interactivity to your data portal? Reach out to our data curation team to get started: [support\@arcticdata.io](mailto::support@arcticdata.io)
54+
4755
### Metrics, Metrics, Metrics {.unnumbered}
4856

49-
As with the full Arctic Data Center catalog, we aggregate metrics for the collection of data packages within a portal. This page is not customizable - it comes as a default with the portal - but you can choose to delete it. The metrics provided include a summary of the holdings: number, volume, time period, format of datasets, metadata assessment scores, citations across all packages, and counts of downloads and views. These latter metrics can be particularly useful if wanting to track the usage or reach of your project or group's activities.
57+
As with the full Arctic Data Center catalog, we aggregate metrics for the collection of data packages within a portal. This page is not customizable - it comes as a default with the portal - but you can choose to delete it. The metrics provided include a summary of the holdings: number, volume, time period, format of datasets, metadata assessment scores, citations across all packages, and counts of downloads and views. These latter metrics can be particularly useful if wanting to track the usage or reach of your project or group's activities.
5058

51-
![](images/arctic-data-center/ADC_Toolik_portal_metrics1.png)
52-
![](images/arctic-data-center/ADC_Toolik_portal_metrics2.png)
59+
![](images/arctic-data-center/ADC_Toolik_portal_metrics1.png) ![](images/arctic-data-center/ADC_Toolik_portal_metrics2.png)
5360

5461
## Enhancing Access to Social Science Research Data
5562

56-
Many of the portal examples provided above are organizational, individual or project portals created by members of the Arctic research community. The ability to group relevant datasets and customize search criteria increases data discoverability and accessibility among target audiences. The Arctic Data Center has leveraged these features to create a specific portal for social science data.
63+
Many of the portal examples provided above are organizational, individual or project portals created by members of the Arctic research community. The ability to group relevant datasets and customize search criteria increases data discoverability and accessibility among target audiences. The Arctic Data Center has leveraged these features to create a specific portal for social science data.
5764

5865
![](images/Sosci_portal.png)
5966

60-
Within this portal, users can subset by social science [discipline](https://raw.githubusercontent.com/NCEAS/adc-disciplines/main/adc-disciplines.png), data type and other metadata fields built into the portal. These search features depend on sufficient user contributed metadata describing the dataset, and as can be seen from the 'with data' toggle, the portal does not require the data themselves to be uploaded to the Arctic Data Center.
67+
Within this portal, users can subset by social science [discipline](https://raw.githubusercontent.com/NCEAS/adc-disciplines/main/adc-disciplines.png), data type and other metadata fields built into the portal. These search features depend on sufficient user contributed metadata describing the dataset, and as can be seen from the 'with data' toggle, the portal does not require the data themselves to be uploaded to the Arctic Data Center.
6168

6269
![](images/Sosci_portal_discipline.png)
6370

64-
65-
## Relationship between Arctic Data Center portals and DataONE
71+
## Relationship between Arctic Data Center portals and DataONE
6672

6773
Both DataONE and the Arctic Data Center use Metacat and MetacatUI software and both have the capability for individuals and groups to develop portals. This is true of other repositories running this software. The difference between a portal at the Arctic Data Center and one through DataONE is the corpus of data that can be pulled into your portal. Arctic Data Center portals expose only data held in the Arctic Data Center repository. A portal in DataONE can expose data from across the full network of data repositories - including DataONE. This is particularly useful for interdisciplinary research projects, labs that have published data to multiple repositories etc. However, unlike at the Arctic Data Center, there is a cost associated with a DataONE portal as they are part of the organizations sustainability model.
6874

69-
7075
## Creating Portals
7176

7277
A step-by-step guide on how to navigate the Arctic Data Center and create a new portal. For video tutorials on how to create your first portal, please visit the [Arctic Data Center's](https://arcticdata.io/data-portals/#instructional-videos-identifier) website.
@@ -77,7 +82,7 @@ If you are on the [Arctic Data Center's primary website](http://arcticdata.io/),
7782

7883
![](images/arctic-data-center/adc-homepage-2026.png)
7984

80-
You can then navigate to Data -> Portals.
85+
You can then navigate to Data -\> Portals.
8186

8287
![](images/ADC-portalnav.png)
8388

@@ -91,34 +96,33 @@ In a new edit session, the first page you'll be taken to is the settings page wh
9196

9297
![](images/arctic-data-center/ADC_portal_settings1.png)
9398

94-
- Portal URL
95-
- Identify a short name for your portal that will become part of the URL. If the name is available, a label will indicate it's available and if the name is taken already, it will note that the name is already taken. This feature ensures the portals are unique.
96-
- Portal description
97-
- Sharing options
98-
- For the purposes of this training, please leave your portal in 'Private' status. You are welcome to return and make the portal public when the portal is complete and is useful to you and others.
99-
- Permissions
100-
- Adding collaborators to help you create your portal is as straightforward as copying and pasting in their ORCID into the box below the permissions section. You can choose whether the collaborator can view, edit, or is an owner of the portal. You can have multiples of each role.
101-
- Partner Logos
99+
- Portal URL
100+
- Identify a short name for your portal that will become part of the URL. If the name is available, a label will indicate it's available and if the name is taken already, it will note that the name is already taken. This feature ensures the portals are unique.
101+
- Portal description
102+
- Sharing options
103+
- For the purposes of this training, please leave your portal in 'Private' status. You are welcome to return and make the portal public when the portal is complete and is useful to you and others.
104+
- Permissions
105+
- Adding collaborators to help you create your portal is as straightforward as copying and pasting in their ORCID into the box below the permissions section. You can choose whether the collaborator can view, edit, or is an owner of the portal. You can have multiples of each role.
106+
- Partner Logos
102107

103108
![](images/arctic-data-center/ADC_portal_settings2.png)
104109

105-
### Adding Data to Portals{.unnumbered}
110+
### Adding Data to Portals {.unnumbered}
106111

107112
When selecting the data tab you will see a page with two sections. These are titled with instructive statements to help explain their function:
108113

109-
- Add filters to help people find data within your collection
110-
- *build search features for others to use within your portal*
111-
- Add data to your collection
112-
- *construct a search to populate your portal with data*
114+
- Add filters to help people find data within your collection
115+
- *build search features for others to use within your portal*
116+
- Add data to your collection
117+
- *construct a search to populate your portal with data*
113118

114-
![](images/arctic-data-center/ADC_portal_data_editor_1.png)
115-
We're going to start with the second section: Adding data to your collection.
119+
![](images/arctic-data-center/ADC_portal_data_editor_1.png) We're going to start with the second section: Adding data to your collection.
116120

117-
When adding data to your collection, you can include any of the datasets that are available at the Arctic Data Center. You build rules based on metadata to define which datasets should be included. Of course, where metadata is incomplete or abbreviated, this will impact your results. Data added to the network in the future that match these rules will also be added to your collection.
121+
When adding data to your collection, you can include any of the datasets that are available at the Arctic Data Center. You build rules based on metadata to define which datasets should be included. Of course, where metadata is incomplete or abbreviated, this will impact your results. Data added to the network in the future that match these rules will also be added to your collection.
118122

119123
The first thing we notice is the ability to include/exclude data based on all/any metadata criteria. This setting applies across all rules.
120124

121-
In the default view, you have the starting point for a single rule, and a view showing 0 datasets.
125+
In the default view, you have the starting point for a single rule, and a view showing 0 datasets.
122126

123127
![](images/arctic-data-center/ADC_portal_data_editor_2.png)
124128

@@ -130,20 +134,19 @@ The metadata fields available for rule construction are easily visible in the dr
130134

131135
![](images/arctic-data-center/ADC_portal_data_editor_4.png)
132136

133-
### Building Search Options for Your Audience{.unnumbered}
137+
### Building Search Options for Your Audience {.unnumbered}
134138

135139
This section covers the first part of the 'data' page: "Add filters to help people find data within your collection". Although it appears first, I recommend constructing these filters after you have defined your data, as you will have a better understanding of the metadata fields that are relevant to your portal collection. It appears at the top of this editor page, as when published, it will be at the top for users. Hence, the editor page reflects the layout of the published page.
136140

137-
When selecting "add a search filter" you will be presented with a pop-up that comprises three primary elements:
141+
When selecting "add a search filter" you will be presented with a pop-up that comprises three primary elements:
138142

139-
1. The metadata filed you will be querying
140-
2. The way in which you want the user to interact with that metadata
141-
3. Language settings for the filter you are building
143+
1. The metadata filed you will be querying
144+
2. The way in which you want the user to interact with that metadata
145+
3. Language settings for the filter you are building
142146

143147
![](images/arctic-data-center/ADC_portal_filter_1.png)
144148

145-
146-
As you select options for number 1 - the metadata field, the pop-up will refresh to show only those relevant options. Save this filter to close the pop-up, return to the main editor and add another search filter.
149+
As you select options for number 1 - the metadata field, the pop-up will refresh to show only those relevant options. Save this filter to close the pop-up, return to the main editor and add another search filter.
147150

148151
![](images/arctic-data-center/ADC_portal_filter_2.png)
149152

@@ -155,7 +158,7 @@ To see metric summaries, navigate to your portal in view mode. See 'Saving and E
155158

156159
![](images/arctic-data-center/ADC-editmetrics.png)
157160

158-
### Creating Unique Freeform Pages{.unnumbered}
161+
### Creating Unique Freeform Pages {.unnumbered}
159162

160163
To watch a tutorial on creating a new freeform page see this video:[Creating a Freeform Text Page](https://arcticdata.io/data-portals/#instructional-videos-identifier)
161164

@@ -177,7 +180,7 @@ Please see these additional resources for help with markdown:
177180
- [Ten minute tutorial](https://commonmark.org/help/tutorial/)
178181
- For a longer example where you can also preview the results, checkout the [Showdown Live Editor](http://demo.showdownjs.com/)
179182

180-
### Saving and Editing Portals{.unnumbered}
183+
### Saving and Editing Portals {.unnumbered}
181184

182185
Be sure to save your portal when you complete a page to ensure your progress is retained.
183186

materials/sections/adc-intro-to-policies.qmd

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ We’re best known in the research community as a data archive – researchers u
1818

1919
NSF has long had a commitment to data reuse and sharing. Since our start in 2016, we’ve grown substantially – from that original 4 TB of data from ACADIS to now over 300 TB at the start of 2026. In 2021 alone, we saw 16% growth in dataset count, and about 30% growth in data volume. This increase has come from advances in tools – both ours and of the scientific community, plus active community outreach and a strong culture of data preservation from NSF and from researchers. We plan to add more storage capacity in the coming months, as researchers are coming to us with datasets in the terabytes, and we’re excited to preserve these research products in our archive. We’re projecting our growth to be around several hundred TB this year, which has a big impact on processing time. Give us a heads up if you’re planning on having larger submissions so that we can work with you and be prepared for a large influx of data.
2020

21-
![](images/arctic-data-center/ADC repo size jan 2025.png)
21+
![](images/arctic-data-center/ADC-growth-repro.png)
2222

2323
The data that we have in the Arctic Data Center comes from a wide variety of disciplines. These different programs within NSF all have different focuses – the Arctic Observing Network supports scientific and community-based observations of biodiversity, ecosystems, human societies, land, ice, marine and freshwater systems, and the atmosphere as well as their social, natural, and/or physical environments, so that encompasses a lot right there in just that one program. We’re also working on a way right now to classify the datasets by discipline, so keep an eye out for that coming soon.
2424

materials/sections/metadata-adc-data-documentation-hands-on.qmd

Lines changed: 41 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -757,6 +757,47 @@ fig-align="center"}](https://datascience.codata.org/articles/10.5334/dsj-2020-04
757757
[guidelines](https://arcticdata.io/data-ethics/) on how to write and
758758
what to include in an Ethical Research Practices Statement.
759759

760+
## Research Data Publishing Ethics
761+
762+
For over 20 years, the [Committee on Publication Ethics (COPE)](https://publicationethics.org/) has provided trusted guidance on ethical practices for scholarly publishing.
763+
The COPE guidelines have been broadly adopted by academic publishers across disciplines, and represent a common approach to identify, classify, and adjudicate potential breaches of ethics in publication such as authorship conflicts, peer review manipulation, and falsified findings, among many other areas.
764+
Despite these guidelines, there has been a lack of ethics standards, guidelines, or recommendations for data publications, even while some groups have begun to evaluate and act upon reported issues in data publication ethics.
765+
766+
![Data retractions](images/ethical-dataset-retractions.png)
767+
768+
To address this gap, the [Force 11 Working Group on Research Data Publishing Ethics](https://force11.org/groups/research-data-publishing-ethics/home/) was formed as a collaboration among research data professionals and the Committee on Publication Ethics (COPE) "to develop industry-leading guidance and recommended best practices to support repositories, journal publishers, and institutions in handling the ethical responsibilities associated with publishing research data." The group released the "Joint FORCE11 & COPE Research Data Publishing Ethics Working Group Recommendations" [@puebla_2021], which outlines recommendations for four categories of potential data ethics issues:
769+
770+
- [Authorship and Contribution Conflicts](https://zenodo.org/record/5391293/files/Authorship%20%26%20Contributions_datapubethics.pdf?download=1)
771+
- Authorship omissions
772+
- Authorship ordering changes / conflicts
773+
- Institutional investigation of author finds misconduct
774+
- [Legal/regulatory restrictions](https://zenodo.org/record/5391293/files/Legal%20%26%20Regulatory%20Restrictions_datapubethics.pdf?download=1)
775+
- Copyright violation
776+
- Insufficient rights for deposit
777+
- Breaches of national privacy laws (GPDR, CCPA)
778+
- Breaches of biosafety and biosecurity protocols
779+
- Breaches of contract law governing data redistribution
780+
- [Risks of publication or release](https://zenodo.org/record/5391293/files/Risk_datapubethics.pdf?download=1)
781+
- Risks to human subjects
782+
- Lack of consent
783+
- Breaches of himan rights
784+
- Release of personally identifiable information (PII)
785+
- Risks to species, ecosystems, historical sites
786+
- Locations of endangered species or historical sites
787+
- Risks to communities or societies
788+
- Data harvested for profit or surveillance
789+
- Breaches of data sovereignty
790+
- [Rigor of published data](https://zenodo.org/record/5391293/files/Rigor_datapubethics.pdf?download=1)
791+
- Unintentional errors in collection, calculation, display
792+
- Un-interpretable data due to lack of adequate documentation
793+
- Errors of of study design and inference
794+
- Data manipulation or fabrication
795+
796+
Guidelines cover what actions need to be taken, depending on whether the data are already published or not, as well as who should be involved in decisions, who should be notified of actions, and when the public should be notified.
797+
The group has also published templates for use by publishers and repositories to announce the extent to which they plan to conform to the data ethics guidelines.
798+
799+
![Force11/COPE](images/force11-cope-logos.png)
800+
760801
## Exercise: Evaluate a Data Package on the ADC Repository
761802

762803
Explore data packages published on the ADC assess the quality of their

0 commit comments

Comments
 (0)