v7.3.0

[haoming29]

Highlights

For Users

• Users can now recursively upload and download files. #260, #261
• Users can upload a local directory to a data federation as a tarball and can unpack a tarball into a directory as it downloads.
• For improved debugging, writing a debug file into a known location is now supported. #22
• Introduced Javascript client allowing browsers to perform file transfers. Installation of the Javascript client enables users via their browser to download a file from a data federation supported by Pelican. #344

For Admins

• [Origin] Added support for S3 file backend so that admins may expose or configure the S3 backend. #169
• [Cache] Added authentication to cache service. #311
• [Issuer] Introduced new OAuth2 issuer built into the origin packaging. #262
• [General] Introduced web pages for the director and registry components. #265, #354, #355
• New feature to allow the director to aggregate metrics from registered origins and to allow the director to periodically test origins #291 #175

What's Changed

• Get rid of superfluous symlink by @timtheisen in Get rid of superfluous symlink #348
• Code cleanup in serveNamespaceRegistry by @turetske in Code cleanup in serveNamespaceRegistry #341
• Made Pelican logging able to output to file by @joereuss12 in Made Pelican logging able to output to file #346
• Fix problems with config_test.go by @joereuss12 in Fix problems with config_test.go #363
• Revert "Code cleanup in serveNamespaceRegistry" by @turetske in Revert "Code cleanup in serveNamespaceRegistry" #364
• Namespace registry serve cleanup by @turetske in Namespace registry serve cleanup #365
• Renamed getOriginJWK to getServerJWK by @turetske in Renamed getOriginJWK to getServerJWK #339
• Use Server.Hostname than os.Hostname() in generating CA by @haoming29 in Use Server.Hostname than os.Hostname() in generating CA #356
• Standardize server init and cleanup a few other small items by @jhiemstrawisc in Standardize server init and cleanup a few other small items #362
• Fix issue with progress bar panic on download by @joereuss12 in Fix issue with progress bar panic on download #369
• Always generate a CA if no host certificate present by @haoming29 in Always generate a CA if no host certificate present #375
• Add authorization to Prometheus /metrics endpoint by @haoming29 in Add authorization to Prometheus /metrics endpoint #373
• Set correct log level for Prometheus logger by @haoming29 in Set correct log level for Prometheus logger  #358
• Unit test for namespace-registry by @joereuss12 in Unit test for namespace-registry #337
• Introduce enum for health status and component names for SetComponentHealthStatus by @haoming29 in Introduce enum for health status and component names for SetComponentHealthStatus #376
• Fix Config Bug by @CannonLock in Fix Config Bug #381
• Refactor init_server_cred to be more clear on their usage by @haoming29 in Refactor init_server_cred to be more clear on their usage #382
• Adjusted dev.Dockerfile to run make web-build properly by @turetske in Adjusted dev.Dockerfile to run make web-build properly #386
• Git test action updates by @turetske in Git test action updates #385
• Fix small bugs in DiscoverFederation() by @jhiemstrawisc in Fix small bugs in DiscoverFederation() #400
• Fixed scitokens generation bug by @turetske in Fixed scitokens generation bug #392
• Add swagger spec and include auth APIs and common APIs by @haoming29 in Add swagger spec and include auth APIs and common APIs #401
• Replace ComputeExternalAddress by param Server.ExternalWebUrl and rename Server.Port and Server.Address by @haoming29 in Replace ComputeExternalAddress by param Server.ExternalWebUrl and rename Server.Port and Server.Address #378
• End-to-end test for XRootD by @bbockelm in End-to-end test for XRootD #328
• Add unit tests to XRootD monitoring handler by @haoming29 in Add unit tests to XRootD monitoring handler #347
• Hook up monitoring paths functionality by @bbockelm in Hook up monitoring paths functionality #407
• Refactor origin_ui to web_ui to reuse basic logic for server web UI/API by @haoming29 in Refactor origin_ui to web_ui to reuse basic logic for server web UI/API #398
• If no auth token is present, do not emit verbose error message by @bbockelm in If no auth token is present, do not emit verbose error message #404
• Director-based origin health tests by @haoming29 in Director-based origin health tests #305
• Always unmarshall config when /config API is called by @haoming29 in Always unmarshall config when /config API is called #395
• Update integration test file by @haoming29 in Update integration test file #422
• Rename namespace-registry to conform to go standards and move registry db test by @jhiemstrawisc in Rename namespace-registry to conform to go standards and move registry db test #425
• Update integration test file - update stashcp source by @haoming29 in Update integration test file - update stashcp source #426
• Ensure TTL caches evict expired item by @haoming29 in Ensure TTL caches evict expired item #416
• Federation Overview Federation Overview #221 by @CannonLock in Federation Overview #221 #411
• Reimplimented recursive downloads by @joereuss12 in Reimplimented recursive downloads #377
• Fixed non running e2e test by @turetske in Fixed non running e2e test #434
• Remove content length from upload to enable chunked by @djw8605 in Remove content length from upload to enable chunked #208
• Add authorization policies for OA4MP by @bbockelm in Add authorization policies for OA4MP #393
• Add supervisor script to make origins servable by @jhiemstrawisc in Add supervisor script to make origins servable #428
• Fix bad error message from director by @jhiemstrawisc in Fix bad error message from director #433
• Fix racing conditions in various director-related code and tests by @haoming29 in Fix racing conditions in various director-related code and tests #441
• Periodically prepare a combined custom + system CA bundle by @bbockelm in Periodically prepare a combined custom + system CA bundle #406
• Add cache supervisord process by @jhiemstrawisc in Add cache supervisord process #443
• Add test dependencies to dev.Dockerfile for PR Add S3 backend to Pelican #419 by @jhiemstrawisc in Add test dependencies to dev.Dockerfile for PR #419 #450
• Pelican cache with auth by @turetske in Pelican cache with auth #423
• Automatically unpack tarballs when downloaded by @bbockelm in Automatically unpack tarballs when downloaded #408
• Web UI Move by @CannonLock in Web UI Move #449
• Fix doc missing space for client-usage.mdx by @haoming29 in Fix doc missing space for client-usage.mdx #432
• Update Web UI src code location by @CannonLock in Update Web UI src code location #455
• Upgrade NextJS to ^14 by @CannonLock in Upgrade NextJS to ^14 #454
• Refactor director SD tests and add test for duplicated origins by @haoming29 in Refactor director SD tests and add test for duplicated origins #430
• Refactor generate package by @haoming29 in Refactor generate package #442
• Provide ConfigureOriginAPI a cancel context that can be cancelled on shutdown by @haoming29 in Provide ConfigureOriginAPI a cancel context that can be cancelled on shutdown #431
• Implement recursive uploads by @joereuss12 in Implement recursive uploads #415
• Add listServer API to director Web UI by @haoming29 in Add listServer API to director Web UI #458
• Refactor file transfer tests into a utility class by @haoming29 in Refactor file transfer tests into a utility class #447
• Swagger docs by @CannonLock in Swagger docs #456
• Provide better message (with no error) when we register an already-registered namespace prefix by @jhiemstrawisc in Provide better message (with no error) when we register an already-registered namespace prefix #461
• Arm-compatible Pelican container and fix 404 minio RPM by @haoming29 in Arm-compatible Pelican container and fix 404 minio RPM #469
• Adding dir listing capability to Pelican Origins by @joereuss12 in Adding dir listing capability to Pelican Origins #468
• Enable key chaining to protect super/sub namespaces by @jhiemstrawisc in Enable key chaining to protect super/sub namespaces #460
• Fix progress bar for recursive downloads by @joereuss12 in Fix progress bar for recursive downloads #471
• Director UI by @CannonLock in Director UI #466
• Build containers but don't push on PR by @CannonLock in Build containers but don't push on PR #467
• Data Exports Overview Table Data Exports Overview Table #220 by @CannonLock in Data Exports Overview Table #220 #410
• Lock NextJS to 14.0.3 by @CannonLock in Lock NextJS to 14.0.3 #475
• Fix progress bars w/ recursive uploads and downloads by @joereuss12 in Fix progress bars w/ recursive uploads and downloads #473
• Add S3 backend to Pelican by @jhiemstrawisc in Add S3 backend to Pelican #419
• Refactor checkAPIToken to be more generic and less verbose by @haoming29 in Refactor checkAPIToken to be more generic and less verbose #429
• Make the registry aware of topology by @jhiemstrawisc in Make the registry aware of topology #470
• Add draft of SECURITY.md by @jhiemstrawisc in Add draft of SECURITY.md #324
• Placeholder namespace UI 354 by @CannonLock in Placeholder namespace UI 354 #478

New Contributors

• @timtheisen made their first contribution in Get rid of superfluous symlink #348
• @djw8605 made their first contribution in Remove content length from upload to enable chunked #208

Full Changelog: v7.2.0...v7.3.0

---

This discussion was created from the release v7.3.0.