2.2.0

MAJOR BREAKING CHANGE

From this version on tomcat must be version 10 or above!

What's Changed

• Jakarta/Tomcat migration by @roycpro in #434

New Contributors

• @roycpro made their first contribution in #434

Full Changelog: 2.1.2...2.2.0

2.1.2

Mostly bug fixes to pause, resume and reassign.

What's Changed

• Do not throw a AlreadyRegisteredException when reassigning a PV by @slacmshankar in #429
• Need to remember incoming PV names to cater to aliases in bulkpauseresume by @slacmshankar in #433

Full Changelog: 2.1.1...2.1.2

2.1.1

IMPORTANT BUG FIX INCLUDED

• Fix potential deadlocks in EPICS_V3_PV by @slacmshankar in #425

What's Changed

• Fix javadoc errors by @jacomago in #382
• Add integration tests to ci by @jacomago in #378
• BPL for dynamic reassign appliance by @slacmshankar in #376
• Clean up gradle file by @jacomago in #384
• Fix for #375 - getDataAtTime sometimes picks incorrect values at boundaries of chunks by @slacmshankar in #385
• Rename PlainPB to plain by @jacomago in #387
• Update docs for new PlainStoragePlugin location and rootFolder property by @jacomago in #388
• Rename ComparePBEvent to CompareEvent by @jacomago in #389
• Cleanup and rename ValidatePBFile.java by @jacomago in #393
• Remove unused class GetFileTime by @jacomago in #390
• Improve FailoverETLServerDownTest by @jacomago in #391
• Pbcommonsetup to plaincommonsetup by @jacomago in #394
• Add helper method TimeUtils.getSecondsIntoYear for instant by @jacomago in #397
• Format and fix small lints in static content servlet by @jacomago in #396
• Expose the protobuf.Message in each data type by @jacomago in #392
• Use buildRelease instead of assemble in pipeline by @jacomago in #398
• Fix typo in printtimes.sh by @jacomago in #399
• Add helper enum URLKey by @jacomago in #400
• Use a TTL cache for the filestore disk available and total space. by @slacmshankar in #402
• Urlkeys usage by @jacomago in #403
• Run startETLJobsOnStartup in the background. by @slacmshankar in #406
• Remove computing ApplianceAggregateInfo on startup. by @slacmshankar in #408
• Use queryPVTypeInfos to determine the breakdown of pvcounts in a cluster by @slacmshankar in #409
• Etlbulkstream refactor by @jacomago in #404
• Rather than supporting bidirectional iterator for plain by @jacomago in #405
• Pv overridable siteNameTerminator by @jacomago in #410
• Add unit test version of MissingDataYearSpanRetrievalTest by @jacomago in #395
• Fix MissingDataYearSpanRetrievalUnitTest by @jacomago in #412
• Abstract file info by @jacomago in #414
• Lower log levels by @slacmshankar in #417
• Add a report showing Command thread command queue depths by @slacmshankar in #416
• GitHub release by @jacomago in #418
• Fix a couple of data driven unit tests by @slacmshankar in #420
• #386 - Use a different name for the array count from the API by @slacmshankar in #423
• Fix for HashMapEvent parsing exception by @jacomago in #421
• Abstract the file handling by @jacomago in #415
• Fix potential deadlocks in EPICS_V3_PV by @slacmshankar in #425

Full Changelog: 2.1.0...2.1.1

Release 2.1.0

Major changes

• Refactor ETL threading to support consolidateOnShutdown on multiple dataStores for a PV - Version 2 by @slacmshankar in #368

Paused PVs are not kept track in the db anymore but are part of the clustering mechanism.

What's Changed

• Remove the check for NAME/NAME$ fields containing site name separators by @slacmshankar in #359
• Allow pvAccess for alias workflow by @jacomago in #364
• Update the user guide to use requests and bokeh by @slacmshankar in #366
• Remove Selenium from the unit tests. by @slacmshankar in #365
• Refactor ETL threading to support consolidateOnShutdown on multiple dataStores for a PV - Version 2 by @slacmshankar in #368
• Move Time utils test by @jacomago in #373
• Move compression mode out to pbcompressionmode by @jacomago in #372
• Document searchPeriod by @slacmshankar in #374
• Test pvAccess works with alias by @jacomago in #371
• Preformat file with spotless before adding the parquet changes by @jacomago in #370
• slightly nicer disconnects handling by @jacomago in #360

Full Changelog: 2.0.10...2.1.0

2.0.10

Important fix for the svg viewer,
And update to core-pva to latest.

What's Changed

• Improve typeinfo config load by @jacomago in #353
• Update core-pva to 5.0.0 by @jacomago in #350
• Update build.gradle for svg viewer 1.2.1 by @jacomago in #354
• Remove flaky test that isn't needed by @jacomago in #355

Full Changelog: 2.0.9...2.0.10

2.0.9

We targeting JDK 21+ from this release onwards - Update to java 21

Full Changelog: 2.08...2.0.9

2.0.8

What's Changed

• CSSTUDIO-3042 Bugfix: Duplicate and out of order samples when using optimized in a query to the archiver by @abrahamwolk in #333
• Handle Empty waveforms more elegantly by @jacomago in #336

Full Changelog: 2.0.7...2.08

2.0.7

Summary

• Fixes some bugs with the default builds.
• Cleans up the thread handling for channels.
• Thanks to @wanglin86769 for upgrading the scripts to python3
• Adds a feature to skip a datastore

What's Changed

• Add the documentation for the other preprocessors by @jacomago in #274
• Allow github actions on all pull requests by @jacomago in #276
• Move Licenses to single folder by @jacomago in #275
• Provide a clear datetime string yst by @jacomago in #278
• Use partitionGranularity for test seconds by @jacomago in #279
• Check if etl threads are shutdown before trying by @jacomago in #280
• Update the epicsversion in tests by @jacomago in #281
• Use async logger by @jacomago in #277
• Matlab response has incorrect value for daylightsavings by @slacmshankar in #283
• Add default config to the default build by @jacomago in #285
• Add build_docs script for Windows by @wanglin86769 in #289
• Format the StoragePlugin related files by @jacomago in #287
• Close CA channels properly and do not reuse CA channels by @slacmshankar in #288
• PV name cannot be converted to key for Windows by @wanglin86769 in #294
• Static resources cannot be loaded from zip for Windows by @wanglin86769 in #293
• Fix the issue that error occurs when refreshing pv status by @wanglin86769 in #295
• defaultsitespecificpath is not resolved correctly in some environments by @wanglin86769 in #296
• Convert addPostProcessingOperator.py to python3 by @wanglin86769 in #297
• Convert abortNeverConnectedPVs.py to python3 by @wanglin86769 in #298
• Convert archiveFromDB.py to python3 by @wanglin86769 in #299
• Convert archivedPVsNotInList.py to python3 by @wanglin86769 in #301
• Convert emailHandler.py to python3 by @wanglin86769 in #300
• Convert checkConnectedPVs.py to python3 by @wanglin86769 in #303
• Convert changeArchiveStore.py to python3 by @wanglin86769 in #302
• Convert checkForEngineActivity.py to python3 by @wanglin86769 in #304
• Convert checkTypeChangedPVs.py to python3 by @wanglin86769 in #305
• Convert consolidatePausedPVs.py to python3 by @wanglin86769 in #306
• Convert deletePVList.py to python3 by @wanglin86769 in #307
• Convert getPVList.py to python3 by @wanglin86769 in #308
• Convert listTypeChanges.py to python3 by @wanglin86769 in #309
• Convert printCurrentlyDisconnectedPVs.py to python3 by @wanglin86769 in #312
• Convert pingCurrentlyDisconnectedPVs.py to python3 by @wanglin86769 in #311
• Convert renamePVList.py to python3 by @wanglin86769 in #314
• Convert pausePVList.py to python3 by @wanglin86769 in #310
• Convert removeMetaFields.py to python3 by @wanglin86769 in #313
• Convert stopArchivingCurrentlyDisconnectedPVs.py to python3 by @wanglin86769 in #318
• Convert resumePausedPVsMatchingPattern.py to python3 by @wanglin86769 in #316
• Convert resumePVList.py to python3 by @wanglin86769 in #317
• Convert storageSizeCheck.py to python3 by @wanglin86769 in #319
• Convert unarchivedPVs.py to python3 by @wanglin86769 in #320
• Convert addMysqlConnPool.py to python3 by @wanglin86769 in #321
• Convert deployMultipleTomcats.py to python3 by @wanglin86769 in #322
• Retrieval returns zero samples for slowly changing PV #323 by @slacmshankar in #329
• Skip data store for retrieval based on named flag. by @slacmshankar in #330

New Contributors

• @wanglin86769 made their first contribution in #289

Full Changelog: 2.0.5...2.0.7

2.0.5

Release 2.0.5

After a lot of work a new release of the EPICS Archiver Appliance. Lots of changes have been made and this is a major release, so make sure to test thoroughly before pushing into production. Bug reports are very welcome!

Overview

Breaking Changes

Please note the breaking change:

• log4j updated to log4j2 (need a new log configuration file)

  To migrate, the log4j.properties file needs to be changed to a log4j2.xml file. See an example file in the documentation

• The build process has also been overhauled with a new build tool.

  Please see the developers guide and the README for how to use it. Site specific builds should still work, and can now specify a folder outside of the src root.

New Features

• #193: Field modifiers in pv names

  Now you are able to submit a channel name such as PV:Temp.{'dbnd':{'rel':0.1}}
  For more information on available field modifiers see the EPICS documentation

• #193: Support for json input of a pv list to more of the api endpoints

  The getPVStatus endpoint
  now accepts input of the form:
  [ {"pv": "PVNAME1"}, {"pv": "PVNAME2"} ]

• #223: Retrieval Analytics

  Adds some information on number of requests on each PV (since last appliance reboot) to the getPVDetails endpoint.

• #207: Allow each WAR to run on different ip addresses

  This means if running each war file in a different docker container, they can all have different ip addresses.

• #150: Ability to set PV Access or Channel Access as the default protocol

  Setting org.epics.archiverappliance.mgmt.bpl.ArchivePVAction.defaultAccessProtocol in archappl.properties to PVA or CA changes the default protocl for submitting PVs to be archived.

• #241: The list of aliases now appears in pvDetails endpoint

• #268 Meta fields returned with GetDataAtTime endpoint (which should be more efficient and get last value before timestamp if no data on timestamp)

• #260: Option for not looking up the lastKnownTimestamp on appliance startup

  Using the parameter org.epics.archiverappliance.engine.archivePVSonStartup.determineLastKnownEventFromStores
  Also adds a parameter org.epics.archiverappliance.engine.epics.server_ioc_drift_seconds for an allowed clock drift between IOC and archiver appliance

• #173 + #258: Able redirects in retrieval engine (so appliance doesn't need to copy data to host machine before sending)

  Using the parameter org.epics.archiverappliance.retrieval.DataRetrievalServlet.proxyRetrievalRequest

• #261: Paused PV count is now cached.

• #219 A new default theme without any site specific styling

Development changes

• #172: PVAccess library updated to phoebus one
• #149 + #176: Build tool changed to gradle.
• #170: Third party libraries updated
• #243: Documentation now published using read the docs
• #265,#266 Docker builds are now available from github

All changes

• Fix PlainPBFileNameUtilityTest by @jacomago in #145
• Fix for OptimizedPostProcessorTest failing by @jacomago in #147
• Add closing section tag by @jacomago in #148
• Add a setting to make pvAccess or Channel Access the default protocol… by @jacomago in #150
• fix log info message by @jacomago in #152
• Gradle build file and test categorisation by @jacomago in #149
• Add a github workflow to build the project by @jacomago in #151
• Added environment variable to control the name of MySQL DB by @DanielALS in #119
• Ensure PB iterator obeys the iterator protocol. by @willrogers in #45
• Fix load of ARCHAPPL_DB_NAME when it's not set #153 by @jacomago in #154
• Fixes the gradle github actions builds: by @jacomago in #155
• Adds the multi platform provider of web drivers by @jacomago in #156
• Add a GetPVNames button in the GUI #157 by @lcaouen in #159
• Issue#161 by @lcaouen in #162
• Delete multiple PVs by @lcaouen in #160
• Unit test for "Delete multiple PVs" by @lcaouen in #167
• Update depend by @jacomago in #170
• Fixes integration testing by adhoc creating an appliances xml by @jacomago in #171
• Swaps epicsCoreJava pvAccess library for org.phoebus.core-pva by @jacomago in #172
• Redirect single pv retrieval requests by @jacomago in #173
• Add a runner for running the application the same as for the integrat… by @jacomago in #174
• use action-junit-report to see inline test results by @jacomago in #177
• Update quickstart.sh for the log4j2 upgrade by @jacomago in #178
• Timestamp to instant by @jacomago in #181
• Fix PvaGetArchivedPVsTest by checking size of arrays match by @jacomago in #187
• parallel_iocs by @jacomago in #175
• Fixes the Failover tests by @jacomago in #196
• Update double buffer test to junit 5. by @jacomago in #199
• CSSTUDIO-2134 Two bugfixes to SummaryStatsPostProcessor and one bugfix and one improvement to Optimized. by @abrahamwolk in #200
• Remove most of the ant build file by @jacomago in #176
• Makes the PV Metric return the last connected state. by @jacomago in #182
• Add auto formatter for java code by @jacomago in #183
• Use tomcat cors filter instead of manually adding access control header by @jembishop in #186
• Add a file to specify line endings behaviour by @jacomago in #190
• Update gradle wrapper by @jacomago in #198
• Split up the imports list by @jacomago in #205
• Add formatting checks of web code by @jacomago in #201
• Update the documentation to cover formatting and testing by @jacomago in #206
• Ignore intelij files by @jacomago in #213
• Introduce end-of-line normalization by @jacomago in #220
• Retrieval Add ability to use "protocol://pvName" by @jacomago in #215
• Update readme with some quickstart information by @jacomago in https://github.com/archiver-appliance/epi...

1.1.0

Winter 2022 Release

Mostly bug fixes; especially #142. Also some long standing pull requests; thanks to everyone who contributed!

Also, finally shifting to semantic versioning - we're starting at 1.1.0.