Skip to content

Commit 15d64da

Browse files
committed
Additional info about migrating data
1 parent b0213e5 commit 15d64da

File tree

1 file changed

+26
-4
lines changed

1 file changed

+26
-4
lines changed

docs.openc3.com/docs/getting-started/upgrading.md

Lines changed: 26 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -254,12 +254,16 @@ Stop COSMOS 6 first, then migrate after upgrading:
254254
./openc3.sh upgrade v7.0.0
255255
./openc3.sh run
256256

257+
# 3. Pull the migration script from COSMOS 7
258+
curl -O https://raw.githubusercontent.com/OpenC3/cosmos/main/scripts/linux/openc3_migrate_s3.sh
259+
chmod +x openc3_migrate_s3.sh
260+
257261
# 3. Migrate all data from old COSMOS 6 MINIO volume to the running versitygw
258-
./scripts/linux/openc3_migrate_s3.sh migrate
262+
./openc3_migrate_s3.sh migrate
259263

260264
# 4. Verify your data migrated correctly
261-
./scripts/linux/openc3_migrate_s3.sh status
262-
./scripts/linux/openc3_migrate_s3.sh cleanup
265+
./openc3_migrate_s3.sh status
266+
./openc3_migrate_s3.sh cleanup
263267
```
264268

265269
#### Custom Credentials
@@ -293,13 +297,31 @@ After verifying COSMOS 7 works correctly, you can remove the old COSMOS 6 MINIO
293297
docker volume rm openc3-bucket-v
294298
```
295299

300+
### Migrating COSMOS Decom Bin Files to TSDB
301+
302+
Now that you've migrated the binary files from Minio to Versitygw you need to ingest this data into the new Time Series Database (TSDB). Install the [TSDB Migration](https://github.com/OpenC3/openc3-cosmos-tsdb-migration) plugin from the App Store by clicking Browse Plugins from the Admin Console and searching for TSDB. You can get more information about the configuration parameters from the TSDB Migration [README](https://github.com/OpenC3/openc3-cosmos-tsdb-migration).
303+
304+
You will notice CmdTlmServer log messages indicating that the Decom log files are being processed:
305+
306+
```json
307+
{"time":"1774626658233033984","@timestamp":"2026-03-27T15:50:58.233034Z","level":"INFO","microservice_name":"DEFAULT__USER__TSDB-MIGRATION-MICROSERVICE","container_name":"47c6c5a1cc82","message":"Completed: DEFAULT/decom_logs/tlm/INST/20260327/20260327145450822594000__20260327150500322594000__DEFAULT__INST__ALL__rt__decom.bin.gz - 14754 packets (total: 28036 packets, 15 files)","type":"log"}
308+
...
309+
{"time":"1774626662373466880","@timestamp":"2026-03-27T15:51:02.373467Z","level":"INFO","microservice_name":"DEFAULT__USER__TSDB-MIGRATION-MICROSERVICE","container_name":"47c6c5a1cc82","message":"Migration complete! Files: 16, Packets: 42452, Errors: 0","type":"log"}
310+
```
311+
312+
At this point you should be able to use any COSMOS applications that access the streaming API to ensure the data has been migrated. Open Telemetry Grapher or Data Extractor and either graph or extract historical data and verify the contents.
313+
314+
Once the data has been verified you can remove the imported data using Bucket Explorer. Navigate to the `logs` bucket and remove the `processed`, `reduced_minute_logs`, `reduced_hour_logs`, `reduced_day_logs` directories using the Trash icon.
315+
316+
![Bucket Explorer](/img/upgrading/bucket_explorer.png)
317+
296318
### COSMOS Configuration Changes
297319

298320
#### Removed
299321

300322
- **`rubysloc` CLI command** — The `./openc3.sh cli rubysloc` command has been removed. Use external tools for line counting if needed.
301323
- **`LOG_RAW`** — Previously deprecated in favor of `LOG_STREAM`. Now fully removed. Replace any `LOG_RAW` usage with [`LOG_STREAM`](../configuration/plugins.md).
302-
- **Reducer microservices** — All reduced data microservices (REDUCED_MINUTE, REDUCED_HOUR, REDUCED_DAY) have been removed. Reduced data is now handled by QuestDB using `SAMPLE BY` queries. You can safely delete all REDUCED_MINUTE, REDUCED_HOUR, and REDUCED_DAY data once you perform the [TSDB Migration](https://github.com/OpenC3/openc3-cosmos-tsdb-migration).
324+
- **Reducer microservices** — All reduced data microservices (REDUCED_MINUTE, REDUCED_HOUR, REDUCED_DAY) have been removed. Reduced data is now handled by QuestDB using `SAMPLE BY` queries. You can safely delete all REDUCED_MINUTE, REDUCED_HOUR, and REDUCED_DAY data once you perform the TSDB Migration (see above).
303325

304326
#### Deprecated Keywords (Silently Ignored)
305327

0 commit comments

Comments
 (0)