Question on SensorData insertion

[alessandratrapani]

Hello Spyglass team,
I am currently working on converting a dataset that includes accelerometer data (x, y, z time series) to the NWB standard to fit the Spyglass schema requirements. I have two questions regarding this process:

1. Is the SensorData table the appropriate place to store accelerometer data in Spyglass?
2. If so, I'm unclear about the proper method to insert this data. Currently, I'm storing this time series with the name "analog" in an "analog" BehavioralEvents interface within the behavior module of the NWB file, based on my understanding from common_sensors.py. However, I cannot insert this data properly without making modifications to the source code as shown in this branch. I'm wondering if there is an alternative approach to insert accelerometer data without modifying the source code?

Thank you for your assistance.

[edeno]

Hi @alessandratrapani,

Just to clarify --- you're using populate_all_common with SensorData uncommented and this is where you're hitting the error? Or are you separately populating it?

[CBroz1]

Hi @alessandratrapani

1. Yes, I think this is the appropriate table for this data
2. Assuming, yes, you are using populate_all_common instead of SensorData().populate(), those modifications would be needed. And the alternative approach is to run the populate separately after populate_all_common - though this wouldn't allow the same rollback feature

For context, populate_all_common runs batches of tables through single_transaction_make here to make it easier to roll back a set of inserts on an error (or not, depending on args). It serves as a parent transaction for the set of passed tables, which each need allow_direct_insert=True in their respective make functions.

A PR to this effect makes sense to me, but I'd have to check with other folks to make sure there's no conflict with another use of the analog interface

[alessandratrapani]

Hi! Thank you for the quick reply!
I am quite new at spyglass and I am still in the process of learning.
I am going to adopt your suggested solution and populate the SensorData table after populate_all_common, so that there is no need to change the source code.
Thanks again!

[CBroz1]

I have your edits in an open PR - whenever we merge, should save you a little time