Releases: RadioAstronomySoftwareGroup/pyuvdata
Version 2.3.0
This version adds many new features and improvements, the highlights are:
- UVFlag now supports more metadata, including
telescope_name,telescope_location,antenna_names,antenna_numbers,antenna_positions,channel_width,spw_array,flex_spw_id_array. - Added support for UVData for selecting on phase center IDs, including on read.
- Significant speedup when calling
polnum2strand its variants for many baselines.
It also fixed a number of bugs including:
- Fixed bugs in
UVCal.__add__method when data are sorted differently or interleaved. - Fixed some bugs in UVCal methods related to the
time_rangeattribute. - Fixed some bugs in UVData, UVFlag and UVCal
__add__andselectmethods for objects
with only one spectral window andflex_spw_id_arraydefined. - Fixed a bug with the beamfits partial read parameters not being available in the
UVBeam.from_fileclass method and not being passed properly when reading multiple files. - Fix a bug in UVData where trying to select lsts or lst_ranges on read didn't work for some file types.
Deprecations and dependency version changes:
- Reading files into objects without setting
use_future_array_shapesnow results in deprecation warnings. - The
flex_spw_id_arraywill be required on all UVData and UVFlag and all non-wide-band UVCal objects in version 3.0. - Deprecated the older phase attributes (
phase_type,phase_center_ra,phase_center_dec,phase_center_frame,phase_center_epoch,object_name) in favor of thephase_center_catalog. The older phase attributes will be removed in version 3.0. - Deprecated the
interpolation_functionattribute on UVBeams in favor of a new parameter to theUVBeam.interpandUVBeam.to_healpixmethods. - New minimum dependencies: h5py>= 3.1
- New minimum optional dependencies: lunarsky>=0.2.1
Full changes detailed below and in our changelog:
What's Changed
- CVE-2007-4559 Patch by @TrellixVulnTeam in #1237
- Document Nphase in UVH5 Memo by @radonnachie in #1233
- Add metadata & support for flexible spws on UVFlag by @bhazelton in #1219
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1239
- Update the uvh5 memo pdf with changes in #1233 by @bhazelton in #1240
- Deprecate old phase attributes, use the new ones under the hood by @bhazelton in #1170
- Move warnings tests from circleci to GH actions to fix codecov reporting, other CI improvements by @bhazelton in #1242
- Add NSF acknowledgments to README.md by @jpober in #1243
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1241
- Improve beam interp docs by @bhazelton in #1246
- Fix warning test CI by @bhazelton in #1245
- fix tutorial items which raise deprecation warnings by @bhazelton in #1247
- More info in check errors by @steven-murray in #1249
- Fix some handling for old phase attributes by @bhazelton in #1244
- Fix bug with parameter passing for beamfits partial read by @bhazelton in #1254
- perf: use lru_cache for polstr and variants by @steven-murray in #1250
- Minor fix to MIR unit testing by @kartographer in #1260
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1261
- Fix a bug in reading HERA FHD files into UVData without a layout file by @bhazelton in #1255
- Properly handle the telescope frame in coordinate conversion utilities by @bhazelton in #1253
- Use importlib.metadata rather than pkg_resources by @bhazelton in #1264
- Add external tests for pyradiosky and pyuvsim by @bhazelton in #1257
- Require flex_spw_id_array on UVData, UVCal and UVFlag in the future by @bhazelton in #1252
- Add handling for non-utc timescales in MS files by @bhazelton in #1262
- Fix uvcal add by @bhazelton in #1263
- Deprecate the utility methods used by the (deprecated) old phasing by @bhazelton in #1268
- Warn about future shapes change on file read for all objects. by @bhazelton in #1238
- Remove deprecated code, update changelog for version 2.3 by @bhazelton in #1269
New Contributors
- @TrellixVulnTeam made their first contribution in #1237
- @radonnachie made their first contribution in #1233
Full Changelog: v2.2.12...v2.3
Version 2.2.12
This is a patch release to ensure that our wheel building for pypi is properly setup.
Full details in below and in our changelog.
What's Changed
- Fix PyPI publish action by @plaplant in #1230
- Update changelog for new release by @plaplant in #1231
Full Changelog: v2.2.11...v2.2.12
Version 2.2.11
This version fixed a uvh5 reader bug and added better support for non-earth bound telescopes:
- fixed a bug in the uvh5 reader that could cause errors reading in valid version 1.1 uvh5 files because it was looking for a non-standard header item (multi_phase_center).
- Added a frame attribute to the
_telescope_locationattribute on most objects to allow for telescopes not on earth.
Full details below and in our changelog:
What's Changed
- Update the pypi workflow and making release document for CI failures by @bhazelton in #1217
- Fix warnings test CI by @bhazelton in #1220
- Add LocationParameter.frame by @aelanman in #1218
- Improve JPL Horizons error handling by @bhazelton in #1222
- Fix uvh5 reader to check for
phase_center_catalognotmulti_phase_centerby @bhazelton in #1225 - [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1226
- update changelog for new version by @bhazelton in #1227
- Fix the incorrect version in the changelog, add a missed item earlier by @bhazelton in #1228
Full Changelog: v2.2.10...v2.2.11
Version 2.2.10
This version adds many new features and improvements, the highlights are:
- Significantly increased uvh5 reading and writing speed.
- Performance improvement when doing a
UVData.selectusing theblsparameter - Support for bitshuffle compression in uvh5 files.
- Support for flex-pol objects in uvh5 files.
- Major performance improvement in the
UVBeam.to_healpixmethod. - Support for partial reads on beamfits files.
- Support for future array shapes in UVBeam.
Full changes detailed below and in our changelog:
What's Changed
- Add missing changelog entries from PR #1148 by @bhazelton in #1206
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1207
- Partial Reading for Beamfits by @steven-murray in #1205
- Telescope frame by @aelanman in #1199
- UVBeam cython extension by @mkolopanis in #1208
- Add support for future array shapes in UVBeam by @bhazelton in #1209
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1211
- Speedup uvh5, add more flex_pol support by @bhazelton in #1203
- update pipy CI to use up to date action by @bhazelton in #1210
- Fix how setuptools_scm requirements are specified by @plaplant in #1214
- Add support for a SkyCoord UVParameter for pyradiosky by @bhazelton in #1215
- update changelog for v2.2.10 by @bhazelton in #1216
Full Changelog: v2.2.9...v2.2.10
Version 2.2.9
This version adds many new features and improvements, the highlights are:
- New uvh5 version with support for multiple phase centers.
- Support for future array shapes in UVFlag.
- More comprehensive support for the SMA's MIR format.
- Reordering methods for UVCal.
- UVFITS parameters RDATE, UT1UTC and GSTIAO are now properly calculated.
It also fixed a number of bugs including:
- A bug in
UVData.__add__with flexible spectral windows that contain overlapping frequencies. - A bug in
UVData.selectwhenUVData._scan_number_arraywas set. - A bug in
UVBeam.selectwhen selecting down to only auto polarization power beams. - A bug in
UVBeam.__add__when adding cross pol power beams to auto pol power beams.
Deprecations and dependency version changes:
- The "unphased" cat_type in phase_center_catalog is now called "unprojected".
- Dropped support for python 3.7
- New minimum dependencies: astropy>= 5.0.4, numpy>=1.19, scipy>=1.3
- New minimum optional dependencies: python-casacore>=3.3, pyyaml>=5.1, astropy-healpix>=0.6
Full changes detailed below and in our changelog:
What's Changed
- fix mwa_corr_fits bscale handing by @PyxieLouStar in #1150
- Fix CI errors from new pytest version by @bhazelton in #1153
- Update pre-commit config by @plaplant in #1154
- fix test_mwa_corr_fits piping of keywords through read by @PyxieLouStar in #1156
- Improve compress_by_redundancy docstring to explain flag handling by @bhazelton in #1151
- Update astropy requirement to 5.0.4 to fix IERS issue, drop python 3.7 support by @bhazelton in #1164
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1165
- Improve docs related to the basis vectors and components by @bhazelton in #1161
- Improving tolerance to flaky JPL-Horizons tests by @kartographer in #1166
- Add methods to enable sorting along the various axes in UVCal by @bhazelton in #1152
- Cleanup
readparameters and other minor cleanup by @bhazelton in #1158 - add mwax bandpass correction to mwa_corr_fits by @PyxieLouStar in #1167
- Fix baseline number calculation and antenna number handling by @PyxieLouStar in #1148
- Call methods to properly set up object in
checkby @bhazelton in #1162 - Make a github actions CI for the external tests by @bhazelton in #1176
- Streamlining the
selectmethod inUVDataby @kartographer in #1171 - Report the max imaginary part when complex autos are detected by @bhazelton in #1168
- Fixing add for flex-spw datasets by @kartographer in #1175
- "Spoofless" writing of UVFITS files by @kartographer in #1177
- Adding a warning to
fix_phaseby @kartographer in #1172 - remove azure pipelines CI for external tests by @bhazelton in #1179
- Checking that
UVBaseattributes match their expected names by @kartographer in #1181 - Update minimum version requirements, add minimum version CI by @bhazelton in #1178
- change setup-miniconda to use mamba instead by @mkolopanis in #1182
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1183
- Pin version of setuptools_scm for installation and CI jobs by @plaplant in #1188
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1190
- Unpin setuptools_scm by @plaplant in #1189
- Improvements to
MirParserclass by @kartographer in #1125 - Add Azure pipelines CI back by @bhazelton in #1180
- Enable normalizing cross-correlations by autos by @kartographer in #1191
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1196
- Improve uvh5 storage of new phasing info by @bhazelton in #1142
- [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #1198
- Add support for antenna numbers > 2047 by @PyxieLouStar in #1197
- Add support for future array shapes in UVFlag by @bhazelton in #1186
- Prepare for new release (2.2.9) by @bhazelton in #1204
New Contributors
- @pre-commit-ci made their first contribution in #1165
Full Changelog: v2.2.8...v2.2.9
Version 2.2.8
This version adds a new option to the UVBeam.interp method that allows the user to turn off some checking to speed up the interpolation.
Full changes detailed below and in our changelog:
What's Changed
- feat: add check_azza_domain parameter to interp by @steven-murray in #1144
- docs: update changelog by @steven-murray in #1146
Full Changelog: v2.2.7...v2.2.8
Version 2.2.7
This version adds some new features including:
- a method to Initialize a UVCal object from the metadata in a UVData object
- an option to
reorder_bltsto sort autos first
It also fixes a series of small issues, full changes detailed below and in our changelog:
What's Changed
- Adding a check to verify autos are real-only by @kartographer in #1110
- Remove distutils calls that are throwing deprecation warnings by @bhazelton in #1128
- Add option to
reorder_bltsto sort autos first by @bhazelton in #1127 - Make handling of types in Miriad extra_keywords more general by @plaplant in #1134
- Use time tolerances for matching times in UVFlag.to_baseline() by @jsdillon in #1133
- pin the RTD theme version to restore bullets in docs by @bhazelton in #1135
- Improve the documentation on redundancy finding, make keywords consistent by @bhazelton in #1132
- Use pytest < 7 because of conflict with pytest-cases by @bhazelton in #1138
- Increase version requirement for pytest-cases, unpin pytest by @bhazelton in #1140
- add a method to Initialize a UVCal object from the metadata in a UVData object by @bhazelton in #1035
- Tutorial and Docs restructuring by @bhazelton in #1139
- Make release 2.2.7 by @plaplant in #1141
Full Changelog: v2.2.6...v2.2.7
Version 2.2.6
This version adds some new features, including:
- Support for flexible spectral windows on UVCal objects.
- Support for wide-band calibration in UVCal
- Support for converting UVCal objects to use the future array shapes to allow users to upgrade their code before the shapes change.
- Support for flexible polarization setups on UVData objects, allowing for individual spectral windows to carry different polarization data.
This version fixes several bugs, the highest profile ones are:
- A bug where
UVData.compress_by_redundancysometimes produced incorrectly conjugated visibilities. - A bug where
lstsandlst_rangegot ignored when doing partial i/o with multiple files.
Full changes detailed below and in our changelog:
What's Changed
- Bring over kwargs from UVH5.write_uvh5_part() to UVData.write_uvh5_part() by @jsdillon in #1121
- Fix issue where
lstsandlst_rangewas not properly being passed through uvdata.read() for multi-file reads by @jsdillon in #1122 - Fixing conjugation issue in
compress_by_redundancyby @kartographer in #1123 - Add
future_array_shapesand flexible spectral windows support to UVCal by @bhazelton in #1034 - Improved handling of MIR Data + flexible polarization for UVData by @kartographer in #1117
- update the changelog for v2.2.6 by @bhazelton in #1126
Full Changelog: v2.2.5...v2.2.6
Version 2.2.5
This version adds some new features, including:
- Dramatic improvement in memory performance in writing measurement set files and reading MWA correlator files.
- Support for reading the new MWAX correlator files.
- Defining scan numbers in Measurement Sets.
- A
filenameattribute to UVCal, UVBeam and UVFlag objects, matching the implementation in UVData objects.
This version fixes a number of bugs, the highest profile ones are:
- A bug that could cause incorrect data labelling when combining UVData objects with overlapping time-baselines/polarization/frequency channels that were ordered differently.
- Several measurement set bugs that caused problems when the files were used in CASA.
Dependency changes:
- h5py>=3.0
- astroquery>=0.4.4 (this is an optional dependency)
Full changes detailed below and in our changelog:
What's Changed
- Fix a bug in efield_to_power with only one feed by @bhazelton in #1075
- Update CI for external tests to get them working by @bhazelton in #1078
- added warning to uvcalibrate under x_orientation mismatch by @nkern in #1006
- mwa_corr_fits cleanup by @PyxieLouStar in #1079
- Fix expected shapes for data-like arrays on metadata only objects by @bhazelton in #1082
- fix doctests by requiring recent astroquery, updating tutorial output by @bhazelton in #1091
- Uvfits frame by @mkolopanis in #1086
- Handle
Nonevalues inextra_keywordsin UVH5 files by @plaplant in #1088 - Add check for UVH5 metadata only objects by @plaplant in #1092
- Add filename parameter to UVCal, UVBeam and UVFlag by @bhazelton in #1084
- Fix h5py deprecation warnings by @plaplant in #1097
- Write scan number for MS files by @e-koch in #1087
- Astroquery/JPL Horizons deprecation fix by @kartographer in #1099
- Suggesting write_ms when the number of ants > 256 by @kartographer in #1100
- Fixing an issue with UVData objects being incorrectly added by @kartographer in #1105
- MS-related bug fixes by @kartographer in #1101
- Mwax corr fits reader by @PyxieLouStar in #1090
- Testing if yaml change allows github tests to pass by @kartographer in #1113
- Fixes and performance improvements to the measurement set writer by @kartographer in #1112
- Add support for baseline coordinate suffixes in uvfits files by @bhazelton in #1106
- Add a CI to check for warnings, fix some tests by @bhazelton in #1118
- Measurement set
TIME_CENTROIDfield fix by @kartographer in #1119 - Fix a bug in write_calfits when time_range is None by @bhazelton in #1116
- update the changelog for v2.2.5 by @bhazelton in #1120
Full Changelog: v2.2.4...v2.2.5
Version 2.2.4
This version fixes a bug in UVBeam.efield_to_power that was causing the Conda package builds to fail.
Full changes detailed below:
What's Changed
- Raise clear errors when trying to write metadata only objects to files by @bhazelton in #1072
- Fix conversion of non-crosspol power beams to real by @bhazelton in #1074
Full Changelog: v2.2.3...v2.2.4