- Add SUBPRISM_IP/S subarray names to schemas. (#730)
- Fix a bug where comparing the equality of two datamodels would cause a crash if their arrays were not the same, instead of returning False. (#692)
- Fix incorrect datatype for FWPOSTOL and PWPOSTOL (#701)
- Add filter keyword to mask schema. (#594)
- Fixed a bug where MIRI WFSS incorrectly set the along-dispersion axis to be row instead of column (#600)
- Change datatype of SossWaveGridModel wave_grid to float64 as expected by ATOCA code (#642)
- Replace array shape assignments with reshape to avoid upcoming deprecation warnings from numpy. (#648)
- Fix a bug where ndim and max_ndim within table-like datatypes were ignored during default array creation (#659)
- Fix a bug where accessing array-like attributes that did not exist would set them to default values (#670)
- Fix duplication of TDIM header keywords on datamodel save to FITS (#677)
- Fix Rotation3DToGWAConverter not accepting length-one rotation lists (#678)
- Fix a bug where accessing metadata attributes that did not exist would set them to default values (#688)
- Major restructure of docs pages (#622)
- Document "legacy" schemas that will no longer receive updates. (#641)
- Add PA_APER keyword to EXTRACT1D extension headers. (#601)
- Add S_REGION keyword to spec meta schema (#602)
- Add the following keywords to core schema for level 1b files: PWPOSOFF, PWPOSTOL, FWPOSOFF and FWPOSTOL. (#603)
- Add new MIRI subarray keywords to core and subarray schemas (#605)
- Added PictureFrame reference model (#607)
- Add SUB_SHRT and SUB_LONG keywords for MIRI IFU; remove unneeded names from base subarray enum list (#615)
- Add ta_xpos and ta_ypos attributes to SlitModel schemas, and meta.cal_step.targ_centroid attribute to core schema, in support of new targ_centroid step (#620)
- Add a
cal_stepstatus keyword for theadaptive_trace_modelstep. Add atrace_modelimage to the IFUImageModel schema. (#632) - Give new metadata attributes to PastasossModel (#664)
- Add PHOTUNIT and WAVEUNIT attributes to WFSS photom ref file schemas (#665)
- Update NIRCamGrismModel to allow for nested transforms keyed off DHS stripe ID; update wavelengthrange schema to allow for DHS fieldpoint column; update RegionsModel schema to support use with NIRCam DHS subarrays. (#666)
- Add MIRI WFSS Photom datamodel (#668)
- Add
get_defaultandget_dtypemethods to datamodel, which return the schema-defined default and datatype,respectively, of the requested attribute (#670) - Add FILTER keyword to MIRI filteroffset reference file schema. (#671)
- Add support for NIRISS SOSS superstripe subarrays. Also, for superstripe
support, allow the RampModel
pixeldqarray to have 3 dimensions. (#683)
- Add UnsupportedConverter class and UnsupportedConverterError as part of procedure for removing legacy transforms and their converters (#589)
- Add dependency on gwcs, and update Snell and MIRI_AB2Slice to avoid repeated code by calling gwcs methods. (#612)
- Updated RSCD datamodel and added RSCD processing values to core schema (#638)
- Warn when
DataModel.historyis used and add replacementDataModel.add_history_entry. (#562) - Remove deprecated V23ToSky and Rotation3D transforms and associated asdf converter (#589)
- Remove DataModel.read and DataModel.write (deprecated since 3.0.0) (#595)
- Remove DataModel.open_asdf (deprecated since 3.0.1) (#596)
- Remove private
_kwtoolmodule which has been migrated to a private repository. (#598) - Removed nsclean from cal_step status. (#608)
- Remove handling of unsupported "clobber" keyword argument in
DataModel.save. (#617) - Deprecate AmiLgModel; AmiLgFitModel should be used instead (#636)
- Deprecate AsnModel (#654)
- Remove unused attribute 'padding' from PastasossModel schema (#685)
- Fix incorrect trace function sampling in NIRCam forward grism dispersion models (#519)
- Updated units in WFSS tables to adhere to FITS standard. (#529)
- Update units to match FITS standard. (#530)
- Add S_CONTAM keyword to denote wfss_contam calibration step status (#557)
- Remove module-level logging configuration. (#563)
- Make documentation of stdatamodels.jwst.transforms public (#569)
- Added a datamodel for MIRI WFSS specwcs reference file and the transforms for this model. (#493)
- Tidy up output FITS headers by removing extra blank keywords associated with each reference file. (#494)
- Added an extension for background mask used in background step to image datamodel. (#532)
- Add optional time dependence coefficient tables to all photom reference file models except MIRI MRS. Update the MIRI MRS time dependence coefficients to expect a power law functional form. (#555)
- Add
asdf_in_fits.to_hdulistto add an ASDF extension to an in memory HDUList (or create one if needed). (#567) - Added FAILED to background step completion status, options are now COMPLETED, SKIPPED, FAILED. (#575)
- Add
cal_logshandling to theupdatemethod for JWST datamodels. (#579) - Added q4 object to oifits schema to include quad amplitudes, phases in AMI OIFITS data products. (#582)
- Updated MIRI WFSS prism transforms to handle updates to their specwcs reference file: the x and y models are now both 3rd order polynomials in the trace parameter. (#587)
- Refactor grism transforms to reduce repeated code and drop some partially-supported dispersion model types (#528)
- Update DataModel init to make it so kwargs are exclusively used for initializing data arrays as model attributes, and other args are used to control how the model is opened and validated. (#533)
- When opening models from a .fits file, close the FITS HDUList on init instead of retaining a FileReference to it (#552)
- Make transform models available in stdatamodels.jwst.transforms namespace (#569)
- Deprecate passing kwargs into asdf.open from asdf_in_fits.open (#533)
- Deprecate V23ToSky transform. Use the function jwst.assign_wcs.pointing.v23tosky to construct an equivalent CompoundModel that relies only on models from astropy.modeling. Deprecate Rotation3D transform. Use astropy.modeling.models.RotationSequence3D instead. Deprecate the converters that allow datamodels relying on V23ToSky to be loaded from file (note that V23ToSky has been unused by the pipeline since pre-launch). (#539)
- Deprecate None, shape tuple, array, and HDUList as valid inits to datamodels.open(). DataModel.__init__() should be used directly instead. Deprecate assigning data arrays during model init when the init type is already file-like (e.g. filename, model tree, HDUList, etc) (#540)
- Removed mrs_imatch from cal_step status. (#550)
- Remove unused schema.build_docstring function (#556)
- Change interpretation of bit flag 256 from UNRELIABLE_ERROR to RESERVED (kept unset for future use) (#580)
- Turn non-schema-mapped data arrays in ASDF extension into links on save instead of duplicating them, saving disk space and memory on re-load (#509)
- Fix SlitModel deleting wht attribute on init from an already-open datamodel. Fix IFUImageModel deleting zeroframe attribute on init from an already-open datamodel. Fix SlitModel populating zero-filled area array on init. (#511)
- Add channel and band keywords to specpsf schema. (#513)
- Add S_REGION keyword to WFSS spectral metadata schema. (#524)
- Drop support for memory mapping when opening datamodels (#507)
- Add time-related metadata back to MultiSpecModel and SpecModel schemas, for backward compatibility for existing time series spectral products. (#508)
- Remove file-less AsdfFile instances from DataModel file reference tracking. (#461)
- Allow read_metadata to handle nested lists from extra_fits (#476)
- Add new informational processing status keywords to slit and spectral datamodels for NIRSpec multi-slit data. (#431)
- Add read_metadata for reading partial metadata from saved files. (#445)
- Update NIRSpec transforms to support slit name propagation. Add inverse transforms for Slit2Msa and Gwa2Slit; add Slit2MsaLegacy to support reading existing data products. (#465)
- Add flat file format for WFSS multi-source x1d and c1d products (#466)
- Add support for multi-valued defaults in table schemas (#469)
- Add new spectral models for TSO spectral data, intended to combine all integrations into a single flat table rather than multiple FITS extensions. (#477)
- Add a new data array in the
regionsattribute to IFUImageModel, to hold a pixel-to-slice map for NIRSpec IFU data. (#479) - Update transform schemas to use new asdf-transform-schemas. (#483)
- Allow extra columns in the NrcImgPhotomModel phot_table, to support the ability to specify different values by subarray. (#484)
- Added new nirspec_dark model with dark_rate and dark_rate_unc extensions. Added p_gratin to dark and superbias models to support selecting different reference files based on p_gratin in CRDS. (#485)
- Add new datamodel SossBkgModel to support background reference files for NIRISS SOSS data. (#492)
- Change background alias to bkg_subtract to fix conflicting aliases for the step. The new alias is the one currently used for running the step or changing parameters from the stage2 pipeline. (#495)
- Vectorize NIRCAMBackwardGrismDispersion transform (#497)
- Add guidestar-related header keywords to core schema (#500)
- Add docstring rules to pre-commit hook (#406)
- Remove unused GLS_RampFitModel (#464)
- Remove initialization of err array from dark datamodel init methods. (#480)
- Deprecate DataModel.get_fits_wcs and DataModel.set_fits_wcs (#482)
- Deprecate dqflags.interpret_bit_flags in favor of astropy.nddata.bitmask.interpret_bit_flags (#486)
- Drop support for initializing datamodels from buffer (was already raising errors) Drop support for initializing datamodels from byte strings (#487)
- Revert #409 to restore dqflag utility functions (#459)
- Add missing values to pexptype pdetector and pgrating schemas. (#430)
- Fix ndim, max_ndim and datatype validation during FITS array writing. (#443)
- Add documentation for NoTypeWarning and ValidationWarning (#433)
- Move NoTypeWarning and ValidationWarning to new exceptions submodule (#433)
- Remove deprecated skip_fits_update and SKIP_FITS_UPDATE (#380)
- Deprecate DataModel.open_asdf use asdf.open instead. (#450)
- Deprecate DataModel.from_fits and DataModel.from_asdf. Use DataModel.__init__ instead. (#455)
- Validate dimension against schema when instantiating datamodel from array shape (#395)
- Fix bug preventing NirspecQuadFlatModel instantiation from NirspecFlatModel (#401)
- Force array validation when initializing a datamodel from another datamodel of different type (#403)
- Changed data types in MIRI LRS specwcs ref model to float64 (#425)
- Expand reference file schema documentation. (#375)
- added Spectral PSF reference model (#336)
- Added channel keyword to MIRI LRS and imaging apcorr schemas (#374)
- Add new spectral models for MIRI MRS data, including new table columns for residual fringe corrected flux, surface brightness, and background. (#377)
- Add keywords for NIRSpec MSA quadrant and slit area scales to slit and spectral datamodels. (#379)
- Removed the unused error array from 4D ramp models. (#384)
- added MIRI LRS specwcs datamodel to jwst models (#393)
- Add scaling factor to background schema (#407)
- Add eight multistripe subarray keywords to support NIRCam DHS modes. (#426)
- Add new schema keywords for DHS subarrays. (#427)
- Add a missing subarray value for DHS. (#428)
- Apply style checks to code to match jwst. (#383)
- Increase minimum versions of asdf-astropy, asdf and astropy dependencies. (#399)
- test with latest supported version of Python (#418)
- Remove deprecated schema_editor (#373)
- Remove fits metaschema, use updated asdf metaschema. (#378)
- Drop support for python 3.10 (#392)
- Remove deprecated DataModel.get_fileext() method (#400)
- Remove unused dqflags and basic_utils submodules. (#409)
- Remove unused Extract1dImageModel and MultiExtract1dImageModel. (#419)
- Remove unused can_broadcast, to_camelcase, ensure_ascii, fits_hdu_name and bytes2human functions. (#420)
- Remove unused OulierPars model. (#421)
- Deprecate Datamodel.read and Datamodel.write. (#424)
- Change IRS2Model parent class to ReferenceFileModel (#348)
- Update schema FITS keyword titles to match keyword dictionary. (#354)
- Avoid unnecessary validation on Model.__init__. (#356)
- Allow
merge_property_treesto retain input schema id inmodel.schema["id"]. (#364)
- Add to schema docs describing schema types. (#338)
- Adding datamodel schema for jwst refpix convolution kernel. (#321)
- Add python 3.13 support. (#333)
- Add new keyword dictionary comparison tool for developers. (#337)
- Add CALIB and PA keywords to amioi schema (#357)
- Add DHS readout patterns to JWST schema (#360)
- Add NRM reference file keywords to schema. (#361)
- Add hybrid full-frame boolean to core exposure schema (#362)
- Modify warning filters to re-show identical ValidationWarnings on re-validation. (#367)
- allow new-look ModelContainer to be the default container when opening any list-like (#330)
- Updated schema subarray enums with new WFS&C subarray names. (#358)
- Add function to
jwst.Level1bModelwhich fills moving target tables with missing columns (#329)
- Fix invalid
abvegaoffsetandcoordsschemas. (#327)
- use
towncrierto handle change log entries (#326)
- Add
mt_v2andmt_v3keywords tomoving_targetschema (#263) - Added
MEDIUMDEEP2andMEDIUMDEEP8to allowed readout patterns in JWST core schema,READPATT, andPREADPATT. (#315) - add grating keyword to dark and superbias schemas (#317)
- Update JWST datamodel
irs2datatype to providenumpy>=2.0compatibility. (#319) - Add datamodel and schema for
PastasossModel, a new reference file type for JWST NIRISS SOSS exposures. (#320) - Add keyword to JWST core schema to track status of new step
clean_flicker_noise. (#328)
- replace usages of
copy_arrayswithmemmap(#306) - remove uses of now unused
ignore_version_mismatch(#313) - Remove deprecated
R_DRIZPARkeyword from core schema as well asjwst.datamodels.DrizParsModel. (#316)
- Remove deprecated jwst.datamodels models: DataModel, DrizProductModel, MIRIRampModel, MultiProductModel [#171]
- Increase CRDS minimum version to 11.17.1 [#171]
- Removed deprecated
deprecate_class,cast_arraysandjwst.datamodels.util[#298] - Remove
stdatamodels.jwst.datamodels.schemawhich is an out-of-date duplicate ofstdatamodels.schema[#175] - Remove unnecessary references to overwritten datamodel attributes to free up memory [#301]
- Remove unused
deprecated_properties[#303]
- Added ALL_MRS to allowed values for keyword MRSPRCHN in core schema. [#285]
- Provide existing
AsdfFileinstance tovalidateto speed up assignment validationcheck_value. [#276] - Deprecate
deprecate_classunused by downstream. [#274] - Add cache to hdu accesses during
_load_from_schemato speed up file opening. [#278] - Remove
TEXPTIMEkeyword from the JWST core datamodel schema because it duplicates the information ofXPOSURE. [#277] - Deprecate
check_memory_allocation. This function did not work as intended. [#273] - Decrease size of
SPECTYPandTARGETcolumns inOI_TARGETtable of oifits schema to 16 characters. [#281] - Change
integration_numberfrom int16 to int32 ingroupschema. [#283] - Fix datamodel schema ids for abvegaoffset, keyword_lampmode, nrsfs_apcorr [#258]
- Drop support for python 3.9 [#287]
- Convert
FITS_recinstances read from old files where a hdu was linked in the old schema (but is no longer linked) when rewriting files. [#268] - Deprecate
skip_fits_updateand environment variableSKIP_FITS_UPDATE. Future behavior will be as ifskip_fits_updatewasFalseand the FITS headers will always be read [#270] - Increase minimum required asdf version [#288]
- Add
S_BPXSLFkeyword to the JWST core schema to reflect the addition of thebadpix_selfcalstep. [#305]
- Adding "IMAGER" as another allowed value for the "MRSPRCHN" keyword, in order to support proper handling of MIRI MRS and Imager exposures done in parallel. [#259]
- Fix mask schema to allow for non-integer ngroups selectors [#256]
- Add
NRMModelfor new NIRISS NRM reference file [#253]
- Add
gratingkeyword to JWSTbarshadowref file schema to match parkeys on crds [#260] - Add
average_dark_currentin both scalar keyword and array extension options toDarkModelandMIRIDarkModel. Add the array extension to theRampModel, for tracking the average dark current. [#265] - Add
EXTRXSTR,EXTRXSTP,EXTRYSTR, andEXTRYSTPkeywords to the jwstMultiSpecschema. [#264]
- Remove
json_idargument use for callbacks passed toasdf.treeutil.walk_and_modify[#244]
- Add
ngroupskeyword to JWSTmaskref file schema to match parkeys on crds [#249] - Added keywords
noutputsandbunitto the JWST readnoise and superbias datamodel schemas. [#250] - Updated JWST core datamodel schema to include the new
TMEASUREkeyword for measurement time. [#248]
- Fix search in documentation [#241]
- Deprecate
cast_arraysargument tofrom_fits_hduandcast_fits_arraysargument toDatamodel.__init__[#214] - Use
DataModel.__init__memmapargument when opening ASDF files [#232]
- Updated JWST core datamodel schema to include the new step status keyword "S_NSCLEN" for the new "nsclean" calibration step. [#237]
- Adding emicorr datamodel and schema, as well as corresponding completion and reference file keywords [#200]
- Fixed
ValidationErrorduringAmiOIModel.update[#234] - Fix
rebuild_fits_rec_dtypehandling of unsigned integer columns with shapes [#213] - Fix unit roundtripping when writing to a datamodel with a table to a FITS file [#242]
- Sort keyword files used for schema_editor to make output non-arbitrary copy schema before merging to avoid schema modification [#227]
- Add mrsptcorr ref_file to core.schema [#228]
- Avoid unnecessary validation during
DataModel.clone[#230] - Replace uses of
utcnow(deprecated in python 3.12) [#231] - Updated JWST MIRI imager photom model to include time-dependent correction coeffs. [#235]
- Add
channelkeyword to MIRI MRS Apcorr schema [#224]
- Update
RefractionIndexFromPrismconverting single element ndarrays to scalar values before use to avoidDeprecationWarningintroduced in numpy 1.25 [#210] - Add band to
GainModelschema to account for miri crds file updates [#219]
- Add
AmiLgFitModelclass and schema [#199] - Switch schema refs from tags to equivalent uris [#201]
- Add
DITH_RAandDITH_DECto JWST core schema metadata, to be used in spectral extraction window centering. [#203] - Change format of the MirMrsPtCorrModel to use a 1d reference table instead of 2d FITS image extensions [#196]
- Convert
FITS_recinstances to arrays before serializing or validating with asdf [#205]
- Remove ignored V23ToSkyConverter from jwst.transforms version 1.0.0 asdf extension [#184]
- Use ValidationError and type validator from asdf instead of from jsonschema directly, remove jsonschema as a direct dependency, increase asdf minimum version to 2.15.0. [#177]
- Use binary masks for DQ calculations in dynamicdq [#185]
- Add keyword_filter.schema reference to gain schema to accomodate addition of FILTER as a CRDS selector for GAIN ref files. [#197]
- Add charge_migration (new name for undersampling_correction) with keyword S_CHGMIG to cal_step section of core schema. Change UNDERSAMP DQ flag to CHARGELOSS. [#194]
- Add option to
allow_extra_columnsin datamodel schema that defines structured arrays (tables) and allow extra columns in tables [#189] - Fix typo in
outlierifuoutputschema forkernel_ysize[#191]
- Added the new keyword "GSC_VER" to the JWST core datamodels schema. [#190]
- Added two new header keywords to the JWST core schema target section: TARGCAT and TARGDESC, which record the target category and description as given by the user in the APT. [#179]
- Enable searching docs directory for doctests and fix failing doctest. [#182]
- Add error column to NIRSpec flat schema's
flat_tabledefinition, and remove fixed shape definition for other table columns. [#183]
- Link FITS_rec instances to created HDU on save to avoid data duplication. [#178]
- Update the allocation of the ZEROFRAME array for the RampModel. [#176]
- Added two new header keywords to the JWST core schema exposure section: PRIMECRS and EXTNCRS, which are used to record the rate of primary cosmic rays and extended cosmic rays (Snowballs and Showers). [#173]
- Add OIFITS compatible schema and
AmiOIModel[#174]
- Update jwst outlierpars schema to support new IFU outlier detection algorithm
and add new
OutlierIFUOutputModeldata model. [#164] - Reduce interpolation vector length in NIRCam backwards transform to improve computation times [#165]
- Update of JWST/MIRI MRS photom datamodel to include the time dependent correction. [#166]
- Add a parameter to jwst outlierpars schema to support a second level of flagging outliers for JWST MIRI/MRS and NIRSpec IFU data. [#167]
- Close for opened files [#169]
- Provide second-order polynomial transforms for NIRCam WFSS grisms. [#124]
- Deprecate
stdatamodels.jwst.datamodels.DataModelin favor ofstdatamodels.jwst.datamodels.JwstDataModel. [#160] - Provide backwards compatibility for grism transform schemas; remove inverse models from required properties of transform schemas. [#161]
- Add wavelength tables for NIRSpec Drizzle cubepars reference file model. [#162]
- Add pixel replacement step keyword to jwst.datamodels core schema, and change
DQ bit 28 from
UNRELIABLE_RESETtoFLUX_ESTIMATED. [#149] - drop support for Python 3.8 [#143]
- use Mamba to build docs [#155]
- Remove the defunct
s3_utilsmodule, so thatstpipeno longer needs to depend on this package. This also removes theawsinstall option as this is no longer need. [#154] - Remove use of deprecated
pytest-openfilespytestplugin. This has been replaced by catchingResourceWarninginstances. [#152] - Fix open file handles, which were previously ignored by
pytest-openfiles, but which raise blockedResourceWarningerrors. [#153]
- Add units to BARTDELT and HELIDELT jwst keywords in datamodels schema. [#147]
- Added inverse functionality to
dynamic_mask, which allows for properly saving of datamodels withdq_defdefined. [#132] - Move the
dqflagsand related code fromstcalto this package so that thestcaldependency can be dropped. [#134] - increase
requires-pythonto3.8[#144] - Add R_MRSXAR as the keyword for the jwst straylight mrsxartcorr reference filename in core schema in stdatamodels.jwst.datamodels [#145]
- Add support for reading from already open HDUList to asdf_in_fits.open [#136]
- Add UNDERSAMP flag to dqflags and undersample correction metadata to core schema in stdatamodels.jwst.datamodels [#127]
- Add helper functions to aid in migration of ASDF-in-FITS uses from asdf to this package [#114]
- Reimplement support for ASDF-in-FITS in this package. [#110]
- Move
jwst.datamodelsfrom thejwstpackage into this package. [#112] - Move
jwst.transformsfrom thejwstpackage into this package. [#113]
- improve datamodels memory usage [#109]
- added environments in
tox.inito support Tox 4 [#108]
- Increase asdf version to >=2.14.1 to fix hdu data duplication [#105]
- Remove use of deprecated
override__dir__[#103] - Add requirement of asdf-astropy >= 0.3.0 to prevent future issues with using deprecated astropy serialization methods [#104]
- Pin astropy min version to 5.0.4. [#94]
- Fix FITS writing validators with jsonschema 4.x. [#92]
- Changed the way NDArrayType wrappers are handled on write. [#89]
- Bugfix for JWST failing with latest asdf-transform-schemas. [#90]
- Add schema feature to forward deprecated model attributes to a new location. [#86]
- Support casting of FITS_rec tables with unsigned integer columns. [#87]
- Remove NDData interface from DataModel. [#77]
- Add cast_fits_arrays and validate_arrays options for controlling array validation behavior. [#79]
- Prevent data corruption by raising an error when asked to cast a table with a pseudo-unsigned integer column. [#82]
- Remove DataModel.my_attribute function. [#72]
- Workaround for setuptools_scm issues with recent versions of pip. [#83]
- Don't allow ASDF hdus to get passed through
extra_fits, and don't write out any ASDF extension ifself._no_asdf_extension=True[#71]
- Make arrays contiguous on save to prevent issue with duplicate array data between ASDF and FITS. [#70]
- Stop setting level of package loggers. [#64]
- Remove automatic management of meta.date attribute and create on_init hook. [#44]
- Fix bug where asdf.tags.core.NDArrayType instances remain in flat dict when include_arrays=False. [#58]
- Improve handling of open files among shallow copies of a DataModel. [#59, #60]
- Create package and import code from jwst.datamodels. [#1, #27]
- Remove stdatamodels.open. [#2]
- Fix validation behavior when an object with nested None values is assigned to a DataModel attribute. [#45]
- Rename is_builtin_fits_keyword to make clear that it is used outside of this package. [#47]
- Add flag to disable validation on DataModel attribute assignment. [#36]