|
5 | 5 | Change Log
|
6 | 6 | ==========
|
7 | 7 |
|
| 8 | +Release 2.5 - 11/2/2021 |
| 9 | +----------------------- |
| 10 | + |
| 11 | +Model Compression |
| 12 | +^^^^^^^^^^^^^^^^^ |
| 13 | + |
| 14 | +* New major version of pruning framework `(doc) <https://nni.readthedocs.io/en/v2.5/Compression/v2_pruning.html>`__ |
| 15 | + |
| 16 | + * Iterative pruning is more automated, users can use less code to implement iterative pruning. |
| 17 | + * Support exporting intermediate models in the iterative pruning process. |
| 18 | + * The implementation of the pruning algorithm is closer to the paper. |
| 19 | + * Users can easily customize their own iterative pruning by using ``PruningScheduler``. |
| 20 | + * Optimize the basic pruners underlying generate mask logic, easier to extend new functions. |
| 21 | + * Optimized the memory usage of the pruners. |
| 22 | + |
| 23 | +* MobileNetV2 end-to-end example `(notebook) <https://github.com/microsoft/nni/blob/v2.5/examples/model_compress/pruning/mobilenetv2_end2end/Compressing%20MobileNetV2%20with%20NNI%20Pruners.ipynb>`__ |
| 24 | +* Improved QAT quantizer `(doc) <https://nni.readthedocs.io/en/v2.5/Compression/Quantizer.html#qat-quantizer>`__ |
| 25 | + |
| 26 | + * support dtype and scheme customization |
| 27 | + * support dp multi-gpu training |
| 28 | + * support load_calibration_config |
| 29 | + |
| 30 | +* Model speed-up now supports directly loading the mask `(doc) <https://nni.readthedocs.io/en/v2.5/Compression/ModelSpeedup.html#nni.compression.pytorch.ModelSpeedup>`__ |
| 31 | +* Support speed-up depth-wise convolution |
| 32 | +* Support bn-folding for LSQ quantizer |
| 33 | +* Support QAT and LSQ resume from PTQ |
| 34 | +* Added doc for observer quantizer `(doc) <https://nni.readthedocs.io/en/v2.5/Compression/Quantizer.html#observer-quantizer>`__ |
| 35 | + |
| 36 | +Neural Architecture Search |
| 37 | +^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| 38 | + |
| 39 | +* NAS benchmark `(doc) <https://nni.readthedocs.io/en/v2.5/NAS/Benchmarks.html>`__ |
| 40 | + |
| 41 | + * Support benchmark table lookup in experiments |
| 42 | + * New data preparation approach |
| 43 | + |
| 44 | +* Improved `quick start doc <https://nni.readthedocs.io/en/v2.5/NAS/QuickStart.html>`__ |
| 45 | +* Experimental CGO execution engine `(doc) <https://nni.readthedocs.io/en/v2.5/NAS/ExecutionEngines.html#cgo-execution-engine-experimental>`__ |
| 46 | + |
| 47 | +Hyper-Parameter Optimization |
| 48 | +^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
| 49 | + |
| 50 | +* New training platform: Alibaba DSW+DLC `(doc) <https://nni.readthedocs.io/en/v2.5/TrainingService/DLCMode.html>`__ |
| 51 | +* Support passing ConfigSpace definition directly to BOHB `(doc) <https://nni.readthedocs.io/en/v2.5/Tuner/BohbAdvisor.html#usage>`__ (thanks to khituras) |
| 52 | +* Reformatted `experiment config doc <https://nni.readthedocs.io/en/v2.5/reference/experiment_config.html>`__ |
| 53 | +* Added example config files for Windows (thanks to @politecat314) |
| 54 | +* FrameworkController now supports reuse mode |
| 55 | + |
| 56 | +Fixed Bugs |
| 57 | +^^^^^^^^^^ |
| 58 | + |
| 59 | +* Experiment cannot start due to platform timestamp format (issue #4077 #4083) |
| 60 | +* Cannot use ``1e-5`` in search space (issue #4080) |
| 61 | +* Dependency version conflict caused by ConfigSpace (issue #3909) (thanks to @jexxers) |
| 62 | +* Hardware-aware SPOS example does not work (issue #4198) |
| 63 | +* Web UI show wrong remaining time when duration exceeds limit (issue #4015) |
| 64 | +* cudnn.deterministic is always set in AMC pruner (#4117) thanks to @mstczuo |
| 65 | + |
| 66 | +And... |
| 67 | +^^^^^^ |
| 68 | + |
| 69 | +* New `emoticons <https://github.com/microsoft/nni/blob/v2.5/docs/en_US/Tutorial/NNSpider.md>`__! |
| 70 | + |
| 71 | +.. image:: https://raw.githubusercontent.com/microsoft/nni/v2.5/docs/img/emoicons/Holiday.png |
| 72 | + |
8 | 73 | Release 2.4 - 8/11/2021
|
9 | 74 | -----------------------
|
10 | 75 |
|
|
0 commit comments