2.2.0-rc2

TensorFlow Serving using TensorFlow 2.2.0-rc4

2.2.0-rc1

Release 2.2.0-rc1

Major Features and Improvements

Breaking Changes

Bug Fixes and Other Changes

• Add a SourceAdapter that adds a prefix to StoragePath. (commit: f337623)
  In ServableStateMonitor, introduce a helper method 'GetAvailableServables' in ServableStateMonitor. (commit: 4dcfa25)
• Adds performance guide and documentation for TensorBoard integration (commit: f1e4eb2)
• Use SavedModelBundleFactory for session source adapter instead (commit: a59e0dc)
• Update TF Text to 2.0.1 (commit: bd206e4)
• API spec for httpserver response-streaming (with flow-control). (commit: fd597f0)
• Update TF Text to v2.1.1 which removes ICU variable conflict with core TF. (commit: 2fd33e1)
• Reduce contention in FastReadDynamicPtr by sharding the ReadPtrs, by default one per CPU. (commit: d3b374b)
• Refined the httpserver flow-control API for streaming writes. (commit: e085cb3)
• Explicitly disable Tensorflow v2 behaviors for all TF1.x binaries and tests (commit: 3ffd969)
• Allow splitting fields from batched session metadata into individual sessions (commit: caf2a92)
• For google-internal, optimize proto parse code for lazy scenario, by annotate byte-type fields with Cord. (commit: 726ca19)
• Allow passing ThreadPoolOptions in various Session implementations. (commit: 2b6212c)
• Small performance optimization. (commit: 4196a72)

Thanks to our Contributors

This release contains contributions from many people at Google.

2.2.0-rc0

TensorFlow Serving using TensorFlow 2.2.0-rc0.

Major Features and Improvements

Breaking Changes

Bug Fixes and Other Changes

• Add a SourceAdapter that adds a prefix to StoragePath. (commit: f337623)
• Switch users of tensorflow::Env::Now*() to EnvTime::Now*(). (commit: 8a0895e)
• Update the serving model test to use profiler_client.start_tracing instead of (commit: 495e15b)
• Remove SessionBundle usage from regressor/classifier. (commit: b1b6ffd)
• Remove SessionBundle support from Predictor. (commit: 2090d67)
• In ServableStateMonitor, introduce a helper method 'GetAvailableServables' in ServableStateMonitor. (commit: 4dcfa25)
• Adds performance guide and documentation for TensorBoard integration (commit: f1e4eb2)
• Fix docs to refer to SavedModelBundleSourceAdatperConfig as (commit: 4de4c7b)
• Update minimum bazel version to 1.2.1. (commit: 1a36026)
• Drop support for beta gRPC APIs. (commit: 13d01fc)
• Change Python version to PY3. (commit: 7516746)
• Change dockerfile for PY3. (commit: 7cbd06e)
• Update TF Text to v2.1.1 which removes ICU variable conflict with core TF. (commit: 2fd33e1)
• Reduce contention in FastReadDynamicPtr by sharding the ReadPtrs, by default one per CPU. (commit: d3b374b)
• Ensure that all outstanding ReadPtrs are destroyed before allowing a (commit: e41ee40)
• Refined the httpserver flow-control API for streaming writes. (commit: e085cb3)
• Makes clear that version labels are not supported by REST API surface (commit: 9781ed1)
• Allow splitting fields from batched session metadata into individual sessions (commit: caf2a92)
• Allow passing ThreadPoolOptions in various Session implementations. (commit: 2b6212c)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Haiming, Shyam Saladi, Tensorflow-Copybara

2.1.0

TensorFlow Serving using TensorFlow 2.1.0

Major Features and Improvements

• Add integration with TensorBoard profiler service.

Breaking Changes

Bug Fixes and Other Changes

• Fix link for TFRecord in Saved Model Warmup documentation. (commit: 127a112)
• Fix typo in http server log message. (commit: 509f6da)
• Be able to discard aspired-versions request from SourceRouter (commit: 10e4987)
• Use public tf.config APIs (commit: 87a4b2b)
• Fix copying of string tensor outputs by explicitly copying each (commit: 9544077)
• Migrate from std::string to tensorflow::tstring. (commit: e24571a)

TensorFlow Serving using TensorFlow 2.1.0-rc1

Release 2.1

Major Features and Improvements

• Be able to discard aspired-versions request from SourceRouter (commit: 10e4987)
• Adds integration with TensorBoard profiler service (commit: 91adea9)

Breaking Changes

Bug Fixes and Other Changes

• Fix link for TFRecord in Saved Model Warmup documentation. (commit: 127a112)
• Use public tf.config APIs (commit: 87a4b2b)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Minglotus-6

1.13.1

TensorFlow Serving using TensorFlow 1.13.2

2.0.0

TensorFlow Serving using TensorFlow 2.0.0

Major Features and Improvements

• Some Tensorflow Text ops have been added to ModelServer (specifically constrained_sequence_op, sentence_breaking_ops, unicode_script_tokenizer, whitespace_tokenizer, wordpiece_tokenizer)

Breaking Changes

• As previously announced123, Contrib ops will not be packaged with Tensorflow, and therefore will not be available in Tensorflow Serving. If serving with Tensorflow Serving >1.15, please ensure your models do not contain any tf.contrib ops. If you are critically dependent on custom ops, please review this guide for instructions to statically build ops into the model server.
• After being deprecated for multiple years, as a part of tf.contrib deprecation, SessionBundle API will be removed starting from Tensorflow Serving 2.0 - if currently using SessionBundle, please migrate to SavedModel APIs.

Bug Fixes and Other Changes

• Add a section in the documentation for testing custom op manually. (commit: 1b65af1)
• Add ops delegate library to enable running TF ops. (commit: 1411235)
• Add command line tool to load TF Lite model for manual testing/debugging. (commit: 0b0254d)
• Fixes broken relative docs links (commit: 1281314)
• Cleaning up BUILD visibility for tf_pyclif_proto_library intermediate targets. (commit: 81ed5ef)
• Remove unused load statements from BUILD files (commit: d0e01a3)
• Manual tests for model server and including tf.Text in serving build. (commit: 142d0ad)
• Remove tensorflow/contrib/session_bundle as dependency for Tensorflow Serving. (commit: 1bdd349)

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

chaox

1.15.0

TensorFlow Serving using TensorFlow 1.15.0

Major Features and Improvements

Breaking Changes

• As previously announced, Contrib ops will not be packaged with Tensorflow, and therefore will not be available in Tensorflow Serving. If serving with Tensorflow Serving >1.15, please ensure your models do not contain any tf.contrib ops. If you are critically dependent on custom ops, please review this guide for instructions to statically build ops into the model server.
• After being deprecated for multiple years, as a part of tf.contrib deprecation, SessionBundle API will be removed starting from Tensorflow Serving 2.0 - if currently using SessionBundle, please migrate to SavedModel APIs.

Bug Fixes and Other Changes

• This release is based on TF version 1.15.0

Thanks to our Contributors

This release contains contributions from many people at Google, as well as:

Abolfazl Shahbazi, chaox, gison93, Minglotus-6, William D. Irons, ynqa

1.15.0-rc2

TensorFlow Serving using TensorFlow 1.15.0-rc3.

1.15.0-rc1

Merge pull request #1446 from minglotus-6/releng_20190924_115434

Update version for 1.15.0-rc1 release.