Add SoftKNNClassifierModel (#5072)#5072
Conversation
|
@sunnyshen321 has exported this pull request. If you are a Meta employee, you can view the originating Diff in D90894389. |
Summary: X-link: facebook/Ax#5072 Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is fully differentiable, enabling gradient-based acquisition function optimization. The model uses Gaussian kernel weights: P(y=1|x) = sum(w_i * y_i) / sum(w_i) where w_i = exp(-||x - x_i||^2 / (2 * sigma^2)) Implements construct_inputs classmethod for seamless Ax integration. Differential Revision: D90894389
ba554b3 to
f523295
Compare
Summary: X-link: meta-pytorch/botorch#3243 Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is fully differentiable, enabling gradient-based acquisition function optimization. The model uses Gaussian kernel weights: P(y=1|x) = sum(w_i * y_i) / sum(w_i) where w_i = exp(-||x - x_i||^2 / (2 * sigma^2)) Implements construct_inputs classmethod for seamless Ax integration. Differential Revision: D90894389
Summary: X-link: meta-pytorch/botorch#3243 Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is fully differentiable, enabling gradient-based acquisition function optimization. The model uses Gaussian kernel weights: P(y=1|x) = sum(w_i * y_i) / sum(w_i) where w_i = exp(-||x - x_i||^2 / (2 * sigma^2)) Implements construct_inputs classmethod for seamless Ax integration. Differential Revision: D90894389
f523295 to
f01f0f9
Compare
Summary: X-link: facebook/Ax#5072 Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is fully differentiable, enabling gradient-based acquisition function optimization. The model uses Gaussian kernel weights: P(y=1|x) = sum(w_i * y_i) / sum(w_i) where w_i = exp(-||x - x_i||^2 / (2 * sigma^2)) Implements construct_inputs classmethod for seamless Ax integration. Differential Revision: D90894389
Summary: X-link: meta-pytorch/botorch#3243 Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is fully differentiable, enabling gradient-based acquisition function optimization. The model uses Gaussian kernel weights: P(y=1|x) = sum(w_i * y_i) / sum(w_i) where w_i = exp(-||x - x_i||^2 / (2 * sigma^2)) Implements construct_inputs classmethod for seamless Ax integration. Differential Revision: D90894389
f01f0f9 to
6bc88c5
Compare
Summary: X-link: meta-pytorch/botorch#3243 Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is fully differentiable, enabling gradient-based acquisition function optimization. The model uses Gaussian kernel weights: P(y=1|x) = sum(w_i * y_i) / sum(w_i) where w_i = exp(-||x - x_i||^2 / (2 * sigma^2)) Implements construct_inputs classmethod for seamless Ax integration. Differential Revision: D90894389
6bc88c5 to
6d73f2c
Compare
Summary: X-link: facebook/Ax#5072 Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is fully differentiable, enabling gradient-based acquisition function optimization. The model uses Gaussian kernel weights: P(y=1|x) = sum(w_i * y_i) / sum(w_i) where w_i = exp(-||x - x_i||^2 / (2 * sigma^2)) Implements construct_inputs classmethod for seamless Ax integration. Differential Revision: D90894389
|
Hi @sunnyshen321! Thank you for your pull request. We require contributors to sign our Contributor License Agreement, and yours needs attention. You currently have a record in our system, but the CLA is no longer valid, and will need to be resubmitted. ProcessIn order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA. Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks! |
Summary:
X-link: meta-pytorch/botorch#3243
Add a differentiable Soft K-Nearest Neighbors classifier model for failure-aware
Bayesian optimization. Unlike tree-based classifiers (RF, XGBoost), SoftKNN is
fully differentiable, enabling gradient-based acquisition function optimization.
The model uses Gaussian kernel weights:
P(y=1|x) = sum(w_i * y_i) / sum(w_i)
where w_i = exp(-||x - x_i||^2 / (2 * sigma^2))
Implements construct_inputs classmethod for seamless Ax integration.
Differential Revision: D90894389