Skip to content

SQtqmse4 decoded-vector norms shifted +15% from 1.14.2 to 1.14.3, intentional? #5317

@mandakinee

Description

@mandakinee

The bits=8 codec is essentially unchanged. The bits=4 codec systematically returns decoded vectors with ~15% larger norm. Tested with (L2norm,RR,SQtqmse{bits} with METRIC_INNER_PRODUCT)

  ┌──────────────────────────┬────────┬────────┬───────┐
  │          Metric          │ 1.14.2 │ 1.14.3 │   Δ   │
  ├──────────────────────────┼────────┼────────┼───────┤
  │ bits=4 max recon norm    │ 1.0246 │ 1.2615 │ +23%  │
  ├──────────────────────────┼────────┼────────┼───────┤
  │ bits=4 median recon norm │ 1.0005 │ 1.1503 │ +15%  │
  ├──────────────────────────┼────────┼────────┼───────┤
  │ bits=4 max search IP     │ 0.378  │ 0.464  │ +23%  │
  ├──────────────────────────┼────────┼────────┼───────┤
  │ bits=4 median search IP  │ 0.289  │ 0.326  │ +13%  │
  ├──────────────────────────┼────────┼────────┼───────┤
  │ bits=8 max recon norm    │ 1.0083 │ 1.0085 │ ≈0    │
  ├──────────────────────────┼────────┼────────┼───────┤
  │ bits=8 median recon norm │ 0.9991 │ 1.0018 │ +0.3% │
  └──────────────────────────┴────────┴────────┴───────┘

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions