Commit f4a5608
Fix outlines task1706: pin transformers and tokenizers versions (#39)
The Dockerfile and runner.sh install transformers and tokenizers without
version pins. transformers>=5.0.0 combined with tokenizers>=0.22 breaks
the test suite in two ways:
1. tokenizers 0.22 turns the BPE.__init__ DeprecationWarning into a hard
error, causing GPT2Tokenizer initialization to fail.
2. transformers 5.x has a code path in _from_pretrained that calls
import_protobuf_decode_error() inside an except clause, which raises
ImportError when protobuf is not installed — even for non-protobuf
tokenizers like GPT2.
Pin transformers<5 and tokenizers<0.21 in both the Dockerfile and
runner.sh to restore compatibility. Verified locally: both feature 4 and
feature 6 tests pass (9/9 and 11/11) with the pinned versions.
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>1 parent 62e6a97 commit f4a5608
File tree
2 files changed
+2
-2
lines changed- dataset/dottxt_ai_outlines_task/task1706
2 files changed
+2
-2
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
26 | 26 | | |
27 | 27 | | |
28 | 28 | | |
29 | | - | |
| 29 | + | |
30 | 30 | | |
31 | 31 | | |
32 | 32 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
67 | 67 | | |
68 | 68 | | |
69 | 69 | | |
70 | | - | |
| 70 | + | |
71 | 71 | | |
72 | 72 | | |
73 | 73 | | |
| |||
0 commit comments