forked from rohitg00/ai-engineering-from-scratch
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathquiz.json
More file actions
78 lines (78 loc) · 2.67 KB
/
Copy pathquiz.json
File metadata and controls
78 lines (78 loc) · 2.67 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
{
"lesson": "15-batch-apis",
"title": "Batch APIs — the 50% Discount as Industry Standard",
"questions": [
{
"stage": "pre",
"question": "What is the common batch-API offer across OpenAI, Anthropic, and Google in 2026?",
"options": [
"10% discount with 1-hour turnaround",
"90% discount with 7-day turnaround",
"Free if under 1k tokens",
"50% discount with 24-hour turnaround"
],
"correct": 3,
"explanation": ""
},
{
"stage": "check",
"question": "What does \"24-hour turnaround\" actually guarantee in the lesson's framing?",
"options": [
"24h is the cache TTL",
"The batch always takes 24 hours",
"The provider promises to return within 24 hours, with typical P50 around 2-6 hours",
"Only batches under 1k requests qualify"
],
"correct": 2,
"explanation": ""
},
{
"stage": "check",
"question": "How does stacking batch with cached input change the bill versus synchronous uncached on a shared-system-prompt workload?",
"options": [
"It has no effect because caching is automatic",
"It only helps if the model is on Vertex",
"It can drop to roughly 10% of the synchronous-uncached baseline",
"It increases cost by 50%"
],
"correct": 2,
"explanation": ""
},
{
"stage": "check",
"question": "Which workload-triage lane is wrong to default to in 2026 for content pipelines and offline labeling?",
"options": [
"Interactive, because it sounds urgent",
"Batch, because the user does not see a 24h delay",
"Hybrid batch-and-cache",
"Semi-interactive with async queue"
],
"correct": 0,
"explanation": ""
},
{
"stage": "post",
"question": "What is the output-schema trap across providers?",
"options": [
"JSONL is unsupported by Anthropic",
"All providers use the same OpenAI JSONL format",
"Vertex requires Parquet only",
"Batch file formats differ per provider (OpenAI JSONL, Anthropic JSONL, Vertex BigQuery/GCS), so a portable client needs per-provider adapters"
],
"correct": 3,
"explanation": ""
},
{
"stage": "post",
"question": "Per the lesson, what is the simplest decision rule for triaging a workload to batch?",
"options": [
"If the prompt is under 1k tokens, batch it",
"If it uses tools, batch it",
"Batch only when the gateway requires it",
"If the user wouldn't notice a 24-hour delivery, always batch (and stack caching)"
],
"correct": 3,
"explanation": ""
}
]
}