Skip to content

Commit c18f47e

Browse files
committed
Merge pull request #87 from shadmantabib/main
[ci skip] This build is based on 76d7614. This commit was created by the following CI build and job: https://github.com/AdaptInfer/context-review/commit/76d7614922e1cd1c033813d9949e2d890f108730/checks https://github.com/AdaptInfer/context-review/actions/runs/21290928226
1 parent db12f00 commit c18f47e

7 files changed

Lines changed: 144 additions & 83 deletions

File tree

citations.tsv

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -239,6 +239,7 @@ doi:10.48550/arXiv.2212.09741 doi:10.48550/arXiv.2212.09741 doi:10.48550/arxiv.2
239239
doi:10.1038/s41467-023-43713-1 doi:10.1038/s41467-023-43713-1 doi:10.1038/s41467-023-43713-1 HQXzkG4Q
240240
doi:10.48550/arXiv.2409.08466 doi:10.48550/arXiv.2409.08466 doi:10.48550/arxiv.2409.08466 XpHq6HEw
241241
doi:10.48550/arXiv.2305.14705 doi:10.48550/arXiv.2305.14705 doi:10.48550/arxiv.2305.14705 zWwbz3cX
242+
doi:10.48550/arXiv.2406.19598 doi:10.48550/arXiv.2406.19598 doi:10.48550/arxiv.2406.19598 sooQqOgG
242243
doi:10.48550/arXiv.2311.16142 doi:10.48550/arXiv.2311.16142 doi:10.48550/arxiv.2311.16142 R3AtGoca
243244
doi:10.48550/arXiv.1807.03124 doi:10.48550/arXiv.1807.03124 doi:10.48550/arxiv.1807.03124 J9eXUymQ
244245
doi:10.48550/arXiv.2510.04618 doi:10.48550/arXiv.2510.04618 doi:10.48550/arxiv.2510.04618 1Ft0Gvajp

manuscript.html

Lines changed: 29 additions & 27 deletions
Large diffs are not rendered by default.

manuscript.md

Lines changed: 13 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ keywords:
55
- publishing
66
- manubot
77
lang: en-US
8-
date-meta: '2025-10-29'
8+
date-meta: '2026-01-23'
99
author-meta:
1010
- Yue Yao
1111
- Caleb N. Ellington
@@ -29,11 +29,11 @@ header-includes: |
2929
<meta name="citation_title" content="Context-Adaptive Inference: A Unified Statistical and Foundation-Model View" />
3030
<meta property="og:title" content="Context-Adaptive Inference: A Unified Statistical and Foundation-Model View" />
3131
<meta property="twitter:title" content="Context-Adaptive Inference: A Unified Statistical and Foundation-Model View" />
32-
<meta name="dc.date" content="2025-10-29" />
33-
<meta name="citation_publication_date" content="2025-10-29" />
34-
<meta property="article:published_time" content="2025-10-29" />
35-
<meta name="dc.modified" content="2025-10-29T16:44:51+00:00" />
36-
<meta property="article:modified_time" content="2025-10-29T16:44:51+00:00" />
32+
<meta name="dc.date" content="2026-01-23" />
33+
<meta name="citation_publication_date" content="2026-01-23" />
34+
<meta property="article:published_time" content="2026-01-23" />
35+
<meta name="dc.modified" content="2026-01-23T15:12:53+00:00" />
36+
<meta property="article:modified_time" content="2026-01-23T15:12:53+00:00" />
3737
<meta name="dc.language" content="en-US" />
3838
<meta name="citation_language" content="en-US" />
3939
<meta name="dc.relation.ispartof" content="Manubot" />
@@ -89,9 +89,9 @@ header-includes: |
8989
<meta name="citation_fulltext_html_url" content="https://AdaptInfer.github.io/context-review/" />
9090
<meta name="citation_pdf_url" content="https://AdaptInfer.github.io/context-review/manuscript.pdf" />
9191
<link rel="alternate" type="application/pdf" href="https://AdaptInfer.github.io/context-review/manuscript.pdf" />
92-
<link rel="alternate" type="text/html" href="https://AdaptInfer.github.io/context-review/v/6bdae7b91b69d53589f34e66a19f15cb992f6738/" />
93-
<meta name="manubot_html_url_versioned" content="https://AdaptInfer.github.io/context-review/v/6bdae7b91b69d53589f34e66a19f15cb992f6738/" />
94-
<meta name="manubot_pdf_url_versioned" content="https://AdaptInfer.github.io/context-review/v/6bdae7b91b69d53589f34e66a19f15cb992f6738/manuscript.pdf" />
92+
<link rel="alternate" type="text/html" href="https://AdaptInfer.github.io/context-review/v/76d7614922e1cd1c033813d9949e2d890f108730/" />
93+
<meta name="manubot_html_url_versioned" content="https://AdaptInfer.github.io/context-review/v/76d7614922e1cd1c033813d9949e2d890f108730/" />
94+
<meta name="manubot_pdf_url_versioned" content="https://AdaptInfer.github.io/context-review/v/76d7614922e1cd1c033813d9949e2d890f108730/manuscript.pdf" />
9595
<meta property="og:type" content="article" />
9696
<meta property="twitter:card" content="summary_large_image" />
9797
<link rel="icon" type="image/png" sizes="192x192" href="https://manubot.org/favicon-192x192.png" />
@@ -113,10 +113,10 @@ manubot-clear-requests-cache: false
113113

114114
<small><em>
115115
This manuscript
116-
([permalink](https://AdaptInfer.github.io/context-review/v/6bdae7b91b69d53589f34e66a19f15cb992f6738/))
116+
([permalink](https://AdaptInfer.github.io/context-review/v/76d7614922e1cd1c033813d9949e2d890f108730/))
117117
was automatically generated
118-
from [AdaptInfer/context-review@6bdae7b](https://github.com/AdaptInfer/context-review/tree/6bdae7b91b69d53589f34e66a19f15cb992f6738)
119-
on October 29, 2025.
118+
from [AdaptInfer/context-review@76d7614](https://github.com/AdaptInfer/context-review/tree/76d7614922e1cd1c033813d9949e2d890f108730)
119+
on January 23, 2026.
120120
</em></small>
121121

122122

@@ -1694,7 +1694,7 @@ Several new architectures exemplify how foundation models advance context-sensit
16941694

16951695
**LMPriors** (Pre-Trained Language Models as Task-Specific Priors) [@doi:10.48550/arXiv.2210.12530] leverages semantic insights from pre-trained models like GPT-3 to guide tasks such as causal inference, feature selection, and reinforcement learning. This method markedly enhances decision accuracy and efficiency without requiring extensive supervised datasets. However, it necessitates careful prompt engineering to mitigate biases and ethical concerns.
16961696

1697-
**Mixture of In-Context Experts** (MoICE) [@doi:10.48550/arXiv.2210.12530] introduces a dynamic routing mechanism within attention heads, utilizing multiple Rotary Position Embeddings (RoPE) angles to effectively capture token positions in sequences. MoICE significantly enhances performance on long-context sequences and retrieval-augmented generation tasks by ensuring complete contextual coverage. Efficiency is achieved through selective router training, and interpretability is improved by explicitly visualizing attention distributions, providing detailed insights into the model's reasoning process.
1697+
**Mixture of In-Context Experts** (MoICE) [@doi:10.48550/arXiv.2406.19598] introduces a dynamic routing mechanism within attention heads, utilizing multiple Rotary Position Embeddings (RoPE) angles to effectively capture token positions in sequences. MoICE significantly enhances performance on long-context sequences and retrieval-augmented generation tasks by ensuring complete contextual coverage. Efficiency is achieved through selective router training, and interpretability is improved by explicitly visualizing attention distributions, providing detailed insights into the model's reasoning process.
16981698

16991699
Collectively, these directions suggest a future in which foundation models evolve from passive representation learners into active, context-sensitive inference engines that unify adaptivity, efficiency, and interpretability within a principled framework.
17001700

manuscript.pdf

676 Bytes
Binary file not shown.

0 commit comments

Comments
 (0)