Skip to content

Commit 45ef0fa

Browse files
committed
Update index.html
1 parent 89c7e73 commit 45ef0fa

1 file changed

Lines changed: 1 addition & 2 deletions

File tree

docs/index.html

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -5024,7 +5024,6 @@ <h2>Key Takeaways</h2>
50245024
tag: "DiT",
50255025
subtitle: "",
50265026
body: `
5027-
<h2>Cross-Attention</h2>
50285027
50295028
<p>
50305029
In LLMs, We have only text, So we usually use self-attention or multi-head self-attention.
@@ -5069,7 +5068,7 @@ <h2>One Possible Approach: Concatenate Everything</h2>
50695068
<p> But our case is different </p>
50705069
50715070
<p>
5072-
here in self-attention, after we concatinate all the stream tokens, every token can look at every other token inside that stream.
5071+
Here in self-attention, after we concatinate all the stream tokens, every token can look at every other token inside that stream.
50735072
</p>
50745073
50755074
<ul>

0 commit comments

Comments
 (0)