We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 89c7e73 commit 45ef0faCopy full SHA for 45ef0fa
1 file changed
docs/index.html
@@ -5024,7 +5024,6 @@ <h2>Key Takeaways</h2>
5024
tag: "DiT",
5025
subtitle: "",
5026
body: `
5027
- <h2>Cross-Attention</h2>
5028
5029
<p>
5030
In LLMs, We have only text, So we usually use self-attention or multi-head self-attention.
@@ -5069,7 +5068,7 @@ <h2>One Possible Approach: Concatenate Everything</h2>
5069
5068
<p> But our case is different </p>
5070
5071
5072
- here in self-attention, after we concatinate all the stream tokens, every token can look at every other token inside that stream.
+ Here in self-attention, after we concatinate all the stream tokens, every token can look at every other token inside that stream.
5073
</p>
5074
5075
<ul>
0 commit comments