Skip to content

Commit 8ff068f

Browse files
sarthak247sarthak247
committed
add attention blog
1 parent 869bcbb commit 8ff068f

File tree

129 files changed

+6779
-2093
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

129 files changed

+6779
-2093
lines changed

Diff for: ‎config.yaml

+21-9
Original file line numberDiff line numberDiff line change
@@ -19,9 +19,20 @@ enableRobotsTXT: true
1919

2020
markup:
2121
goldmark:
22-
renderer:
23-
unsafe: true
24-
22+
extensions:
23+
passthrough:
24+
delimiters:
25+
block:
26+
- - \[
27+
- \]
28+
- - $$
29+
- $$
30+
inline:
31+
- - \(
32+
- \)
33+
enable: true
34+
params:
35+
math: true
2536
Menus:
2637
main:
2738
- identifier: blog
@@ -322,21 +333,22 @@ params:
322333
items:
323334
- title: Attention Is All You Need
324335
content: Paper implementation of Attention Is All You Need inspired by Umar Jamil. The model currently supports English to Italian and English to French language translations.
325-
image: /images/projects/attention.png
326-
featured:
327-
name: Demo # Fixit
328-
link: https://hugo-profile.netlify.app
336+
image: /projects/attention.png
337+
# featured:
338+
# name: Demo # Fixit
339+
# link: https://hugo-profile.netlify.app
329340
badges:
330341
- "LLM"
331342
- "Code Follow Along"
332343
- "Language Translation"
344+
- "Transformers"
333345
links:
334346
- icon: fab fa-github
335-
url: # Fixit
347+
url: https://github.com/sarthak247/Attention-Is-All-You-Need
336348
- icon: fas fa-blog # Fixit
337349
url: # Fixit
338350

339-
- title: Image Converter
351+
- title:
340352
content: A web app to convert image to pdf, png to jpg, png to jpg and png to webp without database using django.
341353
image: /images/projects/converter.jpg
342354
featured:

Diff for: ‎content/blogs/attention-is-all-you-need.md

+233
Large diffs are not rendered by default.

Diff for: ‎layouts/partials/math.html

+9
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
<script id="MathJax-script" async src="https://cdn.jsdelivr.net/npm/mathjax@3/es5/tex-chtml.js"></script>
2+
<script>
3+
MathJax = {
4+
tex: {
5+
displayMath: [['\\[', '\\]'], ['$$', '$$']], // block
6+
inlineMath: [['\\(', '\\)']] // inline
7+
}
8+
};
9+
</script>

Diff for: ‎public/404.html

+55-7
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
<!DOCTYPE html>
22
<html>
33

4-
<head><script src="/livereload.js?mindelay=10&amp;v=2&amp;port=1313&amp;path=livereload" data-no-instant defer></script><meta charset="UTF-8">
4+
<head><script src="/livereload.js?mindelay=10&amp;v=2&amp;port=37417&amp;path=livereload" data-no-instant defer></script><meta charset="UTF-8">
55
<meta name="viewport" content="width=device-width, initial-scale=1.0">
66
<meta http-equiv="X-UA-Compatible" content="ie=edge">
77
<meta http-equiv="Accept-CH" content="DPR, Viewport-Width, Width">
@@ -31,7 +31,7 @@
3131

3232

3333

34-
<meta property="og:url" content="http://localhost:1313/404.html">
34+
<meta property="og:url" content="http://localhost:37417/404.html">
3535
<meta property="og:site_name" content="Sarthak Thakur">
3636
<meta property="og:title" content="404 Page not found">
3737
<meta property="og:description" content="Portfolio Website">
@@ -316,13 +316,61 @@ <h1>Page not found</h1>
316316
<div class="card h-100">
317317

318318
<div class="card-header">
319-
<a href="/blogs/hello-world/hello-world/">
320-
<img src="/images/blogs/hello-world/cover.jpg" class="card-img-top" alt="Embracing Freedom: My Journey to Creating a Personal Blog with Hugo and GitHub Pages">
319+
<a href="/blogs/attention-is-all-you-need/">
320+
<img src="/projects/attention.png" class="card-img-top" alt="Attention Is All You Need - From where it all started">
321321
</a>
322322
</div>
323323

324324
<div class="card-body bg-transparent p-3 shadow-sm">
325-
<a href="/blogs/hello-world/hello-world/" class="primary-font card-title">
325+
<a href="/blogs/attention-is-all-you-need/" class="primary-font card-title">
326+
<h5 class="card-title bg-transparent" title="Attention Is All You Need - From where it all started">Attention Is All You Need …</h5>
327+
</a>
328+
<div class="card-text secondary-font">
329+
<p>Introduction In the current landscape of Generative Artificial Intelligence (GenAI), new architectures and methodologies emerge with remarkable frequency. According to recent statistics from arXiv, the volume of papers tagged under LLM averages nine submissions daily. To comprehend these …</p>
330+
</div>
331+
</div>
332+
<div class="mt-auto card-footer">
333+
<span class="float-start">Jul 3, 2024</span>
334+
<a href="/blogs/attention-is-all-you-need/" class="float-end btn btn-outline-info btn-sm">Read</a>
335+
</div>
336+
</div>
337+
</div>
338+
339+
<div class="col-lg-4 col-md-6 pt-2">
340+
<div class="card h-100">
341+
342+
<div class="card-header">
343+
<a href="/blogs/word-embeddings/">
344+
<img src="/blogs/word-embeddings/cover.png" class="card-img-top" alt="Unraveling the Power of Word Vectorization: From Text to Numbers">
345+
</a>
346+
</div>
347+
348+
<div class="card-body bg-transparent p-3 shadow-sm">
349+
<a href="/blogs/word-embeddings/" class="primary-font card-title">
350+
<h5 class="card-title bg-transparent" title="Unraveling the Power of Word Vectorization: From Text to Numbers">Unraveling the Power of …</h5>
351+
</a>
352+
<div class="card-text secondary-font">
353+
<p>Introduction In the realm of Natural Language Processing (NLP), one of the key challenges is to bridge the gap between the textual world of words and the numerical world of computers. We know that computers only understand in form of numbers (0s and 1s to be precise). So how do we make sense of …</p>
354+
</div>
355+
</div>
356+
<div class="mt-auto card-footer">
357+
<span class="float-start">Sep 5, 2023</span>
358+
<a href="/blogs/word-embeddings/" class="float-end btn btn-outline-info btn-sm">Read</a>
359+
</div>
360+
</div>
361+
</div>
362+
363+
<div class="col-lg-4 col-md-6 pt-2">
364+
<div class="card h-100">
365+
366+
<div class="card-header">
367+
<a href="/blogs/hello-world/">
368+
<img src="/blogs/hello-world/cover.jpg" class="card-img-top" alt="Embracing Freedom: My Journey to Creating a Personal Blog with Hugo and GitHub Pages">
369+
</a>
370+
</div>
371+
372+
<div class="card-body bg-transparent p-3 shadow-sm">
373+
<a href="/blogs/hello-world/" class="primary-font card-title">
326374
<h5 class="card-title bg-transparent" title="Embracing Freedom: My Journey to Creating a Personal Blog with Hugo and GitHub Pages">Embracing Freedom: My …</h5>
327375
</a>
328376
<div class="card-text secondary-font">
@@ -331,7 +379,7 @@ <h5 class="card-title bg-transparent" title="Embracing Freedom: My Journey to Cr
331379
</div>
332380
<div class="mt-auto card-footer">
333381
<span class="float-start">Sep 4, 2023</span>
334-
<a href="/blogs/hello-world/hello-world/" class="float-end btn btn-outline-info btn-sm">Read</a>
382+
<a href="/blogs/hello-world/" class="float-end btn btn-outline-info btn-sm">Read</a>
335383
</div>
336384
</div>
337385
</div>
@@ -400,7 +448,7 @@ <h5 class="card-title bg-transparent" title="Embracing Freedom: My Journey to Cr
400448
<div class="col-md-4 text-center">
401449

402450
<div class="pb-2">
403-
<a href="http://localhost:1313/" title="Sarthak Thakur">
451+
<a href="http://localhost:37417/" title="Sarthak Thakur">
404452
<img alt="Footer logo" src="./favicon.png"
405453
height="40px" width="40px">
406454
</a>

Diff for: ‎public/attention.png

-55.1 KB
Binary file not shown.

Diff for: ‎public/blogs/attention-is-all-you-need/IE.png

47.5 KB
Loading

Diff for: ‎public/blogs/attention-is-all-you-need/PE.png

54.5 KB
Loading

Diff for: ‎public/blogs/attention-is-all-you-need/PE_calculation.png

42.8 KB
Loading

Diff for: ‎public/blogs/attention-is-all-you-need/RNN.png

31 KB
Loading

Diff for: ‎public/blogs/attention-is-all-you-need/attention_notes.pdf

4.66 MB
Binary file not shown.

0 commit comments

Comments
 (0)