Hacker News<p>Writing an LLM from scratch, part 8 – trainable self-attention — <a href="https://www.gilesthomas.com/2025/03/llm-from-scratch-8-trainable-self-attention" rel="nofollow noopener noreferrer" translate="no" target="_blank"><span class="invisible">https://www.</span><span class="ellipsis">gilesthomas.com/2025/03/llm-fr</span><span class="invisible">om-scratch-8-trainable-self-attention</span></a><br><a href="https://mastodon.social/tags/HackerNews" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>HackerNews</span></a> <a href="https://mastodon.social/tags/Writing" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>Writing</span></a> <a href="https://mastodon.social/tags/an" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>an</span></a> <a href="https://mastodon.social/tags/LLM" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>LLM</span></a> <a href="https://mastodon.social/tags/from" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>from</span></a> <a href="https://mastodon.social/tags/scratch" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>scratch</span></a> <a href="https://mastodon.social/tags/trainable" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>trainable</span></a> <a href="https://mastodon.social/tags/self" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>self</span></a>-attention <a href="https://mastodon.social/tags/machinelearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>machinelearning</span></a> <a href="https://mastodon.social/tags/AItechnology" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>AItechnology</span></a> <a href="https://mastodon.social/tags/deeplearning" class="mention hashtag" rel="nofollow noopener noreferrer" target="_blank">#<span>deeplearning</span></a></p>