Removing the embedding from my embedding: a byte transformer with a 0-parameter input layer (25M, single RTX 4070)

Hi everyone, a follow-up — and a slightly absurd experiment that worked.

Since the last post, the substrate ablation toolkit shipped inside the encoder (hsl_embedding.ablation — capacity-matched hsl / learned / random / permuted arms, as discussed in this thread). While running the full A/B I got curious about a stranger question:

**what happens if I remove the embedding from my…

Read more →
I Built an Eleventy Plugin for Sharing Posts to Mastodon

I am happy to share a new open source project I have been working on: @kylereddoch/eleventy-plugin-mastodon-share.

You can browse the source on GitHub and try the live demo.

It is a small Eleventy plugin that makes it easier for people to share posts from your site to Mastodon.

If you have ever tried to add Mastodon sharing to a website, you already know the awkward part: there is no single…

Read more →
Page 1