Font where each token is equal-width
&. on X: "working with Astra to make a font where each token has equal width (early prototype)
maybe this will make it easier to understand why models have the quirks they do" / X
maybe this will make it easier to understand why models have the quirks they do"
working with Astra to make a font where each token has equal width (early prototype)
maybe this will make it easier to understand why models have the quirks they do
I did not expect this post to get as much attention as it did...
Anyway! With this webpage, you can make your own token-space font by combining a base font with a tokenizer of your choice
Get smarter about the news
Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.
Create free accountAlready have an account? Sign in