The following code allowed me to successfully download the IMDB dataset with fastai to a Modal volume:
I tried training a language model with fastai on Modal.
Jon wrote an interesting blog on top of Cloudflare Workers and KV.
Ran several experiments using local LLMs (~7b parameter models) like llama3.2 and phi3 to generate a random number between 1 and 100. The exact prompt was
Reading a bunch. Also got inspired to play around with generating random numbers with language models across different temperatures to see their distributions.
There is an enormous amount of jargon in deep learning, including terms like rectified linear unit. The vast vast majority of this jargon is no more complicated than can be implemented in a short...
Reading fastbook, I get the sense we could teach math more effectively if we did so through spreadsheets and Python code.
Current theory on why nbdev and notebooks in general make sense and can work: Writing code for most software is actually pretty similar to writing code for models, but usually you pay less of a cost...
There are many tools for doing evals. I used ell and braintrust together for fun and disaster. The integration is actually not terrible, though I'm not 100% whether they'd be obvious things to try...
Some quotes from Lesson 3 of course.fast.ai by Jeremy Howard. I remember a few years ago when I said something like this in a class somebody on the forum was like "this reminds me of that thing about...