[Submitted on 27 Jun 2022]
Abstract:This is a collection of (mostly) pen-and-paper exercises in machine learning. The exercises are on the following topics: linear algebra, optimisatio
Be the first to know the latest updates
Whoops, you're not connected to Mailchimp. You need to enter a valid Mailchimp API key.
11 Comments
antipaul
So who among current ML practitioners building “useful” ML could solve some of these?
_Should they_ be able to?
kingkongjaffa
complete with solutions, beautiful, thank you for sharing!
I'd be interested in more of these pen and paper exercises, if there is such a term, for other topics.
axpy906
Love it.
simojo
Very neat! Reminds me of Tom Yeh's "AI By Hand" exercises [0].
[0] https://www.byhand.ai/
S4M
Looks neat! My only criticism would be that the solutions are given right after the questions so I couldn't help to read the answer of one question before thinking it through by myself.
plants
This is really neat! I work in machine learning but still feel imposter syndrome with my foundations with math (specifically linear algebra and matrix/tensor operations). Does anyone have any more good resources for problem sets with an emphasis on deep learning foundational skills? I find I learn best if I do a bit of hands-on work every day (and if I can learn things from multiple teachers’ perspectives)
lucasoshiro
Seems to be cool, but, one of thing that most annoys me on studying machine learning is that I may dive as deep as it is possible in theory, but I can't see how it connects to the practice, i. e. how it makes me choose the correct number of neurons in a layer, how many layers, the activation functions, if I should use a neural network or other techniques, and so on…
If someone have something explaining that I'll be grateful
dang
Discussed at the time:
Pen and paper exercises in machine learning (2021) – https://news.ycombinator.com/item?id=31913057 – June 2022 (55 comments)
imranq
If someone could turn these into an adaptive Khan Academy style app, that would be incredible
FilosofumRex
Funny how mathematicians always try to sneak their linear algebra and matrix theory into ML. If you didn't know any better, you'd think academicians had invented LLMs and are the experts to be consulted with.
If anything academicians and theoreticians held ML back and forced generations of grad students doing symbolic proofs, like in this example, just because computational techniques were too lowbrow for them.
bschmidt600
[flagged]