My friend Andrew is an advocate of the “spaced repetition” technique for
memorization of a great many facts [1]. The ideas behind this are two-fold:
-
When one first “learns” a new fact, it needs to be reviewed frequently in
order to not forget it. However, with each additional review, the fact can
be retained longer before a refresher is needed to maintain it in recall. -
Because of this, one can maintain a large, growing body of facts in recall
through daily review: Each day, one need only review for ten minutes or so,
covering a small number of facts. The facts included should be sampled from the
full library in a way that prefers newer entries, but that also sprinkles in
older facts often enough so that none are ever forgotten. Apps have been
written to intelligently take care of the sampling process for us.
Taking this framework as correct motivates questioning exactly how far it can
be pushed: Would an infinitely-long-lived, but forgetful person be able to
recall an infinite number of facts using this method? (ldots) Below, we
show that the answer is: YES!
Proof:
We first posit that the number of days (T) that a fact can be retained before
it needs to be reviewed grows as a power-law in (s), the number of times it’s
been reviewed so far,
begin{eqnarray} tag{1}label{1}
T(s) sim s^{gamma},
end{eqnarray}
with (gamma > 0). Wi
18 Comments
rini17
Fine but what to use in practice. Tried Anki and found its algorithm bit infuriating. SuperMemo is better but thoroughly proprietary.
Etheryte
This is putting the cart before the horse. No matter how you slice and dice your equations, everyone intuitively understands you can't really store infinite data in your brain. Trying to claim otherwise is simply academic sophistry. No matter how hard you write your proof, it won't make information theory, basic physics, etc go away.
kiba
Spaced repetition is an excellent technique, but it shouldn't be the only tool in your learning toolbox.
I found that spaced repetition really works as advertised, with software like Anki. However, it is not really suited at learning large amount of facts and concepts. If it took an hour to review your deck, it's not a good use of your time unless the cards are really high value.
For example, if I want to learn electronics, my time would be better spent on fiddling with circuits and learning through mistakes of implementation. The nice thing is that concepts are interrelated to each other, not discrete and decontextualized that usually happened with utilizing spaced repetition. You get much better value from learning through experimentation and retain it better.
Don't get me wrong, spaced repetition still apply. However, if you can learn something that will last a lifetime, you don't have to repeat it for a long time if ever.
orzig
I have been wondering about this in the context of being ready for work in the age of LLM‘s. What nobody can deny is that they memorize information at a superhuman level, so it might reduce the value of having done that myself. On the other hand, “couldn’t you just google that“has been an erroneous retort to the value of space repetition for decades, during which I’ve gotten a lot of value out of doing. has been a erroneous retort to the value of space repetition for decades, during which I’ve gotten a lot of value out of doing it.
bloomingkales
The redundant nature of mass scale internet content operates on spaced repetition I think. If you doom scroll HN for example, over time you’ll know more about random things. WSB might be a better example. I didn’t realize how many stock ticker prices and movements over the last few years are now embedded in my mind, without deliberately trying.
This is the 1000th time you’ll have read the same thing. The hivemind naturally regurgitates the same information at a predictable cadence. We’re due for a few Rust posts on HN, for example.
If you stay tapped in, you will always be learning from this organic body.
yamrzou
Besides LineByLine (https://linebyline.app), does anyone have tips on memorizing long texts using spaced repetition?
L_i_m_n
FSRS is a really clever iteration on Anki's SM2 algorithm. I've been playing around with various spaced repetition implementations lately – there's a great collection of open source libraries at github.com/open-spaced-repetition. I ended up using their typescript bindings for a vocabulary builder I'm working on (deft.so) and it's been surprisingly straightforward to implement.
gwern
Wozniak estimates that you actually get a maximum of~300,000 based on his decades of data, so it seems the simplified model misses some effect and so converges to the wrong total: https://supermemo.guru/wiki/How_much_knowledge_can_human_bra…
yanis_t
I merged spaced repetition with knowledge management app (), and I must say it was the biggest personal improvement for me in terms of organising and remembering stuff.
As a product though I struggle to make it work. I assume people mostly afraid of their notes and cards stored in the cloud vs local storage, which is understandable.
https://www.mindthis.io/
OskarS
I don't want to rain on anyone's parade, but: of all the really brilliant people I've ever met, interacted with or learned from, I haven't heard of anyone that used techniques like this. Like, the way they learn things and become brilliant is the exact same way every brilliant person has done it for thousands of years: they read books, they discuss and debate with other brilliant people, they study their subjects and work hard. Like, true intelligence is very rarely about rote memorization of facts, it's about making new connections, being creative, and working really hard. There are no shortcuts, you have to put in the work. Aristotle, Leibniz, Einstein or whatever brilliant person you can think of didn't become who they are using cue-cards.
Spaced repetition always seemed like those schemes to get you fit or slim in 30 days that never work. There is exactly one way to get physically healthy, and it's super-unfun: diet and exercise. Same thing with your mind, you have to exercise it and feed it appropriately for months and years. Spend the time you would spend on spaced repetition reading books or watching lectures and doing exercises instead.
purplethinking
I've done the whole spaced repetition and Anki thing, realized that if it's boring, you won't learn as well, and you won't stick with it in the long term, once you miss a week and suddenly you have 863 reps to get through to catch up. Instead, read stuff you're interested, apply it in your work, learn mostly Just In Time for when you need it. Learn by doing.
yamrzou
Related:
https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que…
runarberg
I wrote a kanji learning app around Anki’s Flexable Spaced Repetition (FSRS) algorithm https://shodoku.app
My design principal is that I don’t need to be limited to few words, a sentence, and maybe a picture for each flash card. Instead each flashcard can be the all the relevant parts of the whole dictionary related to the kanji that you are learning.
Another design principal (where I deviate from Wankikani) is that drawing the kanji helps remembering it. So my app has two sided cards, one for drawing and one for reading. Both reading and writing practice include every word in the dictionary + example sentences that contains that kanji.
My third design principal is that I can learn vocabulary at the same time as I learn the meaning and the writing of the kanji (in fact, I like to learn a few vocab words instead of memorizing the different readings). So you can bookmark vocab words you want to learn along the kanji, and the next time the SRS system picks the kanji up for review, these words pop up at the top, to help you recall.
Note that the app is still in development, so use at your own risk, although I am actively using it for my kanji-studies. I still have a couple of features missing before I can call it done enough.
dang
Discussed at the time:
Spaced repetition can allow for infinite recall – https://news.ycombinator.com/item?id=32381206 – Aug 2022 (169 comments)
aerhardt
Anyone had any experience using spaced repetition for reinforcing math learning?
IssaRice
I also made a theoretical calculation like this a couple of years ago [1]. I didn't answer the question "Can you memorize an infinite number of facts?" but rather the question "If you add a constant number of cards to Anki each day, what does your daily review load look like in the limit?"
[1]: https://issarice.com/long-run-anki-review-load
wahnfrieden
I made a well-received native iOS/macOS app for mining Japanese web and ebook content (Mokuro manga up next) into Anki or my own companion flashcard app: https://reader.manabi.io
I'm now working on flashcard auto-reviews while reading, so that if you read words/kanji that you have cards for, it'll automatically mark those cards as reviewed rather than ask you to recall them shortly after you just had to recall during your reading.
I hope this helps people replace more SRS time with actual reading (or listening)
leoc
Hilbert's memory palace.