Discussion about this post

User's avatar
Daniel Aminoff's avatar

This beautiful piece inspired me to consider the differences between English and Hebrew for learning something by heart. Fuller training of AI would do well to recognize this distinction between rote learning (which in English we call “learning by heart” but in Hebrew is “בעל פה”, literally “by mouth”) and more fully learning something “by heart”. Moses needs to go beyond speech to learn “by heart”. In Hebrew “by heart” can be literally translated as “בעל לב” - but idiomatically in Hebrew this means to do something with kindness and sensitivity, i.e., “with heart” in English. This requires interaction with and appreciation of others.

To train AI in this way after initial model building may require actual experience in the world, but this real-world approach would be orders of magnitude slower than initial training, and so likely not scalable. Hence the move to automate real-world reinforcement learning by simulating that AI’s experiences, at least as an initial bootstrap.

An alternative scaling approach to trying to stuff experiential learning into a single grand AI’s “heart”, may be to scale this by letting billions of AI agents bloom, each with their own “learning heart”. This latter approach seems to be the one our own Creator took.

Expand full comment
1 more comment...

No posts