Pinned
Dileep George
@dileeplearning
Head of AI @AsteraInstitute Prev: AGI @DeepMind, cofounder @vicariousai (acqd by Alphabet), cofounder @Numenta. IIT-Bombay, MS&PhD Stanford. agicomics.net
Neural nets were always Neurosymbolic -- have you tried to train a neural net without a symbolic harness? 😇- Today, we’re thrilled to announce a partnership between @AsteraInstitute and @NSF on the Programmable Cloud Laboratories Test Bed Initiative. The initiative will enable automated experimentation, standardized data generation, and rich metadata capture. We see it as a great
- I feel the same!As a scientist, AI has made me feel the most intellectually alive and excited I have felt since I was a graduate student and postdoc more than 20 years ago. Every day I can start with an idea in the morning, and by lunchtime, I see a testable, rational, well-thought-out
- Lempel-Ziv algorithm has been my example counterpoint against simplistic takes of bitter lesson. LZ makes hardly any assumptions. Just stores strings. Is provably asymptotically optimal — will reach the entropy rate of the source given enough data. So as bitter-lesson pilledI found out the other day that any compression tool can be contorted to do language modeling. Turns out gzip can generate text that somewhat *resembles* Shakespeare. Short write up linked below
