Date: April 17, 2015
- A lot of us involved in the resurgence of Deep Learning in the mid-2000s, including Geoff Hinton, Yoshua Bengio, and myself—the so-called “Deep Learning conspiracy”—as well as Andrew Ng, started with the idea of using unsupervised learning more than supervised learning.
- Unsupervised Learning: The Learning That Machines Need Spectrum: How much more about machine learning in general remains to be discovered?
- The type of learning that we use in actual Deep Learning systems is very restricted.
- LeCun: Yes, it is a bit facetious, but it reflects something real: shallow learning systems have one or two layers, while deep learning systems typically have five to 20 layers.
- Spectrum: What can a Deep Learning system do that other machine learning systems can’t do?
Related NLP Articles
Build smarter apps with our natural language processing API.