Dataflow matrix machines (by Anhinga anhinga)

One interesting thing I learned from Schmidhuber's writings was about the early work on deep learning by Ivaknenko, and about "Group method of data handling":

https://en.wikipedia.org/wiki/Group_method_of_data_handling

https://en.wikipedia.org/wiki/Alexey_Ivakhnenko

Schmidhuber says that this was the earliest deep learning work (training an 8-layer net in 1971).