"We introduce requential coding, where a teacher model selects training samples drawn from the student's own distribution" Due to new learning technique the model has achieved better generalization skill without overfitting and memorization. This become possible because of new learning method which made the student model to generate samples for itself. It led to intensive reuse of existing neurons and allowed to encode information in a more dense way While researchers are calling...