Linear Classifier Probes

• Understanding Intermediate Layers Using Linear Classifier Probes
• Black box
• monitor the Features at every layer of a model and measure how suitable they are for classification
• “Probes”
• trained entirely independently of the model
• observe experimentally that the linear separability of Features increase monotonically along the depth of the model