YAT kernel
- Alignment
- Which directions agree?
- Distance
- How close are the vectors?
YAT scores an input against a learned center using both alignment and distance. At a fixed alignment, greater distance weakens the response. Along some directions, alignment can sustain a response even far from the center. The gravity well gives a visual intuition for this geometry.
- 01 / Neuron Explain the response
- The kernel separates the role of alignment from the role of distance. That gives us a mathematical reason why inputs can activate the same unit, even when they are far apart.
- 02 / Layer Describe what it can represent
- With shared positive bias and regularization, a YAT layer is a weighted sum of kernel responses. The theory gives that layer an exact function-space norm and characterizes what the kernel can approximate.
- 03 / Depth Explain what can carry forward
- Once earlier layers are fixed, they induce a kernel on the original inputs. If those layers map two inputs to the same representation, the next layer cannot distinguish them.