Implementation Invariance

  • Two networks are functionally equivalent if their outputs are equal for all inputs, despite having very different implementations.
  • Attribution methods should satisfy Implementation Invariance, i.e., the attributions are always identical for two functionally equivalent networks.