Fine Tuning Based Pruning

  • Some store weights before Pruning and use that to continue training.
  • Others somehow try to rewind to a previous state and reinitialize the network entirely