Markov Transition Kernel

  • for all
  • Homogenous if for all n,n’
  • First get a value from a random drow from
  • Then get the next from the distribution which is specified by the transition kernel