Markov Property A property of certain environments, where state transitions are entirely determined by information implicit in the current state and the agent’s action.