Maximum likelihood criterion

Since each observed output should have high probability under its corresponding distribution $Pr(y_i|{\theta }_i)$, we can choose the model params $\varphi$ so they MAXIMIZE the combined probability across all I training examples

• 
• Assumptions
  • data are identically distributed
  • 
  • independent and identically distributed