Subhaditya's KB
Search
Search
Dark mode
Light mode
Reader mode
Explorer
Home
❯
KB
❯
AI
❯
Machine Learning
❯
Training
❯
Loss function
❯
Log Likelihood Loss
Log Likelihood Loss
Oct 14, 2025
1 min read
loss
Log Likelihood Loss
L
(
U
)
=
Σ
i
l
o
g
P
(
u
i
∣
u
i
−
k
,
…
,
u
i
−
1
)
k is size of context window of past tokens
Graph View
Backlinks
Chapter 5 - Loss functions
GPT
Maximum LIkelihood
Negative Log Likelihood
_Index_of_Loss function
__Index_of__Loss function