Subhaditya's KB
Search
Search
Dark mode
Light mode
Home
❯
KB
❯
AI
❯
Machine Learning
❯
Training
❯
Loss function
❯
Log Likelihood Loss
Log Likelihood Loss
Sep 18, 2024
1 min read
loss
Log Likelihood Loss
L
(
U
)
=
Σ
i
l
o
g
P
(
u
i
∣
u
i
−
k
,
…
,
u
i
−
1
)
k is size of context window of past tokens
Graph View
Backlinks
Chapter 5 - Loss functions
GPT
Negative Log Likelihood
_Index_of_Loss function
Maximum LIkelihood