Subhaditya's KB
Search
Search
Dark mode
Light mode
Home
❯
Knowledge Base
❯
Log Likelihood Loss
Log Likelihood Loss
Sep 18, 2024
1 min read
loss
Log Likelihood Loss
L
(
U
)
=
Σ
i
l
o
g
P
(
u
i
∣
u
i
−
k
,
…
,
u
i
−
1
)
k is size of context window of past tokens
Graph View
Backlinks
Chapter 5 - Loss functions
GPT
Maximum LIkelihood
Negative Log Likelihood