Hopfield Networks

• from
• Older architecture used to store and retrieve patterns
• Building blocks
  • Data (list of patterns)
  • Network
    • Nodes
    • All nodes are connected with each other
  • Retrieval
    • Input: partial pattern
    • Output: full pattern (retrieved)
      • “best match” partial pattern to entire data
      • Filling out the missing nodes with the best pattern is called update rule
  • Energy Function
    • Theoretical concept, similar to a loss function
    • Is not being optimized directly but trough update function
  • Update function
    • Optimizes the pattern that will be retrieved to best match the partial pattern
•