Date: 2023-10-30 05:04 am (UTC)
dmm: (0)
From: [personal profile] dmm
~ 1:17:30 not only does attention move info from residual stream of one token to another, then information accumulated from multiple residual streams of many tokens can be moved again (combining aggregation and compositionality)
This account has disabled anonymous posting.
If you don't have an account you can create one now.
No Subject Icon Selected
More info about formatting
 
Notice: This account is set to log the IP addresses of everyone who comments.
Links will be displayed as unclickable URLs to help prevent spam.

Profile

dmm: (Default)
Dataflow matrix machines (by Anhinga anhinga)
Neuromorphic Computations with Linear Streams

May 2025

S M T W T F S
    123
456 78910
11 121314151617
18192021222324
25262728293031

Most Popular Tags

Active Entries

Style Credit

Expand Cut Tags

No cut tags
Page generated Jul. 16th, 2025 01:37 am
Powered by Dreamwidth Studios