LocalLLaMA
[NEW MODEL] SupraElegans-500K
*SupraLabs released a new experimental model!\ * SupraElegans-500K is a ~500,000-parameter causal language model built around a sparse, signed, recurrent neural graph. No Transformer, no attention mechanism, no positional encoding, no KV cache. Context is carried by a persistent per-neuron membrane potential updated token by token. The architecture is loosely inspired by ideas from the C. elegans nervous system: sparse connectivity, distinct neuron populations, excitatory/inhibitory si...
Read the full discussion on Reddit
This article was aggregated from Reddit. Click to join the conversation.
View on Reddit