Owain Evans’ idea of feeding a historical LLM non-anachronistic images is, I think, well worth doing. But it’s also worth expanding on further. Would it be helpful, when training a historical LLM, to simulate dream imagery based on premodern themes? What about audio of birdcalls, which were far more prominent in the audioscapes of premodern people? What about taking it on a walk through the woods?
Factorized embed, rotation Q (2 angles), tied embed+V dir, rank-1 MLP, parabolic head, sinusoidal PE (period 11)
，这一点在heLLoword翻译官方下载中也有详细论述
[&:first-child]:overflow-hidden [&:first-child]:max-h-full"
Anthropic 点名的三家公司，抓取的重心都落在代理行为 (agentic behavior) 这同一个方向上，包括 AI 自主规划、工具调用、分解复杂任务并逐步执行的能力等。
There's strong British representation on this year's list - Billy Idol, Iron Maiden, Joy Division/New Order and Sade are all up for induction at the second or third attempts.