Link stream
https://x.com/MechanizeWork/status/1912904151874625928
Core people at Epoch AI have founded Mechanize to develop RL environments, benchmarks, and datasets to automate white collar work.
https://x.com/nickcammarata/status/1912934075628949982
Interpretability lab Goodfire has raised $50M to do interpretability research. They have great taste and great people, very bullish.
Knowing Enough About MoE to Explain Dropped Tokens in GPT-4
Great piece on a surprising design choice for the MOEs in GPT-4 and DeepSeek that results in token dropping. I don’t believe this design will be used for much longer.
How do you describe that property of high-entropy autobiography and personal fiction that relates to its particular aesthetic qualities? here’s an example of a blog with such qualities, including an on-the-ground description of frontier AI research. Ideas:
- vivid, textured, or dense descriptiveness
- presence