Ken Osumi
  • 日本語
  • English
Categories
All (2)
esmc (2)
interpretability (2)
reproduction (2)

Ken Osumi

Reading the internal representations of protein language models to generate residue-level mechanistic hypotheses.

About · 日本語 · GitHub

Reproducing ESMC’s SAE features: I lost half a day to one wrong repo

Reproducing Figure S33 of the ESMC paper, solo. I picked the wrong one of two similarly-named SAEs, lost half a day, and came out the other side at the most interesting feature in the figure.

Jun 22, 2026
6 min

ESMC の SAE 図を一人で再現したら、repo の取り違えで半日溶かした話

ESMC 論文の Figure S33 を一人で再現した記録。よく似た名前の SAE を取り違えて半日ハマり、抜けた先で一番おもしろい特徴に行き着くまで。

Jun 22, 2026
2 min
No matching items
 

© 2026 Ken Osumi