Check if all neurons lead to ROME

[lauritowal]

Using interpretability tools (e.g the causal tracing method from the ROME publication), we could check if we can figure out how truth is represented and in which neurons. We could even combine this approach with the previous idea and see if they produce the same results.

Link

[KayKozaronek]

I am interested in this, but I think that it would take some time to understand the ROME paper and the causal tracing method.

I will look into the paper on the weekend and decide whether I deem it plausible that I'd be able to implement it before the paper deadline.