I wonder if we could find novel algorithms within LLMs' weights.

Even back in the Claude 2 days, the interoperability research could see Claude replace memorized facts about numbers with the algorithm for doing arithmetic.

The algorithm wasn't one that we'd have developed ourselves.

There are also presumably many other emergent algorithms in the weights that are novel to us, some of which are more useful than another fuzzy algorithm for arithmetic.

For example, AlphaFold seems to have absorbed some fundamental algorithm or estimate that eludes us.

If only we had some systematic way to abduct them.