Overfitness feels great in the moment.

  • Overfitness feels great in the moment.
    • Whether it's overfit is whether you have a model that doesn't generalize in time to new scenarios since it fits to what is temporary noise.
    • Overfit structures are 'fit' but not in a robust way.
    • Even if you were exactly right about prediction for today you'd be wrong tomorrow.
    • The world changes in ways you can't predict, fundamentally
    • This riff and the next 10 were based on a talk I attended this week by Emmet Shear.