Assistant Games are an interesting area of ML research.

  • Assistant Games are an interesting area of ML research.
    • Most models have a baked in reward function.
    • Assistant games try to infer what the user wants to do, based on their actions, and then help them do it.
      • Like an ebike.
    • Each action the user does helps update the model's priors about what the user's goals might be (or definitely are not).
    • Instead of a baked in reward function, they have a floating reward.
    • They're much harder to do, but potentially valuable.