How useful an AI system is comes down to:
- How useful an AI system is comes down to:
- 1) The quality of the model
- Which in most cases is a commodity, since everyone can use any model.
- 2) Prompting quality
- How good is the system at wringing quality out of the model?
- If the model is over-capable, then this isn't that important, because it will do a good job automatically.
- 3) What is the token budget?
- How many tokens is the user willing to pay for?
- How many tokens is the service willing to subsidize?
- 4) The richness of context and tools.
- Does the tool have access to the information it needs to make and execute good suggestions?