Don't Put All Your Tokens in One Basket

3 comments

• 8 hours ago
  [deleted]
• turtleyacht 8 hours ago

  How do you prepare the fallback if it already took tokens to query the simpler model?

• plumman1 7 hours ago

  don't litellm and similar do this already?