Context Window
Context Window
📖 定义
Context Window is the maximum token count limit that an LLM can process in a single session. It determines how much conversation history and reference information the model can "remember". Larger context windows support longer conversations and more reference documents.
🔗 在 Higress 中的应用
Higress can intelligently route to models of different specifications based on request context length, optimizing the balance between cost and performance.
💡 示例
- 1 GPT-4 Turbo supports a 128K token context window
- 2 Claude 3 supports an ultra-long 200K token context
- 3 Long document analysis requires model support with large context windows
🔄 相关术语
❓ 常见问题
Context Window 是什么？
Context Window is the maximum token count limit that an LLM can process in a single session. It determines how much conversation history and reference information the model can "remember". Larger context windows support longer conversations and more reference documents.
Higress 如何支持 Context Window？
Higress can intelligently route to models of different specifications based on request context length, optimizing the balance between cost and performance.
深入了解 Higress
探索更多 Higress 的功能和最佳实践