ContextCompaction Module
Advanced context management beyond simple windowing
Functions and values
| Function or value |
Description
|
Full Usage:
applyAsync strategy tokenBudget conversation
Parameters:
CompactionStrategy
tokenBudget : int
conversation : Conversation
Returns: Task<CompactionResult>
|
Apply a compaction strategy to a conversation
|
Full Usage:
dropOldest tokenBudget conversation
Parameters:
int
conversation : Conversation
Returns: CompactionResult
|
Drop oldest messages to fit within token budget
|
Full Usage:
estimateConversationTokens conversation
Parameters:
Conversation
Returns: int
|
|
|
|
Full Usage:
hierarchicalCompactAsync chunkSize provider options tokenBudget conversation
Parameters:
int
provider : ILlmProvider
options : CompletionOptions
tokenBudget : int
conversation : Conversation
Returns: Task<CompactionResult>
|
Apply hierarchical summarization: chunk -> summarize -> combine
|
Full Usage:
summarizeChunkAsync provider options messages
Parameters:
ILlmProvider
options : CompletionOptions
messages : Message list
Returns: Task<string>
|
Summarize a chunk of messages using LLM
|
Nao