⚠ Switch to EXCALIDRAW VIEW in the MORE OPTIONS menu of this document. ⚠ You can decompress Drawing data with the command palette: ‘Decompress current Excalidraw file’. For more info check in plugin settings under ‘Saving’

Excalidraw Data

Text Elements

Start

Process

Decision?

CONTEXT COMPRESSION METHODS

Hard Compression

(Token Removal)

• Remove actual tokens

• Output is still readable text

• Can be inspected/debugged

Examples:

  • LLMLingua

  • Selective Context

  • Extractive Summarization

Soft Compression

(Embedding)

• Map tokens to dense vectors

• Output is continuous embeds

• Black-box representation

Examples:

  • Gist Tokens

  • AutoCompressors

  • Soft Prompts