Skip to content

vllm.entrypoints.pooling.typing

Classes:

  • LateChunkingSlot –

    Per-document source ranges shared by frontend rendering and output contexts.

LateChunkingSlot dataclass

Per-document source ranges shared by frontend rendering and output contexts.

Source code in vllm/entrypoints/pooling/typing.py 
84
85
86
87
88
@dataclass
class LateChunkingSlot:
    """Per-document source ranges shared by frontend rendering and output contexts."""

    metadata: LateChunkingMetadata | None = None