Skip to content

[FEA] Decode Parquet decimals directly into prescribed per-column types #24194

Description

@devavret

Problem

The Parquet reader decimal-width option applies one width to all decimal columns and currently casts after decoding. Consumers may need mixed target widths in one read, including nested decimal leaves, without the extra allocation and cast kernel.

Request

Allow callers to prescribe decimal types per column or nested leaf and decode directly into those target buffers in the regular, chunked, and hybrid readers.

Motivating use case: facebookincubator/velox#19042

Related: #20062 and #21472.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions