Skip to content

(re) Allow Large FixedSizeBinaryArrays #9906

@alamb

Description

@alamb

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

As part of #9872, I changed FixedSizeBinaryArray to prevent any FixedSizedBinaryArrays from being constructed where the offset calculation could overflow

However, this also prevents the code from constructing valid FixedSizeBinaryArrays (over 2GB).

I made the change in #9872 so it was easy to review for correctness and we could easily backport it

Describe the solution you'd like
I would like to allow very large FixedSizeBinaryArrays and ensure the offset calculations will not overflow

Describe alternatives you've considered

Additional context

Metadata

Metadata

Assignees

Labels

arrowChanges to the arrow crateenhancementAny new improvement worthy of a entry in the changelog

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions