Skip to content

Implement DictionaryArray converter for type pa.large_string and pa.large_binary #49505

@0x26res

Description

@0x26res

Describe the enhancement requested

I get these error when using pa.array with dictionary using large binary / string passed as values

pyarrow.lib.ArrowNotImplementedError: DictionaryArray converter for type dictionary<values=large_string, indices=int32, ordered=0> not implemented
pyarrow.lib.ArrowNotImplementedError: DictionaryArray converter for type dictionary<values=large_binary, indices=int32, ordered=0> not implemented
def test_arrow_missing_function():
    pa.array([], pa.dictionary(pa.int32(), pa.string()))
    pa.array([], pa.dictionary(pa.int32(), pa.binary()))

    with pytest.raises(
        pa.ArrowNotImplementedError,
        match="DictionaryArray converter for type dictionary\<values=large_string, indices=int32, ordered=0\> not implemented",
    ):
        pa.array([], pa.dictionary(pa.int32(), pa.large_string()))

    with pytest.raises(
        pa.ArrowNotImplementedError,
        match="DictionaryArray converter for type dictionary\<values=large_binary, indices=int32, ordered=0\> not implemented",
    ):
        pa.array([], pa.dictionary(pa.int32(), pa.large_binary()))

Component(s)

Python

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions