-
Notifications
You must be signed in to change notification settings - Fork 4.1k
Open
Description
Describe the enhancement requested
I get these error when using pa.array with dictionary using large binary / string passed as values
pyarrow.lib.ArrowNotImplementedError: DictionaryArray converter for type dictionary<values=large_string, indices=int32, ordered=0> not implemented
pyarrow.lib.ArrowNotImplementedError: DictionaryArray converter for type dictionary<values=large_binary, indices=int32, ordered=0> not implemented
def test_arrow_missing_function():
pa.array([], pa.dictionary(pa.int32(), pa.string()))
pa.array([], pa.dictionary(pa.int32(), pa.binary()))
with pytest.raises(
pa.ArrowNotImplementedError,
match="DictionaryArray converter for type dictionary\<values=large_string, indices=int32, ordered=0\> not implemented",
):
pa.array([], pa.dictionary(pa.int32(), pa.large_string()))
with pytest.raises(
pa.ArrowNotImplementedError,
match="DictionaryArray converter for type dictionary\<values=large_binary, indices=int32, ordered=0\> not implemented",
):
pa.array([], pa.dictionary(pa.int32(), pa.large_binary()))Component(s)
Python
Reactions are currently unavailable