Skip to content
This repository has been archived by the owner on Feb 18, 2024. It is now read-only.

Not yet implemented: Decoding Int32 "PlainDictionary"-encoded optional parquet pages #1526

Open
mdrach opened this issue Aug 3, 2023 · 2 comments

Comments

@mdrach
Copy link
Contributor

mdrach commented Aug 3, 2023

Hey, I encountered an issue similar to this one. Hit during

            let arrays =
                column_iter_to_arrays(pages, types, field.clone(), None, row_group.num_rows())?;

pages is one of the pages in this file.

Error:

Not yet implemented: Decoding Int32 "PlainDictionary"-encoded optional  parquet pages. 

Hope the fix is straightforward like the fix for the other issue. Please let me know if I can provide any additional information.

Using arrow2 0.17.0.

@mdrach
Copy link
Contributor Author

mdrach commented Aug 3, 2023

Hitting these related issues on other parquet files as well.

  Not yet implemented: Decoding Double "PlainDictionary"-encoded required  parquet pages',
   Not yet implemented: Decoding FixedLenByteArray(16) "PlainDictionary"-encoded optional  parquet pages'

Link to file that produced second error.

@avfeinberg
Copy link

Experimented with the latest HEAD, still seeing this.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants