Skip to content

Unable to get parquets-lite library to work for dash-renderer #1806

Closed

Description

@workaholicAB

Context

As a part of this PR, the dash renderer client now needs to decode parquet data from layout to create pandas.DataFrame-like objects or records for DataTable React component.

Wanna take a look?

Since it's a part of Two-way serialization PR, you need to check out this branch.

Once checked out the repo/branch,

  1. Change this line like below.
            return DataFrameSerializer.serialize(value, engine="fastparquet")
  1. Change another line like below again.
            return DataFrameSerializer.serialize(propValue, engine="fastparquet")
  1. npm run build
  2. Run this Dash app code
  3. Open the browser to see the page rendered

Expected Behavior

Supposed to see 3 tables on the rendered page, without any rendering or console issues.

Actual Behavior

You'll see the rendering failed and some console logs like invalid parquet version or errors thrown out from parquets-lite which is added here

Some more context for in-Slack engineers 🦸

https://plotly.slack.com/archives/C01HT8G2RHQ/p1634282108324100?thread_ts=1634040338.304200&cid=C01HT8G2RHQ

Activity

  1. nicholas-esterer commented on Oct 22, 2021

    @nicholas-esterer

    I have a fix of the parquet decoding but it seems there are still errors when encoding the parquet. Anyhow, how can I open a PR into this branch? @workaholicpanda you are in a different organization as you have a fork of dash, but probably we sure eventually merge my branch into yours on your fork before merging into plotly/dash
    My branch:
    https://github.com/plotly/dash/tree/two-way-serialization-fastparquet

  2. workaholicAB commented on Oct 22, 2021

    @workaholicAB
    ContributorAuthor

    @nicholas-esterer Thanks so much for getting this fixed. I'm testing it right now.
    Are you okay if I can cherry pick your commit to my fork then get everything merged in a single PR?

  3. nicholas-esterer commented on Oct 22, 2021

    @nicholas-esterer

    Yep no problem!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions