CSV Remote URL - GDrive

[app-generator]

Hello guys,

The CVS processing should be extended to remote files stored on GDrive.
Only the public links are supported.

Here is a sample:

https://docs.google.com/spreadsheets/d/1IToimLIEwt-5Hlihza7sEYULB_OCPlgjEbJGivFPoA4/edit?usp=sharing

The related code is pretty straightforward:

https://stackoverflow.com/questions/56611698/pandas-how-to-read-csv-file-from-google-drive-public

The related features are mentioned in the README:

Status	Delivery	Input	Output	Info
❌	Drop 2	CSV Remote URL (Gdrive)	DB Model	DB Model
❌	Drop 2	CSV Remote URL (Gdrive)	DataTables	Paginated Data View (vanilla JS)
❌	Drop 2	CSV Remote URL (Gdrive)	Charts	Data to visualisation
❌	Drop 2	CSV Remote URL (Gdrive)	Export (with filters)	CSV, PDF

Please proceed with the code.

Ty!

[masoom80]

Hi @app-generator
I tested the method mentioned above but got an internal server error!
It seems like the link is not valid or something you can test the link yourself.
the link achieved

[app-generator]

Hello @masoom80

Use this remove CSV [document is public]:

https://docs.google.com/spreadsheets/d/1IToimLIEwt-5Hlihza7sEYULB_OCPlgjEbJGivFPoA4/edit?usp=sharing

Let me know if something is not clear.

[masoom80]

Hello @app-generator

I know the link to the web page is the link you gave me(https://docs.google.com/spreadsheets/d/1IToimLIEwt-5Hlihza7sEYULB_OCPlgjEbJGivFPoA4/edit?usp=sharing) but to get the CSV file or read it we must use google API or read it using pandas.

In the Pandas case, we must use another link (https://drive.google.com/uc?id=1IToimLIEwt-5Hlihza7sEYULB_OCPlgjEbJGivFPoA4) which is achieved by the link you sent me(the StackOverflow link) but the link achieved as I said before gives an internal server error.

I searched the web a little more and could not find a solution.

I think the best way is to use a google API key.

[app-generator]

Hello @masoom80

Ty for your research. Let's use a Google API key.
Please use a value provided is the .env and warn the user if the key is not provided.

If you see other blocking points, I'm here.

10x again.

[masoom80]

Hello @app-generator
could check this enhancement?

[masoom80]

Hi again @app-generator
for testing this section you should put your own API key in the GOOGLE_API_KEY field in config.py.

[app-generator]

Hello guys.
Please commit all local changes.
The product is scheduled for pre-release tests tomorrow morning.
In the mean time, please double-check all features using the project INPU files.

Thanks for your work.

[app-generator]

Feature works.
The only issue is the remaining context from the previous context. For instance:

• use whatever conversion and generate a chart -> OK
• use google sheet import URL -> OK
• generate a dataTable ->OK
• go to the charts page -> OK
• the previous chart is visible -> NOT_OK

As a general rule, when the user switches to another conversion (CSV, PKL, URL), all previous JS data should be deleted.
We need to manage this before the new release.

TY!

[masoom80]

Feature works. The only issue is the remaining context from the previous context. For instance:

• use whatever conversion and generate a chart -> OK
• use google sheet import URL -> OK
• generate a dataTable ->OK
• go to the charts page -> OK
• the previous chart is visible -> NOT_OK

As a general rule, when the user switches to another conversion (CSV, PKL, URL), all previous JS data should be deleted. We need to manage this before the new release.

TY!

we are on it @alivarastepour .