Repository navigation
feature: display progress bar when downloading multi-page responses #72
Description
Motivation
For a long running command (longer than 1 minute) for a big table (like pull requests or commits), it can be tricky to know if the script is still running, or if a rate limit/error was encountered
We know how many pages there are, so it may be possible to indicate how many remain.
github-to-sqlite/github_to_sqlite/utils.py
Line 367 in a6e237f
Resources
- Using the existing Click API:
- Loading spinner: https://github.com/pavdmyt/yaspin
- Progress bar: https://github.com/tqdm/tqdm
Activity
simonw commentedon Apr 21, 2022
That's interesting - yeah it looks like the number of pages can be derived from the
Linkheader, which is enough information to show a progress bar, probably using Click just to avoid adding another dependency.https://docs.github.com/en/rest/guides/traversing-with-pagination
[-]feature: display progress bar when downloading responses[/-][+]feature: display progress bar when downloading multi-page responses[/+]