Conversation
hsc/crawler.py
Outdated
| print('Auth was unsuccessful') | ||
|
|
||
| limit = input('Enter limit needed to crawl: ') | ||
| limit = crawler.options.limit or crawler.get_number_of_submissions() |
There was a problem hiding this comment.
There's no need of requesting the number of submissions again, because we have stored the total number of submissions while authenticating the user. We can directly use crawler.total_submissions.
Issue FoundDescriptionWhen you pass wrong username and password either from the config file or from the command line, it will retry with those credentials only, because earlier when the credentials were being taken from the user, and if found wrong, then it used to ask the user again. But now it will go into an infinite loop (which can still be cancelled by pressing Ctrl + C), which is not the right way. Reference ScreenshotSolutionWe can check if the credentials are taken from either command line or config file, and accordingly terminate the program if auth was unsuccessful. |
|
or we can just skip retry part now? |






Related Issue
Closes #23
Closes #24
Closes #28
Options to use while running script
Script
hscsupports following optionsUsage:
We can use above script helpers as
We can also use config file to download solutions
Let config file be /etc/user.yaml