Closed
Milestone
expired on Mar 15, 2023
Preliminary Scraper
Work on a MWE based on the files of https://gitlab.engr.illinois.edu/r-sowers/ukraine-data/-/tree/main/API_Calls/scraper.
- Find a small square of a region in Ukraine (perhaps Donetsk?)
- Modify https://gitlab.engr.illinois.edu/r-sowers/ukraine-data/-/blob/main/API_Calls/scraper/scraper.ipynb to break the region into 4 subsquares, and modify the API_Call part to handle 2 API calls; one like
- Modify https://gitlab.engr.illinois.edu/r-sowers/ukraine-data/-/blob/main/API_Calls/scraper/scraper.py to call the API's and locally store 20 lines of each result. Set CTR_MAX=2, so that each call to scraper.py does only 2 out of the 4 subsquares
Test everything.