Scrape MLB Advanced Media Pitch F/X Data
-
brew install mysql (on a Mac) -
brew install rabbitmq (on a Mac) -
install needed python packages
-
Navigate to mlbam_scraper directory
-
Start a celery worker
celery -A GidScrapers worker --loglevel=info -
Submit the urls that
library/GidScraper.pyfinds to the celery worker queue -
Submit the paths of the data files to the celery worker queue to be writte to your mysql db
I plan on making this a lot easier on the user in the future.