This is the POC for my learning
Visit http://staydan.xyz:3001/list, but it looks like the new remote server needs more modifications.
- nginx configurations update
- merge two spider into one, so that the comment spider doesn't need to wait for the shop spider finished.
- because of the limitation of dianping.com, needs more ways to get shops.
- Use node-spider-man to fetch data from the internet
- Use Mongodb to store all the formated data
- Use nodejs / Express to setup the backend
- Use websocket to setup the live-time communication between server and client
- Use Angularjs / Pug / Stylus to build the front-end pages
nohup node ./bin/www &
tail -f nohup.out
DEBUG=comment-forest:* npm start
Visit http://localhost:3001/list
Copyright to @2012-2016 Staydan.com