hubot-scrapyd
Scrapyd commands for hubot
Last updated 6 years ago by jayzeng .
MIT · Repository · Bugs · Original npm · Tarball · package.json
$ cnpm install hubot-scrapyd 
SYNC missed versions from official npm registry.

Hubot Scrapyd

Scrapyd commands for hubot!

Installation

Add hubot-scrapyd to your package.json file:

"dependencies": {
  "hubot": ">= 2.5.1",
  "hubot-scripts": ">= 2.4.2",
  "hubot-scrapyd": ">= 0.0.0"
}

Add hubot-scrapyd to your external-scripts.json:

["hubot-scrapyd"]

Run npm install hubot-scrapyd

Set SCRAPED_URL as environmental variable.

E.g (Heroku) heroku config:set SCRAPED_URL=http://scrape.mywebsite.com:6800

Commands

# Commands:
hubot scrape projects - list projects
hubot scrape spiders - List available spiders for a given project
hubot scrape versions - Get the list of versions available for some project. The versions are returned in order, the last one is the currently used version.
hubot scrape jobs - Get the list of pending, running and finished jobs of some project
hubot scrape run <spider_name> - Schedule a spider to run
hubot scrape cancel <jobid> - cancel a running job

Contributing

  • Fork this repo
  • Submit your code to your fork
  • Create a pull request from your fork

API

The Scrapyd API can be found at: http://scrapyd.readthedocs.org/en/latest/api.html

https://github.com/jayzeng/scrapyd-bot

Feel free to contribute there as well, following the same steps above in Contributing

Current Tags

  • 0.0.3                                ...           latest (6 years ago)

3 Versions

  • 0.0.3                                ...           6 years ago
  • 0.0.2                                ...           6 years ago
  • 0.0.1                                ...           6 years ago
Maintainers (1)
Downloads
Today 0
This Week 0
This Month 0
Last Day 0
Last Week 0
Last Month 4
Dependencies (1)
Dev Dependencies (1)
Dependents (2)

Copyright 2014 - 2016 © taobao.org |