@harshad1011/product-scraper
Web scraper for E-Commerce platforms like Grofers, Big Basket, Nature's Basket. Returns product details given product's URL.
Last updated 2 years ago by harshad1011 .
MIT · Repository · Bugs · Original npm · Tarball · package.json
$ cnpm install @harshad1011/product-scraper 
SYNC missed versions from official npm registry.

product-scraper

Description

This npm is developed for basic scraping of E-Commerce platforms like Grofers, Big Basket, Nature's Basket. It can also be used for customized scraping of any URL, given the json object. See examples for explaination.

APIs

  1. productScraper: This API takes 3 parameters.
    • First parameter is url in string type.
    • Second parameter is meta-data, which is used to scrape custom data from given url. This parameter is optional.
    • Third parameter is callback function to which takes argument error & data.`

Examples

Running npm via command line

node index.js -u http://www.naturesbasket.co.in/Products/Organic-Tulsi-Green-Tea---25-TB---Organic-India/4054_0_0_0 -p

Install npm via command line

npm install @harshad1011/product-scraper --save

Importing npm as a node module:

var ps = require('@harshad1011/product-scraper');
ps.productScraper("https://grofers.com/prn/bitter-gourd-karela/prid/197969", {
    "name": ".LinesEllipsis",
    "price": ".pdp-product__price--new"
}, function (err, data) {
    if (err) {
        console.error(err);
    } else if (data) {
        Object.keys(data).forEach(function (key) {
            console.log(data[key]);
        });
    } else {
        console.error("No response received");
    }
});

Limitations

This npm doesn't work well with dynamic pages. Feel free to suggest changes.

Current Tags

  • 1.0.1                                ...           latest (2 years ago)

2 Versions

  • 1.0.1                                ...           2 years ago
  • 1.0.0                                ...           2 years ago
Maintainers (1)
Downloads
Today 0
This Week 0
This Month 0
Last Day 0
Last Week 3
Last Month 4
Dependencies (3)
Dev Dependencies (2)
Dependents (0)
None

Copyright 2014 - 2016 © taobao.org |