eaze-sitemap-generator
Combines blog slugs with a web crawler to build an xml sitemap
Last updated 5 months ago by jtthackery .
ISC · Original npm · Tarball · package.json
$ cnpm install eaze-sitemap-generator 
SYNC missed versions from official npm registry.

Site Map

This script will use sitemap-generator-cli to scrape the website for urls and generates an xml sitemap from those urls. It will then combine the blog slugs found here and a base-url to generate a site map with all (non-product) links. There are two boolean flags to control whether to test the url for a 200 response (one for existing sitemap urls, and one for the blog slugs).

Variables

- BLOGS_BASE_PATH    (string) - Sets base url for blog (default: https://cms.ore0.eaze.tech)
- SCRAPE_WEBSITE     (bool)   - Sets whether to scrape website (default: true)
- CHECK_BLOG_URLS    (bool)   - Sets whether to test that the blog slugs + base url resolve (default: false)
- CHECK_SCRAPED_URLS (bool)   - Sets whether to check the links within the existing sitemap.xml (default: false)
- DEBUG              (bool)   - Sets whether to display debug information (default: false)

Installation

git clone git@github.com:eaze/site-map.git
cd site-map
npm install

Usage

npm run web-start

CI/CD

A CircleCI script runs on any push to master and at 9am UTC (1am PST) to generate a new sitemap.xml file and push it to an s3 bucket.

Current Tags

  • 2.0.1                                ...           latest (5 months ago)

2 Versions

  • 2.0.1                                ...           5 months ago
  • 2.0.0                                ...           5 months ago
Maintainers (1)
Downloads
Today 0
This Week 0
This Month 0
Last Day 0
Last Week 0
Last Month 0
Dependencies (6)
Dev Dependencies (0)
None
Dependents (0)
None

Copyright 2014 - 2016 © taobao.org |