@cumulus/ingest
Ingest utilities
Last updated 2 months ago by lfrederick .
Apache-2.0 · Repository · Bugs · Original npm · Tarball · package.json
$ cnpm install @cumulus/ingest 
SYNC missed versions from official npm registry.

@cumulus/ingest

@cumulus/ingest is a collection of modules for discovering and ingesting data.

About Cumulus

Cumulus is a cloud-based data ingest, archive, distribution and management prototype for NASA's future Earth science data streams.

Cumulus Documentation

Installation

npm install @cumulus/ingest

Testing

Running tests locally requires localstack.

With localstack running, you can run tests using:

LOCALSTACK_HOST=localhost npm test

Modules

All modules are accessible using require: require('@cumulus/ingest/<MODULE_NAME>') or import: import <MODULE_NAME> from '@cumulus/ingest/<MODULE_NAME>'.

  • consumer - comsumer for SQS messages
  • crypto - provides encryption and decryption methods with a consistent API but differing mechanisms for dealing with encryption keys
  • ftp - for accessing FTP servers
  • granule - discovers and ingests granules
  • http - for accessing data via HTTP and HTTPS
  • lock - creates locks for S3 data
  • log - stringifies JS object logs for ElasticSearch indexing
  • parse-pdr - tools for validating PDRs and generating PDRD and PAN messages
  • pdr - discovers and ingests pdrs
  • queue - creates queues for ingesting data
  • recursion - handles recursion of a FTP/SFTP list operation
  • sftp - for accessing SFTP servers

Contributing

To make a contribution, please see our contributing guidelines.

Current Tags

  • 1.0.0-beta.4610474d                                ...           canary (3 years ago)
  • 1.24.0                                ...           latest (2 months ago)
  • 1.7.1                                ...           patch-1.7.1 (2 years ago)
  • 1.10.1-1                                ...           release-v1.10.1-1 (2 years ago)
  • 1.13.6                                ...           release-v1.13.6 (9 months ago)

96 Versions

  • 1.24.0                                ...           2 months ago
  • 1.23.2                                ...           2 months ago
  • 1.23.1                                ...           2 months ago
  • 1.23.0                                ...           3 months ago
  • 1.22.1                                ...           3 months ago
  • 1.22.0                                ...           3 months ago
  • 1.21.0                                ...           4 months ago
  • 1.20.0                                ...           5 months ago
  • 1.19.0                                ...           5 months ago
  • 1.18.0                                ...           6 months ago
  • 1.17.0                                ...           7 months ago
  • 1.14.5                                ...           7 months ago
  • 1.16.1                                ...           8 months ago
  • 1.16.0                                ...           9 months ago
  • 1.15.0                                ...           9 months ago
  • 1.13.6                                ...           9 months ago
  • 1.14.4                                ...           9 months ago
  • 1.14.3                                ...           10 months ago
  • 1.14.2                                ...           10 months ago
  • 1.14.1                                ...           a year ago
  • 1.13.5                                ...           a year ago
  • 1.14.0                                ...           a year ago
  • 1.13.4                                ...           a year ago
  • 1.13.3                                ...           a year ago
  • 1.13.2                                ...           a year ago
  • 1.13.1                                ...           a year ago
  • 1.13.0                                ...           a year ago
  • 1.12.1                                ...           a year ago
  • 1.12.0                                ...           a year ago
  • 1.11.3                                ...           a year ago
  • 1.11.2                                ...           a year ago
  • 1.11.1                                ...           2 years ago
  • 1.11.0                                ...           2 years ago
  • 1.10.4                                ...           2 years ago
  • 1.10.1-1                                ...           2 years ago
  • 1.10.3                                ...           2 years ago
  • 1.10.2                                ...           2 years ago
  • 1.10.1                                ...           2 years ago
  • 1.10.0                                ...           2 years ago
  • 1.9.1                                ...           2 years ago
  • 1.9.0                                ...           2 years ago
  • 1.8.1                                ...           2 years ago
  • 1.7.1                                ...           2 years ago
  • 1.8.0                                ...           2 years ago
  • 1.7.0                                ...           2 years ago
  • 1.6.0                                ...           2 years ago
  • 1.5.5                                ...           2 years ago
  • 1.5.4                                ...           2 years ago
  • 1.5.3                                ...           2 years ago
  • 1.5.2                                ...           2 years ago
  • 1.5.1                                ...           2 years ago
  • 1.5.0                                ...           2 years ago
  • 1.4.1                                ...           2 years ago
  • 1.4.0                                ...           2 years ago
  • 1.2.1-alpha.1                                ...           2 years ago
  • 1.3.0                                ...           2 years ago
  • 1.2.0                                ...           2 years ago
  • 1.1.4                                ...           2 years ago
  • 1.1.3                                ...           2 years ago
  • 1.1.2                                ...           2 years ago
  • 1.1.1                                ...           2 years ago
  • 1.1.0                                ...           2 years ago
  • 1.0.1                                ...           2 years ago
  • 1.0.0                                ...           2 years ago
  • 1.0.0-beta.20                                ...           2 years ago
  • 1.0.0-beta.19                                ...           2 years ago
  • 1.0.0-beta.18                                ...           2 years ago
  • 1.0.0-beta.17.2.0                                ...           2 years ago
  • 1.0.0-beta.17                                ...           3 years ago
  • 1.0.0-beta.16                                ...           3 years ago
  • 1.0.0-beta.15                                ...           3 years ago
  • 1.0.0-beta.14                                ...           3 years ago
  • 1.0.0-beta.13                                ...           3 years ago
  • 1.0.0-beta.12                                ...           3 years ago
  • 1.0.0-beta.11                                ...           3 years ago
  • 1.0.0-beta.10                                ...           3 years ago
  • 1.0.0-1.0.0-beta.9.1                                ...           3 years ago
  • 1.0.0-1.0.0-beta.9.0                                ...           3 years ago
  • 1.0.0-beta.8.3                                ...           3 years ago
  • 1.0.0-beta.8                                ...           3 years ago
  • 1.0.0-beta.7                                ...           3 years ago
  • 1.0.0-beta.6                                ...           3 years ago
  • 1.0.0-beta.4                                ...           3 years ago
  • 1.0.0-beta.3                                ...           3 years ago
  • 1.0.0-beta.2                                ...           3 years ago
  • 1.0.0-beta.581d31f6                                ...           3 years ago
  • 1.0.0-beta.222                                ...           3 years ago
  • 1.0.0-beta.111                                ...           3 years ago
  • 1.0.0-beta.4610474d                                ...           3 years ago
  • 1.0.0-beta.581d31f4                                ...           3 years ago
  • 1.2.0-alpha.95df4cc6                                ...           3 years ago
  • 1.4.0-alpha.95df4cc6                                ...           3 years ago
  • 1.3.0-alpha.c0ebdcd8                                ...           3 years ago
  • 1.2.0-alpha.c0ebdcd8                                ...           3 years ago
  • 1.1.0-alpha.c0ebdcd8                                ...           3 years ago
  • 1.0.0-beta.259fee54                                ...           3 years ago

Copyright 2014 - 2016 © taobao.org |