@venzee/dynamo_streams
Venzee Streaming tools for DynamoDB access
Last updated 2 years ago by noisygerman .
MIT · Repository · Bugs · Original npm · Tarball · package.json
$ cnpm install @venzee/dynamo_streams 
SYNC missed versions from official npm registry.

@venzee/dynamo_streams

NodeJs Stream wrappers around DynamoDB requests.

Installation

npm i -S @venzee/dynamo_streams

Usage

QueryStream

You can inject DocumentClient instances or DynamoDB instances. The stream uses calls the query method of the injected client with the provided params. The stream handles pagination and will emit all items found that match the provided query.

See the documentation for DynamoDB and DocumentClient for more info;

const client = new AWS.DynamoDB.DocumentClient();
const queryStream = require( '@venzee/dynamo_streams/query' )( client, params );

queryStream
  .on( 'data', doStuffWithData)
  .on( 'error', handleError);

ScanStream

Same behavior as a QueryStream, except we are streaming scan results, not query results.

Errors

When query or scan return errors, the 'error' event raised by the stream includes the error raised by the method as well as the parameters used to last invoke the method. This allows client code to retry using custom retry logic, for example.

function runQuery( params, doStuffWithData, onQueryRun ){

  const client = new AWS.DynamoDB.DocumentClient();
  const queryStream = require( '@venzee/dynamo_streams/query' )( client, params );

  queryStream
    .on( 'data', doStuffWithData)
    .on( 'error', onQueryRun )
    .on( 'finish', onQueryRun );
}

function onQueryRun( err ){

  if( err ){

    const { error, queryParameters } = err;

    if( error.code === 'ProvisionedThroughputExceededException' ) return setTimeout( runQuery, 1000, queryParameters, doStuffWithData, onQueryRun );
    return handleError( error );

  }

}

Current Tags

  • 1.2.0                                ...           latest (2 years ago)

5 Versions

  • 1.2.0                                ...           2 years ago
  • 1.1.0                                ...           2 years ago
  • 1.0.2                                ...           2 years ago
  • 1.0.1                                ...           2 years ago
  • 1.0.0                                ...           2 years ago
Downloads
Today 0
This Week 0
This Month 0
Last Day 0
Last Week 0
Last Month 1
Dependencies (0)
None
Dev Dependencies (26)
Dependents (0)
None

Copyright 2014 - 2017 © taobao.org |