Nifi 模板

简介:

 

  Acqusition_and_Processing.xml Moving templates to own directory to make repo cleaner
  CADF_Parser.xml Moving templates to own directory to make repo cleaner 6 months ago
  CassandraProcessors.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Convert_To_Avro_From_CSV_and_JSON.xml Added a template showcasing Avro processors 6 months ago
  Decompression_Circular_Flow.xml Moving templates to own directory to make repo cleaner 6 months ago
  Decrypt_Alter_Encrypt_OpenSSL.xml Moving templates to own directory to make repo cleaner 6 months ago
  ElasticsearchDemonstration.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Fun_with_HBase.xml Updating the Fun_with_HBase template a month ago
  GetFileEncodingInFlight.xml Moving templates to own directory to make repo cleaner 6 months ago
  Get_CSV_data_validate_it_and_route_to_Kafka.xml Moving templates to own directory to make repo cleaner 6 months ago
  GroovyJsonToJsonExample.xml Added ExecuteScript example using Groovy for JSON-to-JSON transform 4 months ago
  HandleNifiReports.xml Adding Ambari report handler template 3 months ago
  Hello_NiFi_Web_Service.xml Adding new templates 6 months ago
  HttpExecuteLsCommand.xml Moving templates to own directory to make repo cleaner 6 months ago
  InvokeHttp_And_Route_Original_On_Status.xml Fixing InvokeHttp_And_Route_Original_On_Status.xml template 6 months ago
  List_and_Fetch_SFTP_template.xml Forgot to add template 6 months ago
  MongoDB_Get_and_Put_Example.xml Added a MongoDB template 5 months ago
  NetworkActvityExample.xml Moving templates to own directory to make repo cleaner 6 months ago
  PostHTTP_Content-Type.xml Adding the PostHTTP_Content-Type template that demonstrates how to sp… 6 months ago
  Publish_Consume_JMS.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Pull_from_Twitter_Garden_Hose.xml Moving templates to own directory to make repo cleaner 6 months ago
  ReplaceText_Expression_Language_CSV_Reformatting.xml Moving templates to own directory to make repo cleaner 6 months ago
  Retry_Count_Loop.xml Moving templates to own directory to make repo cleaner 6 months ago
  Self_Referencing_Http_Client_and_Server.xml Moving templates to own directory to make repo cleaner 6 months ago
  SplitRouteMerge.xml Moving templates to own directory to make repo cleaner 6 months ago
  SplitRouteMergeVsRouteText.xml Moving templates to own directory to make repo cleaner 6 months ago
  Splunk_Processors_with_Listen_TCP.xml Adding templates for processors released in NiFi 0.6.0 3 months ago
  Stress_Test_Framework.xml Moving templates to own directory to make repo cleaner 6 months ago
  SyslogExample.xml Moving templates to own directory to make repo cleaner 6 months ago
  Syslog_HBase.xml Adding new templates 6 months ago
  Twitter_Dashboard.xml Adding new templates 6 months ago
  Twitter_Solr.xml Moving templates to own directory to make repo cleaner 6 months ago
  WebCrawler.xml Update WebCrawler.xml 3 months ago
  Web_Scraper_Sample.xml Touching up Web_Scraper_Sample.xml 3 months ago
  Working_With_CSV.xml Moving templates to own directory to make repo cleaner 6 months ago
  Working_with_Logs.xml Moving templates to own directory to make repo cleaner 6 months ago
  csv-to-json-flow.xml Moving templates to own directory to make repo cleaner 6 months ago
  pgp_encryption.xml Adding template to demonstrate PGP Encrypt/Decrypt. Credit to Andrew … 3 months ago
  replacetextwithmapping-example.xml Adding a simple example using the ReplaceTextWithMapping processor. C… 3 months ago
  self_reference_flow_fix.xml Moving templates to own directory to make repo cleaner 6 months ago
  simple-httpget-route-flow.xml Moving templates to own directory to make repo cleaner 6 months ago

collect-stream-logs

This flow shows workflow for log collection, aggregation, store and display.

  1. Ingest logs from folders.
  2. Listen for syslogs on UDP port.
  3. Merge syslogs and drop-in logs and persist merged logs to Solr for historical search.
  4. Dashboard: stream real-time log events to dashboard and enable cross-filter search on historical logs data.

csv-to-json

This flow shows how to convert a CSV entry to a JSON document using ExtractText and ReplaceText.

decompression

This flow demonstrates taking an archive that is created with several levels of compression and then continuously decompressing it using a loop until the archived file is extracted out.

http-get-route

his flow pulls from a web service (example is nifi itself), extracts text from a specific section, makes a routing decision on that extracted value, prepares to write to disk using PutFile.

invoke-http-route

This flow demonstrates how to call an HTTP service based on an incoming FlowFile, and route the original FlowFile based on the status code returned from the invocation. In this example, every 30 seconds a FlowFile is produced, an attribute is added to the FlowFile that sets q=nifi, the google.com is invoked for that FlowFile, and any response with a 200 is routed to a relationship called 200.

retry-count-loop

This process group can be used to maintain a count of how many times a flowfile goes through it. If it reaches some configured threshold it will route to a 'Limit Exceeded' relationship otherwise it will route to 'retry'. Great for processes which you only want to run X number of times before you give up.

split-route

This flow demonstrates splitting a file on line boundaries, routing the splits based on a regex in the content, merging the less important files together for storage somewhere, and sending the higher priority files down another path to take immediate action.

twitter-garden-hose

This flow pulls from Twitter using the garden hose setting; it pulls out some basic attributes from the Json and then routes only those items that are actually tweets.

twitter-solr

This flow shows how to index tweets with Solr using NiFi. Pre-requisites for this flow are NiFi 0.3.0 or later, the creation of a Twitter application, and a running instance of Solr 5.1 or later with a tweets collection. Here are sample steps to set this up (along with Banana dashboard) on HDP Sandbox.

 

 


本文转自疯吻IT博客园博客,原文链接:http://www.cnblogs.com/fengwenit/p/5557035.html,如需转载请自行联系原作者


目录
相关文章
|
7月前
|
SQL 分布式计算 Hadoop
Azkaban【基础 01】核心概念+特点+Web界面+架构+Job类型(一篇即可入门Azkaban工作流调度系统)
【2月更文挑战第6天】Azkaban【基础 01】核心概念+特点+Web界面+架构+Job类型(一篇即可入门Azkaban工作流调度系统)
573 0
|
存储 监控 Java
NiFi 监控2 | 学习笔记
快速学习 NiFi 监控2
332 0
NiFi 监控2  |  学习笔记
|
前端开发 Java Unix
【NiFi】(二)三分钟搞定 NiFi 安装与简单使用!
【NiFi】(二)三分钟搞定 NiFi 安装与简单使用!
2393 0
【NiFi】(二)三分钟搞定 NiFi 安装与简单使用!
|
存储 安全 Java
【NiFi】(一)NiFi 简介及核心概念
【NiFi】(一)NiFi 简介及核心概念
2595 0
【NiFi】(一)NiFi 简介及核心概念
|
7月前
|
数据采集 物联网 大数据
NiFi【部署 01】NiFi最新版本1.18.0下载安装配置启动及问题处理(一篇学会部署NiFi)
NiFi【部署 01】NiFi最新版本1.18.0下载安装配置启动及问题处理(一篇学会部署NiFi)
1075 0
|
XML Java 关系型数据库
NiFi 模板 | 学习笔记
快速学习 NiFi 模板
370 0
NiFi 模板 |  学习笔记
|
XML 数据格式 开发者
NiFi 模板和组 | 学习笔记
快速学习 NiFi 模板和组
334 0
NiFi 模板和组  |  学习笔记
|
XML 数据格式 开发者
了解 Nifi 其他组件 | 学习笔记
快速学习了解 Nifi 其他组件
314 0
了解 Nifi 其他组件  |  学习笔记
|
监控 Java 开发者
NiFi 监控1 | 学习笔记
快速学习 NiFi 监控1
172 0
NiFi 监控1  |  学习笔记
|
监控 安全 开发者
监控 NiFi | 学习笔记
快速学习监控 NiFi
328 0
监控 NiFi  |  学习笔记