druid相关的时间序列数据库——也用到了倒排相关的优化技术

简介:
Cattell [6] maintains a great summary about existing Scalable SQL and NoSQL data stores. Hu [18] contributed another great summary for streaming databases. Druid feature-wise sits some-
where between Google’s Dremel [28] and PowerDrill [17]. Druid has most of the features implemented in Dremel (Dremel handles arbitrary nested data structures  while Druid only allows for a single
level of array-based nesting) and many of the interesting compression algorithms mentioned in PowerDrill. Although Druid builds on many of the same principles as other distributed columnar data stores [15],  many of these data stores are  
designed to be more generic key-value stores [23] and do not sup
 
port computation directly in the storage layer. There are also other 
 
data stores designed for some of the same data warehousing issues 
 
that Druid is meant to solve. These systems include in-memory 
databases such as SAP’s HANA [14] and VoltDB [43]. These data 
 
stores lack Druid’slowlatency ingestion characteristics. Druidalso 
 
has native analytical features baked in, similar to ParAccel [34], 
 
however, Druid allows system wide rolling software updates with 
 
no downtime. 
 
Druid is similiar to C-Store [38] and LazyBase [8] in that it has 
twosubsystems,aread-optimizedsubsysteminthehistoricalnodes 
 
andawrite-optimizedsubsysteminreal-timenodes. Real-timenodes 
 
are designed to ingest a high volume of append heavy data, and do 
 
not support data updates. Unlike the two aforementioned systems, 
 
Druid is meant for OLAP transactions and not OLTP transactions. 
 
Druid’s low latency data ingestion features share some similar-
 
ities with Trident/Storm [27] and Spark Streaming [45], however,
 
both systems are focused on stream processing whereas Druid is 
 
focused on ingestion and aggregation.  Stream processors are great 
 
complements to Druid as a means of pre-processing the data before 
 
the data enters Druid. 
 
There are a class of systems that specialize in queries on top of
cluster computing frameworks. Shark [13] is such a system for  
queriesontopofSpark,andCloudera’sImpala[9]isanothersystem 
 
focused on optimizing query performance on top of HDFS. Druid
historical nodes download data locally and only work with native  
Druid indexes. We believe this setup allows for faster query laten
 
cies. 
 
Druid leverages a unique combination of algorithms in its archi-
tecture. Although we believe no other data store has the same set  
of functionality as Druid, some of Druid’s optimization techniques 
 
suchas using inverted indices to perform fast filter sarealsousedin
other data stores [26].
 
druid白皮书:http://static.druid.io/docs/druid.pdf















本文转自张昺华-sky博客园博客,原文链接:http://www.cnblogs.com/bonelee/p/6433333.html ,如需转载请自行联系原作者

相关文章
|
JavaScript 关系型数据库 MySQL
❤Nodejs 第六章(操作本地数据库前置知识优化)
【4月更文挑战第6天】本文介绍了Node.js操作本地数据库的前置配置和优化,包括处理接口跨域的CORS中间件,以及解析请求数据的body-parser、cookie-parser和multer。还讲解了与MySQL数据库交互的两种方式:`createPool`(适用于高并发,通过连接池管理连接)和`createConnection`(适用于低负载)。
18 0
|
21天前
|
存储 关系型数据库 MySQL
轻松入门MySQL:数据库设计之范式规范,优化企业管理系统效率(21)
轻松入门MySQL:数据库设计之范式规范,优化企业管理系统效率(21)
|
14天前
|
存储 中间件 关系型数据库
数据库切片大对决:ShardingSphere与Mycat技术解析
数据库切片大对决:ShardingSphere与Mycat技术解析
23 0
|
27天前
|
SQL 关系型数据库 MySQL
【MySQL技术专题】「问题实战系列」深入探索和分析MySQL数据库的数据备份和恢复实战开发指南(8.0版本升级篇)
【MySQL技术专题】「问题实战系列」深入探索和分析MySQL数据库的数据备份和恢复实战开发指南(8.0版本升级篇)
96 0
|
21天前
|
存储 关系型数据库 MySQL
MySQL数据库性能大揭秘:表设计优化的高效策略(优化数据类型、增加冗余字段、拆分表以及使用非空约束)
MySQL数据库性能大揭秘:表设计优化的高效策略(优化数据类型、增加冗余字段、拆分表以及使用非空约束)
|
23小时前
|
存储 缓存 关系型数据库
掌握MySQL数据库这些优化技巧,事半功倍!
掌握MySQL数据库这些优化技巧,事半功倍!
|
1天前
|
SQL Java 数据库连接
Java从入门到精通:2.3.1数据库编程——学习JDBC技术,掌握Java与数据库的交互
ava从入门到精通:2.3.1数据库编程——学习JDBC技术,掌握Java与数据库的交互
|
1天前
|
缓存 关系型数据库 MySQL
MySQL数据库优化技巧:提升性能的关键策略
索引是提高查询效率的关键。根据查询频率和条件,创建合适的索引能够加快查询速度。但要注意,过多的索引可能会增加写操作的开销,因此需要权衡。
|
7天前
|
SQL 监控 druid
Druid数据库连接池简介及应用推广(老项目翻出来做下记录)
Druid数据库连接池简介及应用推广(老项目翻出来做下记录)
|
9天前
|
存储 SQL 安全
6.数据库技术基础
6.数据库技术基础

热门文章

最新文章