Special Issue: Computer Architecture and Systems

• Distributed Computing and Systems • Previous Articles     Next Articles

Cache-Based Aggregate Query Shipping: An Efficient Scheme of Distributed OLAP Query Processing

Hua-Ming Liao and Guo-Shun Pei   

  1. Research Center for Grid and Service Computing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China
  • Received:2008-01-24 Revised:2008-07-17 Online:2008-11-10 Published:2008-11-10

Our study introduces a novel distributed query plan refinement phase in an enhanced architecture of distributed query processing engine (DQPE). Query plan refinement generates potentially efficient distributed query plan by reusable aggregate query shipping (RAQS) approach. The approach improves response time at the cost of pre-processing time. If the overheads could not be compensated by query results reusage, RAQS is no more favorable. Therefore a global cost estimation model is employed to get proper operators: RR\_Agg, R\_Agg, or R\_Scan. For the purpose of reusing results of queries with aggregate function in distributed query processing, a multi-level hybrid view caching (HVC) scheme is introduced. The scheme retains the advantages of partial match and aggregate query results caching. By our solution, evaluations with distributed TPC-H queries show significant improvement on average response time.

[1] Chaudhuri S, Shim K. Including group-by in query optimization. In {\it Proc. VLDB}, Santiago, Chile, 1994, pp.354--366.
[2]} Dar S, Franklin M J, Jonsson B T, Srivastava D, Tan M. Semantic data caching and replacement. In {\it Proc. VLDB}, Bombay, India, 1996, pp.330--341.
[3]} Amiri K, Park S, Tewari R, Padmanabhan S. DBProxy: A dynamic data cache for web applications. In {\it Proc. ICDE}, Bangalore, India, March 2003, pp.821--831.
[4]} Li R, Zhou M, Liao H. Request window: An approach to improve throughput of RDBMS-based data integration system by utilizing data sharing across concurrent distributed queries. In {\it Proc. VLDB}, Vienna, Austria, September 2007, pp.1219--1230.
[5]} Kotidis Y, Roussopoulos N. DynaMat: A dynamic view management system for data warehouses., In {\it Proc. ACM-SIGMOD}, Philadelphia, Pennsylvania, USA, June 1999, pp.371--382.
[6]} Deshpande P, Ramasamy K, Shukla A, Naughton J F. Caching multidimensional queries using chunks. In {\it Proc. ACM-SIGMOD}, Seattle, Washington, United States, 1998, pp.259--270.
[7]} Scheuermann P, Shim J, Vingralek R. WATCHMAN: A data warehouse intelligent cache manager. In {\it Proc. VLDB}, Bombay, India, 1996, pp.51--62.
[8]} TPC Homepage. TPC-H benchmark. www.tpc.org.
[9]} Josifovski V, Schwarz P, Haas L, Lin E. Garlic: A new flavor of federated query processing for DB2. In {\it Proc. SIGMOD}, Madison, Wisconsin, USA, June 2002, pp.524--532.
[10]} Kossmann D. The state of the art in distributed query processing. \it ACM Computing Surveys, \rm 2000, 32(4): 422--469.
[11]} Jonsson B, Arinbjarnar M, Borsson B, Franklin M J, Srivastava D. Performance and overhead of semantic cache management. \it ACM Transactions on Internet Technology $($TOIT$)$, \rm 2006, 6(3): 302--331.
[12]} Amiri K, Park S, Tewari R, Padmanabhan S. Scalable template-based query containment checking for web semantic caches. In {\it Proc. ICDE}, Bangalore, India, March 2003, pp.493--504.
[13]} Hao X W, Zhang T, Li L. Optimization technology of query processing based on logic rules in semantic caching. \it Chinese Journal of Computers, \rm 2005, 28(7): 1096--1103. (In Chinese)
[14]} Franklin M J, Jonsson B T, Kossmann D. Performance tradeoffs for client-server query processing. In {\it Proc. SIGMOD}, Montreal, Quebec, Canada, June 1996, pp.149--160.
[15]} Zhou J, Larson P A, Freytag J C, Lehner W. Efficient exploitation of similar subexpressions for query processing. In \it Proc. ACM-SIGMOD, \rm Beijing, China, June 2007, pp.533--544.
No related articles found!
Full text



[1] Xiong Zhiguo; Xu Xi; Dong Shihai;. CX11: A Chinese Language Supporting Interface for X Window Environment[J]. , 1995, 10(1): 15 -22 .
[2] Zeng Jianchao; Hidehiko Sanada; Yoshikazu; Tezuka Xu Guangyou;. A Form-Correcting System of Chinese Characters Using a Model of Correcting Procedures of Calligraphists[J]. , 1995, 10(1): 23 -34 .
[3] WANG Xiaodong; XU Ming; ZHOU Xingming;. Fast Multicast on Multistage Interconnection Networks Using Multi-Head Worms[J]. , 1999, 14(3): 250 -258 .
[4] XU Xiaofei; YE Dan; LI Quanlong; ZHAN Dechen;. Dynamic Organization and Methodology for Agile Virtual Enterprises[J]. , 2000, 15(4): 368 -375 .
[5] Peter M. Haverty, Zhi-Ping Weng, and Ulla Hansen. Transcriptional Regulatory Networks Activated by PI3K and ERK Transduced Growth Signals in Human Glioblastoma Cells[J]. , 2005, 20(4): 439 -445 .
[6] Qi Ge, Hai-Tao Wang, and Hong Zhu. An Improved Algorithm for Finding the Closest Pair of Points[J]. , 2006, 21(1): 27 -31 .
[7] Yan-Li Liu, Jin Wang, Xi Chen, Yan-Wen Guo, and Qun-Sheng Peng. A Robust and Fast Non-Local Means Algorithm for Image Denoising[J]. , 2008, 23(2): 270 -279 .
[8] Jian-Wei Xu, Student Member, CCF, Ming-Yu Chen, Member, CCF, ACM, IEEE, Gui Zheng, Zheng Cao, Hui-Wei Lv, and Ning-Hui Sun, Senior Member, CCF, Member, IEEE. SimK: A Large-Scale Parallel Simulation Engine[J]. , 2009, 24(6): 1048 -1060 .
[9] Limsoon Wong and Guimei Liu. Protein Interactome Analysis for Countering Pathogen Drug Resistance[J]. , 2010, 25(1): 124 -130 .
[10] Min-Yi Guo, Zi-Li Shao, Edwin Hsing-Mean Sha. Preface[J]. , 2011, 26(3): 373 -374 .

ISSN 1000-9000(Print)

CN 11-2296/TP

Editorial Board
Author Guidelines
Journal of Computer Science and Technology
Institute of Computing Technology, Chinese Academy of Sciences
P.O. Box 2704, Beijing 100190 P.R. China
E-mail: jcst@ict.ac.cn
  Copyright ©2015 JCST, All Rights Reserved