TOPAZ: a Cost-Based, Rule-Driven, Multi-Phase Parallelizer.
Clara Nippl, Bernhard Mitschang:
TOPAZ: a Cost-Based, Rule-Driven, Multi-Phase Parallelizer.
VLDB 1998: 251-262@inproceedings{DBLP:conf/vldb/NipplM98,
author = {Clara Nippl and
Bernhard Mitschang},
editor = {Ashish Gupta and
Oded Shmueli and
Jennifer Widom},
title = {TOPAZ: a Cost-Based, Rule-Driven, Multi-Phase Parallelizer},
booktitle = {VLDB'98, Proceedings of 24rd International Conference on Very
Large Data Bases, August 24-27, 1998, New York City, New York,
USA},
publisher = {Morgan Kaufmann},
year = {1998},
isbn = {1-55860-566-5},
pages = {251-262},
ee = {db/conf/vldb/NipplM98.html},
crossref = {DBLP:conf/vldb/98},
bibsource = {DBLP, http://dblp.uni-trier.de}
}
Abstract
Currently the key problems of query optimization are extensibility imposedby object-relational technology, as well as query complexity caused by forthcoming applications, such as OLAP.
We propose a generic approach to parallelization, called TOPAZ.
Different forms of parallelism are exploited to obtain maximum speedup combined with lowest resource consumption.
The necessary abstractions w.r.t. operator characteristics and system architecture are provided by rules that are used by a cost-based, top-down search engine.
A multi-phase pruning based on a global analysis of the plan efficiently guides the search process, thus considerably reducing complexity and achieving optimization performance.
Since TOPAZ solely relies on the widespread concepts of iterators and datarivers common to (parallel) execution models, it fits as an enabling technology into most state-of-the-art (object-) relational systems.
Copyright © 1998 by the VLDB Endowment.
Permission to copy without fee all or part of this material is granted provided that the copies are not made or
distributed for direct commercial advantage, the VLDB
copyright notice and the title of the publication and
its date appear, and notice is given that copying
is by the permission of the Very Large Data Base
Endowment. To copy otherwise, or to republish, requires
a fee and/or special permission from the Endowment.
Online Paper
CDROM Version: Load the CDROM "DiSC, Volume 1 Number 1" and ...
DVD Version: Load ACM SIGMOD Anthology DVD 1" and ...
Printed Edition
Ashish Gupta, Oded Shmueli, Jennifer Widom (Eds.):
VLDB'98, Proceedings of 24rd International Conference on Very Large Data Bases, August 24-27, 1998, New York City, New York, USA.
Morgan Kaufmann 1998, ISBN 1-55860-566-5
Contents
References
- [BJ+96]
- Giannis Bozas, Michael Jaedicke, Andreas Listl, Bernhard Mitschang, Angelika Reiser, Stephan Zimmermann:
On Transforming a Sequential SQL-DBMS into a Parallel One: First Results and Experiences of the MIDAS Project.
Euro-Par, Vol. II 1996: 881-886
- [BF+95]
- Chaitanya K. Baru, Gilles Fecteau, Ambuj Goyal, Hui-I Hsiao, Anant Jhingran, Sriram Padmanabhan, George P. Copeland, Walter G. Wilson:
DB2 Parallel Edition.
IBM Systems Journal 34(2): 292-322(1995)
- [BF97]
- Carrie Ballinger, Ron Fryer:
Born To Be Parallel: Why Parallel Origins Give Teradata an Enduring Performance Edge.
IEEE Data Eng. Bull. 20(2): 3-12(1997)
- [BFV96]
- Luc Bouganim, Daniela Florescu, Patrick Valduriez:
Dynamic Load Balancing in Hierarchical Parallel Database Systems.
VLDB 1996: 436-447
- [Ce96]
- Pedro Celis:
The Query Optimizer in Tandem's new ServerWare SQL Product.
VLDB 1996: 592
- [CJ97]
- Alexander Clausnitzer, Michael Jaedicke, Bernhard Mitschang, Clara Nippl, Angelika Reiser, Stephan Zimmermann:
On the Application of Parallel Database Technology for Large Scale Document Management Systems.
IDEAS 1997: 388-396
- [De+90]
- David J. DeWitt, Shahram Ghandeharizadeh, Donovan A. Schneider, Allan Bricker, Hui-I Hsiao, Rick Rasmussen:
The Gamma Database Machine Project.
IEEE Trans. Knowl. Data Eng. 2(1): 44-62(1990)
- [DG92]
- David J. DeWitt, Jim Gray:
Parallel Database Systems: The Future of High Performance Database Systems.
Commun. ACM 35(6): 85-98(1992)
- [GHK92]
- Sumit Ganguly, Waqar Hasan, Ravi Krishnamurthy:
Query Optimization for Parallel Execution.
SIGMOD Conference 1992: 9-18
- [GI97]
- Minos N. Garofalakis, Yannis E. Ioannidis:
Parallel Query Scheduling and Optimization with Time- and Space-Shared Resources.
VLDB 1997: 296-305
- [Gra94]
- Goetz Graefe:
Volcano - An Extensible and Parallel Query Evaluation System.
IEEE Trans. Knowl. Data Eng. 6(1): 120-135(1994)
- [Gra95]
- Goetz Graefe:
The Cascades Framework for Query Optimization.
IEEE Data Eng. Bull. 18(3): 19-29(1995)
- [Gra96]
- Goetz Graefe:
The Microsoft Relational Engine.
ICDE 1996: 160-161
- [Gr95]
- ...
- [GB+96]
- Jim Gray, Adam Bosworth, Andrew Layman, Hamid Pirahesh:
Data Cube: A Relational Aggregation Operator Generalizing Group-By, Cross-Tab, and Sub-Total.
ICDE 1996: 152-159
- [GGS96]
- Sumit Ganguly, Akshay Goel, Abraham Silberschatz:
Efficient and Acurate Cost Models for Parallel Query Optimization.
PODS 1996: 172-181
- [Ha95]
- ...
- [HK+97]
- Laura M. Haas, Donald Kossmann, Edward L. Wimmers, Jun Yang:
Optimizing Queries Across Diverse Data Sources.
VLDB 1997: 276-285
- [HS93]
- Wei Hong, Michael Stonebraker:
Optimization of Parallel Query Execution Plans in XPRS.
Distributed and Parallel Databases 1(1): 9-32(1993)
- [JMP97]
- Anant Jhingran, Timothy Malkemus, Sriram Padmanabhan:
Query Optimization in DB2 Parallel Edition.
IEEE Data Eng. Bull. 20(2): 27-34(1997)
- [JM98]
- Michael Jaedicke, Bernhard Mitschang:
On Parallel Processing of Aggregate and Scalar Functions in Object-Relational DBMS.
SIGMOD Conference 1998: 379-389
- [KD96]
- ...
- [Lo88]
- Guy M. Lohman:
Grammar-like Functional Rules for Representing Query Optimization Alternatives.
SIGMOD Conference 1988: 18-27
- [LC+93]
- Ming-Ling Lo, Ming-Syan Chen, Chinya V. Ravishankar, Philip S. Yu:
On Optimal Processor Allocation to Support Pipelined Hash Joins.
SIGMOD Conference 1993: 69-78
- [LST91]
- Hongjun Lu, Ming-Chien Shan, Kian-Lee Tan:
Optimization of Multi-Way Join Queries for Parallel Execution.
VLDB 1991: 549-560
- [LVZ93]
- Rosana S. G. Lanzelotte, Patrick Valduriez, Mohamed Zaït:
On the Effectiveness of Optimization Search Strategies for Parallel Execution Spaces.
VLDB 1993: 493-504
- [MB+96]
- William J. McKenna, Louis Burger, Chi Hoang, Melissa Truong:
EROC: A Toolkit for Building NEATO Query Optimizers.
VLDB 1996: 111-121
- [MD95]
- Manish Mehta, David J. DeWitt:
Managing Intra-operator Parallelism in Parallel Database Systems.
VLDB 1995: 382-394
- [NJM97]
- ...
- [NM98]
- ...
- [Or98]
- ...
- [OL90]
- Kiyoshi Ono, Guy M. Lohman:
Measuring the Complexity of Join Enumeration in Query Optimization.
VLDB 1990: 314-325
- [ON+95]
- Fatma Ozcan, Sena Nural, Pinar Koksal, Mehmet Altinel, Asuman Dogac:
A Region Based Query Optimizer Through Cascades Query Optimizer Framework.
IEEE Data Eng. Bull. 18(3): 30-40(1995)
- [PGK97]
- Arjan Pellenkoft, César A. Galindo-Legaria, Martin L. Kersten:
The Complexity of Transformation-Based Join Enumeration.
VLDB 1997: 306-315
- [Sch97]
- ...
- [SD90]
- Donovan A. Schneider, David J. DeWitt:
Tradeoffs in Processing Complex Join Queries via Hashing in Multiprocessor Database Machines.
VLDB 1990: 469-480
- [SM+98]
- ...
- [STY93]
- Eugene J. Shekita, Honesty C. Young, Kian-Lee Tan:
Multi-Join Optimization for Symmetric Multiprocessors.
VLDB 1993: 479-492
- [SM96]
- Michael Stonebraker, Dorothy Moore:
Object-Relational DBMSs: The Next Great Wave.
Morgan Kaufmann 1996, ISBN 1-55860-397-2
- [TD93]
- Joachim Thomas, Stefan Deßloch:
A Plan-Operator Concept for Client-Based Knowledge Progressing.
VLDB 1993: 555-566
- [TPC95]
- ...
- [WFA95]
- Annita N. Wilschut, Jan Flokstra, Peter M. G. Apers:
Parallel Evaluation of Multi-Join Queries.
SIGMOD Conference 1995: 115-126
- [Zou97]
- Chendong Zou:
XPS: A High Performance Parallel Database Server.
IEEE Data Eng. Bull. 20(2): 21-26(1997)
- [ZZS93]
- Mikal Ziane, Mohamed Zaït, Pascale Borla-Salamet:
Parallel Query Processing with Zigzag Trees.
VLDB J. 2(3): 277-301(1993)
Copyright © Tue Mar 16 02:22:07 2010
by Michael Ley (ley@uni-trier.de)