GeMDA: A multidimensional data partitioning technique for multiprocessor database systems

    Authors

    Y. L. Lo; K. A. Hua;H. C. Young

    Comments

    Authors: contact us about adding a copy of your work at STARS@ucf.edu

    Abbreviated Journal Title

    Distrib. Parallel Databases

    Keywords

    data allocation; data fragmentation; parallel database system; query; processing; system utilization; DISK ALLOCATION; MECHANISM; Computer Science, Information Systems; Computer Science, Theory &; Methods

    Abstract

    Several studies have repeatedly demonstrated that both the performance and scalability of a shared nothing parallel database system depend on the physical layout of data across the processing nodes of the system. Today, data is allocated in these systems using horizontal partitioning strategies. This approach has a number of drawbacks. If a query involves the partitioning attribute, then typically only a small number of the processing nodes can be used to speedup the execution of this query. On the other hand, if the predicate of a selection query includes an attribute other than the partitioning attribute, then the entire data space must be searched. Again, this results in waste of computing resources. In recent years, several multidimensional data declustering techniques have been proposed to address these problems. However, these schemes are too restrictive (e.g., FX, ECC, etc.), or optimized for a certain type of queries (e.g., DM, HCAM, etc.). In this paper, we introduce a new technique which is flexible, and performs well for general queries, We prove its optimality properties, and present experimental results showing that our scheme outperforms DM and HCAM by a significant margin.

    Journal Title

    Distributed and Parallel Databases

    Volume

    9

    Issue/Number

    3

    Publication Date

    1-1-2001

    Document Type

    Article

    Language

    English

    First Page

    211

    Last Page

    236

    WOS Identifier

    WOS:000168717400002

    ISSN

    0926-8782

    Share

    COinS