Benjamin Bin Yao, M. Tamer Özsu and John Keenleyside, XBench - A Family of Benchmarks for XML DBMSs, TR-CS-2002-39, University of Waterloo, December 2002.
Abstract:
XML is beginning to be extensively used in various application
domains, and as a result, large amounts of XML documents are being
generated. Researchers in both industry and academia have proposed
a number of approaches to efficiently store, manipulate, and
retrieve XML documents. The individual performance characteristics
of these approaches as well as the relative performance of various
systems is an ongoing concern.
The range of XML application and the XML data that they manage are
quite varied and no one database schema and workload can properly
capture this variety. We propose a family of XML benchmarks,
collectively call XBench, to measure and evaluate the performance
of different approaches to deal with the management of XML
documents. The family is defined according to a classification of
applications, and each class has its own database and workload.
We will discuss the general requirements for an XML DBMS
benchmark, followed by a detailed explanation of the XBench,
including: the methodology of database generation, the workload,
and the setup of test environment. A brief discussion of other
existing XML benchmarks and comparison among them will be given as
well.