XBench -
A Family of Benchmarks for XML DBMSs
Conference/Symposium/Workshop Papers
B. B. Yao, M. T. Özsu, and N. Khandelwal,
"XBench Benchmark and Performance Testing of XML DBMSs", In Proceedings
of 20th International Conference on Data Engineering, Boston, MA, March 2004, pages 621-632.
Abstract:
XML support is being added to existing database management systems (DBMSs) and native XML systems are being developed both in industry and in academia. The individual performance characteristics of these approaches as well as the relative performance of various systems is an ongoing concern. In this paper we discuss the XBench XML benchmark and report on the relative performance of various DBMSs. XBench is a family of XML benchmarks which recognizes that the XML data that DBMSs manage are quite varied and no one database schema and workload can properly capture this variety. Thus, the members of this benchmark family have been defined for capturing diverse application domains.
B. B. Yao, M. T. Özsu, and J. Keenleyside,
"XBench -- A Family of Benchmarks for XML DBMSs", In Proceedings of
EEXTT 2002 and DiWeb 2002, Lecture Notes in Computer Science Volume 2590,
S. Bressan, A. B. Chaudhri, M. L.
Lee, J. Yu, Z. Lacroix (eds), Springer-Verlag, pages 162-164.
Abstract:
This paper summarizes the XBench family of benchmarks that are under
development at the University of Waterloo. The benchmark
identifies various classes of XML databases and applications and
proposes a set of benchmarks to accommodate these classes.
Technical Reports
Benjamin Bin Yao and M. Tamer Özsu, Evaluation of DBMSs Using XBench Benchmark, TR-CS-2003-24, University of Waterloo, August 2003.
Abstract:
XML support is being added to existing database management
systems (DBMSs) and native XML systems are being developed both in industry
and in academia. The individual performance characteristics of these
approaches as well as the relative performance of various systems is an
ongoing concern.
XBench is a family of XML benchmarks which recognizes that the XML data that
DBMSs manage are quite varied and no one database schema and workload can
properly capture this variety. Thus, the members of this benchmark family have
been defined for capturing diverse application domains.
In this report we briefly discuss the XBench XML benchmark and report on the
relative performance of three commercial DBMSs: X-Hive, DB2 and SQL Server. We
also describe the potential issues when storing XML documents into relational
DBMSs.
Benjamin Bin Yao, M. Tamer Özsu and John Keenleyside, XBench - A Family of Benchmarks for XML DBMSs, TR-CS-2002-39, University of Waterloo, December 2002.
Abstract:
XML is beginning to be extensively used in various application
domains, and as a result, large amounts of XML documents are being
generated. Researchers in both industry and academia have proposed
a number of approaches to efficiently store, manipulate, and
retrieve XML documents. The individual performance characteristics
of these approaches as well as the relative performance of various
systems is an ongoing concern.
The range of XML application and the XML data that they manage are
quite varied and no one database schema and workload can properly
capture this variety. We propose a family of XML benchmarks,
collectively call XBench, to measure and evaluate the performance
of different approaches to deal with the management of XML
documents. The family is defined according to a classification of
applications, and each class has its own database and workload.
We will discuss the general requirements for an XML DBMS
benchmark, followed by a detailed explanation of the XBench,
including: the methodology of database generation, the workload,
and the setup of test environment. A brief discussion of other
existing XML benchmarks and comparison among them will be given as
well.
|