next up previous
Next: Introduction

STXXL : Standard Template Library for XXL Data Sets

Roman Dementiev1

Lutz Kettner2

Peter Sanders1

Technical Report 2005/18

Fakultät für Informatik

Universität Karlsruhe

Abstract:

We present a software library STXXL, that enables practice-oriented experimentation with huge data sets. STXXL is an implementation of the C++ standard template library STL for external memory computations. It supports parallel disks, overlapping between I/O and computation and is the first external memory algorithm library that supports the pipelining technique that can save more than half of the I/Os. STXXL has already been used for the following applications: implementations of external memory algorithms for computing minimum spanning trees, connected components, breadth-first search decompositions, constructing suffix arrays, and computing social network analysis metrics for huge graphs.





Roman Dementiev 2005-08-09