Abstract
Generating synthetic data sets is integral to benchmarking, debugging, and simulating future scenarios. As data sets become larger, real data characteristics thereby become necessary for the success of new algorithms. Recently introduced software systems allow for synthetic data generation that is truly parallel. These systems use fast pseudorandom number generators and can handle complex schemas and uniqueness constraints on single attributes. Uniqueness is essential for forming keys, which identify single entries in a database instance. The uniqueness property is usually guaranteed by sampling from a uniform distribution and adjusting the sample size to the output size of the table such that there are no collisions. However, when it comes to real composite keys, where only the combination of the key attribute has the uniqueness property, a different strategy needs to be employed. In this paper, we present a novel approach on how to generate composite keys within a parallel data generation framework. We compute a joint probability distribution that incorporates the distributions of the key attributes and use the unique sequence positions of entries to address distinct values in the key domain.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
- 2.
denoted by \(\oplus \).
- 3.
Under the condition that the pad is used only once and not known to the adversary.
References
Alexandrov, A., Tzoumas, K., Markl, V.: Myriad: scalable and expressive data generation. Proc. VLDB Endowment 5(12), 1890–1893 (2012)
Bruno, N., Chaudhuri, S.: Flexible database generators. In: Proceedings of the 31st International Conference on Very Large Data Bases, VLDB 2005, pp. 1097–1107. VLDB Endowment (2005)
Codd, E.F.: A relational model of data for large shared data banks. Commun. ACM 13(6), 377–387 (1970)
Eichenauer-Herrmann, J.: Explicit inversive congruential pseudorandom numbers: the compound approach. Computing 51(2), 175–182 (1993)
Eichenauer-Herrmann, J.: Statistical independence of a new class of inversive congruential pseudorandom numbers. Math. Comput. 60(201), 375–384 (1993)
Gray, J., Sundaresan, P., Englert, S., Baclawski, K., Weinberger, P.J.: Quickly generating billion-record synthetic databases. In: ACM SIGMOD Record, vol. 23, pp. 243–252. ACM (1994)
Hoag, J.E.: Synthetic Data Generation: Theory, Techniques and Applications. PhD thesis, University of Arkansas (2007)
Hoag, J.E., Thompson, C.W.: A parallel general-purpose synthetic data generator. ACM SIGMOD Rec. 36(1), 19–24 (2007)
Marsaglia, G.: Xorshift rngs. J. Stat. Softw. 8(14), 1–6, 7 (2003)
Panneton, F., L’ecuyer, P.: On the xorshift random number generators. ACM Trans. Model. Comput. Simul. 15(4), 346–361 (2005)
Rabl, T., Poess, M.: Parallel data generation for performance analysis of large, complex RDBMS. DBTest, pp. 1–6 (2011)
Acknowledgements
We thank the anonymous reviewers for their input that helped to improve the quality of the paper. Furthermore, the first author would like to thank Christian Lessig for his valuable assistance in editing.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
A Composite Keys
A Composite Keys
Listing 1.1 shows four SQL statements for creating simple schemas. For the sake of simplicity the statements only declare key columns. Table Simple has one column protein which is declared as primary key and is necessarily unique, i.e. protein makes up a simple key. Table Compound has two attributes, each making up a simple key in its own right, since they are declared as unique. Tables Composite1 and Composite2 are examples of composite key declarations. Composite1 has only one key attribute which makes up a simple key. Table Composite2 has even two attributes for which uniqueness exclusively holds for their combination. Possible instances of all four relations are shown below.
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Hoffmann, M., Alexandrov, A., Andritsos, P., Soto, J., Markl, V. (2015). Composite Key Generation on a Shared-Nothing Architecture. In: Nambiar, R., Poess, M. (eds) Performance Characterization and Benchmarking. Traditional to Big Data. TPCTC 2014. Lecture Notes in Computer Science(), vol 8904. Springer, Cham. https://doi.org/10.1007/978-3-319-15350-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-15350-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-15349-0
Online ISBN: 978-3-319-15350-6
eBook Packages: Computer ScienceComputer Science (R0)