Abstract
This article examines the usefulness ofvocabulary richness for authorship attributionand tests the assumption that appropriatemeasures of vocabulary richness can capture anauthor's distinctive style or identity. Afterbriefly discussing perceived and actualvocabulary richness, I show that doubling andcombining texts affects some measures incomputationally predictable but conceptuallysurprising ways. I discuss some theoretical andempirical problems with some measures anddevelop simple methods to test how wellvocabulary richness distinguishes texts bydifferent authors. These methods show thatvocabulary richness is ineffective for largegroups of texts because of the extremevariability within and among them. I concludethat vocabulary richness is of marginal valuein stylistic and authorship studies because thebasic assumption that it constitutes awordprint for authors is false.
Similar content being viewed by others
References
Baayen R.H. (1993) Statistical Models for Word Frequency Distributions: A Linguistic Evaluation. Computers and the Humanities, 26, pp. 347–363.
Baayen R.H. (1996) The Effect of Lexical Specialization on the Growth Curve of the Vocabulary. Computational Linguistics, 22, pp. 455–480.
Baayen R.H., Van Halteren H., Tweedie F.J. (1996) Outside the Cave of Shadows: Using Syntactic Annotation to Enhance Authorship Attribution. Literary and Linguistic Computing, 11(3), pp. 121–131.
Brainerd B. (1988) Two Models for the Type–Token Relation with Time Dependant Vocabulary Reservoir. In Thoiron P., Serant D., Labbe D. (eds.), Vocabulary Structure and Lexical Richness, Champion–Slatkine, Paris.
Burrows J.F. (1987) Computation into Criticism. Clarendon Press, Oxford.
Burrows J.F. (1992) Computers and the Study of Literature. In Butler, pp. 167–204.
Burrows J.F., Craig D.H. (1994) Lyrical Drama and the ‘Turbid Mountebanks’: Styles of Dialogue in Romantic and Renaissance Tragedy. Computers and the Humanities, 28, pp. 63–86.
Craig H. (1999) Authorial Attribution and Computational Stylistics: If You Can Tell Authors Apart, Have You Learned Anything About Them? Literary and Linguistic Computing, 14(1), pp. 103–113.
Craig H. (1999) Contrast and Change in the Idiolects of Ben Jonson Characters. Computers and the Humanities, 33, pp. 221–240.
Holmes D.I. (1994) Authorship Attribution. Computers and the Humanities, 28(2), pp. 87–106.
Holmes D.I., Forsyth R.S. (1995) The Federalist Revisited: New Directions in Authorship Attribution. Literary and Linguistic Computing, 10(2), pp. 111–127.
Hoover D.L. (1999) Language and Style in The Inheritors. University Press of America, Lanham, MD.
Lancashire I., Bradley J., McCarty W., Stairs M., Wooldridge R.R. (1996) Using TACT with Electronic Texts. MLA, New York.
Minitab Release 12.2, Minitab, Inc., State College, Pennsylvania. TACT Version 2.1, Centre for Computing in the Humanities, University of Toronto.
Thoiron P. (1986) Diversity Index and Entropy as Measures of Lexical Richness. Computers and the Humanities, 20, pp. 197–202.
Tweedie F.J., Baayen R.H. (1998) How Variable May a Constant Be? Measures of Lexical Richness in Perspective. Computers and the Humanities, 32, pp. 323–352.
Tweedie F.J., Holmes D.I., Corns T.N. (1998) The Provenance of De Doctrina Christiana, Attributed to John Milton: A Statistical Investigation. Literary and Linguistic Computing, 13(2), pp. 77–87.
Tweedie F.J., Singh S., Holmes D.I. (1996) Neural Network Applications in Stylometry: The Federalist Papers. Computers and the Humanities, 30, pp. 1–10.
Yule G.U. (1994) The Statistical Study of Literary Vocabulary. Cambridge University Press, Cambridge.
The Acts of the Apostles (KJV). (2000) Online. Humanities Text Initiative, University of Michigan. [http://www.hti.umich.edu/] Downloaded January 12, 2000.
Anderson, Sherwood. (1996) Winesburg, Ohio. 1919. Online. Project Gutenberg. [http://www. promo.net/pg/list.html] Downloaded March 1, 1996.
Baum, L. Frank. (2000) The Marvelous Land of Oz. 1904. Online. Project Gutenberg. [ftp:// uiarchive.cso.uiuc.edu/pub/etext/gutenberg/etext93/] Downloaded January 12, 2000.
Baum, L. Frank. (2000) The Wonderful Wizard of Oz. 1900. Online. Robert Stockwell, Carnegie Mellon University. [http://www.cs.cmu.edu/People/rgs/] Downloaded January 12, 2000.
Brontë, Charlotte. (1998) Jane Eyre. 1846. Online. The English Server, Carnegie Mellon University. [http://english–www.hss.cmu.edu/fiction/] Downloaded December 18, 1998.
Brontë, Charlotte. (2000) Shirley. 1849. Online. The Brontë Sisters Web. [http://www. lang.nagoyau. ac.jp/∼matsuoka/Bronte.html] Downloaded January 21, 2000.
Brontu, Emily. (2000) Wuthering Heights. 1847. Online. University of Virginia Library. [http://etext. lib.virginia.edu/modeng/modeng0.browse.html] Downloaded January 14, 2000.
Carroll, Lewis. (2000) Alice's Adventures in Wonderland. 1866. Online. Project Gutenberg. Available: ftp://sunsite.unc.edu/pub/docs/books/gutenberg/etext97/. Downloaded January 12, 2000.
Carroll, Lewis. (2000) Through the Looking–Glass and What Alice Found There. 1862–63. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html/] Downloaded January 12, 2000.
Cather, Willa. (1996) My Antonia. 1918. Online. The English Server, Carnegie Mellon University. [http://english–server.hss.cmu.edu/fiction/] Downloaded May 16, 1996.
Cather, Willa. (2000) The Professor's House. 1925. Online. Humanities Text Initiative, University of Michigan. [http://www.hti.umich.edu/] Downloaded January 18, 2000.
Chestnutt, Charles W. (1996) The House Behind the Cedars. 1900. Athens: University of Georgia Press. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0. browse.html] Downloaded May 23, 1996.
Chopin, Kate. (1996) The Awakening and Selected Short Stories. 1899. [New York: Bantam Books, 1988.] Online. Project Gutenberg. [http://www.promo.net/pg/list.html] Downloaded May 16, 1996.
Conrad, Joseph. (1996) Lord Jim. 1900. N.p. [1961 reprint of the first edition.] Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded May 29, 1996.
Conrad, Joseph. (2000) The Nigger of the Narcissus. 1897. New York: Penguin Classics, 1987. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse. html] Downloaded January 21, 2000.
Crane, Stephen. (1996a) “The Bride Comes to Yellow–Sky”. McClure's Magazine X, February 1898, 377–384. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/ modeng0.browse.html] Downloaded May 28, 1996.
Crane, Stephen. (1996b) The Red Badge of Courage. 1895. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded May 31, 1996.
Doyle, Sir Arthur Conan. (2000) The Hound of the Baskervilles. The Strand Magazine, August 1901–April 1902. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/ modeng0.browse.html] Downloaded January 12, 2000.
Doyle, Sir Arthur Conan. (1996) The Return of Sherlock Holmes. The Strand Magazine, October 1903. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0. browse.html] Downloaded May 29, 1996.
Doyle, Sir Arthur Conan. (2000) The Sign of Four. 1890. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded January 12, 2000.
Doyle, Sir Arthur Conan. (2000) The Valley of Fear. The Strand Magazine, September 1914–May 1915. Online. University of Virginia Library. http://etext.lib.virginia.edu/modeng/modeng0. browse.html. Downloaded January 12, 2000.
Dreiser, Theodore. (1996) Sister Carrie. 1900. Online. Virginia Tech. University. [gopher://gopher. vt.edu:10010/10/33] Downloaded May 16, 1996.
Faulkner, William. (1994) Light in August. 1932. Novels, 1930–1935. New York: Library of America, 1985. Online. Oxford Text Archive. No longer available. Downloaded June 9, 1994.
Ford, Ford Maddox. (1996) The Good Soldier. 1915. Reprint, New York: Vintage, 1989. Scanned and corrected May 21, 1996.
Forster, E.M. (1996) Howards End. 1910. Great Novels of E.M. Forster: Where Angels Fear to Tread, The Longest Journey, A Room with a View, Howards End. New York: Caroll & Graff Publishers, Inc., 1992. Online. Humanities Text Initiative, University of Michigan. [http://www. hti.umich.edu/english/pd–modeng/bibl.html] Downloaded May 16, 1996.
Forster, E.M. (2000) A Room with a View. 1908. Great Novels of E. M. Forster: Where Angels Fear to Tread, The Longest Journey, A Room with a View, Howards End. New York: Caroll & Graff Publishers, Inc., 1992. Online. Humanities Text Initiative, University of Michigan. [http://www.hti.umich.edu/english/pd–modeng/bibl.html] Downloaded May 16, 1996.
Frederic, Harold. (1996) The Damnation of Theron Ware. 1896. Online. Project Gutenberg. http:// www.promo.net/pg/list.html. Downloaded May 23, 1996.
Golding, William. (1960) Free Fall. 1959. New York: Harcourt, Brace, & World. Scanned and corrected January 6, 1997.
Golding, William. (1955b) The Inheritors. New York: Harcourt, Brace, & World. Created 1985.
Hardy, Thomas. (1996) Jude the Obscure. 1896. Online. Humanities Text Initiative, University of Michigan. [http://www.hti.umich.edu/english/pd–modeng/bibl.html] Downloaded May 31, 1996.
Hardy, Thomas. (2000) The Mayor of Casterbridge. Online. Wiretap. [gopher://wiretap.area.com/ 00/Library/Classic/] Downloaded January 17, 2000.
James, Henry. (1996) The Ambassadors. 1909. The Novels and Tales of Henry James. New York: Charles Scribner's Sons, 1907–17. Online. Project Gutenberg. [http://www.promo.net/pg/list. html] Downloaded May 16, 1996.
James, Henry. (2000) Confidence. 1879. Literary Classics of the United States, New York: Viking Press, 1983. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/ modeng0.browse.html] Downloaded January 12, 2000.
James, Henry. (2000) The Europeans. Boston: Houghton, Osgood and Company, 1878. Online. The Henry James scholar's Guide toWeb Sites. [http://www.newpaltz.edu/∼hathaway/] Downloaded January 12, 2000.
Joyce, James. (1996) APortrait of the Artist as a Young Man. 1916. Online. Bibliomania. [http://www.bibliomania.com/Fiction/] Downloaded May 31, 1996.
Kipling, Rudyard. (2000) The Jungle Book. 1893. Online. Robert Stockwell, Carnegie Mellon University. [http://www.cs.cmu.edu/People/rgs/] Downloaded January 19, 2000.
Kipling, Rudyard. (1996) Kim. 1901. Online. Virginia Tech University. [gopher://gopher.vt.edu: 10010/10/33] Downloaded May 16, 1996.
Lawrence, D.H. (1996) Sons and Lovers. New York: Viking Press, 1913. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded May 16, 1996.
Lewis, Sinclair. (2000) Babbitt. 1922. Online. Project Gutenberg. [http://www.promo.net/pg/list. html] Downloaded January 21, 2000.
Lewis, Sinclair. (1996) Main Street. 1920. Online. Project Gutenberg. [http://www.promo.net/pg/ list.html] Downloaded May 16, 1996.
London, Jack. (2000) The Call of the Wild. 1903. Online. Wiretap. [gopher://wiretap.area.com/ 00/Library/Classic/] Downloaded January 8, 2000.
London, Jack. (1996) The Sea Wolf. 1904. Reprint, New York: Library of America, 1982. Online. Oxford Text Archive. [ftp://ftp.hti.umich.edu/pub/ota/public/] Downloaded May 31, 1996.
Luke (KJV). (2000) Online. Humanities Text Initiative, University of Michigan. [http://www. hti.umich.edu/] Downloaded January 12, 2000.
Maugham, W. Somerset. (1996) Of Human Bondage. Garden City, New York: Doubleday, Doran & Company, Inc., 1915. Online. Wiretap. [gopher://wiretap.spies.com:70/11/Books] Downloaded May 19, 1996.
Norris, Frank. (1996) McTeague. 1899. Reprint, New York: Rinehart & Co., 1958. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded May 31, 1996.
Orwell, George. (1994) Nineteen Eighty–Four. 1949. Reprint, New York: New American Library, 1961. Online. Oxford Text Archive. [http://ota.ahds.ac.uk/] Downloaded June 9, 1994.
Sinclair, Upton. (1996) The Jungle. 1906. [Reprint, New York: Signet, 1960?] Online. Project Gutenberg. [http://www.promo.net/pg/list.html] Downloaded May 16, 1996.
Stevenson, Robert Louis. (1996) Treasure Island. 1883. Reprint, New York: Signet, 1981. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded May 29, 1996.
Stoker, Bram. (1996) Dracula. 1897. Online. University of Virginia Library. [http://etext.lib. virginia.edu/modeng/modeng0.browse.html] Downloaded May 22, 1996.
Twain, Mark. (1996) The Tragedy of Pudd'nhead Wilson. 1894. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded May 31, 1996.
Wells, H.G. (2000) The Invisible Man. 1897. Best Science Fiction Stories of H. G. Wells, New York: Dover, 1966. Online. University of Virginia Library. [http://etext.lib.virginia.edu/ modeng/modeng0.browse.html]. Downloaded January 12, 2000.
Wells, H.G. (1996) The War of the Worlds. 1898. Online. University of Virginia Library. [http:// etext.lib.virginia.edu/modeng/modeng0.browse.html] Downloaded May 31, 1996.
Wharton, Edith. (1996) The Age of Innocence. 1920. Online. Project Gutenberg. [http://www. promo.net/pg/list.html] Downloaded May 16, 1996.
Wilde, Oscar. (1996) The Picture of Dorian Gray. 1891. Reprint, New York: New American Library, 1962. Online. University of Virginia Library. [http://etext.lib.virginia.edu/modeng/ modeng0.browse.html] Downloaded May 31, 1996.
Woolf, Virginia. (1996) To the Lighthouse. 1927. Reprint, New York: Harcourt, Brace, & World, 1955. Online. Oxford Text Archive. [http://ota.ahds.ac.uk/] Downloaded December 13, 1996.
Woolf, Virginia. (1996) The Voyage Out. 1915. Online. Project Gutenberg. [http://www.promo. net/pg/list.html] Downloaded May 11, 1996.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hoover, D.L. Another Perspective on Vocabulary Richness. Computers and the Humanities 37, 151–178 (2003). https://doi.org/10.1023/A:1022673822140
Issue Date:
DOI: https://doi.org/10.1023/A:1022673822140