World Library  
Flag as Inappropriate
Email this Article

Moby Project

Article Id: WHEBN0000535248
Reproduction Date:

Title: Moby Project  
Author: World Heritage Encyclopedia
Language: English
Subject: Grady Ward, Public domain databases, PGP word list, Applied linguistics, Phonetics
Collection:
Publisher: World Heritage Encyclopedia
Publication
Date:
 

Moby Project

The Moby Project is a collection of public-domain lexical resources. It was created by Grady Ward. The resources were dedicated to the public domain, and are now mirrored at Project Gutenberg. As of 2007, it contains the largest free phonetic database, with 177,267 words and corresponding pronunciations.

Contents

  • Hyphenator 1
  • Language 2
  • Part-of-Speech 3
  • Pronunciator 4
  • Shakespeare 5
  • Thesaurus 6
  • Words 7
  • References 8
  • External links 9

Hyphenator

The Moby Hyphenator II contains 187,175 hyphenated words, with 9,752 indicating that they should not be hyphenated. Hyphenation is indicated by a character value 165 (hex A5). Some entries, however, have a combination of actual hyphens and character 165, such as "bar¥ber-sur¥geon".

There is little to no documentation with the Moby Hyphenator, but the entries would suggest that the hyphenation was to separate syllables in the words: "Skep¥tic ; skep¥ti¥cal ; skep¥ti¥cism ; skep¥to¥phy¥lax¥is".

Language

Moby Language II contains wordlists of five languages - French, German, Italian, Japanese, and Spanish:

Language Words Size (in bytes)
French 138,257 1,524,757
German 159,809 2,055,986
Italian 60,453 561,981
Japanese 115,523 934,783
Spanish 86,059 850,523
Total 560,101 5,928,030

However, some of the lists are contaminated, for example the Japanese list contains English words such as abnormal and non-words such as abcdefgh and m,./. There are also unusual peculiarities in the sorting of these lists, as the French list contains a straight alphabetical listing, while the German list contains the alphabetical listing of traditionally capitalized words and then the alphabetical listing of traditionally lower-cased words. The list of Italian words, however, contains no capitalized words whatsoever.

The foreign languages list does not use accented characters, so "e^tre" is how you would look up the French word "être" ("To Be").

Part-of-Speech

Moby Part-of-Speech contains 233,356 words fully described by part(s) of speech, listed in priority order. The format of the file is word\parts-of-speech, with the following parts of speech being identified:

Part-of-speech Code
Noun N
Plural p
Noun phrase h
Verb (usually participle) V
Transitive verb t
Intransitive verb i
Adjective A
Adverb v
Conjunction C
Preposition P
Interjection !
Pronoun r
Definite article D
Indefinite article I
Nominative o

Pronunciator

The Moby Pronunciator II contains 177,267 words with corresponding pronunciations. The Project Gutenberg distribution also contains a copy of the cmudict v0.3. The file follows the format word[/part-of-speech] pronunciation. The part-of-speech field is used to disambiguate 770 of the words which have differing pronunciations depending on their part-of-speech. For example for the words spelled close, the verb has the pronunciation , whereas the adjective is . The parts-of-speech have been assigned the following codes:

Part-of-speech Code
Noun n
Verb v
Adjective aj
Adverb av
Interjection interj

Following this is the pronunciation. Several special symbols are present:

Symbol Meaning
/ Used to separate phonemes
_ Used to separate words
' Primary stress on the following syllable
, Secondary stress on the following syllable

The rest of the symbols are used to represent IPA characters, according to the following table:

Symbol
& æ
- ə
@ ʌ, ə
@r ɜr, ər
A ɑː
aI
Ar ɑr
AU
b b
d d
D ð
dZ
E ɛ
eI
f f
g ɡ
h h
hw hw
i
I ɪ
j j
k k
l l
m m
n n
N ŋ
O ɔː
Oi ɔɪ
oU
p p
r r
s s
st st
S ʃ
t t
T θ
tS
u
U ʊ
v v
w w
z z
Z ʒ

Shakespeare

Moby Shakespeare contains the complete unabridged works of Shakespeare. This specific resource is not available from Project Gutenberg.

Thesaurus

The Moby Thesaurus II contains 30,260 root words, with 2,520,264 synonyms and related terms - an average of 83.3 per root word. Each line consists of a list of comma-separated values, with the first term being the root word, and all following words being related terms.

Grady Ward placed this thesaurus in the public domain in 1996. It is also available as a Debian package.

Words

Moby Words II is the largest wordlist in the world.[1] The distribution consists of the following 16 files:

Filename Words Description
ACRONYMS.TXT 6,213 Common acronyms and abbreviations
COMMON.TXT 74,550 Common words present in two or more published dictionaries
COMPOUND.TXT 256,772 Phrases, proper nouns, and acronyms not included in the common words file
CROSSWD.TXT 113,809 Words included in the first edition of the Official Scrabble Players Dictionary
CRSWD-D.TXT 4,160 Additions to the Official Scrabble Players Dictionary in the second edition
FICTION.TXT 467 A list of the most commonly occurring substrings in the book The Joy Luck Club
FREQ.TXT 1,000 Most frequently occurring words in the English language, listed in descending order
FREQ-INT.TXT 1,000 Most frequently occurring words on Usenet in 1992, listed with corresponding percentage in decreasing order
KJVFREQ.TXT 1,185 Most frequently occurring substrings in the King James Version of the Bible, listed in descending order
NAMES.TXT 21,986 Most common names used in the USA and Great Britain
NAMES-F.TXT 4,946 Common English female names
NAMES-M.TXT 3,897 Common English male names
OFTENMIS.TXT 366 Most common misspelled English words
PLACES.TXT 10,196 Place names in the USA
SINGLE.TXT 354,984 Single words excluding proper nouns, acronyms, compound words and phrases, but including archaic words and significant variant spellings
USACONST.TXT 7,618 United States Constitution including all amendments current to 1993
Total 863,149

References

  1. ^ Electronic Dictionaries

External links

  • Moby Project homepage
  • Project Gutenberg downloads
  • Searching for Rhymes with Perl; corresponding code
  • Conversion to relational database
This article was sourced from Creative Commons Attribution-ShareAlike License; additional terms may apply. World Heritage Encyclopedia content is assembled from numerous content providers, Open Access Publishing, and in compliance with The Fair Access to Science and Technology Research Act (FASTR), Wikimedia Foundation, Inc., Public Library of Science, The Encyclopedia of Life, Open Book Publishers (OBP), PubMed, U.S. National Library of Medicine, National Center for Biotechnology Information, U.S. National Library of Medicine, National Institutes of Health (NIH), U.S. Department of Health & Human Services, and USA.gov, which sources content from all federal, state, local, tribal, and territorial government publication portals (.gov, .mil, .edu). Funding for USA.gov and content contributors is made possible from the U.S. Congress, E-Government Act of 2002.
 
Crowd sourced content that is contributed to World Heritage Encyclopedia is peer reviewed and edited by our editorial staff to ensure quality scholarly research articles.
 
By using this site, you agree to the Terms of Use and Privacy Policy. World Heritage Encyclopedia™ is a registered trademark of the World Public Library Association, a non-profit organization.
 


Copyright © World Library Foundation. All rights reserved. eBooks from Project Gutenberg are sponsored by the World Library Foundation,
a 501c(4) Member's Support Non-Profit Organization, and is NOT affiliated with any governmental agency or department.