Information in Spoken Language

A quantitative approach

Literature

The Literature can be downloaded by executing:
perl GetURLsfrombbl.pl > Literature/Literature.html
after building all of the pdf´s (using the \lecture macro's Monday-Friday) with
./runmultibibtex LOTwinterschool2006
(several times if needed)

Slides

1. Introduction to Information Theory
2. Symbolic Information in language
3. Acoustic information in speech (with sound)
4. Information Structure
5. Efficiency in speech
6. Bibliography

TeX sources

• TeX source
• BibTeX file
• All TeX in a Bzip2 package

Course materials

• Texts
  Can by executing (in the words directory)
  make -f ConstructDistances.makefile all
• Bronte
• Bronte.tbz2
• HenryFielding
• HenryFielding.tbz2
• JaneAusten
• JaneAusten.tbz2
• Plato
• Plato.tbz2


• Unigram counts
• BronteUnigram.txt
• HenryFieldingUnigram.txt
• JaneAustenUnigram.txt
• PlatoUnigram.txt
• NCD_Unigram.txt


• Make and Perl scripts (--help gives information)
• ConstructDistances.makefile, use make to construct everything
• NCDcountfile.pl: Compare Ngram count files and calculate NCD
• Ngramcount.pl: Construct Ngram count files
• ngramprobability.pl: Use Ngram count files for a toy language model

See also the README file

©2006, R.J.J.H. van Son

GNU General Public License

This program is free software; you can redistribute it and/or modify
it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or
(at your option) any later version.

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

You should have received a copy of the GNU General Public License
along with this program; if not, write to the Free Software
Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA  02110-1301, USA.