A statistical model from information theory to explain Zipf's law of abbreviation

Hernández-Fernández, Antoni and González Torres, Iván and Lacasa, Lucas and Kello, Christopher T. and Luque Serrano, Bartolome (2019). A statistical model from information theory to explain Zipf's law of abbreviation. In: "International Conference on Interdisciplinary Advances in Statistical Learning..", 27-29 jun., San-Sebastian, España. p. 1.

Description

Title: A statistical model from information theory to explain Zipf's law of abbreviation
Author/s:
  • Hernández-Fernández, Antoni
  • González Torres, Iván
  • Lacasa, Lucas
  • Kello, Christopher T.
  • Luque Serrano, Bartolome
Item Type: Presentation at Congress or Conference (Poster)
Event Title: International Conference on Interdisciplinary Advances in Statistical Learning..
Event Dates: 27-29 jun.
Event Location: San-Sebastian, España
Title of Book: International Conference on Interdisciplinary Advances in Statistical Learning
Date: June 2019
Subjects:
Faculty: E.T.S. de Ingeniería Aeronáutica y del Espacio (UPM)
Department: Matemática Aplicada a la Ingeniería Aeroespacial
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (899kB) | Preview

Abstract

Brevity and frequency are two crucial factors in the processes of statistical learning in language. The compression principle had already been used previously to explain the origin of Zipf’s law for the frequency of words. Here we use a model from information theory to also explain the Zipf’s law of abbreviation, or the statistical tendency of more frequent elements in language to be shorter (in characters in the case of written language, and in time durations for oral communication). As far as we know, we show for the first time that Zipf’s law of abbreviation is a global speech process that holds in words regardless of what are the linguistics units of study. In addition, the derived model from information theory allows us to fit empirically linguistic data in English (Buckeye Corpus), considering both acoustic elements (phonemes and words) and its transcripts. This raises that the processes measured in units of written text are a byproduct of spontaneous speech patterns. The more a word is used, the greatest effort in compression that will make it shorter; but also the shorter it is, the more times it will be used statistically. This work paves the way for new experimental approaches to the study of statistical learning in human language and other communication systems.

Funding Projects

TypeCodeAcronymLeaderTitle
Government of SpainFIS2017-84151-PUnspecifiedUnspecifiedInteracción entre estructura y función en redes complejas: teoría, experimentos y aplicaciones
Government of SpainTIN2017-89244-RUnspecifiedUnspecifiedUnspecified

More information

Item ID: 67880
DC Identifier: https://oa.upm.es/67880/
OAI Identifier: oai:oa.upm.es:67880
Deposited by: Memoria Investigacion
Deposited on: 12 Jan 2022 08:51
Last Modified: 12 Jan 2022 08:51
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM