Identifying Foreign Person Names in Chinese Text

Publication

In: Proc. of the 6th International Conference on Language Resources and Evaluation. International Conference on Language Resources and Evaluation (LREC-2008) 6th May 28-30 Marrakech Morocco ELRA 2008.

Abstract

Foreign name expressions written in Chinese characters are difficult to recognize since the sequence of characters represents the Chinese pronunciation of the name. This paper suggests that known English or German person names can reliably be identified on the basis of the similarity between the Chinese and the foreign pronunciation. In addition to locating a person name in the text and learning that it is foreign, the corresponding foreign name is identified, thus gaining precious additional information for cross-lingual applications. This idea is implemented as a statistical module into the rule-based shallow parsing system SProUT, forming the HyFex system.

The statistical component is invoked if a sequence of "trigger" characters is found that may correspond to a foreign name. Their phonetic Pinyin representation is produced and compared to the phonetic representations (SAMPA) of given foreign names, which are generated by the MARY TTS system for German and English pronunciations. This comparison is achieved by a hand-crafted metric that assigns costs to specific edit operations. The person name corresponding to the SAMPA representation with the lowest costs attached is returned as the most similar result, if a threshold is not exceeded. Our evaluation on publicly available data shows competitive results.

lrec08.pdf (pdf, 267 KB )

Identifying Foreign Person Names in Chinese Text

Abstract

Follow us on:

Editor

Newsletter

Locations