Automatic summary evaluation. Roug e modifications
Электронный научный архив УРФУ
Информация об архиве | Просмотр оригинала| Поле | Значение | |
| Заглавие |
Automatic summary evaluation. Roug e modifications
|
|
| Автор |
Ermakova, Liana
|
|
| Тематика |
ИНФОРМАТИКА
ИНФОРМАЦИОННЫЙ ПОИСК В ИНТЕРНЕТЕ ПОИСК ИНФОРМАЦИИ В ИНТЕРНЕТЕ КОНФЕРЕНЦИИ AUTOMATIC SUMMARY EVALUATION ROUGE SUMMARIZATION EDIT DISTANCE READABILITY SENTENCE ORDERING REDUNDANT INFORMATION |
|
| Описание |
Nowadays there is no common approach to summary. Manual evaluation is expensive and subjective and it is not applicable in real time or on a large corpus. Widely used approaches involve little human efforts and assume comparison with a set of reference summaries. We tried to overcome drawbacks of existing metrics such as ignoring redundant information, synonyms and sentence ordering. Our method combines edit distance, ROUGE-SU and trigrams similarity measure enriched by weights for different parts of speech and synonyms. Since nouns provide the most valuable information, each sentence is mapped into a set of nouns. If the normalized intersection of any pair is greater than a predefined threshold the sentences are penalized. Doing extracts there is no need to analyze sentence structure but sentence ordering is crucial. Sometimes it is impossible to compare sentence order with a gold standard. Therefore similarity between adjacent sentences may be used as a measure of text coherence. Chronological constraint violation should be penalized. Relevance score and readability assessment may be combined in the F-measure. In order to choose the best parameter values machine learning can be applied.
|
|
| Дата |
2012-11-13T11:26:43Z
2012-11-13T11:26:43Z 2012 |
|
| Тип |
Article
Journal article (info:eu-repo/semantics/article) Published version (info:eu-repo/semantics/publishedVersion) |
|
| Идентификатор |
Ermakova L. Automatic summary evaluation. Roug e modifications / L. Ermakova // VI Russian Summer School in Information Retrieval, August 6–10, 2012. Proceedings of the Sixth Russian Young Scientists Conference in Information Retrieval / B. Sokolov, P. Braslavski (Eds.). — Yaroslavl, 2012. — P. 58-70.
978-5-8397-0888-4 http://elar.urfu.ru/handle/10995/4561 |
|
| Язык |
en
|
|
| Связанные ресурсы |
RuSSIR 2012
|
|
| Формат |
193736 bytes
application/pdf |
|