From Synsets to Videos: Enriching ItalWordNet Multimodally
The paper describes the multimodal enrichment of ItalWordNet action verbsÂ’ entries by means of an automatic mapping with an ontology of action types instantiated by video scenes (ImagAct). The two resources present important differences as well as interesting complementary features, such that a mapping of these two resources can lead to a an enrichment of IWN, through the connection between synsets and videos apt to illustrate the meaning described by glosses. Here, we describe an approach inspired by ontology matching methods for the automatic mapping of ImagAct video scened onto ItalWordNet sense. The experiments described in the paper are conducted on Italian, but the same methodology can be extended to other languages for which WordNets have been created, since ImagAct is done also for English, Chinese and Spanish. This source of multimodal information can be exploited to design second language learning tools, as well as for language grounding in video action recognition and potentially for robotics.
Code (0)
등록된 구현이 없습니다.
Tasks
Action RecognitionLanguage AcquisitionOntology MatchingTemporal Action LocalizationSimilar Papers 제목 키워드 기반
Enriching a Portuguese WordNet using Synonyms from a Monolingual Dictionary
In this article we present an exploratory approach to enrich a WordNet-like lexical ontology with the synonyms present in a standard monolingual Portuguese dictionary. The dictionary was converted from PDF into XML and s…
Mapping WordNet synsets to Wikipedia articles
Lexical knowledge bases (LKBs), such as WordNet, have been shown to be useful for a range of language processing tasks. Extending these resources is an expensive and time-consuming process. This paper describes an approa…
ArticlesInformation RetrievalWord Sense DisambiguationTextual genre based approach to use WordNet in language-for-specific-purpose classroom as dictionary
When teaching language for specific purposes (LSP) linguistic resources are needed to help students understand and write specialised texts. As building a lexical resource is costly, we explore the use of wordnets to repr…
Can Topic Modelling benefit from Word Sense Information?
This paper proposes a new topic model that exploits word sense information in order to discover less redundant and more informative topics. Word sense information is obtained from WordNet and the discovered topics are gr…
A picture is worth a thousand words: Using OpenClipArt library for enriching IndoWordNet
WordNet has proved to be immensely useful for Word Sense Disambiguation, and thence Machine translation, Information Retrieval and Question Answering. It can also be used as a dictionary for educational purposes. The sem…
Information RetrievalMachine TranslationQuestion AnsweringRetrieval+1