Meta Semantics: Towards better natural language understanding and reasoning

2023-04-20 · Xiaolin Hu

Natural language understanding is one of the most challenging topics in artificial intelligence. Deep neural network methods, particularly large language module (LLM) methods such as ChatGPT and GPT-3, have powerful flexibility to adopt informal text but are weak on logical deduction and suffer from the out-of-vocabulary (OOV) problem. On the other hand, rule-based methods such as Mathematica, Semantic web, and Lean, are excellent in reasoning but cannot handle the complex and changeable informal text. Inspired by pragmatics and structuralism, we propose two strategies to solve the OOV problem and a semantic model for better natural language understanding and reasoning.

📄 PDF Abstract BibTeX arXiv:2304.10663

Code (0)

등록된 구현이 없습니다.

Tasks

Natural Language Understanding

Methods 이 논문이 사용한 방법론

{Dispute@FaQ-s}How to file a dispute with Expedia? How to file a dispute with Expedia? To file a complaint against Expedia, first try contacting their customer service directly. You can reach them by phone at…

15 Ways to Contact How can i speak to someone at Delta Airlines 설명 없음

Multi-Head Attention 설명 없음

Attention 설명 없음

Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Adam 설명 없음

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Semantics-Aware Inferential Network for Natural Language Understanding

2020-04-28 · Shuailiang Zhang, Hai Zhao, Junru Zhou

For natural language understanding tasks, either machine reading comprehension or natural language inference, both semantics-aware and inference are favorable features of the concerned modeling for better understanding p…

Machine Reading Comprehension Natural Language Inference Natural Language Understanding Reading Comprehension

A Metamodel and Framework for Artificial General Intelligence From Theory to Practice

2021-02-11 · Hugo Latapie, Ozkan Kilic, Gaowen Liu, Yan Yan 외

This paper introduces a new metamodel-based knowledge representation that significantly improves autonomous learning and adaptation. While interest in hybrid machine learning / symbolic AI systems leveraging, for example…

BIG-bench Machine Learning Federated Learning Hybrid Machine Learning Knowledge Graphs+3

Fusing Audio and Metadata Embeddings Improves Language-based Audio Retrieval

2024-06-22 · Paul Primus, Gerhard Widmer

Matching raw audio signals with textual descriptions requires understanding the audio's content and the description's semantics and then drawing connections between the two modalities. This paper investigates a hybrid re…

AudioCaps Retrieval

Learning Meta-Embeddings by Using Ensembles of Embedding Sets

2015-08-18 · Wenpeng Yin, Hinrich Schütze

Word embeddings -- distributed representations of words -- in deep learning are beneficial for many tasks in natural language processing (NLP). However, different embedding sets vary greatly in quality and characteristic…

Part-Of-Speech Tagging Word Embeddings Word Similarity

MetaSRL++: A Uniform Scheme for Modelling Deeper Semantics

2023-05-16 · Fritz Hohl, Nianheng Wu, Martina Galetti, Remi van Trijp

Despite enormous progress in Natural Language Processing (NLP), our field is still lacking a common deep semantic representation scheme. As a result, the problem of meaning and understanding is typically sidestepped thro…