paper-with-me

홈 › Papers

FreeTxt-Vi: A Benchmarked Vietnamese-English Toolkit for Segmentation, Sentiment, and Summarisation

2026-03-05 · Hung Nguyen Huy, Mo El-Haj, Dawn Knight, Paul Rayson arxiv

FreeTxt-Vi is a free and open source web based toolkit for creating and analysing bilingual Vietnamese English text collections. Positioned at the intersection of corpus linguistics and natural language processing NLP it enables users to build explore and interpret free text data without requiring programming expertise. The system combines corpus analysis features such as concordancing keyword analysis word relation exploration and interactive visualisation with transformer based NLP components for sentiment analysis and summarisation. A key contribution of this work is the design of a unified bilingual NLP pipeline that integrates a hybrid VnCoreNLP and Byte Pair Encoding BPE segmentation strategy a fine tuned TabularisAI sentiment classifier and a fine tuned Qwen2.5 model for abstractive summarisation. Unlike existing text analysis platforms FreeTxt Vi is evaluated as a set of language processing components. We conduct a three part evaluation covering segmentation sentiment analysis and summarisation and show that our approach achieves competitive or superior performance compared to widely used baselines in both Vietnamese and English. By reducing technical barriers to multilingual text analysis FreeTxt Vi supports reproducible research and promotes the development of language resources for Vietnamese a widely spoken but underrepresented language in NLP. The toolkit is applicable to domains including education digital humanities cultural heritage and the social sciences where qualitative text data are common but often difficult to process at scale.

📄 PDF Abstract BibTeX arXiv:2603.05690

Code (0)

등록된 구현이 없습니다.

Tasks

Sentiment Analysis

Similar Papers 제목 키워드 기반

State-of-the-Art Vietnamese Word Segmentation

2019-06-18 · Song Nguyen Duc Cong, Quoc Hung Ngo, Rachsuda Jiamthapthaksin

Word segmentation is the first step of any tasks in Vietnamese language processing. This paper reviews stateof-the-art approaches and systems for word segmentation in Vietnamese. To have an overview of all stages from bu…

BIG-bench Machine LearningSegmentationVietnamese Word Segmentation

Is word segmentation necessary for Vietnamese sentiment classification?

2023-01-01 · Duc-Vu Nguyen, Ngan Luu-Thuy Nguyen

To the best of our knowledge, this paper made the first attempt to answer whether word segmentation is necessary for Vietnamese sentiment classification. To do this, we presented five pre-trained monolingual S4- based la…

ClassificationSegmentationSentiment AnalysisSentiment Classification

A Feature-Rich Vietnamese Named-Entity Recognition Model

2018-03-12 · Pham Quang Nhat Minh

In this paper, we present a feature-based named-entity recognition (NER) model that achieves the start-of-the-art accuracy for Vietnamese language. We combine word, word-shape features, PoS, chunk, Brown-cluster-based fe…

Chunkingmodelnamed-entity-recognitionNamed Entity Recognition+5

CanVEC - the Canberra Vietnamese-English Code-switching Natural Speech Corpus

2020-05-01 · LREC 2020 5 · Li Nguyen, Christopher Bryant

This paper introduces the Canberra Vietnamese-English Code-switching corpus (CanVEC), an original corpus of natural mixed speech that we semi-automatically annotated with language information, part of speech (POS) tags a…

POS

VnCoreNLP: A Vietnamese Natural Language Processing Toolkit

2018-01-04 · NAACL 2018 6 · Thanh Vu, Dat Quoc Nguyen, Dai Quoc Nguyen, Mark Dras 외

We present an easy-to-use and fast toolkit, namely VnCoreNLP---a Java NLP annotation pipeline for Vietnamese. Our VnCoreNLP supports key natural language processing (NLP) tasks including word segmentation, part-of-speech…

Dependency Parsingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+5