Comparative Study and Framework for Automated Summariser Evaluation: LangChain and Hybrid Algorithms
Automated Essay Score (AES) is proven to be one of the cutting-edge technologies. Scoring techniques are used for various purposes. Reliable scores are calculated based on influential variables. Such variables can be computed by different methods based on the domain. The research is concentrated on the user's understanding of a given topic. The analysis is based on a scoring index by using Large Language Models. The user can then compare and contrast the understanding of a topic that they recently learned. The results are then contributed towards learning analytics and progression is made for enhancing the learning ability. In this research, the focus is on summarizing a PDF document and gauging a user's understanding of its content. The process involves utilizing a Langchain tool to summarize the PDF and extract the essential information. By employing this technique, the research aims to determine how well the user comprehends the summarized content.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
A Proposition-Based Abstractive Summariser
Abstractive summarisation is not yet common amongst today{'}s deployed and research systems. Most existing systems either extract sentences or compress individual sentences. In this paper, we present a summariser that wo…
Language ModelingLanguage ModellingSentenceSentence CompressionCreation of an Evaluation Corpus and Baseline Evaluation Scores for Welsh Text Summarisation
As part of the effort to increase the availability of Welsh digital technology, this paper introduces the first human vs metrics Welsh summarisation evaluation results and dataset, which we provide freely for research pu…
Towards Abstractive Timeline Summarisation using Preference-based Reinforcement Learning
This paper introduces a novel pipeline for summarising timelines of events reported by multiple news sources. Transformer-based models for abstractive summarisation generate coherent and concise summaries of long documen…
reinforcement-learningReinforcement LearningReinforcement Learning (RL)