Automatic question generation for propositional logical equivalences
The increase in academic dishonesty cases among college students has raised concern, particularly due to the shift towards online learning caused by the pandemic. We aim to develop and implement a method capable of generating tailored questions for each student. The use of Automatic Question Generation (AQG) is a possible solution. Previous studies have investigated AQG frameworks in education, which include validity, user-defined difficulty, and personalized problem generation. Our new AQG approach produces logical equivalence problems for Discrete Mathematics, which is a core course for year-one computer science students. This approach utilizes a syntactic grammar and a semantic attribute system through top-down parsing and syntax tree transformations. Our experiments show that the difficulty level of questions generated by our AQG approach is similar to the questions presented to students in the textbook [1]. These results confirm the practicality of our AQG approach for automated question generation in education, with the potential to significantly enhance learning experiences.
Code (0)
등록된 구현이 없습니다.
Tasks
AttributeQuestion GenerationQuestion-GenerationSimilar Papers 제목 키워드 기반
LFC-DA: Logical Formula-Controlled Data Augmentation for Enhanced Logical Reasoning
For complex logical data augmentation, heavy reliance on human annotation is costly, whereas direct generation with large language models yields uninterpretable and logically homogeneous examples. To address this, we pre…
Data AugmentationLogical ReasoningImproving RAG Retrieval via Propositional Content Extraction: a Speech Act Theory Approach
When users formulate queries, they often include not only the information they seek, but also pragmatic markers such as interrogative phrasing or polite requests. Although these speech act indicators communicate the user…
RAGRetrievalRetrieval-augmented GenerationSemantic Similarity+1Towards a Mechanistic Understanding of Propositional Logical Reasoning in Large Language Models
Understanding how Large Language Models (LLMs) perform logical reasoning internally remains a fundamental challenge. While prior mechanistic studies focus on identifying taskspecific circuits, they leave open the questio…
Logical ReasoningSPICE: Semantic Propositional Image Caption Evaluation
There is considerable interest in the task of automatically generating image captions. However, evaluation is challenging. Existing automatic evaluation metrics are primarily sensitive to n-gram overlap, which is neither…
Image CaptioningDisentangling Logic: The Role of Context in Large Language Model Reasoning Capabilities
This study intends to systematically disentangle pure logic reasoning and text understanding by investigating the contrast across abstract and contextualized logical problems from a comprehensive set of domains. We explo…
Language ModelingLanguage ModellingLarge Language ModelLogical Reasoning