AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuning

2024-10-10 · Muhammad Awais, Ali Husain Salem Abdulla Alharthi, Amandeep Kumar, Hisham Cholakkal, Rao Muhammad Anwer

Significant progress has been made in advancing large multimodal conversational models (LMMs), capitalizing on vast repositories of image-text data available online. Despite this progress, these models often encounter substantial domain gaps, hindering their ability to engage in complex conversations across new domains. Recent efforts have aimed to mitigate this issue, albeit relying on domain-specific image-text data to curate instruction-tuning data. However, many domains, such as agriculture, lack such vision-language data. In this work, we propose an approach to construct instruction-tuning data that harnesses vision-only data for the agriculture domain. We utilize diverse agricultural datasets spanning multiple domains, curate class-specific information, and employ large language models (LLMs) to construct an expert-tuning set, resulting in a 70k expert-tuning dataset called AgroInstruct. Subsequently, we expert-tuned and created AgroGPT, an efficient LMM that can hold complex agriculture-related conversations and provide useful insights. We also develop AgroEvals for evaluation and compare {AgroGPT's} performance with large open and closed-source models. {AgroGPT} excels at identifying fine-grained agricultural concepts, can act as an agriculture expert, and provides helpful information for multimodal agriculture questions. The code, datasets, and models are available at https://github.com/awaisrauf/agroGPT.

📄 PDF Abstract BibTeX arXiv:2410.08405

Code (1)

awaisrauf/agrogpt 공식 구현

Tasks

Language ModelingLanguage Modelling

Fine-Tuning General-Purpose Large Language Models for Agricultural Applications:A Reproducible Framework and Evaluation Protocol Based on Qwen3-8B

2026-06-27 · Zhaoyang Li, Ruijie Zhang, Jiaqi Liu, Zhaoji Sun arxiv

General-purpose large language models (LLMs) have demonstrated strong abilities in opendomain question answering, information extraction, and text generation. Agricultural applications, however, are domain-specific, regi…

parameter-efficient fine-tuning Information Extraction Question Answering Text Generation

Agri-R1: Agricultural Reasoning for Disease Diagnosis via Automated-Synthesis and Reinforcement Learning

2026-01-08 · Wentao Zhang, Mingkun Xu, Qi Zhang, Shangyang Li 외 arxiv

Agricultural disease diagnosis challenges VLMs, as conventional fine-tuning requires extensive labels, lacks interpretability, and generalizes poorly. While reasoning improves model robustness, existing methods rely on c…

Reinforcement Learning Domain Generalization

AgroBench: Vision-Language Model Benchmark in Agriculture

2025-07-28 · Risa Shinoda, Nakamasa Inoue, Hirokatsu Kataoka, Masaki Onishi 외 arxiv

Precise automated understanding of agricultural tasks such as disease identification is essential for sustainable crop production. Recent advances in vision-language models (VLMs) are expected to further expand the range…

Fine-Tuning and Evaluating Conversational AI for Agricultural Advisory

2026-02-06 · Sanyam Singh, Naga Ganesh, Vineet Singh, Lakshmi Pedapudi 외 arxiv

Large Language Models show promise for agricultural advisory, yet vanilla models exhibit unsupported recommendations, generic advice lacking specific, actionable detail, and communication styles misaligned with smallhold…

Fact Verification

PlantExpertVQA: A Visual Question Answering Dataset for Benchmarking Vision-Language Models in Plant Science

2025-08-23 · Syed Nazmus Sakib, Nafiul Haque, Mohammad Zabed Hossain, Shifat E. Arman arxiv

Existing plant-disease datasets target classification and detection, leaving vision-language models unable to support interactive, reasoning-based diagnosis. To address this, we present PlantExpertVQA, a large-scale visu…

parameter-efficient fine-tuning Visual Question Answering Domain Adaptation