paper-with-me

홈 › Papers

Gorilla: Large Language Model Connected with Massive APIs

2023-05-24 · Shishir G. Patil, Tianjun Zhang, Xin Wang, Joseph E. Gonzalez

Large Language Models (LLMs) have seen an impressive wave of advances recently, with models now excelling in a variety of tasks, such as mathematical reasoning and program synthesis. However, their potential to effectively use tools via API calls remains unfulfilled. This is a challenging task even for today's state-of-the-art LLMs such as GPT-4, largely due to their inability to generate accurate input arguments and their tendency to hallucinate the wrong usage of an API call. We release Gorilla, a finetuned LLaMA-based model that surpasses the performance of GPT-4 on writing API calls. When combined with a document retriever, Gorilla demonstrates a strong capability to adapt to test-time document changes, enabling flexible user updates or version changes. It also substantially mitigates the issue of hallucination, commonly encountered when prompting LLMs directly. To evaluate the model's ability, we introduce APIBench, a comprehensive dataset consisting of HuggingFace, TorchHub, and TensorHub APIs. The successful integration of the retrieval system with Gorilla demonstrates the potential for LLMs to use tools more accurately, keep up with frequently updated documentation, and consequently increase the reliability and applicability of their outputs. Gorilla's code, model, data, and demo are available at https://gorilla.cs.berkeley.edu

📄 PDF Abstract BibTeX arXiv:2305.15334

Code (1)

ShishirPatil/gorilla 공식 구현 tf

Tasks

HallucinationLanguage ModelingLanguage ModellingLarge Language ModelMathematical ReasoningmodelProgram SynthesisRetrieval

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음

Similar Papers 제목 키워드 기반

The speciation of Australopithecus and Paranthropus was caused by introgression from the Gorilla lineage

2018-08-21

The discovery of Paranthropus deyiremeda in 3.3-3.5 million year old fossil sites in Afar (Haile-Selassie, 2015), together with 30% of the gorilla genome showing lineage sorting between humans and chimpanzees (Scally, 20…

Global Open Resources and Information for Language and Linguistic Analysis (GORILLA)

2016-05-01 · LREC 2016 5 · Damir Cavar, Malgorzata Cavar, Lwin Moe

The infrastructure Global Open Resources and Information for Language and Linguistic Analysis (GORILLA) was created as a resource that provides a bridge between disciplines such as documentary, theoretical, and corpus li…

GorillaWatch: An Automated System for In-the-Wild Gorilla Re-Identification and Population Monitoring

2025-12-08 · Maximilian Schall, Felix Leonard Knöfel, Noah Elias König, Jan Jonas Kubeler 외 arxiv

Monitoring critically endangered western lowland gorillas is currently hampered by the immense manual effort required to re-identify individuals from vast archives of camera trap footage. The primary obstacle to automati…

Multi-Object Tracking

Querying Databases with Function Calling

2025-01-23 · Connor Shorten, Charles Pierse, Thomas Benjamin Smith, Karel D'Oosterlinck 외

The capabilities of Large Language Models (LLMs) are rapidly accelerating largely thanks to their integration with external tools. Querying databases is among the most effective of these integrations, enabling LLMs to ac…

Hominin evolution was caused by introgression from Gorilla

2018-10-02 · Johan Nygren

The discovery of Paranthropus deyiremeda in 3.3-3.5 million year old fossil sites in Afar, together with 30% of the gorilla genome showing lineage sorting between humans and chimpanzees, and a NUMT ("nuclear mitochondria…