paper-with-me

Papers

A Survey on the Applications of Frontier AI, Foundation Models, and Large Language Models to Intelligent Transportation Systems

2024-01-12 · Mohamed R. Shoaib, Heba M. Emara, Jun Zhao

This survey paper explores the transformative influence of frontier AI, foundation models, and Large Language Models (LLMs) in the realm of Intelligent Transportation Systems (ITS), emphasizing their integral role in advancing transportation intelligence, optimizing traffic management, and contributing to the realization of smart cities. Frontier AI refers to the forefront of AI technology, encompassing the latest advancements, innovations, and experimental techniques in the field, especially AI foundation models and LLMs. Foundation models, like GPT-4, are large, general-purpose AI models that provide a base for a wide range of applications. They are characterized by their versatility and scalability. LLMs are obtained from finetuning foundation models with a specific focus on processing and generating natural language. They excel in tasks like language understanding, text generation, translation, and summarization. By leveraging vast textual data, including traffic reports and social media interactions, LLMs extract critical insights, fostering the evolution of ITS. The survey navigates the dynamic synergy between LLMs and ITS, delving into applications in traffic management, integration into autonomous vehicles, and their role in shaping smart cities. It provides insights into ongoing research, innovations, and emerging trends, aiming to inspire collaboration at the intersection of language, intelligence, and mobility for safer, more efficient, and sustainable transportation systems. The paper further surveys interactions between LLMs and various aspects of ITS, exploring roles in traffic management, facilitating autonomous vehicles, and contributing to smart city development, while addressing challenges brought by frontier AI and foundation models. This paper offers valuable inspiration for future research and innovation in the transformative domain of intelligent transportation.

📄 PDF Abstract BibTeX arXiv:2401.06831

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesManagementText Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Residual Connection 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Low-Rank Adaptation for Foundation Models: A Comprehensive Review

2024-12-31 · Menglin Yang, Jialin Chen, Yifei Zhang, Jiahong Liu 외

The rapid advancement of foundation modelslarge-scale neural networks trained on diverse, extensive datasetshas revolutionized artificial intelligence, enabling unprecedented advancements across domains such as natural l…

scientific discoverySurvey

Advancing Financial Engineering with Foundation Models: Progress, Applications, and Challenges

2025-07-07 · Liyuan Chen, Shuoling Liu, Jiangpeng Yan, Xiaoyu Wang 외 arxiv

The advent of foundation models (FMs), large-scale pre-trained models with strong generalization capabilities, has opened new frontiers for financial engineering. While general-purpose FMs such as GPT-4 and Gemini have d…

Multimodal Reasoning

A Survey of Reinforcement Learning for Large Reasoning Models

2025-09-10 · Kaiyan Zhang, Yuxin Zuo, Bingxiang He, Youbang Sun 외 arxiv

In this paper, we survey recent advances in Reinforcement Learning (RL) for reasoning with Large Language Models (LLMs). RL has achieved remarkable success in advancing the frontier of LLM capabilities, particularly in a…

Reinforcement Learning

A Survey on Efficient Vision-Language-Action Models

2025-10-27 · Zhaoshu Yu, Bo Wang, Pengpeng Zeng, Haonan Zhang 외 arxiv

Vision-Language-Action models (VLAs) represent a significant frontier in embodied intelligence, aiming to bridge digital knowledge with physical-world interaction. Despite their remarkable performance, foundational VLAs …

Model Compression

A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers

2023-06-03 · Xiaoyan Zhao, Yang Deng, Min Yang, Lingzhi Wang 외

Relation extraction (RE) involves identifying the relations between entities from underlying content. RE serves as the foundation for many natural language processing (NLP) and information retrieval applications, such as…

Information RetrievalKnowledge Graph CompletionQuestion AnsweringRelation+4