paper-with-me

Papers

Platform for Situated Intelligence

2021-03-29 · Dan Bohus, Sean Andrist, Ashley Feniello, Nick Saw, Mihai Jalobeanu, Patrick Sweeney, Anne Loomis Thompson, Eric Horvitz

We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems. The framework provides infrastructure for sensing, fusing, and making inferences from temporal streams of data across different modalities, a set of tools that enable visualization and debugging, and an ecosystem of components that encapsulate a variety of perception and processing technologies. These assets jointly provide the means for rapidly constructing and refining multimodal, integrative-AI systems, while retaining the efficiency and performance characteristics required for deployment in open-world settings.

📄 PDF Abstract BibTeX arXiv:2103.15975

Code (1)

microsoft/psi 공식 구현

Similar Papers 제목 키워드 기반

Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence

2020-10-12 · Sean Andrist, Dan Bohus

We describe Platform for Situated Intelligence, an open-source framework for multimodal, integrative-AI systems. The framework provides infrastructure, tools, and components that enable and accelerate the development of …

Embodied, Situated, and Grounded Intelligence: Implications for AI

2022-10-24 · Tyler Millhouse, Melanie Moses, Melanie Mitchell

In April of 2022, the Santa Fe Institute hosted a workshop on embodied, situated, and grounded intelligence as part of the Institute's Foundations of Intelligence project. The workshop brought together computer scientist…

SIMMC: Situated Interactive Multi-Modal Conversational Data Collection And Evaluation Platform

2019-11-07 · Paul A. Crook, Shivani Poddar, Ankita De, Semir Shafi 외

As digital virtual assistants become ubiquitous, it becomes increasingly important to understand the situated behaviour of users as they interact with these assistants. To this end, we introduce SIMMC, an extension to Pa…

AI AgentUnity

A Paradigm for Situated and Goal-Driven Language Learning

2016-10-12 · Jon Gauthier, Igor Mordatch

A distinguishing property of human intelligence is the ability to flexibly use language in order to communicate complex ideas with other humans in a variety of contexts. Research in natural language dialogue should focus…

Mars: Situated Inductive Reasoning in an Open-World Environment

2024-10-10 · Xiaojuan Tang, Jiaqi Li, Yitao Liang, Song-Chun Zhu 외

Large Language Models (LLMs) trained on massive corpora have shown remarkable success in knowledge-intensive tasks. Yet, most of them rely on pre-stored knowledge. Inducing new general knowledge from a specific environme…

Decision MakingGeneral Knowledge