paper-with-me

Papers

Musical Chair: Efficient Real-Time Recognition Using Collaborative IoT Devices

2018-02-05 · Ramyad Hadidi, Jiashen Cao, Matthew Woodward, Michael S. Ryoo, Hyesoon Kim

The prevalence of Internet of things (IoT) devices and abundance of sensor data has created an increase in real-time data processing such as recognition of speech, image, and video. While currently such processes are offloaded to the computationally powerful cloud system, a localized and distributed approach is desirable because (i) it preserves the privacy of users and (ii) it omits the dependency on cloud services. However, IoT networks are usually composed of resource-constrained devices, and a single device is not powerful enough to process real-time data. To overcome this challenge, we examine data and model parallelism for such devices in the context of deep neural networks. We propose Musical Chair to enable efficient, localized, and dynamic real-time recognition by harvesting the aggregated computational power from the resource-constrained devices in the same IoT network as input sensors. Musical chair adapts to the availability of computing devices at runtime and adjusts to the inherit dynamics of IoT networks. To demonstrate Musical Chair, on a network of Raspberry PIs (up to 12) each connected to a camera, we implement a state-of-the-art action recognition model for videos and two recognition models for images. Compared to the Tegra TX2, an embedded low-power platform with a six-core CPU and a GPU, our distributed action recognition system achieves not only similar energy consumption but also twice the performance of the TX2. Furthermore, in image recognition, Musical Chair achieves similar performance and saves dynamic energy.

📄 PDF Abstract BibTeX arXiv:1802.02138

Code (0)

등록된 구현이 없습니다.

Tasks

Action RecognitionCPUGPUTemporal Action Localization

Similar Papers 제목 키워드 기반

Multi-Player Bandits -- a Musical Chairs Approach

2015-12-09 · Jonathan Rosenski, Ohad Shamir, Liran Szlak

We consider a variant of the stochastic multi-armed bandit problem, where multiple players simultaneously choose from the same set of arms and may collide, receiving no reward. This setting has been motivated by problems…

Continuous and Simultaneous Gesture and Posture Recognition for Commanding a Robotic Wheelchair; Towards Spotting the Signal Patterns

2015-12-02 · Ali Boyali, Naohisa Hashimoto, Manolya Kavakli

Spotting signal patterns with varying lengths has been still an open problem in the literature. In this study, we describe a signal pattern recognition approach for continuous and simultaneous classification of a tracked…

ClusteringGeneral ClassificationSparse Representation-based Classification

Revival: Collaborative Artistic Creation through Human-AI Interactions in Musical Creativity

2025-01-19 · Keon Ju M. Lee, Philippe Pasquier, Jun Yuri

Revival is an innovative live audiovisual performance and music improvisation by our artist collective K-Phi-A, blending human and AI musicianship to create electronic music with audio-reactive visuals. The performance f…

Musical Agent Systems: MACAT and MACataRT

2025-01-19 · Keon Ju M. Lee, Philippe Pasquier

Our research explores the development and application of musical agents, human-in-the-loop generative AI systems designed to support music performance and improvisation within co-creative spaces. We introduce MACAT and M…

MirBot: A collaborative object recognition system for smartphones using convolutional neural networks

2017-06-09 · Antonio Pertusa, Antonio-Javier Gallego, Marisa Bernabeu

MirBot is a collaborative application for smartphones that allows users to perform object recognition. This app can be used to take a photograph of an object, select the region of interest and obtain the most likely clas…

image-classificationImage ClassificationObjectObject Recognition+1