paper-with-me

Papers

LB-CNN: An Open Source Framework for Fast Training of Light Binary Convolutional Neural Networks using Chainer and Cupy

2021-06-25 · Radu Dogaru, Ioana Dogaru

Light binary convolutional neural networks (LB-CNN) are particularly useful when implemented in low-energy computing platforms as required in many industrial applications. Herein, a framework for optimizing compact LB-CNN is introduced and its effectiveness is evaluated. The framework is freely available and may run on free-access cloud platforms, thus requiring no major investments. The optimized model is saved in the standardized .h5 format and can be used as input to specialized tools for further deployment into specific technologies, thus enabling the rapid development of various intelligent image sensors. The main ingredient in accelerating the optimization of our model, particularly the selection of binary convolution kernels, is the Chainer/Cupy machine learning library offering significant speed-ups for training the output layer as an extreme-learning machine. Additional training of the output layer using Keras/Tensorflow is included, as it allows an increase in accuracy. Results for widely used datasets including MNIST, GTSRB, ORL, VGG show very good compromise between accuracy and complexity. Particularly, for face recognition problems a carefully optimized LB-CNN model provides up to 100% accuracies. Such TinyML solutions are well suited for industrial applications requiring image recognition with low energy consumption.

📄 PDF Abstract BibTeX arXiv:2106.15350

Code (1)

radu-dogaru/LB-CNN-compact-and-fast-binary-including-very-fast-ELM 공식 구현

Tasks

Face Recognition

Methods 이 논문이 사용한 방법론

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

wav2letter++: The Fastest Open-source Speech Recognition System

2018-12-18 · Vineel Pratap, Awni Hannun, Qiantong Xu, Jeff Cai 외

This paper introduces wav2letter++, the fastest open-source deep learning speech recognition framework. wav2letter++ is written entirely in C++, and uses the ArrayFire tensor library for maximum efficiency. Here we expla…

Speech Recognition

FastCLIP: A Suite of Optimization Techniques to Accelerate CLIP Training with Limited Resources

2024-07-01 · Xiyuan Wei, Fanjiang Ye, Ori Yonay, Xingyu Chen 외

Existing studies of training state-of-the-art Contrastive Language-Image Pretraining (CLIP) models on large-scale data involve hundreds of or even thousands of GPUs due to the requirement of a large batch size. However, …

SpecForge: A Flexible and Efficient Open-Source Training Framework for Speculative Decoding

2026-03-19 · Shenggui Li, Chao Wang, Yikai Zhu, Yubo Wang 외 arxiv

Large language models incur high inference latency due to sequential autoregressive decoding. Speculative decoding alleviates this bottleneck by using a lightweight draft model to propose multiple tokens for batched veri…

FLAML: A Fast and Lightweight AutoML Library

2019-11-12 · Chi Wang, Qingyun Wu, Markus Weimer, Erkang Zhu

We study the problem of using low computational cost to automate the choices of learners and hyperparameters for an ad-hoc training dataset and error metric, by conducting trials of different configurations on the given …

AutoMLHyperparameter Optimization

Self-Rewarding Rubric-Based Reinforcement Learning for Open-Ended Reasoning

2025-09-19 · Zhiling Ye, Yun Yue, Haowen Wang, Xudong Han 외 arxiv

Open-ended evaluation is essential for deploying large language models in real-world settings. In studying HealthBench, we observe that using the model itself as a grader and generating rubric-based reward signals substa…

Reinforcement Learning