Dragon-Alpha&cu32: A Java-based Tensor Computing Framework With its High-Performance CUDA Library

2023-05-15 · Zhiyi Zhang, Pengfei Zhang, Qi Wang

Java is very powerful, but in Deep Learning field, its capabilities probably has not been sufficiently exploited. Compared to the Java-based deep-learning-frameworks, the Python-based (PyTorch, TensorFlow, etc) are undoubtedly the mainstream, due to their easy-to-use, flexibility and better ecosystem. Dragon-Alpha is a Java-based Tensor Computing Framework, with easy-to-use, high-scalability and high-performance, trying to break Java's dilemma in deep learning field and make it more effective. Dragon-Alpha supports different levels of APIs, and can be used as a deep-learning-framework through its user-friendly high-level APIs. Dragon-Alpha has potential to aggregate computing-power across heterogeneous platforms and devices, based on its multi-layer architecture and Java's big-data ecosystem. Dragon-Alpha has its asynchronized APIs to improve parallelism, and highly-optimized CUDA library cu32 which adopts unique convolution\deconvolution operators for small feature maps. The experiments show that, compared to PyTorch&cuDNN, Dragon-Alpha&cu32 costs less time and memory (75.38% to 97.32%, 29.2% to 66.4%), to train some typical neural networks (AlexNet, VGG, GoogleNet, ResNet) on Cifar-10.

📄 PDF Abstract BibTeX arXiv:2305.08819

Code (1)

gilgameshxyz123/dragon-alpha pytorch

Tasks

Deep Learning

Methods 이 논문이 사용한 방법론

Library 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Max Pooling Max Pooling is a pooling operation that calculates the maximum value for patches of a feature map, and uses it to create a downsampled (pooled) feature map. It is usually…

Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

WikiDragon: A Java Framework For Diachronic Content And Network Analysis Of MediaWikis

2018-05-01 · LREC 2018 5 · R{\"u}diger Gleim, Alex Mehler, er, Sung Y. Song

Named Entity Recognition (NER)Word Sense Disambiguation

TensorFlow.js: Machine Learning for the Web and Beyond

2019-01-16 · Daniel Smilkov, Nikhil Thorat, Yannick Assogba, Ann Yuan 외

TensorFlow.js is a library for building and executing machine learning algorithms in JavaScript. TensorFlow.js models run in a web browser and in the Node.js environment. The library is part of the TensorFlow ecosystem, …

BIG-bench Machine Learning

DRAGON (Differentiable Graph Execution) : A suite of Hardware Simulation and Optimization tools for Modern AI/Non-AI Workloads

2022-04-13 · Khushal Sethi

We introduce DRAGON, an open-source, fast and explainable hardware simulation and optimization toolchain that enables hardware architects to simulate hardware designs, and to optimize hardware designs to efficiently exec…

Discovering faster matrix multiplication algorithms with reinforcement learning

2022-10-05 · Nature 2022 10 · Alhussein Fawzi, Matej Balog, Aja Huang, Thomas Hubert 외

Improving the efficiency of algorithms for fundamental computations can have a widespread impact, as it can affect the overall speed of a large amount of computations. Matrix multiplication is one such primitive task, oc…

Deep Reinforcement Learning reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

OpenTensor: Reproducing Faster Matrix Multiplication Discovering Algorithms

2024-05-31 · Yiwen Sun, Wenye Li

OpenTensor is a reproduction of AlphaTensor, which discovered a new algorithm that outperforms the state-of-the-art methods for matrix multiplication by Deep Reinforcement Learning (DRL). While AlphaTensor provides a pro…

Deep Reinforcement Learning reinforcement-learning