paper-with-me

홈 › Papers

Neither hype nor gloom do DNNs justice

2023-12-08 · Felix A. Wichmann, Simon Kornblith, Robert Geirhos

Neither the hype exemplified in some exaggerated claims about deep neural networks (DNNs), nor the gloom expressed by Bowers et al. do DNNs as models in vision science justice: DNNs rapidly evolve, and today's limitations are often tomorrow's successes. In addition, providing explanations as well as prediction and image-computability are model desiderata; one should not be favoured at the expense of the other.

📄 PDF Abstract BibTeX arXiv:2312.05355

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
RAdam 설명 없음
Graph Self-Attention 설명 없음
HypE Hyperboloid Embeddings (HypE) is a novel self-supervised dynamic reasoning framework, that utilizes positive first-order existential queries on a KG to learn representations of…

Similar Papers 제목 키워드 기반

Neural Network Topologies for Sparse Training

2018-09-14 · Ryan A. Robinett, Jeremy Kepner

The sizes of deep neural networks (DNNs) are rapidly outgrowing the capacity of hardware to store and train them. Research over the past few decades has explored the prospect of sparsifying DNNs before, during, and after…

RadiX-Net: Structured Sparse Matrices for Deep Neural Networks

2019-04-30 · Ryan A. Robinett, Jeremy Kepner

The sizes of deep neural networks (DNNs) are rapidly outgrowing the capacity of hardware to store and train them. Research over the past few decades has explored the prospect of sparsifying DNNs before, during, and after…

Fast Hyperparameter Optimization of Deep Neural Networks via Ensembling Multiple Surrogates

2018-11-06 · Yang Li, Jiawei Jiang, Yingxia Shao, Bin Cui

The performance of deep neural networks crucially depends on good hyperparameter configurations. Bayesian optimization is a powerful framework for optimizing the hyperparameters of DNNs. These methods need sufficient eva…

Bayesian OptimizationHyperparameter Optimization

Data Justice Stories: A Repository of Case Studies

2022-04-06 · David Leslie, Morgan Briggs, Antonella Perini, Smera Jayadeva 외

The idea of "data justice" is of recent academic vintage. It has arisen over the past decade in Anglo-European research institutions as an attempt to bring together a critique of the power dynamics that underlie accelera…

Stochastic Gradient Descent with Nonlinear Conjugate Gradient-Style Adaptive Momentum

2020-12-03 · Bao Wang, Qiang Ye

Momentum plays a crucial role in stochastic gradient-based optimization algorithms for accelerating or improving training deep neural networks (DNNs). In deep learning practice, the momentum is usually weighted by a well…

Adversarial Robustness