paper-with-me

홈 › Papers

The Effective Depth Paradox: Evaluating the Relationship between Architectural Topology and Trainability in Deep CNNs

2026-02-09 · Manfred M. Fischer, Joshua Pitts arxiv

This paper investigates the relationship between convolutional neural network (CNN) topology and image recognition performance through a comparative study of the VGG, ResNet, and GoogLeNet architectural families. Utilizing a unified experimental framework, the study isolates the impact of depth from confounding implementation variables. A formal distinction is introduced between nominal depth ($D_{\mathrm{nom}}$), representing the physical layer count, and effective depth ($D_{\mathrm{eff}}$), an operational metric quantifying the expected number of sequential transformations. Empirical results demonstrate that architectures utilizing identity shortcuts or branching modules maintain optimization stability by decoupling $D_{\mathrm{eff}}$ from $D_{\mathrm{nom}}$. These findings suggest that effective depth serves as a superior framework for predicting scaling potential and practical trainability, ultimately indicating that architectural topology - rather than sheer layer volume - is the primary determinant of gradient health in deep learning models.

📄 PDF Abstract BibTeX arXiv:2602.13298

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Sowing the Wind, Reaping the Whirlwind: The Impact of Editing Language Models

2024-01-19 · Rima Hazra, Sayan Layek, Somnath Banerjee, Soujanya Poria

In the rapidly advancing field of artificial intelligence, the concept of Red-Teaming or Jailbreaking large language models (LLMs) has emerged as a crucial area of study. This approach is especially significant in terms …

Model EditingRed Teaming

The Perfection Paradox: From Architect to Curator in AI-Assisted API Design

2026-03-12 · Mak Ahmad, Andrew Macvean, JJ Geewax, David Karger arxiv

Enterprise API design is often bottlenecked by the tension between rapid feature delivery and the rigorous maintenance of usability standards. We present an industrial case study evaluating an AI-assisted design workflow…

GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation

2020-12-13 · Xiaojuan Qi, Zhengzhe Liu, Renjie Liao, Philip H. S. Torr 외

In this paper, we propose a geometric neural network with edge-aware refinement (GeoNet++) to jointly predict both depth and surface normal maps from a single image. Building on top of two-stream CNNs, GeoNet++ captures …

3D ReconstructionDepth EstimationDepth PredictionSurface Normal Estimation

Simpson's Paradox and the Accuracy-Fluency Tradeoff in Translation

2024-02-20 · Zheng Wei Lim, Ekaterina Vylomova, Trevor Cohn, Charles Kemp

A good translation should be faithful to the source and should respect the norms of the target language. We address a theoretical puzzle about the relationship between these objectives. On one hand, intuition and some pr…

SentenceTranslation

The VLLM Safety Paradox: Dual Ease in Jailbreak Attack and Defense

2024-11-13 · Yangyang Guo, Fangkai Jiao, Liqiang Nie, Mohan Kankanhalli

The vulnerability of Vision Large Language Models (VLLMs) to jailbreak attacks appears as no surprise. However, recent defense mechanisms against these attacks have reached near-saturation performance on benchmark evalua…