paper-with-me

Papers

CNTK: Microsoft's Open-Source Deep-Learning Toolkit

2016-08-01 · ACM SIGKDD 2016 8 · Frank Seide, Amit Agarwal

This tutorial will introduce the Computational Network Toolkit, or CNTK, Microsoft's cutting-edge open-source deep-learning toolkit for Windows and Linux. CNTK is a powerful computation-graph based deep-learning toolkit for training and evaluating deep neural networks. Microsoft product groups use CNTK, for example to create the Cortana speech models and web ranking. CNTK supports feed-forward, convolutional, and recurrent networks for speech, image, and text workloads, also in combination. Popular network types are supported either natively (convolution) or can be described as a CNTK configuration (LSTM, sequence-to-sequence). CNTK scales to multiple GPU servers and is designed around efficiency. The tutorial will give an overview of CNTK's general architecture and describe the specific methods and algorithms used for automatic differentiation, recurrent-loop inference and execution, memory sharing, on-the-fly randomization of large corpora, and multi-server parallelization. We will then show how typical uses looks like for relevant tasks like image recognition, sequence-to-sequence modeling, and speech recognition.

📄 PDF Abstract BibTeX

Code (1)

Microsoft/CNTK tf

Tasks

ClusteringDeep LearningDimensionality ReductionGeneral ClassificationGPUspeech-recognition

Similar Papers 제목 키워드 기반

A detailed comparative study of open source deep learning frameworks

2019-02-25 · Ghadeer Al-Bdour, Raffi Al-Qurran, Mahmoud Al-Ayyoub, Ali Shatnawi

Deep Learning (DL) is one of the hottest trends in machine learning as DL approaches produced results superior to the state-of-the-art in problematic areas such as image processing and natural language processing (NLP). …

Deep Learning

DyNet: The Dynamic Neural Network Toolkit

2017-01-15 · Graham Neubig, Chris Dyer, Yoav Goldberg, Austin Matthews 외

We describe DyNet, a toolkit for implementing neural network models based on dynamic declaration of network structure. In the static declaration strategy that is used in toolkits like Theano, CNTK, and TensorFlow, the us…

graph construction

Microsoft Icecaps: An Open-Source Toolkit for Conversation Modeling

2019-07-01 · ACL 2019 7 · Vighnesh Leonardo Shiv, Chris Quirk, Anshuman Suri, Xiang Gao 외

The Intelligent Conversation Engine: Code and Pre-trained Systems (Microsoft Icecaps) is an upcoming open-source natural language processing repository. Icecaps wraps TensorFlow functionality in a modular component-based…

Language ModelingLanguage ModellingResponse Generation

UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

2024-06-10 · Shivani Upadhyay, Ronak Pradeep, Nandan Thakur, Nick Craswell 외

Copious amounts of relevance judgments are necessary for the effective training and accurate evaluation of retrieval systems. Conventionally, these judgments are made by human assessors, rendering this process expensive …

RAGRetrieval

On-the-fly Operation Batching in Dynamic Computation Graphs

2017-05-22 · NeurIPS 2017 12 · Graham Neubig, Yoav Goldberg, Chris Dyer

Dynamic neural network toolkits such as PyTorch, DyNet, and Chainer offer more flexibility for implementing models that cope with data of varying dimensions and structure, relative to toolkits that operate on statically …