Skip to content

314rated/notes

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

37 Commits
 
 
 
 
 
 

Repository files navigation

Project Introduction Project Introduction

notes: Notes of Deep Learning

Category


Background knowledge


Computer Vision

  • Deep Residual Learning for Image Recognition (2015, 12)

Natural Language Processing

  • Convolutional Neural Networks for Sentence Classification (2014. 8)
  • Neural Machine Translation by Jointly Learning to Align and Translate (2014. 9)
  • Text Understanding from Scratch (2015. 2)
    • CNN, Character-level
    • arXiv
  • Ask Me Anything: Dynamic Memory Networks for Natural Language Processing (2015. 6)
  • Pointer Networks (2015. 6)
    • Seq2Seq, Attention, Combinatorial
    • arXiv | note
  • Skip-Thought Vectors (2015. 6)
  • A Neural Conversational Model (2015. 6)
    • Seq2Seq, Conversation
    • arXiv
  • Teaching Machines to Read and Comprehend (2015. 6)
  • Effective Approaches to Attention-based Neural Machine Translation (2015. 8)
  • Character-Aware Neural Language Models (2015. 8)
    • CNN, Character-level
    • arXiv
  • Neural Machine Translation of Rare Words with Subword Units (2015. 8)
    • Out-Of-Vocabulary, Translation
    • arXiv | note
  • A Diversity-Promoting Objective Function for Neural Conversation Models (2015. 10)
  • Multi-task Sequence to Sequence Learning (2015. 11)
  • Multilingual Language Processing From Bytes (2015. 12)
    • Byte-to-Span, Multilingual, Seq2Seq
    • arXiv | note
  • Strategies for Training Large Vocabulary Neural Language Models (2015. 12)
    • Vocabulary, Softmax, NCE, Self Normalization
    • arXiv | note
  • Recurrent Memory Networks for Language Modeling (2016. 1)
  • Exploring the Limits of Language Modeling (2016. 2)
    • Google Brain, Language Modeling
    • arXiv | note
  • Incorporating Copying Mechanism in Sequence-to-Sequence Learning (2016. 3)
  • Attention Is All You Need (2017. 6)
  • Neural Text Generation: A Practical Guide (2017. 11)
  • Recent Advances in Recurrent Neural Networks (2018. 1)
    • RNN, Recent Advances, Review
    • arXiv

Optimization

  • Dropout (2012, 2014)
  • Batch Normalization (2015)
    • Regulaizer, Accelerate Training, CNN
    • arXiv | note
  • Training Very Deep Networks (2015. 7)
  • Layer Normalization (2016)
    • Regulaizer, Accelerate Training, RNN
    • arXiv | note

Unsupervised & Generative

  • Auto-Encoding Variational Bayes (2013, 12)

About

Notes of deep learning papers

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published