References L. Fei-Fei, Justin Johnson (Spring 2017)CS231n: Convolutional Neural Networks for Visual Recognition. [LINK] Jefkine (5 September 2016). Backpropagation In Convolutional Neural Networks. [LINK] Convnet: Implementing Convolution Layer with Numpy [LINK] CNN의 역전파(backpropagation) [LINK]
Chapter 8. Principal-Components Analysis 8.1 Introduction 8.2 Principles of Self-Organization Principle 1. Self-Amplification Principle 2. Competition Principle 3. Cooperation Principle 4. Structural Information 8.3 Self-Organized Feature Analysis 8.4 Principal-Components Analysis: Perturbation Theory 8.5 Hebbian-Based maximum Eigenfilter 8.6 Hebbian-Based Principal Components Analysis 8.7 Case Study: Image Coding 8.8 Kernel Principal-Components Analysis 8.9 Basic Issues Involved in […]
Range 8.1~8.7 9.1~9.10 10.1~10.14 10.19~10.21 Chapter 8. Principal-Components Analysis 8.1. Introduction Self-organized learning Self-organized learning is a type of unsupervised learning. locality of learning 8.2. Principles of Self-Organization Principle 1: self-amplification The following rule is based on Hebb’s postulate of learning. If two neurons of a synapse are activated simultaneously, then synaptic strength is […]
References Ilya Sutskever, Oriol Vinyals, Quoc V. Le (2014). “Sequence to Sequence Learning with Neural Networks”. NIPS 2014: 3104-3112. [PDF] Sequence-to-Sequence Models. TensorFlow [LINK] The official tutorial for sequence-to-sequence models. Seq2seq Library (contrib). Tensorflow [LINK] Translation with a Sequence to Sequence Network and Attention. PyTorch. [LINK]
References LearningTensorFlow.com Géron, A. (2017). Hands-On Machine Learning with Scikit-Learn and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems. O’Reilly Media [Amazon] Siraj Raval (2016. 8. 19.). TensorFlow in 5 Minutes. YouTube. [YouTube] Terms of Tensorflow Variable ≠constant Session Placeholder Objects in Tensorflow tf.Graph contains tf.Operation and tf.Tensor tf.Operation tf.Tensor tf.constant tf.Variable tf.placeholders tf.Session tf.train.GradientDescentOptimizer […]
Heroes of Deep Learning: Andrew Ng interviews Geoffrey Hinton [40:23] Heroes of Deep Learning: Andrew Ng interviews Ian Goodfellow [14:56] Heroes of Deep Learning: Andrew Ng interviews Yoshua Bengio [25:49] Heroes of Deep Learning: Andrew Ng interviews Pieter Abbeel [16:04] Heroes of Deep Learning: Andrew Ng interviews Head of Baidu Research, Yuanqing Lin [13:37] Heroes […]
Brief Information Instructor: Vincent Vanhoucke (Principal Scientist at Google Brain) Flatform: Udacity Course homepage: https://www.udacity.com/course/deep-learning–ud730 Duration 2017-08-24~25: Took Lesson 1, 3-7 without programming assignments. Course Overview Lesson 1: From Machine Learning to Deep Learning Lesson 2: Assignment: notMNIST Lesson 3: Deep Neural Networks Lesson 4: Convolutional Neural Networks Lesson 5: Deep Models for Text and Sequences Lesson 6: […]
Chapter 1 (h3) Section 1.1 (h4) Section 1.1.1 (h5) Theme (h6) Chapter 1 Introduction The performance of machine learning algorithms depends heavily on the representation of the data. The representation consists of features. Representation learning is machine learning to learn efficient representation of the given data. Deep learning so
References Lectures Hinton, G. (2013) Neural Networks for Machine Learning. Coursera Deep Learning Nanodegree Foundations. Udacity CS231n: Convolutional Neural Networks for Visual Recognition. Stanford University CS224d: Deep Learning for Natural Language Processing. Stanford University CS 294-131: Special Topics in Deep Learning. UC Berkeley CS 294: Deep Reinforcement Learning, Spring 2017. UC Berkeley Vanhoucke, V.. Deep Learning. Udacity Books Goodfellow, […]
Install Caffe on Linux Ubuntu 16.04 My Configurations Linux: Ubuntu 16.04 LTS Anaconda: Anaconda 2 (64-bit), Anaconda2-4.3.0-Linux-x86_64.sh CPU or GPU: CPU Install Caffe 1. Install CUDA 8 (Optional. I failed this installation.) Go to the CUDA download page(https://developer.nvidia.com/cuda-downloads). ‘ Go to the directory where the downloaded file cuda_8.0.44_linux.run is located.
$ sudo sh cuda_8.0.44_linux.run
Installing the NVIDIA display driver...
It appears that an X server is running. Please exit X before installation. If you're sure that X is not running, but are getting this error, please delete any X lock files in /tmp.
= Summary =
Driver: Installation Failed
Toolkit: Installation skipped
Samples: Installation skipped
I got an error. http://askubuntu.com/questions/149206/how-to-install-nvidia-run Hit CTRL+ALT+F1 […]