Inception Module | Summary

References Udacity (2016. 6. 6.). Inception Module. YouTube. [LINK] Udacity (2016. 6. 6.). 1×1 Convolutions. YouTube. [LINK] Tommy Mulc (2016. 9. 25.). Inception modules: explained and implemented. [LINK] Szegedy et al. (2015). Going Deeper with Convolutions. CVPR 2015. [arXiv] Summary History The inception module was first introduced in GoogLeNet for ILSVRC’14 competition. Key concept Let a convolutional network decide […]

Graduate School Guide | Summary

References A Survival Guide to a PhD. Andrej Karpathy blog. Sep 7, 2016 [LINK] HOWTO: Get into grad school for science, engineering, math and computer science [LINK] 대학원생을 위한 지극히 개인적인 10가지 조언 [LINK] 논문 읽기 초보자를 위한 Literature survey (문헌 조사) 팁! [LINK] 석사와 박사 [LINK] 내가 대학원에서 생존한 방법 [LINK] 박사 과정을 통해 배운 것들 […]

Batch Normalization | Summary

References Sergey Ioffe, Christian Szegedy (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. ICML 2015. [ICML][arXiv] Lecture 6: Training Neural Networks, Part 1. CS231n:Convolutional Neural Networks for Visual Recognition. 48:52~1:04:39 [YouTube] Choung young jae (2017. 7. 2.). PR-021: Batch Normalization. Youtube. [YouTube] tf.nn.batch_normalization. Tensorflow. [LINK] Rui Shu (27 DEC 2016). A GENTLE […]

Convolutional Neural Networks | Study

  References L. Fei-Fei, Justin Johnson (Spring 2017)CS231n: Convolutional Neural Networks for Visual Recognition. [LINK] Jefkine (5 September 2016). Backpropagation In Convolutional Neural Networks. [LINK] Convnet: Implementing Convolution Layer with Numpy [LINK] CNN의 역전파(backpropagation) [LINK]

CS231n: Convolutional Neural Networks for Visual Recognition | Course

Lecture 6 | Training Neural Networks I Sigmoid Problems of the sigmoid activation function Problem 1: Saturated neurons kill the gradients. Problem 2: Sigmoid outputs are not zero-centered. Suppose a given feed-forward neural network has hidden layers and all activation functions are sigmoid. Then, except the first layer, the other layers get only positive inputs. […]

Minds and Machines (24.09x) | edX

Brief Summary Course title: Minds and Machines [HOME] Platform: edX Duration: 15 weeks Instructors: Alex Byrne, Chair of Philosophy Section, MIT Ryan Doody, PhD in Philosophy & Linguistics, MIT Short summary of this course An introduction to philosophy of mind, exploring consciousness, reality, AI, and more. The most in-depth philosophy course available online. About this course What is […]

Applying to Ph.D. Programs in Computer Science

  Author: Mor Harchol-Balter (Computer Science Department Carnegie Mellon University) Last updated: 2014 1 Introduction This document is intended for people applying to Ph.D. programs in computer science or related areas. The author is a professor of computer science at CMU, and has been involved in the Ph.D. admissions process at CMU, U.C. Berkeley, and MIT. 2 Do I […]