taught by Alan Blair and Nitin Indurkhya
In this online course, you will learn about the rapidly evolving field of Deep Learning. The surge in deployed applications based on concepts and methods in this field is an indication of its potential to help fully realize the promise of Artificial Intelligence. At the end of this course you will understand the basic concepts underlying the representations and methods in deep learning and see some applications where deep learning is most effective. You will also gain an appreciation of what kind of problems are most suited for this field and current research trends.
WEEK 1: Neural Networks and Optimization
- Machine Learning Basics
- Deep Feedforward Networks
- Basic Optimization Algorithms
WEEK 2: Convolutional Networks and Image Processing
- Convolutional Networks
- Practical Methodology
- Image Applications
WEEK 3: Recurrent Architectures and Language Processing
- Recurrent Networks
- Long Short Term Memory
- Language Applications
WEEK 4: Advanced Topics, Research Trends
- Representation Learning
- Deep Generative Models
Homework in this course consists of short answer questions to test concepts, practice with using public-domain tools and some guided exercises that involve freely available data. There is also an end-of-course project.
Deep learning and its place in the learning hierarchy
From Deep Learning by Ian Goodfellow and Yoshua Bengio and Aaron Courville
Data scientists, statisticians, software engineers, technical managers interested in learning about what is deep learning, the state-of-the-art techniques/concepts and the range of applications in which they can be used.
You should have some familiarity with linear algebra, probability and information theory. The course text's chapters 2 and 3 can be read in advance to gain this background. You should also be able to run open-source tools and install them on your personal computer. You shoudl be sufficiently familiar with Python to write programs to read/generate data and process it in appropriate data structures using relevant packages.
This course takes place online at the Institute for 4 weeks. During each course week, you participate at times of your own choosing - there are no set times when you must be online. Course participants will be given access to a private discussion board. In class discussions led by the instructor, you can post questions, seek clarification, and interact with your fellow students and the instructor.
At the beginning of each week, you receive the relevant material, in addition to answers to exercises from the previous session. During the week, you are expected to go over the course materials, work through exercises, and submit answers. Discussion among participants is encouraged. The instructor will provide answers and comments, and at the end of the week, you will receive individual feedback on your homework answers.
About 15 hours per week, at times of your choosing.
Students come to the Institute for a variety of reasons. As you begin the course, you will be asked to specify your category:
- No credit - You may be interested only in learning the material presented, and not be concerned with grades or a record of completion.
- Certificate - You may be enrolled in PASS (Programs in Analytics and Statistical Studies) that requires demonstration of proficiency in the subject, in which case your work will be assessed for a grade.
- CEUs and/or proof of completion - You may require a "Record of Course Completion," along with professional development credit in the form of Continuing Education Units (CEU's). For those successfully completing the course, CEU's and a record of course completion will be issued by The Institute, upon request.
- Other options - Statistics.com Specializations, INFORMS CAP recognition, and academic (college) credit are available for some Statistics.com courses
Specializations are an easy way for you to demonstrate mastery of a specific skill in statistics and analytics. This course is part of the Intelligence and Security Analytics Specialization which teaches statistical and machine learning methods for detecting anomalies, identifying images, and processing data from sensors. Take all three Statistics.com courses on this topic (this course, plus the courses listed to the right under "related courses," not including conferences). For savings, use the promo code "anomaly-specialization" and register for all three courses at once for $1197 ($399 per course, not combinable with other tuition savings).
The required text is Deep Learning (MIT Press, 2016) by I. Goodfellow, Y. Bengio and A. Courville.
A freely available html version is available at http://www.deeplearningbook.org/ .
It will be supplemented in the course by other technical papers, also available online.
The assignments will use Theano. Instructions for installing Theano can be found here:
You will need to choose between Python 2 (>= 2.6) and pip or Python 3 (>= 3.3) and pip3. It is possible to install both and switch between them for different purposes. One advantage of Python 3 is that it uses Unicode natively, which is very convenient if, for example, you want to process Chinese text.
If you are using a computer with a CUDA-enabled graphics card, try to install CUDA and integrate it into Theano. Otherwise, the assignments can be completed in CPU mode (but some of the models will be run on a smaller scale).
Some of the assignments will build on the software found at
The necessary code can be downloaded by typing:
git clone https://github.com/lisa-lab/DeepLearningTutorials.git
In order to do this, you will need to have git installed on your computer. If you don't have it, the install process is very simple with git being freely available for almost any operating system available today.
Course Fee: $549
Do you meet course prerequisites? What about book & software? (Click here to learn more)
Group rates: Click here to get information on group rates.
First time student or academic? Click here for an introductory offer on select courses. Academic affiliation? You may be eligible for a discount at checkout.
Add $50 service fee if you require a prior invoice, or if you need to submit a purchase order or voucher, pay by wire transfer or EFT, or refund and reprocess a prior payment. Please use this printed registration form, for these and other special orders.
Courses may fill up at any time and registrations are processed in the order in which they are received. Your registration will be confirmed for the first available course date, unless you specify otherwise.
The Institute for Statistics Education is certified to operate by the State Council of Higher Education in Virginia (SCHEV).