★★★★★ 5
Excellent book, possibly currently unique in coverage of latest ideas
This book is possibly currently unique in its coverage of the latest ideas in the field of deep learning -- and it is a very convenient and good survey of fundamental concepts (linear algebra, optimization, performance metrics, activation function types), different network types (multi-layer perceptron, convolutional neural networks, and recurrent neural networks), practical considerations (data set, training and validation, implementation), and applications (comments on existing real-world/commercial uses). The final 235 pages of the content portion of the book is dedicated to topics in "Deep Learning Research", and these topics are truly at the current frontier.
Another reviewer said that one could gain the same knowledge of cutting-edge research by reading all of the latest papers (from academia and industry), but the "research" section of this book offers the following: Selection of the most notable research by the very experienced authors of the book, and collection of similar research in to a broader discussion of themes, and the additional insights. The book covers very advanced and new ideas currently being explored, and it is very nice to be able to have a consistent and coherent presentation of all of those ideas.
However, the book is also packed with valuable observations and pointers about more basic aspects of deep learning implementations and practices -- and such commentary is in depth and includes substantial analysis and mathematical derivation (in an intuitive presentation that often includes graphs illustrating the phenomenon).
As someone with an intermediate level of knowledge and experience of neural networks, I am really grateful for this book, because seems like the ideal resource for learning cutting-edge ideas and practices, with context. The book has excellent scope and depth, and I am confident that anyone with a solid background in linear algebra, calculus, statistics, and general machine learning, and basic neural networks (multi-layer perceptrons) will find this book to be very exciting and perhaps unique in its ability to take the reader to the next level and a new frontier. I was personally excited to learn about the idea of representing the dependencies of intermediate quantities by directed graphs, and how this can be used to perform calculations for recurrent neural networks efficiently. And I think the long chapter on recurrent neural networks is very helpful.
Having said all of this, I think only people with significant working knowledge and experience with neural networks and mathematics -- people whose academic or professional focus has been neural networks for at least a year or two -- would benefit from this book. This book answers a lot of the deeper questions that one is likely to have while developing a solid understanding of the fundamentals, and that's one of the book's tremendous values, but this book assumes an understanding of the fundamentals (but does briskly cover the basics).
I think this book is a perfect follow-up book for the excellent book "Neural Network Design (2nd edition)" by Hagan, Demuth, Beale, and de Jesus, and I highly recommend the latter for gaining the solid background needed to have a thrilling experience with the "Deep Learning" book.
In summary, I am very glad this "Deep Learning" book was written, and I think the "Deep Learning" book will be a great benefit to a lot of people, and to the evolution of the field.
WAS THIS REVIEW HELPFUL?YesReportShare
Reviewed in the United States on April 18, 2017