For your category 2 book I would recommend:
The Master Algorithm: How the Quest for the Ultimate Learning Machine
https://www.goodreads.com/book/show/24612233-the-master-algo...
What I like about this book is that it covers the various ML camps. Not just Deep Learning, but the Baysean approach as well.