I'd highly recommend reading this book, which is available free online: https://www.deeplearningbook.org/ . It covers the foundations up to 2016 very well, with useful references for understanding the underlying math/theory.