|
A lot of people must be purchasing books for the Stanford classes-- I bought Peter Norvig's AI book, and because of that, Amazon is now recommending Daphne Koller's Probabilistic Graphical Models book. Which textbooks, if any, are required for the Machine Learning, Probabilistic Graphical Models and Natural Language Processing classes? Which books would it be a good idea to have? As I said, I bought the Norvig book, and I'm glad I did, even though it wasn't required. I found the more in-depth discussion of some of the topics helped me understand them more deeply. 1
Cool tags!
(29 Dec '11, 16:25)
EllenL
|
The NLP reccomended textbooks:are mentioned in the description of course in this post. Some of them are completely free, so no harm in getting them.
Other Free online books (for ML and PGM):
|
|
Amazon is fast! I asked this question yesterday, and today I have the Koller-Friedman Probabilistic Graphical Models book in my hand. First impression: this book is big. The package holding it alone had one of those yellow Warning, Heavy labels on it. The book goes into considerably more depth on several main ideas of the AI class: naive Bayes networks, Bayes networks in general, Markov models, particle filters. If you didn't like those sections of the AI class, or if you found them difficult, I hope you're not taking the PGM class, because it will be more of the same. This book costs a fortune, but having read the introductory section and the first part on Bayes networks, I'm glad I bought it. Koller & Friedman give clear, mathematically detailed expositions of what's going on. The equations, of which there are many, come with verbal explanations, making the text readable and easy to follow. In the naive Bayes section (and I presume in the other sections as well) they explain not only the mathematical underpinning of the technique, but how to apply the technique to real problems, which real problems to use the technique on, and where the pitfalls are. For algorithms, they supply code. I only gave a cursory look at the exercises, but they look good too. Koller & Friedman write with both precision and clarity. Five stars. Thanks for the review. This may sound odd after some of my other comments in this thread, but I thought the book was a relative bargain. $72 for a current (2009) and well written 1200 page hardcover textbook seems very reasonable to me.
My only complaint so far is I am not impressed with the errata. It does not include typos and is not set up to distinguish between the different printings. This impression was not helped by the first thing I looked at in it (eq. A.4 on p. 1149 in appendix A) has what I believe to be an incorrect correction (I'd be interested in a second opinion if you have a chance to look, in my 4th printing it is actually p. 1151 and equation A.4 should add ^q1 not "neg q_1" as stated in the errata if I understand correctly).
The book web page is at http://pgm.stanford.edu/
It includes the errata, TOC, and chapter 1.
@rseiter, evidently LaTex isn't allowed in comments on comments. See my top-level comment about the errata.
2
"If you didn't like those sections of the AI class, or if you found them difficult, I hope you're not taking the PGM class, because it will be more of the same."
I would not say that. Someone may have difficulties with the AI class or not like how this topic was taught in the AI class, it doesn't necessarily mean Daphne Koller would have the same effect on the student. I don't know her teaching style. And provided this is a very central topic in AI, I don't think someone wishing to work in that field can avoid it. If you had difficulties with this topic and really want to do AI, work hard and take the course.
|
|
I bought AIMA and thought it helpful for the additional depth it provided. I especially liked the historical notes and detailed bibliography. For ML I did not use a textbook (except for AIMA where applicable). I looked around a bit, but did not find one I thought would add enough value to buy. One that tempted me was Pattern Recognition and Machine Learning. That might be worth considering if you really like learning from books. I purchased the optional text for PGM: Probabilistic Graphical Models: Principles and Techniques. After reading the introductory material (chapters 1 and 2 and appendix A) I'm glad I did (it looks like a good book). I ran across some online books that might be worth checking out as well. This book is recommended in PGM appendix A for more detail on optimization if desired: http://www.stanford.edu/~boyd/cvxbook/ This book has been recommended in a few aiqus threads: http://www.inference.phy.cam.ac.uk/mackay/itprnn/book.html I purchased a copy of the first edition of Jurafsky and Martin for NLP. I'm hoping that will be sufficient. http://nlp.stanford.edu/IR-book/ (by Chris Manning, the other instructor) might be worth a look as well. |
|
As robrambusch wrote, the textbook for NLP is Jurafsky's Speech and Language Processing, available at Amazon: http://www.amazon.com/Speech-Language-Processing-Daniel-Jurafsky/dp/0131873210/ Take a look at who wrote the first review of it. I'll give you a hint: wild shirts. Take a look, too, at the price. $115. That was why I bought the first edition, <$20. Note that Peter Norvig's review was for the first edition (presumably the second is even better, but I don't know about 6x better).
@rseiter: Where did you find it for < $20?
update @rseiter: Thanks!!
1
A number of copies of the first edition (from 2000 NOT the current second edition from 2008) on Amazon for <$20 at http://www.amazon.com/gp/offer-listing/0130950696/ref=tmm_hrd_used_olp_sr?ie=UTF8&condition=used
NLP is a fast-moving field. I suspect that there was a lot of progress between 2000 and 2008. The old textbook is no doubt nonetheless valuable, but I'm guessing the new textbook has significant upgrades.
You can get the international paparback version from amazon.co.uk for 36 GBP (~$56). US customers have to pay additional shipping costs though
|
|
PGM -
NLP -
quoted from class pages (see right-hand menu) |