All the volumes are a good read - just skip the maths and assembly sections in the first book. The rest of the work is understandable/readable without them.
Skip the maths?! I bought volume 4 because the math was interesting. I just skip all of the coding bits. Reading Knuth, for me, is similar to reading Martin Gardner's books.