Yeah, I'd say that linear algebra is at least as important as any geometry text. Generally, 3D is simply one more dimension than 2D. Problems aren't really more complicated - it's the same stuff... problems are just longer. Linear algebra helps do it more quickly & keep things better organized.
For what it's worth, my undergrad thesis was on 4-D graphics. 3-D?? Pssshhh. Sissy stuff. When you start looking at 3-dimensional cross sections of 4-dimensional objects, and 3-dimensional "shadows" of 4-dimensional objects, and try to piece together in your mind what the 4-dimensional object is... Well, I got a lot of headaches.