CPU / GPU Bottlenecking?

I've seen some people say that your video will start stuttering if you have a bottleneck, seems wrong to me, and I've seen other people say to just get the best video card you can afford, that no weirdness or harm will come, which seems more reasonable, doesn't it? Does anyone actually *know* and care not to just guess?