Here are a number of points to consider.
1) It's an analog format. Because vinyl is an analog medium, a record has a theoretical frequency response that goes to the moon. Seriously though, it goes way beyond our what we consider our "text book" hearing limits. It's easy to get into a debate as to if that really matters or not. Some audio scientists will tell you that we can feel the harmonic detail beyond 20kHz and that adds to the realism, while others will point to a mountain of data that shows that theory is rubbish.
That said, it sure does sound better than a CD, doesn't it? A CD's upper frequency response is theoretically around limited to around 22kHz, thanks to the 44.1kHz CD sample rate and something called the Nyquist Frequency, which states that you can't have a frequency response that goes beyond 1/2 of the sample rate (otherwise, you get some nasty sonic digital artifacts). What actually happens in real life is that a filter is used to keep the frequency response below the Nyquist Frequency, and that filter introduces it's own set of artifacts. That's one of the reasons why some CD/DVD players are so expensive; they've got better filters.
What this all adds up to is there's something going on in the upper frequencies on vinyl that our ears seem to like. What that is can be debatable, but we do like it.
2) Was the master analog? Vinyl really helps the sound and feel of a digital master, especially one made at a higher sampling rate like 96 or 192kHz, but it really sounds great if the source was originally an analog magnetic tape master. It still sounds pretty good if the source is from a 44.1kHz CD master source, but not as good as a hi-res digital or analog master. Yes, it's better than a CD, but doesn't have nearly the depth and "air" that an analog master has. This is why we tend to like the vinyl reissues of classic albums so much.
3) Vinyl is subject to sonic degradation. The big downside to vinyl is that from the first play onward, a vinyl record sonically degrades. Think about it. You have this diamond stylus (you know, the hardest natural substance known to man) that's constantly grinding up against the soft plastic grooves and wearing them down. After the first 10 plays or so, you're never going to hear it that good again. After about 20, you'll be hearing a lot of more of the noise floor, clicks and pops, although it will happen so gradually that you'll get used to them by then. Still, like magnetic tape losing oxide from the friction across the tape head. Your first pass is always the best.
Those are just a few things to think about when it comes to vinyl. Now get out to your record store and buy some!
