Yes, I agree that the interest of vinyl is in physicality, not technicality, and to me it's not worth the hassle.
Technically, the CD can be made to sound perfect. The fact that early CDs sounded "metallic" was because the mastering process was in its infancy, but today, a CD produced at British Grove studio can sound perfect. No matter what "Hi-rez" aficionados claim, 44.1khz sampling rate is more than enough to hear the whole human ear range (up to 20khz), we are not dogs, we can't hear ultrasounds... And 16-bit dynamic range is a bit small, but with proper dithering it can be made to accomodate 96 to 120db. On the contrary, the vinyl only has a 60db dynamic range. That is quite compressed, but as always, limitations are opportunities for clever mastering to shine, some vinyls are produced to make best use of this small range... Also, vinyls can render frequencies up to 50Khz, which is actually too much for the human earing, so no gain here.