… It’s not that “art is important and rare”, and thus valuable, but rather that the artists themselves are important and rare, and impute value on whatever they wish.
To put it another way, while we used to pay for plastic discs and thought we were paying for songs (or newspapers/writing or cable/TV stars), empowering distribution over creators, today we pay with both money and attention according to the direction of creators, giving them power over everyone. If the creator decides that their NFTs are important, they will have value; if they decide their show is worthless, it will not. And, in the case of Swift, if she decides that albums are valuable they will be, not because they are now scarce, but because only she can declare an album “Taylor’s Version”.