Having no opinion, in the sense I'm describing, is probably meant to say you actually do care a lot.
But you're right. Just having no opinion wouldn't make sense either. It is the withholding that creates the value, not the negation of it.