Writing-oriented gear

As part of my "sporty nerd" wardrobe I'm assembling for Comic-Con, I bought a baseball jersey that says: "My muse is a mean, mean muse".  It is too cute. Now the question - do I wear it with the black fedora or the Panama hat?