Swine flu is not more contagious (rather less) than seasonal flu so not taking vaccine wouldn't change that much. In fact "the majority of people who contract the virus experience the milder disease and recover without antiviral treatment or medical care" according to WHO. So if you are not afraid of seasonal flu why are you afraid of swine flu :D