That all depends on how comfortable you are around other people who do drink. People will not judge you if you don't choose to drink. There are students that do not drink... but they are few and far in between.
This is entirely a matter of personal choice. If you're uncomfortable being around people who are drinking when you're not, I would suggest avoiding the party scene. It's not impossible to find parties where people aren't drinking but they're definitely not as large-scale.