Drinking tea and coffee is such a massive part of just about everyone's day. I don't drink either and am met with really puzzled looks when I'm offered one and I decline saying I don't drink.
If you want to give it up just cut it out, it won't be long until you don't miss it.