Yes, and if lava is forced down your gullet until if fills you up you'll probably burn too... to drink enough tea to have an actual effect on your body temperature you'd have to take a damn nearl lethal dose... cause, yes, the heat has to go somewhere but your digestive, circulatory and immune systems, at least, are designed to dissipate any type of heat OR cold your body takes.
Because, y'know, maintaining your core body temperature is KEY TO YOUR SURVIVAL.