In a small pot, bring the water to a gentle boil.
Add the tea bags and let them steep for 3–5 minutes until strong.
Pour in the milk and heat until warm but not boiling.
Stir in sugar or sweetener if using, then remove from heat.
Strain if using loose leaf tea and pour into cups. Serve hot.