Bring first 8 ingredients and 2 cups water to a boil in a large saucepan over medium-high heat, stirring occasionally.
Add tea bags; cover, reduce heat to low, and simmer 10 minutes.
Pour mixture through a fine wire-mesh strainer into a heatproof pitcher, discarding solids.
Serve warm or chilled over ice.
Dark Chocolate Chai Latte: Stir 4 oz. chopped dark chocolate and 1/4 tsp. ground cinnamon in with first 8 ingredients, stirring until chocolate is melted. Proceed with recipe as directed.