Combine milk, sugar, and salt in a medium saucepan.
Heat on medium until sugar is dissolved and mixture is just about to boil.
Remove from heat and place in tea bags. Cover and let steep for about 30 minutes.
Remove tea bags and bring mixture back to a boil over medium heat on the stove. Meanwhile, whisk egg yolks together in a medium bowl.
Pour hot milk mixture into the egg yolks, whisking constantly to avoid cooking the eggs. Return mixture to saucepan and place back on stove.Cook mixture over medium heat, stirring constantly with a wooden spoon, until mixture thickens and coats the back of the spoon.
Place heavy cream in a large bowl.
Combine lemon zest, lemon juice, milk and cream together in a large bowl and stir together to combine.
Add sugar and stir to combine.
Add more sugar to taste if necessary.Cover and chill mixture in refrigerator for about an hour. Freeze in ice cream maker per manufacturer's instructions.