Bring 2 cups of water to a boil in a medium saucepan. Once boiling, remove from the heat and add the tea bags. Steep for 5 minutes.
Remove the tea bags from the water, squeezing any excess tea out with a pair of tongs. Transfer the tea into a large pitcher with 4 cups of cold water and the baking soda.
Using the same saucepan, pour in the remaining 2 cups of water, chopped strawberries, and sugar. Bring to a low simmer for 20 minutes. Remove the strawberry syrup from the heat and allow to cool.
Strain the strawberry syrup through a fine-mesh sieve into a small cup or pitcher, pressing the juice out of the berries.
Add the syrup to the pitcher with tea and stir. Pour into glasses filled with ice and serve immediately.