The answer to this question depends on what you are focusing on. While it can be considered a change of physical state, the solid sugar becoming an aqueous solution, it can also be considered a chemical reaction, the sugar linking with the water and tea.
It’s reversible
Stirring sugar into a cup of tea is a chemical change because when you evaporate the tea you can not get the sugar back, instead you get a mixture of glucose and fructose. It is also a chemical change.
It is a chemical change. Table Sugar is the crystallized form of liquid Sucrose(also simply known as, Sugar.) By stirring sugar into the tea you are using the tea as a catalyst in that it "hydrates" the crystal and causes it's chemical structure to return to the liquid form and be absorbed into the makeup of the tea.
No, dissolving sugar in hot tea is a physical change, not a chemical change. The sugar molecules are still present in the tea and can be separated by processes like evaporation. The chemical composition of the sugar does not change during the dissolving process.
Yes. When sugar dissolves in iced tea, it is a physicalchange. The tea does cease to be tea, nor does the sugar cease to be sugar. The water stays the same, of course. No chemical changes have taken place.