Indeed there is a difference. When running on batteries you’ll only get updates every 4 minutes, instead of whenever it changes. You also won’t get kWh while on batteries. It does that to save your batteries.
Here’s a lot more info, plus a link to my device type that does more than ST’s default: