Also, as always, the first rule of home automation applies: “the model number matters.“ Some smart plugs have a parameter that you can set in the plug itself for what behavior you want to see after a power outage. But others don’t.
Here’s an old FAQ on that, but it will give some examples.