Does displayDuringSetup only work for wired devices?

I seem to recall adding at least one device into smartthings and having the preferences page pop up. But at this point, I don’t ever see it come up. I’ve got a basic DTH for door/windor sensor that I have the preferences set to simply bring up one thing and it does not come up when added.

Is it just me or is it because it’s a battery device? I didn’t see anything like this in the docs but could that be it? Or does this functionality just not actually work?