Did you validate that the device is gone 100% by checking the IDE or looking in the Classic app? If any of those devices were in any SmartApp, then you’ve fallen victim to this:
If I were you I’d check the IDE to make sure the device is gone because the new app thinks it is, but it isn’t.