They’re generally safe to use, but review the specs for any specific one you are considering.
Check with the manufacturer on this when you might be able to use two in one device to get it up to 3 V.
https://www.amazon.com/AA-Battery-to-Electric-Converter/dp/B00BFFTDEI