Don’t know how comfortable you are with installing a custom app. But I would like to challenge you to try RemindR and report back if your lag improves.
RemindR has a “deafult” setting that routes tts to speaker using a “fast lane”. If you still have noticeble lag, then it means your connection is slow and the only way to speed it up is to run your speakers on Ethernet.