Z-Wave Died: eeprom write fail

Today I am having issues repairing my zwave network after making some changes and I noticed a lot of eeprom write fails in the logs. The message has been updated to provide a memory address in the eeprom and I noticed that it changes. Given eeproms have a limited number of times you can write to them before they start failing, I wonder whether this message is essentially saying the eeprom chip is starting to fail. If we find the specifications of the eeprom chip inside the hub it will tell us how many writes it can go through before it may start failingā€¦ of course we do not know how many times the hub writes to it but it seems it does so relatively frequently. If the eepromā€™s write cycles are in the millions then I donā€™t believe this would be the case but if it is in the thousands then we may be onto somethingā€¦

I notice Err 112: ZM eeprom write fail after hub reboots. Also having occasional slow processing, delays, and a few zigbee devices going offline each weak.

Reliability (response of lights on with motion) has been inconsistent for a few weeks for me. Still on Hub fw v17.12.

Hi aruffell,

Regarding the ā€œZM eeprom write failā€ messages, we just recently updated the logging to include the number of bytes and the offset in the EEPROM to allow us determine where and how often this issue is occurring. We are updating only when a new device is included, as a result we are updating only one byte in the EEPROM with the offset incremented each time. Therefore the likelihood of hitting the 10,000 EEPROM limit is very unlikely.

We are currently investigating the cause and workarounds to this EEPROM write failures, hopefully we should have a workaround very soon.

Kianoosh

@Kianoosh_Karami - Thank you for the insight. I am guessing the eeprom is on the Sigma Design Zwave module used on the hub as I could not find an individual eeprom chip on the PCB. That might also be what the ā€œZMā€ abbreviation stands for.

I looked at my Events List for the past 6 days and found quite a few of these error messages - 66 or so Err 112:

Date Source Type Name Value User Displayed Text
2017-08-07 4:52:15.939 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B8
2017-08-06 12:49:17.032 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1AD
2017-08-05 2:51:20.974 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-05 11:37:57.785 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-05 11:34:28.340 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-05 11:34:14.321 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-05 11:16:24.932 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-05 11:12:20.672 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-05 11:12:18.606 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-05 11:12:10.596 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-05 11:12:06.421 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-05 11:11:43.344 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x10C
2017-08-05 10:53:48.944 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-05 10:39:18.395 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-05 10:32:01.098 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-05 10:20:19.941 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-05 10:17:39.417 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-05 10:17:26.927 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-05 10:17:00.174 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x97
2017-08-05 9:43:39.431 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-05 9:43:30.066 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-05 9:43:06.315 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-04 12:34:37.644 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1AD
2017-08-03 7:57:43.720 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B8
2017-08-03 7:57:13.776 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-03 7:38:06.219 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-03 6:47:05.606 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-03 6:27:25.596 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-03 6:22:16.737 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-03 6:14:18.498 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-03 5:21:14.077 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-03 5:17:07.309 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-03 3:06:12.954 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-03 11:46:54.086 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-03 12:19:03.074 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1AD
2017-08-02 10:26:43.013 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-02 10:23:54.250 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-02 10:00:15.903 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-02 9:30:02.452 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-02 9:27:54.397 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-02 9:24:00.233 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-02 9:14:03.134 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-02 9:14:01.010 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-02 9:13:52.781 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-02 9:13:48.209 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-02 9:12:16.442 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-02 9:12:04.502 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x10C
2017-08-02 8:09:26.103 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-02 7:34:40.435 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-02 7:25:49.152 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-02 7:14:05.042 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-02 7:09:46.097 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-02 6:46:14.083 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-02 6:38:09.068 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-02 6:35:13.931 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-02 5:35:05.683 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-02 3:58:34.749 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B8
2017-08-02 3:38:28.171 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-02 3:37:34.242 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-02 1:19:04.628 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-02 1:13:28.231 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-02 12:46:05.275 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-02 12:45:42.702 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-02 12:45:40.336 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-02 12:36:38.905 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x10C
2017-08-02 12:36:09.934 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186

Below is the more complete list with all the Error messages for the past 6 days:

Date Source Type Name Value User Displayed Text
2017-08-08 7:09:12.988 AM CDT HUB Err 104: Z-Wave exclude failed Err 104: Z-Wave exclude failed
2017-08-08 7:08:02.308 AM CDT HUB Err 115: Device not considereā€¦ Err 115: Device not considered failed
2017-08-08 7:07:17.797 AM CDT HUB Err 115: Device not considereā€¦ Err 115: Device not considered failed
2017-08-07 5:36:03.403 PM CDT HUB Err 120: Z-Wave send timed out Err 120: Z-Wave send timed out
2017-08-07 4:52:15.939 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B8
2017-08-06 12:49:17.032 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1AD
2017-08-05 2:51:20.974 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-05 1:29:43.691 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-05 11:37:57.785 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-05 11:34:28.340 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-05 11:34:14.321 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-05 11:16:24.932 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-05 11:12:20.672 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-05 11:12:18.606 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-05 11:12:10.596 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-05 11:12:06.421 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-05 11:11:43.344 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x10C
2017-08-05 10:53:48.944 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-05 10:39:18.395 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-05 10:32:01.098 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-05 10:30:20.121 AM CDT HUB Err 105: Z-Wave learn timed out Err 105: Z-Wave learn timed out
2017-08-05 10:20:19.941 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-05 10:17:39.417 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-05 10:17:26.927 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-05 10:17:00.174 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x97
2017-08-05 9:43:39.431 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-05 9:43:30.066 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-05 9:43:06.315 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-05 9:38:31.886 AM CDT HUB Err 103: Z-Wave include failed Err 103: Z-Wave include failed
2017-08-05 9:38:25.716 AM CDT HUB Err 103: Z-Wave include failed Err 103: Z-Wave include failed
2017-08-05 9:38:18.376 AM CDT HUB Err 103: Z-Wave include failed Err 103: Z-Wave include failed
2017-08-05 9:37:20.468 AM CDT HUB Err 103: Z-Wave include failed Err 103: Z-Wave include failed
2017-08-05 9:37:14.307 AM CDT HUB Err 103: Z-Wave include failed Err 103: Z-Wave include failed
2017-08-05 9:37:03.533 AM CDT HUB Err 103: Z-Wave include failed Err 103: Z-Wave include failed
2017-08-04 12:34:37.644 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1AD
2017-08-03 7:57:43.720 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B8
2017-08-03 7:57:13.776 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-03 7:38:06.219 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-03 6:47:05.606 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-03 6:27:25.596 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-03 6:22:16.737 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-03 6:16:34.324 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-03 6:16:34.219 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-03 6:16:34.166 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-03 6:14:18.498 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-03 5:21:14.077 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-03 5:17:07.309 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-03 3:06:12.954 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-03 11:46:54.086 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-03 11:29:54.596 AM CDT HUB Err 120: Z-Wave communicationā€¦ Err 120: Z-Wave communication timed out
2017-08-03 12:19:03.074 AM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1AD
2017-08-02 10:26:43.013 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-02 10:23:54.250 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-02 10:00:15.903 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-02 9:30:02.452 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-02 9:27:54.397 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-02 9:24:00.233 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-02 9:14:03.134 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1BA
2017-08-02 9:14:01.010 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-02 9:13:52.781 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-02 9:13:48.209 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-02 9:13:44.284 PM CDT HUB Err 120: Z-Wave communicationā€¦ Err 120: Z-Wave communication timed out
2017-08-02 9:12:16.442 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-02 9:12:04.502 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x10C
2017-08-02 8:09:26.103 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-02 7:34:40.435 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19F
2017-08-02 7:25:49.152 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-02 7:14:05.042 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-02 7:09:46.097 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-02 6:46:14.083 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-02 6:38:09.068 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-02 6:35:13.931 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-02 6:34:05.166 PM CDT HUB Err 115: Z-Wave replacement tā€¦ Err 115: Z-Wave replacement timed out
2017-08-02 6:28:49.317 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:28:49.199 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:28:49.149 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:28:48.986 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:28:48.840 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:16:40.150 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:16:40.088 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:16:40.023 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:16:39.971 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:16:39.905 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum
2017-08-02 6:14:56.852 PM CDT HUB Err 120: Z-Wave send timed out Err 120: Z-Wave send timed out
2017-08-02 6:01:56.526 PM CDT HUB Err 120: Z-Wave send timed out Err 120: Z-Wave send timed out
2017-08-02 5:56:55.772 PM CDT HUB Err 120: Z-Wave send timed out Err 120: Z-Wave send timed out
2017-08-02 5:56:06.338 PM CDT HUB Err 120: Z-Wave send timed out Err 120: Z-Wave send timed out
2017-08-02 5:35:05.683 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B0
2017-08-02 3:58:34.749 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B8
2017-08-02 3:38:28.171 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A0
2017-08-02 3:37:34.242 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A3
2017-08-02 1:19:04.628 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A4
2017-08-02 1:13:28.231 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x18E
2017-08-02 12:46:05.275 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1B2
2017-08-02 12:45:42.702 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x1A2
2017-08-02 12:45:40.336 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x19C
2017-08-02 12:45:36.903 PM CDT HUB Err 101: ZW module not responā€¦ Err 101: ZW module not responding
2017-08-02 12:45:35.283 PM CDT HUB Err 120: Z-Wave communicationā€¦ Err 120: Z-Wave communication timed out
2017-08-02 12:36:38.905 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x10C
2017-08-02 12:36:09.934 PM CDT HUB Err 112: ZM eeprom write failā€¦ Err 112: ZM eeprom write fail - single byte write at offset 0x186
2017-08-01 10:01:03.084 PM CDT HUB Err 116: Got CRC-16 encapsulaā€¦ Err 116: Got CRC-16 encapsulated command with bad checksum

I have been having some issues with a few devices so the errors may have increased due to me trying to figure out the issues but at this rate my eeprom would potentially start showing issues after 2.5 years. Unless this is what is causing me grief right now, I hope to upgrade to a future v3 hub before then.

Regarding the ā€œGot CRC-16 encapsulated commandā€, We are seeing these with some Z-wave devices. We are fully compliant with the CRC-specification provided by the Sigma Designs. We have noticed these with a few specific devices, I am not really sure why the messages we are receiving from these devices are incorrectly encapsulated. Perhaps, this is the reason they added the CRC-16 encapsulation to ensure the messages are good when passed between the application layers.

I am currently looking into the EEPROM write failures. Hopefully I should know more soon.

Thanks

3 Likes

+1 as I get these failures all the time.

1 Like

I just wanted to give an update on this issue. I have found ways to reproduce this issue, and I believe there is a limitation on the Z-Wave chipset that can skip EEPROM writes when the network is busy. In order to write to the EEPROM, they need to halt their CPU which can shut down the z-wave network momentarily and given their primary objective is to handle the Z-Wave network, the EEPROM writes could be dropped. As a result, we are going to add retries and a sophisticated system to get away from using their EEPROM for future. This will be in future firmware releases. Thanks for the patience.

7 Likes

@Kianoosh_Karami - You mentioned that the write happens when a new device is included but judging by my number of failures it seems to be happening under other circumstances as well. What happens to the system when those values do not get saved to the eeprom? Also, what data is being written to the eeprom?

We are seeing a huge drop in EEPROM write failure issue in 19.13 Firmware Beta Release.

Hopefully once we release the 19.x to everyone, you might initially see the issue (with no bad consequence) a few times (due to nature of the bug), but hopefully cleared for the long term.

The reason I say no consequence is because we have added retries and timeouts that has shown to cover the residue from the found bug in 18.x release and before.

Let me know what you find and I can certainly dig in more. Anything Z-Wave related really.

Thanks again

2 Likes

For those users that have upgraded to 19.x, let me know if you experience this issue anymore.

1 Like

19.19 is turning out to be a Z-wave train wreck. It appears that the frequent, numerous Z-wave reboots are back. Probably 2 dozen events in the past 12 hours so far and counting.

Hereā€™s one example from today. This device, ā€œCeiling Fan in Purple Roomā€ is literally 3 feet away from the hub!

2017-12-06 7:47:28.282 AM EST
3 hours ago	HUB		index:1A, mac:000420F3C826, ip:C0A80716, port:201E, requestId:b6f6d6b6-a697-4f15-b739-6b93a61d8971,	index:1A, mac:000420F3C826, i...		index:1A, mac:000420F3C826, ip:C0A80716, port:201E, requestId:b6f6d6b6-a697-4f15-b739-6b93a61d8971, headers:SFRUUC8xLjEgMjAwIE...
2017-12-06 7:46:24.499 AM EST
3 hours ago	HUB		index:05, mac:4C72B9F8B735, headers:UE9TVCAvbW90aW9uIEhUVFAvMS4xDQpIb3N0OiAxOTIuMTY4LjcuMzA6Mzk1MDAN	index:05, mac:4C72B9F8B735, h...		index:05, mac:4C72B9F8B735, headers:UE9TVCAvbW90aW9uIEhUVFAvMS4xDQpIb3N0OiAxOTIuMTY4LjcuMzA6Mzk1MDANCkFjY2VwdDogKi8qDQpDb250ZW...
2017-12-06 7:46:08.200 AM EST
3 hours ago	HUB		zwStatus	ready		Z-Wave is ready
2017-12-06 7:46:04.445 AM EST
3 hours ago	HUB		zwBadNode			Err 120: Z-Wave send timed out (Ceiling Fan in Purple Room [08])
2017-12-06 7:46:04.426 AM EST
3 hours ago	HUB		zwStatus	power cycle		Z-Wave power cycle started
2017-12-06 7:46:02.239 AM EST
3 hours ago	HUB		ping	ping		ping
2017-12-06 7:45:56.255 AM EST
3 hours ago	HUB		index:1A, mac:000420F3C826, ip:C0A80716, port:201E, requestId:45315859-8568-4197-848f-e9670f61185c,	index:1A, mac:000420F3C826, i...		index:1A, mac:000420F3C826, ip:C0A80716, port:201E, requestId:45315859-8568-4197-848f-e9670f61185c, headers:SFRUUC8xLjEgMjAwIE...

Do you know what changed in 19.19 that has impaired Z-Wave so badly?

Steve, we have not changed anything Z-Wave related since 19.17.

The root of the problem remains to be the Z-Wave chipset, which when 20.x gets released should allow us to update the firmware on the chip and hopefully the issue is solved.