As a vera user seeing if the grass is greener over here I am sad. Veras need add-ons like PLEG to provide good scripting and each software update is as likely to remove useful features as add new ones. I was hoping things were better over here.
We need some competition to drive improvements in both platforms. Unfortunately we seem to have less a race to the top and more a staggering run in place.
Maybe vera ui8 or smartthings 2.1 will be good enough to drive the other.
2 Likes
bamarayne
(Jason "The Enabler" as deemed so by @Smart)
331
Are you sure itās not the size of the system? Cause Iām pretty sure that size mattersā¦ A small system may not work as well a large systemā¦ And sometimes the large system my not work as well as a smaller system. Iām think that the structure the system is in could make a difference in if the size matters as much. J/s
Unfortunately, thereās less competition today than there was a year ago. Revolv - gone, NinjaBlocks - gone, Wink - bankrupt, Staples Connect - almost dead. Vera is still limping. SmartThings is having hard time. Google and Apple are still on the sidelines. No one seems to able to crack this nut just yet. Philips did a good job with Hue, but it only covers lighting. Makes me wish they would expand into other areas. Oh wellā¦
I am still trying to figure out ābest practicesā for this stuff.
I routinely (sorry) use routines and modes and things seem to be working okay. One thing I did learn was that a routine wonāt fire if the mode is already set to the expected mode change. That was an interesting discovery.
Did not know about the specific time / hour-quarter hour thing though so thanks!
For now my routines either only set modes (nothing else) or do some timed actions with no mode checking.
The smartapps only do actions (with mode checks sometimes).
Iāve found that custom device types can mess up your schedule as well so I use them as sparingly as possible.
Like Larry I also employ redundancy - I have for example a āNight Checkā routine that kicks off at around 1 am that simply makes sure all the lights are off that I want to be off etc.
Sorry wanted to clarify - my routines either set a mode OR do an action (which could include checking a mode). I do NOT set a mode and do an action - I keep them separate.
I wish for a more stable SONOS implementation. Had to remove all my sonos speakers from ST after scheduling and rooms starting acting flaky.
Interestingly my presence stuff (2 old key fob sensors and 2 android phones) seems to be working okay at the moment. I have a fairly simple implementation - just an āeveryone leavesā sets the āaway modeā and a āfirst returnā sets the home mode.
Especially when Iāve gone against all of these rules and have had 0 issues (knock on wood). Plus I use modes every day, including for triggering SHM.
I think they point of my original post is clear from the back and forth happening on this thread.
One person says it doesnāt workā¦
next person says it does if you do x and y
third person says I did x and y but still have issues.
forth person says I didnāt do x and y and I have no issues anyway
Basically the server changes are making everyoneās hacks and solutions unstable also.
Currently my setup has been stable for a while. But I have zero confidence that it will remain that way. I hope this changes but it is the uncertainty that is limiting my use of this system.
3 Likes
tgauchat
(ActionTiles.com co-founder Terry @ActionTiles; GitHub: @cosmicpuppy)
340
There needs to be a āHippocratic Oathā for iterative released software / firmware: Do no harm! ā New features should never be an excuse for the introduction of bugs to old functionality or overall instability. Even bug fixes donāt justify new bugsā¦
While anytime you change code there is a risk of what we call āregression bugsā, the use of modern source code control systems help minimize this risk (and permit very quick rollback in many situationsā¦). But a key ingredient is very thorough āregression testingā and āQA Testingā, to the level of detail appropriate for the scope of the change.
One of the problems is that SmartThingsdoes not pre-publish the Release Notes in advance to help us in the Community who are particularly conscious of the system, be prepared to recognize the impact in detail.
Or, like many Software As Service platforms, they donāt offer a fully public āBeta Channelā where releases can be pre-depoloyed regularly in advance to a voluntary subset of living-on-the-edge Customers. Some people are quite willing to run the Beta channels of Firefox and Chrome for example (and many, many other such examples out there).
Weāre currently planning on providing an ongoing Beta pre-release channel for SmartTiles. Itās effort to maintain, but Iād much rather do support calls and debugging for 100 users than several thousand or more. Ohā¦ please donāt request to be invited to the SmartTiles beta yet (weāll give plenty of notice for invitees when weāre ready).
Used to be Iād agree with you, but now, facing the reality of it, Iād be more inclined to say that the introduction of bugs to old functionality is never intentional, hard to detect, and sometimes hard to fix. You can go on all you like about regression testing and all of that, but youāre dealing with an untestable system (separate topic, why that is). It isnāt possible to test a covering set of functionality with any confidence that itās the right covering set. Itās an NP complete problem.
By that Iām referring to testing in an ST system. Asynchronous, event driven, distributed, complexā¦
tgauchat
(ActionTiles.com co-founder Terry @ActionTiles; GitHub: @cosmicpuppy)
345
Sureā¦ but the use of an āin-the-wildā stream of volunteer Beta testers that are a substantial (but fractional) subset of Customers would significantly increase the probability of discovering and resolving bugs before a full rollout. Even a week of pre-release in this Beta stream would subject the system to a wide range of diversely random testing, proportionate to the sample size used.
Iāve done pre and post installation testing for sensor nets with all of the above characteristics.
You canāt catch everything, but you can catch a lot. Use case-based regression testing would catch a number of the areas that weāve seen come through from ST in the last three months.
So I canāt give them a pass on that basis.
Take the oauth issue for the UK. Universal, reproducible, obvious, for an advertised feature.
If they launched not knowing the problem existed, thatās one testing philosophy.
If they launched knowing it existed, thatās another.
There is zero confidence in your statement that it āwould significantly increase the probabilityā, mathematically. If the probability is very low to begin with (due to complexity), then throwing more testing at it isnāt going to move the needle. Itās the same dilemma the company faces in the first place, how much testing is āworth itā. Obviously, they could go bankrupt testing and still not have come close to having confidence that it all works. Tough management call, to say the least.
So you spend however much it is on testing, you deploy when you reach some level of confidence, and then a storm descends on you from things you missed. Fun. What do you change the next time? More testing? Everyone here thinks they know the answer ā they donāt.
1 Like
tgauchat
(ActionTiles.com co-founder Terry @ActionTiles; GitHub: @cosmicpuppy)
349
I totally disagree that some in-the-wild Beta testing couldnāt make a big difference.
As @JDRoberts points out (and I agree), a significant number of the bugs we discover post-release are ones that were, well, extremely obvious and easy to discover post-release.
It only took a few days before this bug was discovered. It could have been fixed before the release instead of 23 days ā¦ and counting.
I didnāt say that it ācouldnāt make a big differenceā. All I said was that mathematically there is no way to know if you are right or wrong. You may well be right. The problem that ST management faces is still the one I describe: Itās a judgment call whether or not to do something like a beta testing program. You have your opinion about it, and evidently someone in ST management has a different opinion.
It is impossible to say whoās right, you or ST. But, we donāt have to, do we?