Nest hello doorbell facial recognition unlock door


(John O) #1

This morning I got my nest doorbell to unlock my door when it recognized my face.

I used tasker, notification listener and sharptools

1st I taught nest doorbell to recognize my face.
2nd I have notification listener read the notification sent by nest in my case (John is at the front door)
if the word John is in the notification from nest, a task is ran from tasker using sharptools to unlock my front door.

Im sure many will point out the security flaws in this, I basically did it just to see if it was possible.
I did it 2 ways…letting the doorbell just see me (without me pressing it) the delay was about 10 seconds .

when i pressed the doorbell the notification gets sent much faster and only took about 3 seconds.

The idea came to me when i was using tasker to pull up a bigger view in Action Tiles on which camera noticed activity.

Again I’m sure there are many downsides to this I was just seeing if i could be done and wanted to share.

(Joshua Lyon ( Dashboard)) #2

That’s awesome! Thanks for sharing your SharpTools use case!

(MacTechGenius) #3

Thanks for sharing!

I want to have the ability to turn on lights if someone rings my Nest Hello or if motion is detected in a specific zone. I think this may be the solution?

But I don’t have any android devices but I do have a Mac that runs 24/7. Any emulator I can use?

(John O) #4

I don’t know of an emulator for Mac. I was just thinking you might be able to accomplish something like you want using Nest manager and webCoRE. I’m pretty sure nest manager can detect camera motion, and pass that to webCoRE?!?!?

or get a old cheap android phone/tablet that can run tasker and SharpTools and leave that plugged in

what I liked about SharpTools and tasker, is i can have the events filtered buy whats in the notification from Nest. I have a zone setup in my Camera called sidewalk and another called road. if i get a notification like motion road from nest that is ignored but if the notification has the word sidewalk in it then the task can run.
I also THINK? in tasker using SharpTools you can further restrict the task from running depending on what mode Smartthings is in. In your case I’m guessing you wouldn’t want your light to come on while in day mode but would want it to come on while in night mode

wish i could be more help.

(MacTechGenius) #5

Can you upload screenshots of the config for tasker/sharptools/notification listener. I just got the emulator running on my Mac but unsure about the specifics of the setup.


(John O) #6

(MacTechGenius) #7

I am unable to select my location on SharpTools…it simply crashes when I try to select it.

Any other way?

Nevermind…I changed my emulator from Nox to Bluestack and got it working. Now need to finish the setup.

(John O) #8

I’m in no way an expert on SharpTools or Mac I suggest you reach out to @joshua_lyon

(Joshua Lyon ( Dashboard)) #9

If you want to send me the logs, I’d be happy to take a look. If it’s literally crashing when you tap the drop-down under the “From” field in the screenshot, then it might be the emulator itself which is crashing since that’s a webview (hosted by the underlying Android OS).

As @johnosstyn mentioned, it might be easier just to pick up a cheap Android phone. You can pick up a cheap phone for under $50 if it’s just going to be used for Tasker automations.

It looks like nox is an emulator for gaming purposes, so if that’s causing the issue, you might try a different emulator. I’ve used both Genymotion and the official Android Emulator on Windows PCs with good results in the past.

(MacTechGenius) #10

This is my setup…so if my Nest notifications contains “spotted” it will toggle the simulated “Nest Hello Motion” switch in ST. And if the notification contains “door” it will toggle the simulated “Nest Hello Ring”. I will then use WebCore to detect when the virtual switch changes and toggle the lights only at night (between sunset and sunrise).

Does SharpTools support a simulated button? I am currently using a virtual switch but a simulated button would make the setup cleaner.

I am going to test out the setup when I get home but here are some screenshots from the emulator. @johnosstyn would you able to confirm if this looks right?

When Nest Hello Detects Motion:

When someone Rings Doorbell

Thanks for your help!

(Joshua Lyon ( Dashboard)) #11

As long as the device has one of the supported capabilities shown in the authorization screen, then you can authorize it in SharpTools. If your Simulated Button doesn’t have a supported capability, you can either add a switch capability to the DTH or use a Simulated Switch and have webCoRE turn the switch off once it has taken its desired action.

Edit: The currently supported capabilities during authorization are: switch, motionSensor, lock, alarm, thermostat, mediaController, musicPlayer, speechSynthesis, colorControl, valve, contactSensor, waterSensor, presenceSensor, temperatureMeasurement

(John O) #12

I’ve been playing with this and found a better way. In the notification listener leave everything blank except the app you are using (in your case nest)

Then set the filter in the if statement of your task.

Note I put * on each side of the word I’m looking for
I. E. john

(John O) #13

NOTE… use %nltext is you are searching for that word in the text of your notification use %nltitle if you are searching for your word in the title of your notification

(MacTechGenius) #14

Do you know how I can limit the actions to only my Nest Hello’s? I have two of them. I have other Nest cams and don’t want into to react when a different one spots a person.

(John O) #15

I’m not sure I’m doing this right or not, but in this case I have Tasker only responding to my nest cam in the driveway. The camera is named driveway and I put the filter in notification listener. Again not sure if this is the correct way but it does work.