SESAME SOLUTIONS

Touch-free smartphone and tablet control.

World’s first completely touch-free smartphone & tablet solution designed for people with mobility disabilities.

Touch-Free Control

Gesture recognition understands small head movements, eliminating the need for touch.

Integrated Voice Control

Users can use their voice to turn on/off the phone or switch between applications.

Download Apps

Touch-free interface extends to nearly any app from the Google Play store.

Works Out of the Box

Works immediately touch-free, no additional set-up required.

Lightweight Mobile Design

The Sesame solution uses Google’s Nexus 5X smartphone.

Affordable & Elegant

No external hardware required.

Who is it for?

People who cannot use their hands to control a smartphone or tablet.

WHO IS IT FOR?

Sesame’s technology was made for people who have limited, or no use of their hands and are able to make small head movements.
The Sesame Phone is highly customizable and works with very small head movement range.


Spinal Cord Injuries (SCI)

Amputees

Cerebral Palsy (CP)

Muscular Dystrophy

Lou Gehrig’s Disease (ALS)

Multiple Sclerosis (MS)

Arthritis

HOW DOES IT WORK?

The Sesame solution works by tracking the user’s head movements using the built-in, front-facing camera on the phone or tablet. These tracked movements are combined with cutting-edge computer vision algorithms to create a cursor that appears on the screen of the mobile device, similar to a cursor on a computer screen.

The on-screen cursor is controlled by the position and movements of a user’s head, and supports even minimal movements. Any and all features of the device can be operated that users would normally operate using one finger on screen. Touch, swipe, browse, play, download, and more – it’s all possible using the Sesame smartphone.

Voice control is integrated to provide a truly hands-free experience for accessing the device. To turn the phone on users just need to say “Open Sesame” and it will wake up and start tracking the user’s head.



Google Nexus 5X


Operating System
Android OS, v6.0 (Marshmallow)
Processor
Qualcomm MSM8992 Snapdragon 808 Hexa-core (4×1.4 GHz Cortex-A53 & 2×1.8 GHz Cortex-A57)
Memory (RAM)
2 GB
Storage (ROM)
16 GB / 32 GB
Dimensions
Height:
147 mm; Width: 72.6 mm; Depth: 7.9 mm
Weight
136g
Display
5.2” 1080 x 1920 pixels
Battery
2700 mAh
Rear Camera
12.3 MP; ƒ / 2.0, video
Front Camera
5 MP; ƒ / 2.0
SIM Card
Nano-SIM
Wi-Fi
802.11 a/b/g/n (2.4 GHz + 5 GHz)
Bluetooth® Technology
Bluetooth version 4.2, A2DP
Connectivity:
3.5 mm headset jack
Carrier Tested
Nexus 5X is unlocked and confirmed to work on Verizon, AT&T, T-Mobile and Sprint


Tablet – Google Pixel C


Operating System
Android OS, v6.0.1 (Marshmallow)
Processor
Nvidia Tegra X1 quad-core 1.9 GHz
Memory (RAM)
3 GB
Storage (ROM)
32 GB / 64 GB
Dimensions
Height:
170 mm; Width: 242 mm; Depth: 7 mm
Weight
517g
Display
10.2” 2560 x 1800 pixels
Battery
34.2 Wh
Rear Camera
8 MP; ƒ / 2.04, video
Front Camera
2 MP
SIM Card
n/a
Wi-Fi
802.11 a/b/g/n (2.4 GHz + 5 GHz)
Bluetooth® Technology
Bluetooth version 4.1, A2DP
Connectivity
3.5 mm headset jack
Speakers
Stereo speakers
GETTING STARTED

To help you get started, we’ve composed a list of recommendations for first time use. Please follow these tips, watch our video tutorials and check out our FAQ.

1

FIRST TIME WIZARD

The first time you use the device, an instructional app will walk you through the basics of using the Touch-Free interface.

2

Positioning

Position the phone so that it is facing the user, on a sturdy mount, approximately 15-25″ (40-60cm) from the user.

3

Lighting

Since the camera is used to track the user, it is best to use the Sesame Phone in a well-lit room, without direct light sources in the background.

4

Open Sesame!

When the phone is powered on (requires assistance), starting to use it is just a matter of saying Open Sesame!

5

Settings

You can access the Sesame Settings through the apps menu. You can adjust the amount of head movement required, dwell times, cursor size, and many other aspects.

6

Android

Beyond it being Touch-Free, the Sesame Phone is a standard Android phone. For information on common tasks using an Android, please see this link.

TESTIMONIALS

TUTORIALS

General Use

Watch an example session of using the Sesame Phone, start to finish.

How to Place the Phone

Shows how to properly position the Sesame Phone prior to first use.

Starting Sesame

Possible methods of starting Sesame’s Touch-Free control

Click Types

Demonstrates how to perform click, swipe, long click, and more

Auto Click Type Modes

Demonstrates Auto Click Modes, for fast clicking or swiping

Cursor Lock/Pause

Lock or Pause the cursor if you need a break to think, read, talk to someone, etc.

Making a Phone Call

Demonstrates making a phone call using Sesame

Customization / Settings

How to customize Sesame’s settings to best fit your experience

Handling Orientations

Shows how to handle different device (or app) orientations

FAQ

Setup & Getting Started

The Sesame Phone should be mounted facing the user’s face, while his head is in a natural relaxed position, around 15-25″ (40-60cm) from his/her face. The initial introduction process guides you on how to get this right.
Yes we do. We recommend stands manufactured by REHadapt, world’s leading manufacurer of mounting assistive technology.
If you just received the Sesame Phone, you should have someone power it on for the first time. The power button is on the right hand side, and requires a push-and-hold to power on the phone. This process requires external assistance, but it isn’t repeated afterwards as long as the phone has battery.
Once the phone is powered on, even if in idle/sleeping state – just say “Open Sesame” and it will turn on and start searching for your face to give control over the phone. (If voice control isn’t an option, the phone can be turned on with assistance by pressing the power button shortly and then the on-screen Open Sesame button.)
Once activated, the phone will focus on your face, and from there on an on-screen cursor will follow your head around. So if you turn your head right, the cursor will go right, etc. This acts like a mouse cursor through which you can control the entire phone.
To make clicks (or swipes), hover with the mouse cursor over one spot, and a selection dialog will open up. To click move the small circle towards the green circle (Tap), and once it’s selected return the small circle to the center of the dialog. This will generate a tap where you initially hovered.
A similar process is done for swiping (but selecting the purple circle instead), and under the blue circle (More Options) you’ll find modes for always clicking or swiping, without needing to select between them.
Yes. Please look for the Sesame Settings app in the device’s app folder. Sensitivity can be controlled separately for the X & Y axis. Dwell times, cursor size, control modes and more can also be configured.

How does it work?

The Sesame Phone is powered by both Voice-Control and Computer-Vision technologies. The phone listens for you to say “Open Sesame” to turn on. From there on the front-facing camera is used and with advanced Computer Vision algorithms the phone follows the user’s head with great precision.
We have gone to great lengths to offer the complete Android experience for our users. It’s not just this or that app, but rather a single interface that works for any Android app. So you can obviously call, text, mail, browse, etc. but you can also download any app you want and use it Touch-Free.
The Sesame Phone works by tracking small head movements. While sensitivity can be configured to accommodate even the slightest movements, you still need to have some movement. And to control the mouse with sufficient accuracy, your head movements should be rather controlled and stable.
We have found people with Spinal Cord Injuries to work with it at ease. Also people with MS, ALS (at some stages), amputees and more. Currently we do not recommend the phone for people with Cerebral Palsy, although we have witnessed cases of some success with the phone.
Our algorithms are written to cater all people and accessories.
So it shouldn’t be a problem, but if you find the phone does not automatically find your face – please try disabling the Auto Face Detection option in Sesame Settings, and try again. Use your finger to mark where the face is in the frame when the camera shows up.



The Sesame Story

Sesame started from a serendipitous connection between a high-current engineer, turned quadriplegic 10 years ago, and a young computer vision expert. Oded Ben Dov, the latter, was demonstrating a game on TV that was controlled using head gestures. A day after the phone rings, and on the line is Giora Livne – “Hello, I can’t move my hands or legs, could you make me a smartphone I could use?”

That was the starting gun for Sesame Enable. The two partnered up and set to create the world’s first Touch-Free Smartphone. The mission was to open a new door for millions who were left outside the smartphone revolution due to limited or no hand movement. Giora just wanted the phone to “order flowers for my wife”, but it was apparent that many are in similar conditions and that they all want the independence and privacy of using a smartphone by themselves.

Today the company has already launched several products in this area, and are looking forward to making more products accessible for people with disabilities. It is becoming the “young, fresh and extremely tech-y” company, in an often over-looked and under-served space.