SESAME SOLUTIONS

Touch-free smartphone and tablet control.

World’s first completely touch-free smartphone & tablet solution designed for people with mobility disabilities.

Touch-Free Control

Gesture recognition understands small head movements, eliminating the need for touch.

Integrated Voice Control

Users can use their voice to turn on/off the phone, answer phone calls, switch between applications, and use “Ok Google” for many more voice commands.

Download Apps

Touch-free interface extends to nearly any app from the Google Play store.

Works Out of the Box

Works immediately touch-free, no additional set-up required.

Lightweight Mobile Design

The Sesame solution utilizes Motorola’s Moto Z3 Play and Moto X4 smartphones or Samsung’s Galaxy Tab S3 tablet.

Affordable & Elegant

No external hardware required.

Who is it for?

People who cannot use their hands to control a smartphone or tablet.

WHO IS IT FOR?

Sesame’s technology was made for people who have limited, or no use of their hands and are able to make small head movements.
The Sesame Phone is highly customizable and works with very small head movement range.


Spinal Cord Injuries (SCI)

Amputees

Cerebral Palsy (CP)

Muscular Dystrophy

Lou Gehrig’s Disease (ALS)

Multiple Sclerosis (MS)

Arthritis

HOW DOES IT WORK?

The Sesame solution works by tracking the user’s head movements using the built-in, front-facing camera on the phone or tablet. These tracked movements are combined with cutting-edge computer vision algorithms to create a cursor that appears on the screen of the mobile device, similar to a cursor on a computer screen.

The on-screen cursor is controlled by the position and movements of a user’s head, and supports even minimal movements. Any and all features of the device can be operated that users would normally operate using one finger on screen. Touch, swipe, browse, play, download, and more – it’s all possible using the Sesame smartphone.

Voice control is integrated to provide a truly hands-free experience for accessing the device. To turn the phone on users just need to say “Open Sesame” and it will wake up and start tracking the user’s head.

moto-Z3-play

Motorola Moto Z3 Play


Operating System
Android™ 8.1 Oreo™
Processor
Qualcomm® Snapdragon™ 835 2.35 GHz octa-Core CPU & Adreno 540 GPU, 850 MHz
Memory (RAM)
4 GB
Storage (ROM)
64 GB with microSD Card support (up to 2 TB)
Dimensions
Height:
156.5 mm; Width: 76.5 mm; Depth: 6.75 mm
Weight
156g
Display
6.01” 2160 x 1080p Full HD+ OLED, Corning® Gorilla® Glass 3
Battery
All-day battery* (3,000 mAh) TurboPower™ Half a day’s power in half an hour.
Rear Camera
12 MP; ƒ / 2.0 aperture; 4K Ultra HD video (30 fps)
Front Camera
8 MP; ƒ / 2.0 aperture; Wide-Angle lens; screen flash
SIM Card
Nano-SIM
Wi-Fi
802.11 a/ac/b/g/n (2.4 GHz + 5 GHz)
Bluetooth® Technology
Bluetooth version 5.0
Connectivity:
3.5 mm headset jack
Carrier Tested
Smartphone is unlocked for Verizon, Sprint, AT&T, T-Mobile, and compatible GSM networks.
Samsung s3 tab

Tablet – Samsung Galaxy Tab S3


Operating System
Android™, v7.0 Nougat™ upgradable to 8.0 Oreo™
Processor
Quad-core (2×2.15 Quad Kryo and 2×1.6 GHz Kryo) Qualcomm MSM 8996 Snapdragon™ 820 with Adreno 530 GPU
Memory (RAM)
4 GB
Storage (ROM)
32 GB internal, up to 256 GB microSD
Dimensions
Height:
9.34″; Width: 6.65″; Depth: 0.24″
Weight
15.1 oz.
Display
9.7” (2048 x 1536) QXGA AMOLED
Battery
6,000 mAh
Rear Camera
13 MP Autofocus
Front Camera
5 MP
SIM Card
n/a
Wi-Fi
802.11 a/b/g/n/ac (2.4 GHz + 5 GHz)
Bluetooth® Technology
Bluetooth version 4.2, A2DP, LE
Connectivity
3.5 mm headset jack, stereo
Speakers
Built-in speaker
 

GETTING STARTED

To help you get started, we’ve composed a list of recommendations for first time use. Please follow these tips, watch our video tutorials and check out our FAQ.

1

FIRST TIME WIZARD

The first time you use the device, an instructional app will walk you through the basics of using the Touch-Free interface.

2

Positioning

Position the phone so that it is facing the user, on a sturdy mount, approximately 15-25″ (40-60cm) from the user.

3

Lighting

Since the camera is used to track the user, it is best to use the Sesame Phone in a well-lit room, without direct light sources in the background.

4

Open Sesame!

When the phone is powered on (requires assistance), starting to use it is just a matter of saying Open Sesame!

5

Settings

You can access the Sesame Settings through the apps menu. You can adjust the amount of head movement required, dwell times, cursor size, and many other aspects.

6

Android

Beyond it being Touch-Free, the Sesame Phone is a standard Android phone.

 

TESTIMONIALS

TUTORIALS

FAQ

Setup & Getting Started

The Sesame Phone should be mounted facing the user’s face, while his head is in a natural relaxed position, around 15-25″ (40-60cm) from his/her face. The initial introduction process guides you on how to get this right.
Yes we do. We recommend stands manufactured by REHadapt, world’s leading manufacurer of mounting assistive technology.
If you just received the Sesame Phone, you should have someone power it on for the first time. The power button is on the right hand side, and requires a push-and-hold to power on the phone. This process requires external assistance, but it isn’t repeated afterwards as long as the phone has battery.
Once the phone is powered on, even if in idle/sleeping state – just say “Open Sesame” and it will turn on and start searching for your face to give control over the phone. (If voice control isn’t an option, the phone can be turned on with assistance by pressing the power button shortly and then the on-screen Open Sesame button.)
Once activated, the phone will focus on your face, and from there on an on-screen cursor will follow your head around. So if you turn your head right, the cursor will go right, etc. This acts like a mouse cursor through which you can control the entire phone.
To make clicks (or swipes), hover with the mouse cursor over one spot, and a selection dialog will open up. To click move the small circle towards the green circle (Tap), and once it’s selected return the small circle to the center of the dialog. This will generate a tap where you initially hovered.
A similar process is done for swiping (but selecting the purple circle instead), and under the blue circle (More Options) you’ll find modes for always clicking or swiping, without needing to select between them.
Yes. Please look for the Sesame Settings app in the device’s app folder. Sensitivity can be controlled separately for the X & Y axis. Dwell times, cursor size, control modes and more can also be configured.

How does it work?

The Sesame Phone is powered by both Voice-Control and Computer-Vision technologies. The phone listens for you to say “Open Sesame” to turn on. From there on the front-facing camera is used and with advanced Computer Vision algorithms the phone follows the user’s head with great precision.
We have gone to great lengths to offer the complete Android experience for our users. It’s not just this or that app, but rather a single interface that works for any Android app. So you can obviously call, text, mail, browse, etc. but you can also download any app you want and use it Touch-Free.
The Sesame Phone works by tracking small head movements. While sensitivity can be configured to accommodate even the slightest movements, you still need to have some movement. And to control the mouse with sufficient accuracy, your head movements should be rather controlled and stable.
We have found people with Spinal Cord Injuries to work with it at ease. Also people with MS, ALS (at some stages), amputees and more. Currently we do not recommend the phone for people with Cerebral Palsy, although we have witnessed cases of some success with the phone.
Our algorithms are written to cater all people and accessories.
So it shouldn’t be a problem, but if you find the phone does not automatically find your face – please try disabling the Auto Face Detection option in Sesame Settings, and try again. Use your finger to mark where the face is in the frame when the camera shows up.


The Sesame Story

Sesame started from a serendipitous connection between a high-current engineer, turned quadriplegic 10 years ago, and a young computer vision expert. Oded Ben Dov, the latter, was demonstrating a game on TV that was controlled using head gestures. A day after the phone rings, and on the line is Giora Livne – “Hello, I can’t move my hands or legs, could you make me a smartphone I could use?”

That was the starting gun for Sesame Enable. The two partnered up and set to create the world’s first Touch-Free Smartphone. The mission was to open a new door for millions who were left outside the smartphone revolution due to limited or no hand movement. Giora just wanted the phone to “order flowers for my wife”, but it was apparent that many are in similar conditions and that they all want the independence and privacy of using a smartphone by themselves.

Today the company has already launched several products in this area, and are looking forward to making more products accessible for people with disabilities. It is becoming the “young, fresh and extremely tech-y” company, in an often over-looked and under-served space.

Sesame in Media