Архив метки: Sight Tech Global

Accessibility’s nextgen breakthroughs will be literally in your head

Jim Fruchterman
Contributor

Share on Twitter

Jim Fruchterman is the founder of Tech Matters and Benetech, nonprofit developers of technology for social good.

More posts by this contributor

A $6 trillion wake up call for the tech industry

Predicting the future of technology for people with visual impairments is easier than you might think. In 2003, I wrote an article entitled “In the Palm of Your Hand” for the Journal of Visual Impairment & Blindness from the American Foundation for the Blind. The arrival of the iPhone was still four years away, but I was able to confidently predict the center of assistive technology shifting from the desktop PC to the smart phone. 
“A cell phone costing less than $100,” I wrote, “will be able to see for the person who can’t see, read for the person who can’t read, speak for the person who can’t speak, remember for the person who can’t remember, and guide the person who is lost.” Looking at the tech trends at the time, that transition was as inevitable as it might have seemed far-fetched.
We are at a similar point now, which is why I am excited to play a part of Sight Tech Global, a virtual event Dec. 2-3 that is convening the top technologists to discuss how AI and related technologies will usher in a new era of remarkable advances for accessibility and assistive tech, in particular for people who are blind or visually impaired.
To get to the future, let me turn to the past. I was walking around the German city of Speyer in the 1990s with pioneering blind assistive tech entrepreneur Joachim Frank. Joachim took me on a flight of fancy about what he really wanted from assistive technology, as opposed to what was then possible. He quickly highlighted three stories of how advanced tech could help him as he was walking down the street with me. 

As I walk down the street, and walk by a supermarket, I do not want it to read all of the signs in the window. However, if one of the signs notes that kasseler kipchen (smoked porkchops, his favorite) are on sale, and the price is particularly good, I would like that whispered in my ear.
And then, as a young woman approaches me walking in the opposite direction, I’d like to know if she’s wearing a wedding ring.
Finally, I would like to know that someone has been following me for the last two blocks, that he is a known mugger, and that if I quicken my walking speed, go fifty meters ahead, turn right, and go another seventy meters, I will arrive at a police substation! 

Joachim blew my mind. In one short walk, he outlined a far bolder vision of what tech could do for him, without bogging down in the details. He wanted help with saving money, meeting new friends and keeping himself safe. He wanted abilities which not only equaled what people with normal vision had, but exceeded them. Above all, he wanted tools which knew him and his desires and needs. 
We are nearing the point where we can build Joachim’s dreams.  It won’t matter if the assistant whispers in your ear, or uses a direct neural implant to communicate. We will probably see both. But, the nexus of tech will move inside your head, and become a powerful instrument for equality of access. A new tech stack with perception as a service. Counter-measures to outsmart algorithmic discrimination. Tech personalization. Affordability. 
That experience will be built on an ever more application rich and readily available technology stack in the cloud. As all that gets cheaper and cheaper to access, product designers can create and experiment faster than ever. At first, it will be expensive, but not for long as adoption – probably by far more than simply disabled people – drives down price. I started my career in tech for the blind by introducing a reading machine that was a big deal because it halved the price of that technology to $5,000. Today even better OCR is a free app on any smartphone.
We could dive into more details of how we build Joachim’s dreams and meet the needs of millions of others of individuals with vision disabilities. But it will be far more interesting to explore with the world’s top experts at Sight Tech Global on Dec. 2-3 how those tech tools will become enabled In Your Head!
Registration is free and open to all. 

Accessibility’s nextgen breakthroughs will be literally in your head

Microsoft’s Seeing AI founder Saqib Shaikh is speaking at Sight Tech Global

When Microsoft CEO Satya Nadella introduced Saqib Shaikh on stage at BUILD in 2016, he was obviously moved by the engineer’s “passion and empathy,” which Nadella said, “is going to change the world.”
That assessment was on the mark because Shaikh went on to co-found the mobile app Seeing AI, which is a showcase for the power of AI applied to the needs of people who are blind or visually impaired. Using the camera on a phone, the Seeing AI app can describe a physical scene, identify persons and their demeanor, read documents (including handwritten ones), read currency values and tell colors. The latest version uses haptic technology to help the user discover the position of objects and people in an image. The app has been used 20 million times since launch nearly three years ago, and today it works in eight languages.
It’s exciting to announce that Shaikh will be speaking at Sight Tech Global, a virtual, global event that addresses how rapid advances in technology, many of them AI-related, will influence the development of accessibility and assistive technology for people who are blind or visually impaired. The show, which is a project for the Vista Center for the Blind and Visually Impaired Silicon Valley, launched recently on TechCrunch. The virtual event is Dec. 2-3 and free to the public. Pre-register here. 
Shaikh lost his vision at the age of 7, and attended a school for blind students, where he was intrigued by computers that could “talk” to students. He went on to study computer science at the U.K.’s University of Sussex. “One of the things I had always dreamt of since university,” he says, “was something that could tell you at any moment who and what’s going on around you.”  That dream turned into his destiny.
After he joined Microsoft in 2006, Shaikh participated in Microsoft’s annual, week-long hackathons in 2014 and 2015 to develop the idea of applying AI in ways that could help people who are blind or visually impaired. Not long after, Seeing AI became an official project and Shaikh’s full-time job at Microsoft. The company’s Cognitive Services APIs have been critical to his work, and he now leads a team of engineers who are leveraging emerging technology to empower people who are blind.
“When it comes to AI,” says Shaikh, “I consider disabled people to be really good early adopters. We can point to history where  blind people have been using talking books for decades and so on, all the way through to OCR text-to-speech, which is early AI. Today, this idea that a computer can look at an image and turn it into a sentence has many use-cases but probably the most compelling is to describe that image to a blind person. For blind people this is incredibly empowering.” Below is a video Microsoft released in 2016 about Shaikh and the Seeing AI project. 

The Seeing AI project is an early example of a tool that taps various AI technologies in ways that produce an almost “intelligent” experience. Seeing AI doesn’t just read the text, for example, it also tells the user how to move the phone so the document is in the viewfinder. It doesn’t just tell you there are people in front of you, it tells you something about them, including who they are (if you have named them in the past) and their general appearance.
At Sight Tech Global, Shaikh will speak about the future of Seeing AI and his views on how accessibility will unfold in a world more richly enabled by cloud compute, low latency networks and ever more sophisticated AI algorithms and data sets. 
To pre-register for a free pass, please visit Sight Tech Global.
Please follow the event on Twitter @Globalsight.
Sponsors are welcome, and there are opportunities available ranging from branding support to content integration. Please email sponsor@sighttechglobal.com for more information.

Microsoft’s Seeing AI founder Saqib Shaikh is speaking at Sight Tech Global