Continuing the Legacy: Assistive Technologies at MIT

September 2, 2014

"I don't know that I would go so far as to say that technology advances hurt people with disabilities, but what you see happening is that when there is some sort of technological advance that becomes ubiquitous in the world and there is a class of people who can't use it, they're left behind.”    —  Seth Teller

The instructors gather to plan the fourth offering of Principles and Practice of Assistive Technology (6.811) including (ltr) instructor Grace Teo, Michelle Chen, Prof. Rob Miller, Abigail Klein and William Li.Jeffrey Drucker, seated center, describes some of the needsof people who are visually impaired to a group of assistive technologies students, from left Nick Wang, postdoctoral associate, Rahul  Namdev, EECS graduate student, William Li, EECS graduate student, seated, and right, Alessandro Frigerio.The blicycle, an off-the-counter bicycle which has been outfitted with assistive technology to enable people who are blind or vision impaired to ride. The work has been done by students starting in PPAT since 2011 under Prof. Seth Teller's guidance.An assistive technology adapted bicycle (a blicycle) is steered in part by a vibrating signal in the handles.PPAT presentations end of Fall 2011 term. The Blicycle team including from left by projection screen Steve Levine, Emily Obert and Sunish Gupta. William Li, then PPAT TA hands out project summaries to visitors.Students gather for the first AT Hack event held in spring 2014.One of the AT Hack teams works to prototype a Smart Walker to help a client with a mobility disability rise after a fall.AT Hack students worked a 10 hour day to build out prototypes based on one-on-one work with their client.2013 PPAT students Casey Chiou, left, and Jason Strauss, right help adjust a new nurse call system for Janet Gardner at The Boston Home in Dorchester, MA.Easily handled remote controllers were designed for Janet Gardner at The Boston Home in 2012 to allow for better communication when help was needed.On the right, an Arduino, an open source microprocessor which was programmed to have the the microphone, buttons, and LEDs interact with each other to trigger The Boston Home's nurse call system. On the left an Arduino EasyVR Shield, a board which can be added to the Arduino to provide voice recognition capabilities.Seth Teller, third from left, appears with members of the MIT Fifth Sense Project, a group of MIT and Northeastern University students who aided people with visual disabilities by developing wearable devices. From left: Nick Wang, David Hayden, Prof. Teller, Ryan Fish, Prof. Carol Livermore, Laura Biancalani (President of Andrea Bocelli Foundation), Xin Xie, and Yafim Landa.

The late Professor Seth Teller created Principles and Practice of Assistive Technology (PPAT, 6.811) in the Fall of 2011. Through his extensive experience developing assistive technologies (AT) at MIT, his compassion for making technology available to all, and his innovative approach and drive to build this class, student interest in PPAT and AT has grown steadily since.

Following Teller’s untimely death on July 1 this year, a group of former PPAT and AT students including his graduate student William Li, SM ‘12, who TA’d the inaugural PPAT offering and Grace Teo, HST PhD ‘14 student and member of the MIT Assistive Technology Club, and a core group of students who took the class in 2013 have formed a team to continue Teller’s legacy through both PPAT and its outgrowth the ATHack, a one-day workshop launched in spring 2014. Li and Teo, who will co-instruct the class and three other members of the team will work with Professor Rob Miller, MIT MacVicar Faculty Fellow and member of the Computer Science and Artificial Intelligence Lab (CSAIL).

Every year since the inaugural offering of PPAT, Miller has worked with Teller, his CSAIL colleague to help develop and teach the course. This was a natural fit since Miller’s research group, the User Interface Design Group, has been involved in work on assistive technology.

Miller says about the class: “Unlike other design classes, which tend to focus on a market need — which is, very often, a need that the students themselves have — PPAT really pushes students out of their usual comfort zone, and drives them to understand another person’s problems and design solutions for them.” He adds, “That’s an incredibly valuable educational experience.”

Need-based design fits well with learning experience

Nicholas Roy, left, assistant professor of aeronautics and astronautics, and Seth Teller, professor of computer science and engineering, stand next to the robotic wheelchair they co-designed, which can be navigated by vocal command.  Photo / Patrick GilloolyTeller’s understanding of the unique challenges of creating novel, practical assistive technologies fed directly into the organization of PPAT. Given the highly specific needs and diversity of interests that people with disabilities have, there is almost an endless demand for assistive technology projects in the community. PPAT was designed to provide the structure to allow student teams to work with clients while learning underlying principles related to design, disability and AT development through multiple prototype iterations of their work.

Li notes that one of the more subtle but profound innovations to PPAT’s setup is a written agreement signed by each team and client at the start of their project to set expectations and accept associated uncertainties in reaching the best solution. The students pledge to listen carefully and understand the client’s context and reality, communicate frequently and openly and work hard to develop a lasting solution. Clients likewise pledge to provide feedback, try different iterations of the design, and acknowledge that the final product might not yield a successful assistive device. The most meaningful end result is a working partnership between students and client — often a mutually beneficial learning experience.

One of Li’s most vivid memories of his work with Prof. Teller was the campus accessibility lab for which manual wheelchairs were rented to enable students to go around campus doing activities and visiting spaces to better understand the challenges that a wheelchair user might face. “He drove the wheelchair and tested the limits of its speed and maneuverability and was vocally frustrated by inaccessible features of campus (out-of-door automatic doors, dangerous uneven outdoor surfaces, and improper signage),” Li noted. In their follow-up discussion, Li and Teller decided to file dozens of MIT Facilities requests. “As with so many other things, Seth took on this task with excitement and vigor, a dissatisfaction for the status quo and a desire to make things better.” [MIT News photo, above, taken in 2008 by Patrick Gillooly: Nicholas Roy, left, then assistant professor of aeronatuics and astronautics and Seth Teller, professor of computer science and anengineering, stand next to the robotic wheelchair they co-designed, which can be navigated by vocal command.] 

Grace Teo was so inspired by her experiences with assistive technologies, that she founded and co-chairs Open Style Lab, an educational 10-week summer program at MIT teaming student designers, engineers and occupational therapists to create clothing for people with disabilities. Teo gained advice from Prof. Teller both in selecting clients for Open Style Lab and in managing client relationships and projects.

Principles and Practices in Assistive Technologies spawns AT Hack and new clients

Co-Instructors Li and Teo lead the first class meeting of PPAT (6.811) in its fourth year at MIT. Now in its fourth offering, 6.811 has attracted over 50 pre-registrants. Li and Teo have advertised the class as a good fit for students interested in public service, user-centered product design, working closely with a client with a disability (potentially in consultation with their caregivers and/or clinicians), and tackling difficult, real-world problems. They will be aided by PPAT teaching assistant Michelle Chen, BS ’14, MS ’15, and lab assistants Ishwarya Ananthabhotla, BS ’15, and Abigail Klein, BS ’14, MS ’15. [Photo left: first day of 6.811 class lead by co-instructors Li and Teo.]

Clients for PPAT are often drawn from centers in the Cambridge and Boston area such as The Boston Home, a specialized-care residence for about 100 adults with multiple sclerosis and other progressive neurological conditions; the Leonard Florence Center for Living, which offers high tech care assistance to people with Lou Gehrig’s disease (ALS) and Multiple Sclerosis (MS); the Carroll Center for the Blind and people affiliated with Perkins School for the Blind; and the Braintree Rehabilitation Center in Newton. In addition, clients from the MIT community including staff and students have come to value the specialized attention that the PPAT students provide. (See the video by Ben Glass and Tommy Girdwood.) All of these sources have been established over the years as Teller continued to develop PPAT.

Another by-product of the class is the ATHack, which was created by several PPAT students in spring 2014 as an intense one-day hackathon to provide an extension of the fall PPAT class. Ananthabhotla and Klein along with Jaya Narain ’14, Jason Yang, ’15, and Sresht Rengesh ’15 organized the first ATHack through financial support from the MIT Public Service Center, the MIT Baker Foundation and other sources. The one-day event allowed two teams 0f 3-4 students each to work intensively with their clients on AT projects – including QR code readers for medicine bottles, auditory application to guide blind users at train stations and “smart walkers to help a client with dystrophied legs stand again after a fall. With continued support, Ananthabhotla and members of the original team are planning to offer an expanded version of ATHack in spring 2015. She notes about AT Hack, “Getting a chance to work on projects tailored to meet client needs across the spectrum of disabilities and engineering disciplines showed us how rewarding working with AT could be.”

Assisting the Legacy of Assistive Technologies at MIT

Steve Levine, one of the original PPAT designers of the blicycle discusses the vibration mechanism to signal the rider about turning.Assistive technologies continue to find a home at MIT in the 3rd floor CSAIL laboratory that Seth Teller had established with his group, the Robotics, Vision, and Sensor Networks Group, as they settled into the Stata Center in 2004. Now, numerous assistive technology projects created via PPAT, and other sources including the Assistive Technology Club established in 2010, are under continued development in an environment that has been so conducive to creative examination and discovery.

Recently, Jeffrey Drucker, a client who is blind shared his articulate reactions to a number of AT projects including the blicycle a project developed in PPAT in 2011 by Steve Levine, currently an EECS graduate student, and Emily Obert. A combination of electrical and mechanical technologies and software were engineered to outfit an off-the-counter bicycle to allow a person who is blind to do what seems unthinkable – to ride it independently!

Levine describes the blicycle’s features. Custom vibrating handlebars signal the rider in what direction and how hard to turn. Sensors including a camera that tracks location and lidar to scan for potential obstacles send data to an onboard computer. The team’s software then signals the direction for the rider to turn via the vibrating handlebars. [Photo left: Drucker discusses the blicycle with Steve Levine.]

The blicycle, which has been tested on indoor running tracks, was initially conceived when client Brian approached Teller in 2010 to fulfill a dream of once more riding a bicycle and at the same time gaining a new way to exercise — something, for which, he explains, people who are vision impaired have few options.

Other students including Ryan Fish, MechE ’15, have worked on this project and recently two visiting students from Italy — Simone Fontanesi and Alessandro Frigerio with the support of the Andrea Bocelli Project, are learning from some of the technologies used for the blicycle to develop a new system to detect pedestrian crossing lines, giving feedback to the user regarding his/her position within the lines. They hope this work can be useful to other projects that arise in PPAT. Inspired by working with the PPAT group and other AT students during their 10-week research visit, Fontanesi and Frigerio were particularly grateful to speak at length with Drucker, who described in detail how he navigates public transportation and walkways to get to a destination such as the Stata Center at MIT.

Rahul Namdev (left), EECS PhD student, describes the Safety Mobility and Navigation project to Jeffery Drucker. The aim of this project is to develop wearable platforms to assist people who are blind or visually impaired to navigate safely and independently. A rapidly refreshable tactile device for private, timely and dense information delivery is treated as a bit-mapped display, to which environmental information can be rendered for the user's consumption. Information can be conveyed both through the tactile device and a stereo aural channel that represent various obstacles and/or hazards.Drucker’s meeting also included discussion on a related project, the Safety Mobility and Navigation system under development by Rahul Namdev, PhD student and Nick Wang, postdoctoral associate. The goal of this technology is to develop wearable platforms to convey live, real-time environmental information to help blind users navigate efficiently and safely without using other assistive tools such as a cane or an assistance animal. This project will ultimately provide information about safe walking regions, hazardous drop-offs, and variables such as ascents, descents, trip hazards, etc., appearing in the path of the visually impaired user. [Photo, right: Namdev (left), demonstrates the prototype technology to Drucker, right. Information can be conveyed both through the tactile device and a stereo aural channel that represent various obstacles and/or hazards.]

If the continuing deep interest on the part of MIT students in assistive technologies is any indication, the foundations that Seth Teller laid in this field will inspire new generations of AT Hackers and PPAT students to partner with new clients and build new life-asserting functionality into their daily lives. And the value of assistive technology, Miller notes, is not necessarily limited to a segment of humanity.

“The fact that PPAT projects also do good in the world, helping people who are otherwise underserved by high tech, is like icing on the cake — not icing, really, but another whole layer of the cake. All of us, unless we’re very, very fortunate, will experience a disability at some point in our lives — whether from illness, accident, or just the ordinary process of aging. I think we should all feel lucky that a generation of MIT students are being challenged to think about, care about, and work on assistive technology.”

Please visit the Seth Teller Memorial Fund to Advance Technology for People with Disabilities. See the video "The Technology We Build: 6.811: Principles and Practice of Assistive Technology (PPAT)" produced by Ben Glass and Tommy Girdwood.



MIT Fifth Sense Project