This research focuses on the privacy and security of the Deaf patient information when using the video relay application to comply with legislation in terms of the South African Protection of Private Information (POPI) Act of 2013. Several video encryption techniques will be investigated to allow for video data security and transit of the sign language communication, together with authentication methods for user authentication. The Action research methodology will be used throughout the research, as there will be consultative sessions with the Deaf community, security experts and legal consultants for input and direction regarding privacy and security and application functionality.

PROJECTS

SignSupport is sufficient to bridge some predictable conversation. In the case of complicated communication, which a Deaf person and a pharmacist (or anyone else) may need assistance for interpretation, the Deaf patient (the owner of the phone) can use a video call option to contact a register and qualified South African Sign Language interpreter. The interpreter would then be able to mediate between the two parties.

PROJECTS

Deaf people are now able to communicate with each other in sign language by using video call or message capabilities available on smart phones. This represents a significant improvement in lifestyle choices where previously communication was limited to text in a 2nd language such as Afrikaans, English or Xhosa.

The Deaf Contact Centre delivers the ability to service communication in Sign Language by leveraging rich digital media calls or messages, as well as more traditional communication modes such as text and file transfer. The specifics of the modes allows for effective asynchronous messaging, enabling the reduction in the complexity of the technical solutions to manage the queuing and handling of the communication.

The centre also allows for an ecosystem of rich capabilities embedded in mobile apps to structure and formalise messages to deliver complex services when users have a simple interface. the EMS project utilises this capability to deliver emergency support.

PROJECTS

SignSupport for pharmacy follows a protocol defined by pharmacists to gather and provide health information in SASL to support a Deaf patient’s understanding of the diagnosed condition(s) and treatment adherence.

While waiting for medication at the hospital pharmacy, the patient can update the patient’s medical profile which are in-line with the pharmacy protocol. For example, information about patient’s gender, pregnancy status(if female), weight, food allergy, medicine allergy, current medication use, current sickness, smoking status, alcohol drinking status, adequate meal time consumption, and access to clean water.

When it is time for the patient to collect medication, the app prompts interaction between the pharmacist and the Deaf patient. The app guides the pharmacist to type in each medication instructions as prescribed. Picture of each medication can be taken, so the patient can see its picture, instead of having to read the medicine name. Once the pharmacist finishes giving the medication instructions by making selections of the available options, the app will match them with the pre-recorded videos in SASL. The app will then compile and orchestrate the medication instructions in SASL video format for the patient to watch. The instructions will be saved on the phone, so the patient can review it before taking the medication.

PROJECTS

SignSupport for diabetes care is designed with its extension called, the Health Knowledge Transfer System (HKTS).

From conceptual design SignSupport is developed for communication bridging, or in other words, health consultations. HKTS, as the extension of SignSupport, is designed as information pool which a health professional can refer the relevant health information to the diagnosed disease to a Deaf patient. The information stored in the HKTS is designed to be accessible for Deaf audience by applying the information delivering techniques which are recommended by Deaf people in SASL.

Diabetic Deaf patient’s journey in a process of care at a primary health center

Design framework of SignSupport and HKTS

The figure below illustrates how SignSupport and HKTS is designed to work together. SignSupport prompts a Deaf user to create a patient account (only applicable to a new user of the system), then to update the patient profile and prepare for a health facility visit. The app assists the communication and interactions between the Deaf patient and each staff/health professional involved the diabetes care process. SignSupport will pull data from HKTS when a staff or a health professional refers some health information (pre-recorded in video form) for the patient to watch.

PROJECTS

The EMS App project aims to deliver a system for providing assistance to Deaf people in an easy to use way.

It is a combination of short video content on diverse First Aid subjects such as CPR, Fainting, Recovery Positions etc, and the guided assembly of specific structured messages to request Emergency help. Location messages are included.

The EMS App has the potential to deliver speedy assistance to not only the Deaf, but also anyone who is unable to communicate in the languages currently used by the Emergency Services in this country.

PROJECTS

Together in multi-stakeholder teams (see partners), we design novel assistive technologies with and for marginalised Deaf communities in the Western Cape province of South Africa.

The team is currently busy with iterative and incremental design and evaluation of a mobile app suite that bridges information and communication gaps for Deaf people in the language that Deaf people understand: South African Sign Language (SASL).

The tool suite consists of the following:
SignSupport for EMS
SignSupport for diabetes
SignSupport for pharmacy
SignSupport Deaf contact centre

Other SignSupport prototypes include:
SignSupport for data collection
SignSupport authoring tool
SignSupport for ICDL training

We are generalising this tool suite to handle:
– multiple limited interaction scenarios
– multiple languages
– multiple form factors and operating system platforms.

PROJECTS