PhD studentship: Wearable AI for Total Communication Support

Award details

Communication is essential for connecting with loved ones, participating in communities, and engaging in work and hobbies. Effective communication involves both verbal (speaking, writing) and non-verbal (gestures, tone of voice) elements — together often referred to as total communication. Total communication is especially important for people with communication disabilities, who make up one-third of stroke survivors [1] and 2—3 children in every classroom [2].

Current technology design largely overlooks non-verbal communication, focusing primarily on verbal aspects. This affects both assistive technologies (i.e. technologies that support communication) and general communication platforms such as video conferencing. Moreover, existing assistive technologies, typically bulky devices like tablets or large computers, can contribute to social stigma and obstruct vital non-verbal communication pathways.

Our team has a strong track record in developing wearable technologies to support users with communication difficulties, including smartwatches [3], smart glasses [4], and smart badges [5], as well as in understanding video-mediated communication [6].

This PhD will investigate how emerging AI — particularly multimodal large language models — can be integrated with wearable technologies to support real-time communication. For example, imagine assisting someone with word-recall difficulties in a coffee shop, helping them and the barista communicate effectively through AI-driven contextual understanding. Your research will explore both the opportunities and risks of these technologies, focusing on how they can empower users while safeguarding privacy, safety, and individual needs.

You will conduct user-centred design research, develop and test innovative solutions in real-world settings, and contribute to improving communication for people with disabilities.

This project is part of Dr Neate's ~£2M Future Leaders Fellowship. Consequently, you will have exceptional support for equipment — e.g. access to a range of wearables, Apple Vision Pro headsets, AI credits, etc. You will also engage with an exceptional network of partners, collaborators, and advisors, including: Microsoft Research, Tobii Dynavox, Transport for London, Hidden Disabilities, Aphasia Re-Connect, Dyscover, Speech and Language UK, Prof. Jonathan Lazar (University of Maryland), and Prof. Karyn Moffatt (McGill University). The work will also be supported by Prof. Cruice (City St George's, University of London), a leading expert in speech and language therapy.

References

[1] Stroke Association, "State of the nation: stroke statistics," 2016.

[2] L. Black et al., Communication Disorders and Use of Intervention Services Among Children Aged 3-17 Years. US Department of Health & Human Services, 2015.

[3] H. Curtis & T. Neate, "Watch Your Language: Using Smartwatches To Support Communication," in ACM ASSETS, 2023.

[4] H. Curtis, A. Jenkins, S. Ibrahim, T. Neate, Looking Past Screens: Exploring Mixed Reality and Discreet AAC Devices, in ACM ASSETS 2024.

[5] H. Curtis et al., "Breaking Badge: Augmenting Communication with Wearable AAC Smartbadges and Displays," in ACM CHI, 2024.

[6] T. Neate et al., "Just Not Together": The Experience of Videoconferencing for People with Aphasia during the Covid-19 Pandemic," in ACM CHI, 2022.

Award value

Stipend: roughly £22,780.00 per annum, subject to increase

Bench Fees: £1,000.00 per annum

Tuition fees: covered in full for home/overseas students

Eligibility criteria

Dr Timothy Neate is seeking applicants who can demonstrate strong technical, HCI, and research skills. Examples include:

• Technical skills: programming, electronics, or related experience.
• HCI skills: conducting user studies or interviews.
• Research skills: data analysis and academic writing.

Applicants are also encouraged to provide evidence of previous work in innovative human–computer interaction (for example, undergraduate or postgraduate projects in this area).

King’s expects applicants to hold a First-Class Honours degree at undergraduate level or a Distinction at Master’s level (or their international equivalents). Applicants who do not meet these criteria may be able to demonstrate their competence through alternative evidence of achievement or experience.

Application process

Applicants are encouraged to contact Dr Timothy Neate (timothy.neate@kcl.ac.uk) by completing this form.

Once you have spoken with Dr Neate and you are both happy to proceed, please follow the formal application process below.

Formal Application

To be considered for the position, candidates must apply through the King’s Apply online application system. Full details are available on the Department of Informatics website.

When applying, please select:

• Programme: Computer Science Research MPhil/PhD (Full-time)
• Supervisor: Dr Timothy Neate
• Project title: Include this in your application and all correspondence

In the Funding section of the form:

1. Select Option 5 – “I am applying for a funding award or scholarship administered by King’s College London.”

Enter the following code exactly as written in the ‘Award Scheme Code or Name’ box: 768

Selection process

The selection process will include a review of application documents, followed by an interview for shortlisted candidates. Applicants who are successful at interview will receive an offer in due course.

Contact Details

Contact Dr Timothy Neate (timothy.neate@kcl.ac.uk) by completing this form.