Speech Research @ UoA
Nau mai, Haere mai

We are a group of researchers who are fascinated by the power of speech and languages. We spend hours discussing about vowels, accents, the way people talk, the way people pause before they talk, how we can use speech to understand peoples’ emotions, language-background, age, if they are healthy and what they had for breakfast (now.. that’s not true!). If you want to meet the team and get to know the specific areas everyone works on – this is the place …

We are a very friendly bunch. So, feel free to contact us via email or say a quick “Hi” if you see us in Auckland.

Dr. Catherine Inez Watson

Associate Professor  in the Electrical, Computer, and Software Engineering department, The University of Auckland.

About me: I joined the Department of Electrical, Computing, and Software Engineering at the University of Auckland in February 2004. Before that I had been at Macquarie University, Sydney, Australia for 8 years. I spent one year as a research fellow in the Department of Information Science at the University of Otago in 1995. I did my undergraduate degree and PhD at the University of Canterbury, both in the Department of Electrical and Electronic Engineering. Between my undergraduate and postgraduate degrees I worked in Medical Physics at the Christchurch Public Hospital.

My research specialty is speech analysis; using both signal processing and acoustic phonetic techniques. My research focus is speech production in machines and people. The two main languages I work in are New Zealand English and te reo Māori.

Fun fact about me: I think spectrograms of speech would be fun to turn into a needle work project.

Webpage: https://unidirectory.auckland.ac.nz/profile/c-watson

Dr. Peter J. Keegan (Waikato-Maniapoto, Ngāti Porou)

Senior Lecturer, Te Puna Wānanga, Faculty of Education and Social Work, The University of Auckland.

About me: I grew up on a dairy farm in central Taranaki. I worked for 8 years as a Telecommunications Technician at NZ Post/Telecom. I joined the University of Auckland in December 2000 for work on an assessment project (https://e-asttle.tki.org.nz/). I completed an undergraduate degree (Linguistics/Māori) at The University of Waikato and postgraduate degrees at The University of Waikato and Victoria University of Wellington.

Research interests: Māori language and education, especially measurement/assessment, the description of Māori (especially sound/lexical change).

Fun fact about me: I edit a website. www.maorilanguage.info

Webpage: https://unidirectory.auckland.ac.nz/profile/p-keegan,http://peterjkeegan.github.io/

Dr. Ellaine Ballard

Senior Lecturer, Speech Science Division of the School of Psychology, Faculty of Science, University of Auckland.

About me: I am a NZBC (New Zealand Born Chinese) who grew up here in Auckland back in the time when there were not that many Asians around. I have always been interested in languages so it’s no surprise that I ended up majoring in languages and literature for my BA, MA (Hons) at Auckland and in Linguistics for my PhD at Cornell.

Research interests: Bilingualism, Phonetics and Phonology, Sound Change, Language Variation, Language Acquisition

Fun fact about me: I have a third degree black belt in Aikido.

Webpage: https://unidirectory.auckland.ac.nz/profile/e-ballard

Dr. Justine Hui

Post doctoral research fellow in mech engineering

 About me: I received my conjoint BE(Hons) in Computer Systems Engineering and BA(Hons) (BA in Linguistics and Japanese and BA(Hons) in Asian Studies) at the University of Auckland in 2012. This was followed by several years in industry at IBM seconded to Air NZ as a software developer, while I completed a ME part-time with Dr. Catherine Watson on speech synthesis. I then went on to do my PhD at Sophia University, Japan, at the Speech Communication Lab under Prof. Takayuki Arai on the relationship between hearing deficits and speech/melody perception in elderly listeners. 

 I am currently a postdoctoral research fellow at the Department of Mechanical Engineering, UoA. My current project looks at how language exposure affects our abilities to make use of spatial information in different rooms to understand speech. I am also involved in the Māori pronunciation aid project.

My research intrests include phonetics and linguistics, psychoacoustics, speech perception and production of hearing impaired listeners and second language speakers, hearing assistive technologies, Audio VR (VR acoustics), learning equity of second language speakers, second language acquisition

Fun fact about me:  I sew to destress and the majority of my summer wardrobe is handmade.

Webpage: https://unidirectory.auckland.ac.nz/people/profile/justine-hui

Jesin James

Lecturer in the Electrical, Computer, and Software Engineering department, The University of Auckland.

About me: I strongly believe that if you can combine your passion with your career, you will never feel that you are working. Engineering offers the possibility to combine your passion with technology and make a difference. I enjoy languages, music and interacting with people – and being a lecturer in Electrical, Computer, and Software Engineering working on speech technology for languages is definitely tying everything up nicely. I am originally from Kerala, India. Being a multilingual and moving to a new country has made me appreciate languages and how language knowledge can help me contribute to technology development for those languages

My main research areas are speech signal processing, under-resourced languages, machine learning and engineering education.

Fun fact about me: I love thrifting and travelling.

Webpage: https://unidirectory.auckland.ac.nz/profile/jjam194

Nicholas Eng

PhD student at the Department of Mechanical Engineering.

About me: I am investigating the creation of synthetic voices using noisy speech samples.

My main research areas are speech synthesis, speech perception, signal processing, machine learning

Fun fact about me: I dab into music production from time to time

Webpage: https://unidirectory.auckland.ac.nz/people/profile/neng668

Isabella Shields (Ngāti Porou)

PhD student at the Department of Electrical, Computer, and Software Engineering

About me: Originally from the deep south (Dunedin), I moved to Auckland in 2015 to study. I completed my conjoint BA in French and BE(Hons) in Electrical Engineering in 2019.

I am investigating the acoustics of te reo Māori /r/. I also work as a Research Assistant.  My areas of interest are Māori phonetics, acoustic phonetics, sound change.

Fun fact about me:  I collect hobbies; sewing, travelling, painting, drawing, embroidery, playing guitar, lego, rewatching the same TV shows, and most recently, needle felting.

Webpage: https://unidirectory.auckland.ac.nz/profile/ishi836

Binu Abeysinghe

Masters student, Department of Electrical, Computer, and Softwaree Engineering

About me: I am a recent post-graduate who has begun a master’s thesis in the area of natural language processing and machine learning. My part 4 project involved a detection and classification end-end system for the secondary human emotions in speech. This was done under the supervision of Jesin James and Catherine Watson, as well as with the aid of my good friend, Gavin Cao as my project partner.

My research interests are synthetic accent detection and how to qualitatively access synthetic voices for under-resourced languages.

Fun fact about me: I helped make the website you are reading this on.

Webpage: https://binu.nz/

Mohammad Hassaan Mirza

 Masters student, Department of Electrical, Computer, and Software Engineering

About me: I completed my Bachelors Honours in Computer Systems Engineering in 2020, with my Part IV Honours Project being to develop a system for automatically transcribing classical piano music to sheet music, and measuring the accuracy of the transcription. The project was conducted under Dr.Catherine Watson and Itay Ben-Dom, in collaboration with fellow student Kimberley Evans-Parker.

I am currently doing my Masters of Engineering under Catherine Watson and Jesin James. My project focuses on implementing a system to identify emotions in speech through the use of machine learning, building upon previously done work in identifying valence and arousal levels in speech. I hope to also be able to represent the changing of valence and arousal levels through data visualisation.

My research intrests include Signal processing, machine learning, and emotion recognition

 Fun fact about me: I love to sketch and write, and often use them as ways to wind down in times of stress.