A Simple Method to Obtain Basic Acoustic Measures From Video Recordings as Subtitles

S. Pravin Kumar, Jan G. Švec
  • Journal of Speech Language and Hearing Research, September 2018, American Speech-Language-Hearing Association (ASHA)
  • DOI: 10.1044/2018_jslhr-s-17-0472

Acoustic measures as video subtitles

What is it about?

We developed a software to measure and display the basic acoustic measures (Sound pressure level (SPL) and fundamental frequency (fo )) on the video recordings in the form of subtitles.

Why is it important?

In the scenarios such as laryngoscopic examinations, evaluating body/head posture on singer's performance and voice training or even in general application like traffic violation monitoring, it is useful to simultaneously evaluate both visual and auditory information from the video recordings. The acoustic measures are usually measured and displayed on these recordings using rather expensive hardware setup and often basic systems lack these facilities. This alternate freely available software based approach helps in integrating the acoustic measures directly over the video recordings as subtitles.

Perspectives

S. Pravin Kumar
spravinkumarin@gmail.com

The motivation for this work came from a clinicians who wanted to have the SPL and fo values displayed on the videokymographic (VKG) recordings, as the advanced version of the VKG system having this feature inbuilt was not available at their clinics. In principle, acoustic measures can be integrated with any videos as subtitles, provided proper calibration is performed as described in the calibration section of this paper.

Read Publication

http://dx.doi.org/10.1044/2018_jslhr-s-17-0472

The following have contributed to this page: Dr. Jan G. Svec and S. Pravin Kumar