Automotive Hands-free Telephony Speech Quality Evaluation - A Subjective Testing Approach

Abstract:
We propose and introduce a testing method for subjective speech quality evaluation of hands-free telephony systems in car environments. In evaluating car hands-free speech quality it is desired to have a procedure available which is repeatable and reproducible, significant and convincing, yet fast and especially resource effective. Proposed is a method, comprising a series of subjective test cases in different scenarios and driving conditions. The goal is to gain insight into possible problems and weaknesses of systems under test and to reliably judge the overall quality during product development and product release process. We describe the approach. the conditions and set-ups we have chosen, but also the limitations and restrictions we face. Finally. first results from real-world driving tests are presented and discussed.