UROP Project

Acoustic and Visual Simulation of Rooms for Immersive Voice Training

Contact

Name

Daniel Holder

Program Director UROP

Telephone

workPhone
+49 241 80-90695

E-Mail

Key Info

Basic Information

Project Offer-Number:
943
Category:
UROP International, UROP Network
Field:
Computer Science
Faculty:
4
Organisation unit:
IMA/ZLW
Language Skills:
English
Computer Skills:
Basic programming knowledge (e.g. object oriented programming) with e.g. Java or C++, Mathematics, UML
Others:
Microsoft Office (Word, PowerPoint, Excel), communicative, creative and motivated to work with mathematics and to transfer concepts into code

RWTH Aachen University is a large university in which lecturers often face the challenge of teaching large audiences with up to 1000 students in one lecture. These circumstances are not only challenging in terms of finding appropriate teaching methods, but also in terms of an efficient and considerate use of one’s voice. Therefore, the IMA/ZLW institutes is currently developing an immersive simulation of lecture halls for a Voice Training in Mixed Reality. This simulation will allow teachers to practice an efficient and considerate use of their voice in front of a virtual classroom. Participating teachers will be wearing e.g. an Oculus Rift as well as a headset. By help of these tools the teacher will be able to speak into the headset under “lifelike“ sound conditions by using convolution reverbs. Since the room was filmed by a 360-degree camera in order to develop the simulated surrounding, the teacher is able to look around and get an immersive feeling of the physical lecture hall.

Task

The downside of the concept: For safety, the acoustic measurement gets executed within empty rooms. The final solution needs a convolution reverb of full rooms. Hence, a process is needed to measure an empty room and to adapt the results towards a full room. The first task of this project is to get familiar with convolution reverbs and research about related work as well as get inspired by other approaches. The ideas must be described as concept, where the desired process gets visualized by using UML diagrams. A basic prototype must be developed. Next, set up and execute experiments in order to proof the concept and the prototype. Finally, the results must be presented.

Requirements

The foundation for the work is a basic mathematical and computer science knowledge as well as practices within a programming language like e.g. Java, C# or Python. Prior knowledge regarding convolution reverbs or acoustics is not necessary but helpful. A basic understanding of the UML – Unified Modeling Language – is presupposed.