What is it about?
We have developed our own algorithm and methodology, to use the found wifi signal strengths from iot devices across multiple locations, and also use the spatial understanding we have of the room to firstly locate and identify where the internet connected devices are, and also give the user an interface to interact with the devices.
Featured Image
Why is it important?
Joining in line with the growing relevance of mixed reality devices, we realise there is an opportunity for making more advanced smart-home environments, allowing users to interact with smart devices (like smart lights, smart speakers, etc.) using the new mixed reality devices (like Apple's Apple Vision Pro, Meta Raybans). Further as we go into an era dominated by internet connected devices, it becomes more difficult for users to keep track of all the devices they own, and the different names and locations of these devices across multiple rooms. Using a setup like this, people can now easily identify, maintain and use all of their devices easily and efficiently, without having to worry about keeping track of too many details. Simply put on the MR glasses and our prototype handles the rest.
Perspectives
I personally too was unsure of mixed reality, and the future of it. However when I demoed the Apple Vision Pro, and also started working with the Meta Quest 3s, I saw immense potential for growth and usability. It truly was a one of a kind experience, allowing me to carry on my day as usual, but have all the comfort and information received by a phone, just floating around me. Now combining this with the already fascinating and frankly just really cool IoT devices and being able to interact with lights with voice commands or just your phone, I truly think we made something really special. I also had a lot of fun playing around with these kinds of devices, and tinkering with the internals of wifi signals, trying to extract the best and most useful information.
Ryan Padamadan
University of Sydney
Read the Original
This page is a summary of: Fusing Point Clouds and Wireless Signals for Seamless Interaction in Smart Spaces, November 2025, ACM (Association for Computing Machinery),
DOI: 10.1145/3742889.3768348.
You can read the full text:
Contributors
The following have contributed to this page







