I-Space 未来人居住

Smart Home

This project stems from advanced research on multi-modal natural human-computer interaction, with the goal of building a "smart metaverse" for smart homes. The foundational concepts and systems are detailed in our published research paper: Meta-Home: Smart Home Digital Twin Design from the Perspective of Smart metaverse.

Working within a real smart-home environment, I gained hands-on experience integrating state-of-the-art IoT devices—including SensFloor® smart floors, smart air conditioners, and smart TVs—to create a seamless, interactive ecosystem.

Technical Implementation

I architected and built a robust Django backend to ingest, process, and stream high-throughput sensor data from these heterogeneous IoT devices in real time.

To bring the physical environment into the digital realm, I streamed the processed data via WebSockets to a dynamic React and Three.js frontend. Utilizing GLTF models, I developed live 3D visualizations that accurately mirrored the physical room and tracked its inhabitants in real time.