Guide

Telespace consists of transmitters and viewers. Transmitters are for RGBD cameras to send out their RGBD pixels, and viewers are for seeing those RGBD pixels.

1. Installation

Our transmitter, which can be installed by our Windows Installer, runs on Windows machines. Streaming a physical space with it requires an Azure Kinect, though the installer includes a recording, which can be used for testing when you do not have an Azure Kinect.

Our viewer is the web application which was running at the front page.

2. Transmitter

In case you are here to try a demo without streaming yourself, go directly to Section 3.Connecting a Transmitter to a room.
The first step to use our transmitter is to create an account. Click the "Account Management Console".
Connecting a Transmitter to a room.
Click the "Sign In" button.
Connecting a Transmitter to a room.
And then, click the "Register" button to continue creating an account. After creating the account, log in to the transmitter with the created account.
Connecting a Transmitter to a room.
Now a new window appears. For camera, choose "Azure Kinect Device," if you are planning to stream using an actual Auzre Kinect device. Other Playback options are for using a recording instead. Then enter the ID of the room you would like to create or join, and press "Connect." If a room with the ID does not exist, you will create the room, otherwise, you will join the room.
Connecting a Transmitter to a room.
Now other people can join your room and see your RGBD pixels and also hear you! If you do not want to let them hear you, check the "Mute Microphone" check box.

3. Viewer

As our system is built with AR/VR in mind, when using our Web Viewer, it functions as an emluator of an AR/VR headset. You can use WASD keys or joystick of the bottom-left to move, and drag or swipe on the viewer window to rotate. Selection of objects can be done by a click on the viewer window. For VR, selection can be done by pressing the main trigger button of a hand controller after facing the target.
Connecting a Viewer to a room.
Now it is time to see RGBD pixels with our viewer. Enter a by typing a room ID and click the "Enter Room" button. Available rooms are listed underneath the buttons.
Connecting a Viewer to a room.
This is it! Move around the room and enjoy seeing somewhere else in 3D!

4. Interpersonal Communication (Advanced)

While we have used Telepsace as a tool to see somewhere else, we have not discussed how multiple people can see each other through Telespace. This support of remote interpersonal communication is the original purpose of Telespace, which has been built as a research project. For this to happen, there are two restrictions: everyone participaing in the interpersonal conversation should use a headset-based viewer, and they should manually point where the RGBD camera is.
Connecting a Viewer to a room.
Pointing out the physical location of the RGBD camera connected to the transmitter can be done by looking at the camera with the headset from above the camera, facing the opposite direction of the camera front direction, and pressing the "Update Room Center" button on the floor of the viewer. Also, click the Transmitter button on the upper-left side until the displayed ID matches the transmitter of yours. When properly done, the RGBD pixels coming from your transmitter will overlay on top of your physical body, fitting the virtual environment of Telespace to your real world. After everyone inside the rooms does this, they will be able to see each other in a manner similar to physically being in the same room.