Ηope

Guidelines: Using Git

• Do not use command line to stage changes. Use a visual tool (like Visual Studio Code or Git Gui) to preview and confirm the changes before commiting. A better way is to selectively stage only the necessary line changes.
• Each developed feature should have its own branch and each person should work on his own branch. After code review and validation, commits will be pushed to each team branch (AUEB and Phasmatic team branches). Since the are two developing teams, focusing on different aspects of the project at any given time, there should also be two different team branches.
• Main branch SHOULD ONLY hold the production stable version of the project.

Guidelines: Working with a team

• Do not alter functions that were written by another contributor. Ask the contributor to change or let you change them, in order for the function to provide the necessary functionality.
• When altering existing functions, always check if the new behaviour affects other functions.

Architecture

Server Client

Server Features

• Data polling from intel SDK
• Object detection (bbox)
• Gesture detection
• Point cloud compression
• Server HTTP
• Server WebSockets
• Point cloud transmission

Client Features

• Connect with server
• Point cloud decompression
• 3D visualization
• Virtual Reality

How to Install

Before you apply the following steps.....

openssl req -x509 -nodes -days 365 -newkey rsa:2048 -keyout server.key -out server.crt

Scope

3D point cloud streaming for the next generation of XR telepresence systems.

Building

1. git clone git@github.com:phasmatic3d/hope

2. cd hope

3. git submodule update --init --recursive

Client

...

Producer

!!!Linux note

sudo apt-get install libssl-dev libusb-1.0-0-dev

4. cd producer

!!! Draco note

Ensure that the path to the hope project root directory does not contain any regex symbols (e.g. +? e.t.c.))

Windows users:

1. Download openssl for windows from. Setup conda environments C:\Program Files\OpenSSL-Win64\bin
2. Download conda from. Setup conda environment vars C:\ProgramData\Anaconda3, C:\ProgramData\Anaconda3\Scripts
3. Download node js from
4. Create a conda environment with python 3.10 or (3.11). conda create -n NAME python=3.10
5. conda init and restart cmd
6. conda activate NAME and pip install --upgrade pip
7. From inside the environment run cd producer and run: cmake -DCMAKE_BUILD_TYPE=Release -S . -B build. If python 3.10 was create open CMakelists and modify the variable
8. If working on visual studio make sure to copy Release/broadcast_wrapper.pyd, Release/encoder.pyd and spdlog.dll to the associate script folder
9. From the root directory (cd ..) run pip install -e ./addons/gesture_recognition
10. Install torch based on your cuda version (12.6 or 12.8) and pip install ultralytics
11. Install realsense for python pip install pyrealsense2
12. Follow sam2 install instructs in placed in addons/onxx/scripts
13. Run producer.py script (and install any additional dependencies, if any)