md-phys/README.md

md-phys

This project aims to create a Physicalization of written texts into emotions and vibrations. The idea here is to make people feel the emotions in a text via vibrations & heat. The project has three different systems:

1. A camera system that catches the users facial expressions and detects the emotion of the user to change the ambient light in the room.
2. A language processing system that analyzes the given text and outputs the emotion the text is trying to express.
3. A physical system that takes the outputs of the previous two systems as input and uses the given information to control a vibration motor and a heat source.
4. A physical construction that holds the motor and heat source. It allows the user to interact with the system.

Specifications

Camera System

Possible Libraries to use:

• https://github.com/serengil/deepface

Language Processing system

Possible Libraries to use:

• https://spacy.io/
• https://github.com/fastino-ai/GLiNER2

TBD:

• Which metrics do we use for text analysis?

Vibration & Heat system control

Possible Libraries to use:

• https://github.com/buttplugio for interacting with the vibrating motor

Hardware Specifications

TBD