35 lines
1.2 KiB
Markdown
35 lines
1.2 KiB
Markdown
# md-phys
|
|
|
|
This project aims to create a Physicalization of written texts into emotions and vibrations.
|
|
The idea here is to make people feel the emotions in a text via vibrations & heat. The project has three different systems:
|
|
|
|
1. A camera system that catches the users facial expressions and detects the emotion of the user to change the ambient light in the room.
|
|
2. A language processing system that analyzes the given text and outputs the emotion the text is trying to express.
|
|
3. A physical system that takes the outputs of the previous two systems as input and uses the given information to control a vibration motor and a heat source.
|
|
4. A physical construction that holds the motor and heat source. It allows the user to interact with the system.
|
|
|
|
## Specifications
|
|
|
|
### Camera System
|
|
|
|
Possible Libraries to use:
|
|
- https://github.com/serengil/deepface
|
|
|
|
|
|
### Language Processing system
|
|
|
|
Possible Libraries to use:
|
|
- https://spacy.io/
|
|
- https://github.com/fastino-ai/GLiNER2
|
|
|
|
TBD:
|
|
- Which metrics do we use for text analysis?
|
|
|
|
### Vibration & Heat system control
|
|
|
|
Possible Libraries to use:
|
|
- https://github.com/buttplugio for interacting with the vibrating motor
|
|
|
|
## Hardware Specifications
|
|
|
|
TBD |