Word Pointer

Finger tracking tool

Year
2021
Client
While employed at Universität der Künste Berlin
Tech
Python, OpenCV, Tesseract
Links
Debug view

For an internal speech recording tool of the Digital Education group we needed to know which word of a text was uttered when. For the purpose of time-stamping the words we built a tool that would first recognize the text on the page (using OCR) and then follow the finger of the speaker as they move it line by line while simultaneously reading the text out loud.

All experiments
Applied
Finding interesting configurations for a generative artwork through data analysis
Experiment
Increasing the chances of finding mushrooms through geospatial data analysis
Applied
Word Pointer
Finger tracking tool
Experiment
Simulating blobs of fluids with particles
Experiment
Modified JPEG encoder for generating glitchy image effects
Experiment
Force-based simulation of bands of particles
Experiment
Mapping line drawings onto street networks
Experiment
GPS trace replay tool
Misc
Proof-of-concept for an alternative, more powerful Are.na client
Misc
Browser extension that collects texts of how designers describe themselves
Applied
Visualization how a text document got written and edited over time
Experiment
Experiments with movie image data
Applied
InDesign script that enforces alternating line lengths