IVISIBLE PEN PDF

Predicted hand coordinates are sent wirelessly to a Python Flask web server using socket.io, which is on the same local network.Front end business logic is written in React.js & Next.js.On-device hand tacking is done by handpose, as a Tensorflow.js model.

IVISIBLE PEN PDF

flip the pages of an e-book or a PDF document Tech Stack Note that the same idea works directly on the laptop screen and doesn’t require any additional monitor per se.Īs we directly control the mouse, this setup can be used beyond rough sketching use cases - e.g. The server translates the finger coordinates to pixels on the screen and moves the mouse pointer thereby tracing the presenter’s drawing on the screen.

A server on the laptop receives the coordinates of the index finger from the mobile device over a local secure connection.

The mobile device which is mounted on the tripod tracks the live hand movements of the presenter / teacher.

While I didn’t solve it completely (and am looking for any like minded folks to work with), here is how the current solution works,

should be accurate enough to be usable for the above problem.

is easy and free for anyone to use and setup.

uses existing devices in houses so that it is economical.

lets the presenter use their hand (and not mouse or external hardware) to express their ideas.

That is, my ideal solution would be something that satisfies all these. Can we have a middle ground?Ĭoming from a computer science and applied machine learning background, I thought what if we could use phone & laptop together, which is present in most households these days, to solve this problem. These work great for people who want to and can afford them.

On the other end of the spectrum there are expensive solutions like Apple Pencil on iPads, touch screen monitors or custom hardware like Airbar. All the above solutions work great and are extremely economical but the overall experience for both the presenter & viewer is suboptimal.

Ivisible pen