Technology

59534 readers

3195 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

125

Apple Vision Pro’s Eye Tracking Exposed What People Type (www.wired.com)

submitted 2 months ago by irreticent@lemmy.world to c/technology@lemmy.world

21 comments fedilink hide all child comments

cross-posted from: https://lemmy.zip/post/22604748

The Vision Pro uses 3D avatars on calls and for streaming. These researchers used eye tracking to work out the passwords and PINs people typed with their avatars.

Archived version: https://web.archive.org/web/20240912100207/https://www.wired.com/story/apple-vision-pro-persona-eye-tracking-spy-typing/

you are viewing a single comment's thread
view the rest of the comments

[–] noughtnaut@lemmy.world 2 points 2 months ago* (last edited 2 months ago) (2 children)

Asking because I've never had the experience: how does one write anything while wearing a VR set? Please don't tell me it's one-finger "Fliegender Adler" on a giant floaty image of a keyboard?

This would utterly kill the comfort, convenience, and speed of touch typing, would it not? Ahh, progress... Even in Minority Report they had (friggin' sweet-looking!) keyboards alongside their fancy futuristic FAUI*.

^((* FAUI - flailing arms UI)^)

[–] Petter1@lemm.ee 2 points 2 months ago

Flying Adler approach works and is the solution for noobs. Pros either use a real world keyboard or just look at the letter they want to type and snap 🫰 like this to type that letter. You can type pretty fast with the look’n’snap technic.

[–] subignition@fedia.io 1 points 2 months ago (2 children)

From the article:

Your eyes are your mouse when using the Vision Pro. When typing, you look at a virtual keyboard that hovers around, and can be moved and resized. When you’re looking at the right letter, tapping two fingers together works as a click.

So they were working backwards to determine the inputs based off of the observed eye motion.

I have a much less modern VR headset and you can definitely still type on a regular keyboard while you're wearing it. You can't see the keyboard though, so you need to be skilled enough to touch type. I can't find any reliable-looking statistics on it with a quick search, but it seems like that is not a very common skill

[–] noughtnaut@lemmy.world 2 points 2 months ago (1 children)

... Like what is not a very common skill? Touch typing in general? Or doing it under VR specifically?

The latter would be quite niche I suppose.
The former? I cry for the current and future generations. It really is not very hard to learn, realistic to master, and incredibly useful in daily (professional and personal) life.

[–] subignition@fedia.io 1 points 2 months ago

Touch typing. Like I said I cannot find any reputable statistics. touchtypeit.co.uk claims "according to research" it's less than 20%, but does not actually link any specific research. There are some other sites like it that are trying to sell you a product and list a low percentage, but I can't find any actual studies or statistics

[–] Petter1@lemm.ee 1 points 2 months ago

Vision pro renders the keyboard into your virtual environment, like it does with your arms/hands