{"id":81842,"date":"2024-03-28T17:21:02","date_gmt":"2024-03-29T00:21:02","guid":{"rendered":"https:\/\/techreviewers.net\/vision-pro-and-quest-3-hand-tracking-latency-compared\/"},"modified":"2024-03-28T17:21:02","modified_gmt":"2024-03-29T00:21:02","slug":"vision-pro-and-quest-3-hand-tracking-latency-compared","status":"publish","type":"post","link":"https:\/\/techreviewers.net\/vision-pro-and-quest-3-hand-tracking-latency-compared\/","title":{"rendered":"Vision Pro and Quest 3 Hand-tracking Latency Compared"},"content":{"rendered":"
<\/div>\n
\n

Vision Pro is built entirely around hand-tracking while Quest 3 uses controllers first and foremost, but also supports hand-tracking as an alternate option for some content. But which has better hand-tracking? You might be surprised at the answer.<\/p>\n

Vision Pro Hand-tracking Latency<\/h2>\n

With no support for motion controllers, Vision Pro\u2019s only motion-based input is hand-tracking. The core input system combines hands with eyes to control the entire interface.<\/p>\n

Prior to the launch of the headset we spotted some footage that allowed us to gauge the hand-tracking latency between 100-200ms<\/a>, but that\u2019s a pretty big window. Now we\u2019ve run our own test and more precisely find Vision Pro\u2019s hand-tracking to be about 128ms on visionOS beta v1.1.1.<\/strong><\/p>\n

Here\u2019s how we measured it. Using a screen capture from the headset which views both the passthrough hand and the virtual hand, we can see how many frames it takes between when the passthrough hand moves and when the virtual hand moves. We used Apple\u2019s Persona system for hand rendering to eliminate any additional latency which could be introduced by Unity.<\/p>\n

After sampling a handful of tests (pun intended), we found this to be about 3.5 frames. At the capture rate of 30 FPS, that\u2019s 116.7ms. Then we add to that Vision Pro\u2019s known passthrough latency of about 11ms<\/a>, for the final result of 127.7ms of photon to hand-tracking latency.<\/p>\n

We also tested how long between a passthrough tap and a virtual input (to see if full skeletal hand-tracking is slower than simple tap detection), but we didn\u2019t find any significant difference in latency. We also tested in different lighting conditions and found no significant difference.<\/p>\n

Quest 3 Hand-tracking Latency<\/h2>\n

How does that compare to Quest 3, a headset which isn\u2019t solely controlled by the hands? Using a similar test, we found Quest 3\u2019s hand-tracking latency to be around 70ms on Quest OS v63<\/strong>. That\u2019s a substantial improvement over Vision Pro, but actual usage of the headset would make one think Quest 3 has even lower<\/em> hand-tracking latency. But it turns out some of the perceived latency is masked.<\/p>\n

Here\u2019s how we found out. Using a 240Hz through-the-lens capture, we did the same kind of motion test as we did with Vision Pro to find out how long between the motion of the passthrough hand and the virtual hand. That came out to 31.3ms. Combined with Quest 3\u2019s known passthrough latency of about 39ms<\/a> that makes Quest 3\u2019s photon to hand-tracking latency about 70.3ms.<\/p>\n

When using Quest 3, hand-tracking feels even snappier than that result suggests, so what gives?<\/p>\n

Because Quest 3\u2019s passthrough latency is about three-and-a-half times that of Vision Pro (11ms vs. 39ms), the time between seeing your hand move and your virtual hand move appears to be<\/em>\u00a0just 31.3ms (compared to 116.7ms on Vision Pro).<\/p>\n

\u2013 \u2013 \u2014 \u2013 \u2013<\/p>\n

An important point here: latency and accuracy of hand-tracking are two different things. In many cases, they may even have an inverse relationship. If you optimize your hand-tracking algorithm for speed, you may give up some accuracy. And if you optimize it for accuracy, you may give up some speed. As of now we don\u2019t have a good measure of hand-tracking\u00a0accuracy<\/em> for either headset, outside of a gut feeling.<\/p>\n<\/p><\/div>\n","protected":false},"excerpt":{"rendered":"

Vision Pro is built entirely around hand-tracking while Quest 3 uses controllers first and foremost, but also supports hand-tracking as an alternate option for some content. But which has better hand-tracking? You might be surprised at the answer. Vision Pro Hand-tracking Latency With no support for motion controllers, Vision Pro\u2019s […]<\/p>\n","protected":false},"author":41,"featured_media":81843,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ocean_post_layout":"","ocean_both_sidebars_style":"","ocean_both_sidebars_content_width":0,"ocean_both_sidebars_sidebars_width":0,"ocean_sidebar":"","ocean_second_sidebar":"","ocean_disable_margins":"enable","ocean_add_body_class":"","ocean_shortcode_before_top_bar":"","ocean_shortcode_after_top_bar":"","ocean_shortcode_before_header":"","ocean_shortcode_after_header":"","ocean_has_shortcode":"","ocean_shortcode_after_title":"","ocean_shortcode_before_footer_widgets":"","ocean_shortcode_after_footer_widgets":"","ocean_shortcode_before_footer_bottom":"","ocean_shortcode_after_footer_bottom":"","ocean_display_top_bar":"default","ocean_display_header":"default","ocean_header_style":"","ocean_center_header_left_menu":"","ocean_custom_header_template":"","ocean_custom_logo":0,"ocean_custom_retina_logo":0,"ocean_custom_logo_max_width":0,"ocean_custom_logo_tablet_max_width":0,"ocean_custom_logo_mobile_max_width":0,"ocean_custom_logo_max_height":0,"ocean_custom_logo_tablet_max_height":0,"ocean_custom_logo_mobile_max_height":0,"ocean_header_custom_menu":"","ocean_menu_typo_font_family":"","ocean_menu_typo_font_subset":"","ocean_menu_typo_font_size":0,"ocean_menu_typo_font_size_tablet":0,"ocean_menu_typo_font_size_mobile":0,"ocean_menu_typo_font_size_unit":"px","ocean_menu_typo_font_weight":"","ocean_menu_typo_font_weight_tablet":"","ocean_menu_typo_font_weight_mobile":"","ocean_menu_typo_transform":"","ocean_menu_typo_transform_tablet":"","ocean_menu_typo_transform_mobile":"","ocean_menu_typo_line_height":0,"ocean_menu_typo_line_height_tablet":0,"ocean_menu_typo_line_height_mobile":0,"ocean_menu_typo_line_height_unit":"","ocean_menu_typo_spacing":0,"ocean_menu_typo_spacing_tablet":0,"ocean_menu_typo_spacing_mobile":0,"ocean_menu_typo_spacing_unit":"","ocean_menu_link_color":"","ocean_menu_link_color_hover":"","ocean_menu_link_color_active":"","ocean_menu_link_background":"","ocean_menu_link_hover_background":"","ocean_menu_link_active_background":"","ocean_menu_social_links_bg":"","ocean_menu_social_hover_links_bg":"","ocean_menu_social_links_color":"","ocean_menu_social_hover_links_color":"","ocean_disable_title":"default","ocean_disable_heading":"default","ocean_post_title":"","ocean_post_subheading":"","ocean_post_title_style":"","ocean_post_title_background_color":"","ocean_post_title_background":0,"ocean_post_title_bg_image_position":"","ocean_post_title_bg_image_attachment":"","ocean_post_title_bg_image_repeat":"","ocean_post_title_bg_image_size":"","ocean_post_title_height":0,"ocean_post_title_bg_overlay":0.5,"ocean_post_title_bg_overlay_color":"","ocean_disable_breadcrumbs":"default","ocean_breadcrumbs_color":"","ocean_breadcrumbs_separator_color":"","ocean_breadcrumbs_links_color":"","ocean_breadcrumbs_links_hover_color":"","ocean_display_footer_widgets":"default","ocean_display_footer_bottom":"default","ocean_custom_footer_template":"","ocean_post_oembed":"","ocean_post_self_hosted_media":"","ocean_post_video_embed":"","ocean_link_format":"","ocean_link_format_target":"self","ocean_quote_format":"","ocean_quote_format_link":"post","ocean_gallery_link_images":"on","ocean_gallery_id":[],"footnotes":""},"categories":[5320,2763,3114,5175,2399,3798,6044],"tags":[5317,2759,3113,5173,2396,3797,6043],"_links":{"self":[{"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/posts\/81842"}],"collection":[{"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/users\/41"}],"replies":[{"embeddable":true,"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/comments?post=81842"}],"version-history":[{"count":0,"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/posts\/81842\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/media\/81843"}],"wp:attachment":[{"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/media?parent=81842"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/categories?post=81842"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/techreviewers.net\/wp-json\/wp\/v2\/tags?post=81842"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}