Asynchronous reprojection
Asynchronous reprojection is a class of motion interpolation technologies aimed ensuring a virtual reality headset's responsiveness to user motion even when the GPU isn't able to keep up with the headset's target framerate, and to reduce perceived input lag at all times regardless of framerate.[1] Reprojection involves the headset's driver taking one or multiple previously rendered frames and using newer motion information from the headset's sensors to "reproject" or "warp" the previous frame into a prediction of what a normally rendered frame would look like.[2] "Asynchronous" refers to this process being continuously performed in parallel with rendering, allowing reprojected frames to be displayed without delay in case a regular frame isn't rendered in time, and is used in all frames by default to reduce perceived latency.[2]
The use of these techniques allows for a lowering in the video rendering hardware specifications required to achieve a certain intended level of responsiveness.[3]
Variations
Various vendors have implemented their own variations of the technique under different names. Basic versions of the technique are referred to as asynchronous reprojection by Google and Valve,[1][4] while Oculus has two implementations, called asynchronous timewarp[2] and asynchronous spacewarp. Asynchronous timewarp uses the headset's rotational data to interpolate a new rendered frame based on the last frame it received. Asynchronous space warp goes beyond, and uses Z-buffer contents to help compensate for perspective and other geometric changes.[5][6] Valve's early version called interleaved reprojection would make the application run at half framerate and reproject every other frame.[7] A later variant by Valve is SteamVR Motion Smoothing, which builds upon regular asynchronous reprojection in being able to reproject two frames instead of one.[4]
See also
References
- "Asynchronous Reprojection". Google Developers. Google Inc. Retrieved 10 June 2019.
- Antonov, Michael (2 March 2015). "Asynchronous Timewarp Examined". Oculus Developer Blog. Facebook Technologies, LLC. Retrieved 10 June 2019.
- Orland, Kyle (10 June 2019). "Oculus lowers minimum Rift specs using "asynchronous spacewarp" tech". ArsTechnica. Condé Nast. Retrieved 10 June 2019.
- Vlachos, Alex (27 November 2018). "Introducing SteamVR Motion Smoothing". Steam Community. Valve. Retrieved 10 June 2019.
- Beeler, Dean; Hutchins, Ed; Pedriana, Paul (10 November 2016). "Asynchronous Spacewarp". Oculus Developer Blog. Facebook Technologies, LLC. Retrieved 10 June 2019.
- Aksoy, Volga; Beeler, Dean (9 August 2019). "Asynchronous Spacewarp 2.0". Oculus Developer Blog. Facebook Technologies, LLC. Retrieved 18 August 2020.
- Leiby, Aaron (26 March 2016). "Interleaved Reprojection now enabled for all applications by default". Steam Community. Valve. Retrieved 10 June 2019.