Motion interpolation: Difference between revisions

Content deleted Content added
Tags: Reverted Mobile edit Mobile web edit
Added {{Merge from}} tag
 
(36 intermediate revisions by 27 users not shown)
Line 1:
{{Short description|Form of video processing}}
{{Merge from|Soap opera effect|discuss=Talk:Motion interpolation#Proposed merge of Soap opera effect into Motion interpolation|date=December 2024}}
{{Use mdy dates|date=January 2015}}
[[File:Interframe motion interpolation.webm|thumb|right|Comparison of a slow down video without interframe interpolation (left) and with motion interpolation (right).]]
'''Motion interpolation''' or '''motion-compensated frame interpolation''' ('''MCFI''') is a form of [[video processing]] in which intermediate film, video or animation frames are generated between existing ones by means of [[interpolation]], in an attempt to make animation more fluid, to compensate for [[display motion blur]], and for fake [[slow motion]] effects.
 
==Hardware applications==
Line 32 ⟶ 34:
 
===Video editing software===
Some [[video editing software]] and [[plug-in (computing)|plugins]] offer motion interpolation effects to enhance [[slow motion|digitally-slowed video]]. [[FFmpeg]] is a [[free software]] non-interactive tool with such functionality. [[Adobe After Effects]] has this in a feature called "Pixel Motion". AI software company Topaz Labs produces Video AI, a video upscaling application with motion interpolation. The effects plugin "Twixtor" is available for most major video editing suites, and offers similar functionality.
 
=== VirtualNeural realitynetworks ===
* [https://github.com/baowenbo/dain Depth-Aware Video Frame Interpolation]
On October 6, 2016, [[Oculus VR]] announced that it would enable the use of motion interpolation on the [[Oculus Rift]] virtual reality headset, via the implementation of features such as [[Asynchronous SpaceWarp]] and [[Asynchronous TimeWarp]]. This allowed the device to be used on computers whose specifications are not high enough to render to the headset at 90&nbsp;frames per second.<ref name="ars-lowerspec">{{cite web|title=Oculus lowers minimum Rift specs using "asynchronous spacewarp" tech|url=https://arstechnica.com/gaming/2016/10/oculus-lowers-minimum-rift-specs-using-asynchronous-spacewarp-tech/|website=Ars Technica|accessdate=6 October 2016}}</ref><ref name="polygon-lowerrequirements">{{cite web|title=Oculus Rift has a new minimum spec, $499 entry-level PC|url=http://www.polygon.com/virtual-reality/2016/10/6/13189600/oculus-rift-minimum-spec|website=Polygon|accessdate=6 October 2016}}</ref>
* [https://github.com/myungsub/cain Channel Attention Is All You Need]
* [https://github.com/megvii-research/ECCV2022-RIFE Real-Time Intermediate Flow Estimation]
* [https://github.com/ltkong218/IFRNet Intermediate Feature Refine Network]
* [[Deep learning super sampling]] used specifically to interpolate frames in real-time for video games
 
==Side effects==
===Visual artifacts===
{{Main|Visual artifact}}
Motion interpolation on certain brands of TVs is sometimes accompanied by visual anomalies in the picture, described by CNET's David Carnoy as a "little tear or glitch" in the picture, appearing for a fraction of a second. He adds that the effect is most noticeable when the technology suddenly kicks in during a fast camera pan.<ref name="Six things"/> Television and display manufacturers refer to this phenomenon as a type of [[digital artifact]]. Due to the improvement of associated technology over time, such artifacts appear less frequently with modern consumer TVs, though they have yet to be eliminated entirely "the artifacts happens more often when the gap between frames are bigger".{{citation needed|date=June 2024}}
 
=== Soap opera effect ===
{{main|Soap opera effect}}
As a byproduct of the perceived increase in frame rate, motion interpolation may introduce a "video" (versus "film") look. This look is commonly referred to as the "'''soap opera effect'''" ('''SOE''')<!--The bold is because this phrase redirects here-->, in reference to the distinctive appearance of most [[television network#United States|broadcast television]] [[soap opera]]s or pre -2000s [[Multiple-camera setup|multicam]] [[sitcom]]s, which were typically shot using less expensive [[List of broadcast video formats|60i]] video rather than film.<ref name="Weird Effects">{{cite web |url=http://www.crunchgear.com/2009/08/12/help-key-why-hd-video-looks-weird |title=Help Key: Why 120 Hz looks "weird" |accessdate=2009-11-13 |last=Biggs |first=John |date=August 12, 2009|publisher=crunchgear.com}}</ref>
Many insane humans complain that the soap opera effect ruins the theatrical look of [[Cinematography|cinematic]] works, by making it appear as if the viewer is either on set or watching a [[making-of|behind the scenes]] [[featurette]].<ref name="Vizio">{{cite web |url=http://ces.cnet.com/8301-13855_1-9845306-67.html |title=Vizio adds 120 Hz LCDs to its lineup |accessdate=2008-02-01 |last=Moskovciak |first=Matthew |date=January 8, 2008 |publisher=CNET.com}}</ref> Almost all manufacturers provide ways to disable the feature, but because methods and terminology differ, the [[UHD Alliance]] proposed that all televisions have a "Filmmaker Mode" button on remote controls to disable motion smoothing.<ref name="wouk20190921">{{Cite web |url=https://www.digitaltrends.com/home-theater/what-is-the-soap-opera-effect-in-tvs-and-how-to-turn-it-off/ |title=What is the Soap Opera Effect and how can you get rid of it on your TV? |last=Wouk |first=Kris |date=2019-09-21 |website=Digital Trends |archive-date=2020-01-31 |access-date=2020-01-31}}</ref>
 
Sports viewers appreciate motion interpolation,{{r|wouk20190921}} as it reduces motion blur produced by [[camera pan]]s and [[shaky camera]]s, and thus yields better clarity of such images. It may also be used to increase the apparent framerate of [[video game]]s for a more realistic feel, although the addition of [[display lag]] may be an undesired side effect.<ref name="techtarget">{{cite web |url=http://whatis.techtarget.com/definition/soap-opera-effect.html |title=What is the Soap Opera Effect? |accessdate=2011-04-20 |publisher=Techtarget.com}}</ref> This "video look" is created deliberately by the [[VidFIRE]] technique to restore archive television programs that only survive as film [[telerecording]]s.<ref name="VIDFIRE">{{cite web |url=http://www.purpleville.pwp.blueyonder.co.uk/rtwebsite/vidfire.htm |title=VIDFIRE – The Doctor Who Restoration Team |accessdate=2011-05-19 |publisher=restoration-team.co.uk/ |url-status=dead |archiveurl=https://web.archive.org/web/20110517121208/http://www.purpleville.pwp.blueyonder.co.uk/rtwebsite/vidfire.htm |archivedate=May 17, 2011 |df=mdy-all }}</ref> The main differences between an artificially (interpolated) and naturally (in-camera) high framerate are that in-camera is not subject to any of the aforementioned artifacts, contains more accurate (or "true to life") image data, and requires more storage space and bandwidth, since frames are not produced in realtime.&nbsp;{{citation needed|date=July 2019}}
 
==See also==
Line 55 ⟶ 60:
* [[Television standards conversion]]
*[[3:2 pulldown]]
 
 
==References==
Line 69 ⟶ 73:
[[Category:Video]]
[[Category:Film and video technology]]
[[Category:Film post-production technology]]