Jump to content

Motion interpolation: Difference between revisions

From Wikipedia, the free encyclopedia
Content deleted Content added
mNo edit summary
Soap opera effect: add a bit more detail (linked source supports)
 
(52 intermediate revisions by 41 users not shown)
Line 1: Line 1:
{{Short description|Form of video processing}}
{{Use mdy dates|date=January 2015}}
{{Use mdy dates|date=January 2015}}
[[File:Interframe motion interpolation.webm|thumb|right|Comparison of a slow down video without interframe interpolation (left) and with motion interpolation (right).]]
[[File:Interframe motion interpolation.webm|thumb|right|Comparison of a slow down video without interframe interpolation (left) and with motion interpolation (right)]]
'''Motion interpolation''' or '''motion-compensated frame interpolation''' ('''MCFI''') is a form of [[video processing]] in which intermediate animation frames are generated between existing ones by means of [[interpolation]], in an attempt to make animation more fluid and to compensate for [[display motion blur]].
'''Motion interpolation''' or '''motion-compensated frame interpolation''' ('''MCFI''') is a form of [[video processing]] in which intermediate film, video or animation frames are generated between existing ones by means of [[interpolation]], in an attempt to make animation more fluid, to compensate for [[display motion blur]], and for fake [[slow motion]] effects.


==Hardware applications==
==Hardware applications==
Line 8: Line 9:


===Difference from display framerate===
===Difference from display framerate===
A display's [[framerate]] is not always equivalent to that of the content being displayed. In other words, a display capable of or operating at a high framerate does not necessarily mean that it can or must perform motion interpolation (most TVs ship with any such feature enabled by default). For example, a TV running at 120&nbsp;Hz and displaying 24&nbsp;FPS content will simply display each content frame for five of the 120 display frames per second. This has no effect on the picture other than eliminating the need for [[3:2 pulldown]] and thus film [[judder]] as a matter of course (since 120 is evenly divisible by 24). Eliminating judder results in motion that is less "jumpy" and which matches that of a [[movie projector|theater projector]]. Motion interpolation can be used to reduce judder, but it is not required in order to do so.<ref name="Six things">{{cite web |url=http://reviews.cnet.com/4520-6449_7-6792632-1.html |title=Six things you need to know about 120&nbsp;Hz LCD TVs |accessdate=2008-02-02 |last=Carnoy |first=David |date=October 25, 2007 |publisher=CNET.com}}</ref>
A display's [[framerate]] is not always equivalent to that of the content being displayed. In other words, a display capable of or operating at a high framerate does not necessarily mean that it can or must perform motion interpolation. For example, a TV running at 120&nbsp;Hz and displaying 24&nbsp;FPS content will simply display each content frame for five of the 120 display frames per second. This has no effect on the picture other than eliminating the need for [[3:2 pulldown]] and thus film [[judder]] as a matter of course (since 120 is evenly divisible by 24). Eliminating judder results in motion that is less "jumpy" and which matches that of a [[movie projector|theater projector]]. Motion interpolation can be used to reduce judder, but it is not required in order to do so.<ref name="Six things">{{cite web |url=http://reviews.cnet.com/4520-6449_7-6792632-1.html |title=Six things you need to know about 120&nbsp;Hz LCD TVs |accessdate=2008-02-02 |last=Carnoy |first=David |date=October 25, 2007 |publisher=CNET.com}}</ref>


===Relationship to advertised display framerate===
===Relationship to advertised display framerate===
The advertised frame-rate of a specific display may refer to either the maximum number of content frames which may be displayed per second, or the number of times the display is [[refresh rate|refreshed]] in some way, irrespective of content. In the latter case, the actual presence or strength of any motion interpolation option may vary. In addition, the ability of a display to show content at a specific framerate does not mean that display is capable of accepting content running at that rate; most consumer displays above 60&nbsp;Hz do not accept a higher frequency [[list of video connectors|signal]], but rather use the extra frame capability to eliminate judder, reduce [[ghosting (television)|ghosting]], or create interpolated frames.
The advertised frame-rate



of a specific display may refer to either the maximum number of content frames which may be displayed per second, or the number of times the display is [[refresh rate|refreshed]] in some way, irrespective of content. In the latter case, the actual presence or strength of any motion interpolation option may vary. In addition, the ability of a display to show content at a specific framerate does not mean that display is capable of accepting content running at that rate; most consumer displays above 60&nbsp;Hz do not accept a higher frequency [[list of video connectors|signal]], but rather use the extra frame capability to eliminate judder, reduce [[ghosting (television)|ghosting]], or create interpolated frames.


As an example, a TV may be advertised as "240&nbsp;Hz", which would mean one of two things:
As an example, a TV may be advertised as "240&nbsp;Hz", which would mean one of two things:
Line 21: Line 18:
# The TV can natively display 240 frames per second, and perform advanced motion interpolation which inserts between 2 and 8 new frames between existing ones (for content running at 60&nbsp;FPS to 24&nbsp;FPS, respectively). For [[Active shutter 3D system|active 3D]], this framerate would be halved.
# The TV can natively display 240 frames per second, and perform advanced motion interpolation which inserts between 2 and 8 new frames between existing ones (for content running at 60&nbsp;FPS to 24&nbsp;FPS, respectively). For [[Active shutter 3D system|active 3D]], this framerate would be halved.
# The TV is natively only capable of displaying 120 frames per second, and basic motion interpolation which inserts between 1 and 4 new frames between existing ones. Typically the only difference from a "120&nbsp;Hz" TV in this case is the addition of a [[strobing backlight]], which [[flicker (screen)|flicker]]s on and off at 240&nbsp;Hz, once after every 120&nbsp;Hz frame. The intent of a strobing backlight is to increase the apparent [[refresh rate|response rate]] and thus reduce ghosting, which results in smoother motion overall. However, this technique has nothing to do with actual framerate. For active 3D, this framerate is halved, and no motion interpolation or pulldown functionality is typically provided. 600&nbsp;Hz is an oft-advertised figure for [[plasma TV]]s, and while technically correct, it only refers to an inter-frame response time of 1.6 milliseconds. This can significantly reduce ghosting and thus improve motion quality, but is unrelated to interpolation and content framerate. There are no consumer films shot at 600 frames per second, nor any [[central processing unit|TV processor]]s capable of generating 576 interpolated frames per second.
# The TV is natively only capable of displaying 120 frames per second, and basic motion interpolation which inserts between 1 and 4 new frames between existing ones. Typically the only difference from a "120&nbsp;Hz" TV in this case is the addition of a [[strobing backlight]], which [[flicker (screen)|flicker]]s on and off at 240&nbsp;Hz, once after every 120&nbsp;Hz frame. The intent of a strobing backlight is to increase the apparent [[refresh rate|response rate]] and thus reduce ghosting, which results in smoother motion overall. However, this technique has nothing to do with actual framerate. For active 3D, this framerate is halved, and no motion interpolation or pulldown functionality is typically provided. 600&nbsp;Hz is an oft-advertised figure for [[plasma TV]]s, and while technically correct, it only refers to an inter-frame response time of 1.6 milliseconds. This can significantly reduce ghosting and thus improve motion quality, but is unrelated to interpolation and content framerate. There are no consumer films shot at 600 frames per second, nor any [[central processing unit|TV processor]]s capable of generating 576 interpolated frames per second.

===HDTV implementations===
{{update section|date=October 2014}}
The commercial name given to HDTV motion interpolation technology varies across [[list of television manufacturers|manufacturers]], as does its implementation.

* Hitachi – Reel120<ref>{{cite web |url=http://www.foxbusiness.com/markets/industries/industrials/article/hitachi-unveil-new-line-ultra-lcds-ces_424621_6.html |title=Archived copy |accessdate=2008-02-01 |deadurl=yes |archiveurl=https://web.archive.org/web/20080108074106/http://www.foxbusiness.com/markets/industries/industrials/article/hitachi-unveil-new-line-ultra-lcds-ces_424621_6.html |archivedate=January 8, 2008 |df=mdy }}</ref>
* Insignia – DCM Plus, for Digital Clear Motion 120&nbsp;Hz, or Insignia Motion 120&nbsp;Hz
* [[Kogan.com]] – MotionMax 100&nbsp;Hz,<ref>{{cite web |url=http://www.kogan.com.au/shop/category/100hz-full-hd-lcd-tv/ |title=Archived copy |accessdate=2010-09-16 |deadurl=yes |archiveurl=https://web.archive.org/web/20100911124549/http://www.kogan.com.au/shop/category/100hz-full-hd-lcd-tv/ |archivedate=September 11, 2010 |df=mdy }}</ref> 200&nbsp;Hz
* LG – TruMotion 120&nbsp;Hz, 240&nbsp;Hz, 480&nbsp;Hz, MCI 120
* AOC – Motion Boost 120&nbsp;Hz
* Bose – VideoWave III 120&nbsp;Hz (Not named)
* Loewe – Digital Movie Mode (DMM)<ref>{{cite web|url=https://www.loewe.tv/uk/support/glossary.html |title=Archived copy |accessdate=2013-01-06 |deadurl=yes |archiveurl=https://web.archive.org/web/20140330225855/https://www.loewe.tv/uk/support/glossary.html |archivedate=March 30, 2014 |df=mdy }}</ref>
* Mitsubishi – Smooth 120&nbsp;Hz
* Panasonic – Intelligent Frame Creation (IFC) 24p Smooth Film (24p material only)
* Philips – HD Digital Natural Motion, Perfect Motion Rate<ref>{{cite web |url=http://www.trimension.philips.com/ |title=Archived copy |accessdate=2008-02-01 |deadurl=yes |archiveurl=https://archive.is/20070606091916/http://www.trimension.philips.com/ |archivedate=June 6, 2007 |df=mdy }}</ref>
* Samsung – Auto Motion Plus 120&nbsp;Hz,<ref>{{cite web |url=http://www.samsung.com/us/consumer/tv-video/televisions/lcd-tv/LN40C650L1FXZA/index.idx?pagetype%3Dprd_detail%26returnurl%3D |title=Archived copy |accessdate=2010-03-22 |deadurl=yes |archiveurl=https://web.archive.org/web/20100314045025/http://www.samsung.com/us/consumer/tv-video/televisions/lcd-tv/LN40C650L1FXZA/index.idx?pagetype=prd_detail&returnurl= |archivedate=March 14, 2010 |df=mdy }}</ref> 240&nbsp;Hz, Clear Motion Rate 100&nbsp;Hz, 200&nbsp;Hz, 400&nbsp;Hz, 500&nbsp;Hz, 600&nbsp;Hz, 800&nbsp;Hz; (PAL video system), Clear Motion Rate 120&nbsp;Hz, 240&nbsp;Hz, 480&nbsp;Hz, 600&nbsp;Hz, 720&nbsp;Hz, 960&nbsp;Hz (NTSC video system)
* Sharp – Fine Motion Enhanced,<ref>{{cite web|url=https://www.engadget.com/2009/07/07/sharp-intros-slate-of-new-aquos-lcd-hdtvs-first-led-models-incl |title=Sharp intros slate of new AQUOS LCD HDTVs, first LED models included |website=Engadget.com |date= |accessdate=2016-11-30}}</ref> AquoMotion 240&nbsp;Hz,<ref>{{cite web|url=https://www.engadget.com/2010/01/06/sharps-debuts-60-inch-240hz-aquos-led-lcd-tv-68-inch-set-with/ |title=Sharp debuts 60-inch 240Hz Aquos LED LCD TV, 68-inch set with a touch of yellow in its RGB |website=Engadget.com |date= |accessdate=2016-11-30}}</ref> AquoMotion Pro
* Sony – MotionFlow 100&nbsp;Hz, 100&nbsp;Hz PRO (XBR series, Australia), 120&nbsp;Hz, 200&nbsp;Hz, 240&nbsp;Hz, 400&nbsp;Hz, 480&nbsp;Hz, 800&nbsp;Hz, 960&nbsp;Hz.<ref>{{cite web|url=http://news.sel.sony.com/en/press_room/consumer/television/flat_panel_displays/lcd/release/28328.html |title=Press Articles – Sony |website=News.sel.sony.com |date= |accessdate=2016-11-30}}</ref><ref>{{cite web|url=http://motionflow.eu/ |title=ACK.de - Professionelle Domain Dienstleistungen und Beratung |website=Motionflow.eu |date= |accessdate=2016-11-30}}</ref>
* Toshiba – ClearScan 120&nbsp;Hz, 240&nbsp;Hz
* Vizio – SmoothMotion<ref>{{cite web |url=http://store.vizio.com/discover/inside/ |title=Archived copy |accessdate=2012-12-20 |deadurl=yes |archiveurl=https://web.archive.org/web/20121231002907/http://store.vizio.com/discover/inside/ |archivedate=December 31, 2012 |df=mdy }}</ref>
* Sceptre – MEMC (Motion Estimation/Motion Compensation)
* Hisense – Ultra Smooth Motion Rate SMR 120
* Westinghouse – MEMC (Motion Estimation/Motion Compensation)


==Software applications==
==Software applications==
Line 54: Line 28:
* [[PowerDVD]] uses TrueTheater Motion for interpolation of DVD and video files to up to 72 frame/s.<ref>{{cite web|url=http://www.cyberlink.com/stat/technology/enu/true-theater-solution.jsp|title=Video Enhancement – TrueTheater Technology|accessdate=2009-08-24|work=CyberLink}}</ref>
* [[PowerDVD]] uses TrueTheater Motion for interpolation of DVD and video files to up to 72 frame/s.<ref>{{cite web|url=http://www.cyberlink.com/stat/technology/enu/true-theater-solution.jsp|title=Video Enhancement – TrueTheater Technology|accessdate=2009-08-24|work=CyberLink}}</ref>
* [[Splash Lite|Splash PRO]] uses Mirillis Motion² technology for up to Full HD video interpolation.<ref>{{cite web|url=http://mirillis.com/en/products/picture2.html |title=Picture2 |website=Mirillis.com |date=2010-07-01 |accessdate=2016-11-30}}</ref>
* [[Splash Lite|Splash PRO]] uses Mirillis Motion² technology for up to Full HD video interpolation.<ref>{{cite web|url=http://mirillis.com/en/products/picture2.html |title=Picture2 |website=Mirillis.com |date=2010-07-01 |accessdate=2016-11-30}}</ref>
* DmitriRender uses GPU-oriented Frame Rate Conversion algorithm with native DXVA support for frame interpolation.<ref>{{cite web|url=http://www.dmitriRender.ru/ |title=Home |website=DmitriRender.ru |date= |accessdate=2016-11-30}}</ref>
* DmitriRender uses GPU-oriented frame rate conversion algorithm with native DXVA support for frame interpolation.<ref>{{cite web|url=http://www.dmitriRender.ru/ |title=Home |website=DmitriRender.ru |date= |accessdate=2016-11-30}}</ref>
* Bluesky Frame Rate Converter a DirectShow Filter that can convert the frame rate using AMD Fluid Motion.<ref>{{cite web|url=http://bluesky23.yukishigure.com/en/BlueskyFRC.html |title=Bluesky Frame Rate Converter |website=Bluesky23.yukishigure.com |date= |accessdate=2016-11-30}}</ref>
* Bluesky Frame Rate Converter is a DirectShow filter that can convert the frame rate using AMD Fluid Motion.<ref>{{cite web|url=http://bluesky23.yukishigure.com/en/BlueskyFRC.html |title=Bluesky Frame Rate Converter |website=Bluesky23.yukishigure.com |date= |accessdate=2016-11-30}}</ref>
* SmoothVideo Project (it used to be free, now it's about 20 $, there is 30 days trial) comes integrated by default with [[Media Player Classic|MPC-HC]]; paid version can integrate with more players, including [[VLC media player|VLC]].<ref>{{cite web|url=https://www.svp-team.com/w/index.php?title=Main_Page |title=SVP - 60 fps / 120 fps HFR motion interpolation for Windows, macOS in mpv, VLC, Plex |website=SVP-team.com |date= |accessdate=2018-02-06}}</ref>
* SVP (SmoothVideo Project) comes integrated by default with [[Media Player Classic|MPC-HC]]; paid version can integrate with more players, including [[VLC media player|VLC]].<ref>{{cite web|url=https://www.svp-team.com/w/index.php?title=Main_Page |title=SVP - 60 fps / 120 fps HFR motion interpolation for Windows, macOS in mpv, VLC, Plex |website=SVP-team.com |date= |accessdate=2018-02-06}}</ref>


===Video editing software===
===Video editing software===
Some [[video editing software]] and [[plugins]] offer motion interpolation effects to enhance [[slow motion|digitally-slowed video]]. [[FFmpeg]] is a [[free software]] non-interactive tool with such functionality. [[Adobe After Effects]] has this in a feature called "Pixel Motion". The effects plugin "Twixtor" is available for most major video editing suites, and offers similar functionality.
Some [[video editing software]] and [[plug-in (computing)|plugins]] offer motion interpolation effects to enhance [[slow motion|digitally-slowed video]]. [[FFmpeg]] is a [[free software]] non-interactive tool with such functionality. [[Adobe After Effects]] has this in a feature called "Pixel Motion". AI software company Topaz Labs produces Video AI, a video upscaling application with motion interpolation. The effects plugin "Twixtor" is available for most major video editing suites, and offers similar functionality.


=== Virtual reality ===
=== Neural networks ===
* [https://github.com/baowenbo/dain Depth-Aware Video Frame Interpolation]
On October 6, 2016, [[Oculus VR]] announced that it would enable the use of motion interpolation on the [[Oculus Rift]] virtual reality headset, allowing it to be used on computers whose specifications are not high enough to render to the headset at 90&nbsp;frames per second.<ref name="ars-lowerspec">{{cite web|title=Oculus lowers minimum Rift specs using "asynchronous spacewarp" tech|url=https://arstechnica.com/gaming/2016/10/oculus-lowers-minimum-rift-specs-using-asynchronous-spacewarp-tech/|website=Ars Technica|accessdate=6 October 2016}}</ref><ref name="polygon-lowerrequirements">{{cite web|title=Oculus Rift has a new minimum spec, $499 entry-level PC|url=http://www.polygon.com/virtual-reality/2016/10/6/13189600/oculus-rift-minimum-spec|website=Polygon|accessdate=6 October 2016}}</ref>
* [https://github.com/myungsub/cain Channel Attention Is All You Need]
* [https://github.com/megvii-research/ECCV2022-RIFE Real-Time Intermediate Flow Estimation]
* [https://github.com/ltkong218/IFRNet Intermediate Feature Refine Network]
* [[Deep learning super sampling]] used specifically to interpolate frames in real-time for video games


==Side effects==
==Side effects==
===Visual artifacts===
===Visual artifacts===
{{Main|Visual artifact}}
{{Main|Visual artifact}}
Motion interpolation on certain brands of TVs is sometimes accompanied by visual anomalies in the picture, described by CNET's David Carnoy as a "little tear or glitch" in the picture, appearing for a fraction of a second. He adds that the effect is most noticeable when the technology suddenly kicks in during a fast camera pan.<ref name="Six things"/> Television and display manufacturers refer to this phenomenon as a type of [[digital artifact]]. Due to the improvement of associated technology over time, such artifacts appear less frequently with modern consumer TVs, though they have yet to be eliminated entirely "the artifacts happens more often when the gap between frames are bigger".
Motion interpolation on certain brands of TVs is sometimes accompanied by visual anomalies in the picture, described by CNET's David Carnoy as a "little tear or glitch" in the picture, appearing for a fraction of a second. He adds that the effect is most noticeable when the technology suddenly kicks in during a fast camera pan.<ref name="Six things"/> Television and display manufacturers refer to this phenomenon as a type of [[digital artifact]]. Due to the improvement of associated technology over time, such artifacts appear less frequently with modern consumer TVs, though they have yet to be eliminated "the artifacts happens more often when the gap between frames are bigger".{{citation needed|date=June 2024}}


=== Soap opera effect ===
=== Soap opera effect ===
As a byproduct of the perceived increase in framerate, motion interpolation may introduce a "video" (versus "film") look. This look is commonly referred to as the "'''soap opera effect'''" ('''SOE''')<!--the bold is because this phrase redirects here-->, in reference to the distinctive appearance of most [[television network#United States|broadcast television]] [[soap opera]]s or pre 2000s [[Multiple-camera setup|multicam]] [[sitcom]]s, which were typically shot using less expensive [[Frame rate#Film and television|60i]] video rather than film.<ref name="Weird Effects">{{cite web |url=http://www.crunchgear.com/2009/08/12/help-key-why-hd-video-looks-weird |title=Help Key: Why 120 Hz looks "weird" |accessdate=2009-11-13 |last=Biggs |first=John |date=August 12, 2009|publisher=crunchgear.com}}</ref>
As a byproduct of the perceived increase in frame rate, motion interpolation may introduce a "video" (versus "film") look. This look is commonly referred to as the "'''soap opera effect'''" ('''SOE''')<!--The bold is because this phrase redirects here-->, in reference to the distinctive appearance of most [[television network#United States|broadcast television]] [[soap opera]]s or pre 2000s [[Multiple-camera setup|multicam]] [[sitcom]]s, which were typically shot using less expensive [[List of broadcast video formats|60i]] video rather than film.<ref name="Weird Effects">{{cite web |url=http://www.crunchgear.com/2009/08/12/help-key-why-hd-video-looks-weird |title=Help Key: Why 120 Hz looks "weird" |accessdate=2009-11-13 |last=Biggs |first=John |date=August 12, 2009|publisher=crunchgear.com}}</ref>
Many complain that the soap opera effect ruins the theatrical look of [[Cinematography|cinematic]] works, by making it appear as if the viewer is either on set or watching a [[making-of|behind the scenes]] [[featurette]].<ref name="Vizio">{{cite web |url=http://ces.cnet.com/8301-13855_1-9845306-67.html |title=Vizio adds 120 Hz LCDs to its lineup |accessdate=2008-02-01 |last=Moskovciak |first=Matthew |date=January 8, 2008 |publisher=CNET.com}}</ref> For this reason, almost all manufacturers have built in an option to turn the feature off or lower the effect strength.
Many complain that the soap opera effect ruins the theatrical look of [[Cinematography|cinematic]] works, by making it appear as if the viewer is either on set or watching a [[making-of|behind the scenes]] [[featurette]].<ref name="Vizio">{{cite web |url=http://ces.cnet.com/8301-13855_1-9845306-67.html |title=Vizio adds 120 Hz LCDs to its lineup |accessdate=2008-02-01 |last=Moskovciak |first=Matthew |date=January 8, 2008 |publisher=CNET.com}}</ref> Almost all manufacturers provide ways to disable the feature, but because methods and terminology differ, the [[UHD Alliance]] proposed that all televisions have a "Filmmaker Mode" button on remote controls to disable motion smoothing.<ref name="wouk20190921">{{Cite web |url=https://www.digitaltrends.com/home-theater/what-is-the-soap-opera-effect-in-tvs-and-how-to-turn-it-off/ |title=What is the Soap Opera Effect and how can you get rid of it on your TV? |last=Wouk |first=Kris |date=2019-09-21 |website=Digital Trends |access-date=2020-01-31}}</ref>


Others appreciate motion interpolation as it reduces [[motion blur]] produced by [[camera pan]]s and [[shaky camera]]s and thus yields better clarity of such images. It may also be used to increase the apparent framerate of [[video game]] software for a more realistic feel, though the addition of [[input lag]] may be an undesired side effect.<ref name="techtarget">{{cite web |url=http://whatis.techtarget.com/definition/soap-opera-effect.html |title=What is the Soap Opera Effect? |accessdate=2011-04-20 |publisher=Techtarget.com}}</ref> This "video look" is created deliberately by the [[VidFIRE]] technique to restore archive television programs that only survive as film [[telerecording]]s.<ref name="VIDFIRE">{{cite web |url=http://www.purpleville.pwp.blueyonder.co.uk/rtwebsite/vidfire.htm |title=VIDFIRE – The Doctor Who Restoration Team |accessdate=2011-05-19 |publisher=restoration-team.co.uk/ |deadurl=yes |archiveurl=https://web.archive.org/web/20110517121208/http://www.purpleville.pwp.blueyonder.co.uk/rtwebsite/vidfire.htm |archivedate=May 17, 2011 |df=mdy-all }}</ref> The main differences between an artificially and naturally high framerate (via interpolation versus in-camera), are that the latter is not subject to any of the aforementioned artifacts, contains more accurate (or "true to life") image data, and requires more storage space and bandwidth since frames are not produced in realtime.
Motion interpolation so annoys filmmakers that [[Tom Cruise]] and [[Christopher McQuarrie]] released a [[public service announcement]] in 2018 describing the effect and how to disable it.<ref name="cruisemcquarrie2018">{{Cite AV media |url=https://www.youtube.com/watch?v=1J0Dan0WaZk |title=Tom Cruise 'Motion Smoothing' PSA |date=2018-12-06 |last=Cruise |first=Tom |author-link=Tom Cruise |last2=McQuarrie |first2=Christopher |author-link2=Christopher McQuarrie |access-date=2024-06-14 |via=YouTube}}</ref> Some sports viewers appreciate motion interpolation,{{r|wouk20190921}} as it can reduce motion blur produced by [[camera pan]]s and [[shaky camera]]s, and thus potentially yield better clarity of such images. It may also be used to increase the apparent framerate of [[video game]]s for a more realistic feel, although the addition of [[display lag]] may be an undesired side effect.<ref name="techtarget">{{cite web |url=http://whatis.techtarget.com/definition/soap-opera-effect.html |title=What is the Soap Opera Effect? |accessdate=2011-04-20 |publisher=Techtarget.com}}</ref> This "video look" is created deliberately by the [[VidFIRE]] technique to restore archive television programs that only survive as film [[telerecording]]s, such as early seasons of the TV series ''[[Doctor Who]]''.<ref name="VIDFIRE">{{cite web |url=http://www.purpleville.pwp.blueyonder.co.uk/rtwebsite/vidfire.htm |title=VIDFIRE – The Doctor Who Restoration Team |accessdate=2011-05-19 |publisher=restoration-team.co.uk/ |url-status=dead |archiveurl=https://web.archive.org/web/20110517121208/http://www.purpleville.pwp.blueyonder.co.uk/rtwebsite/vidfire.htm |archivedate=May 17, 2011 |df=mdy-all }}</ref> The main differences between an artificially (interpolated) and naturally (in-camera) high framerate are that in-camera is not subject to any of the aforementioned artifacts, contains more accurate (or "true to life") image data, and requires more storage space and bandwidth, since frames are not produced in real time.&nbsp;{{citation needed|date=July 2019}}


==See also==
==See also==
* [[Inbetweening]]
* [[Inbetweening]]
* [[Motion compensation]]
* [[Motion compensation]]
* [[Motion interpolation (computer graphics)]]
* [[Flicker-free]]
* [[Flicker-free]]
* [[Television standards conversion]]
* [[Television standards conversion]]
*[[3:2 pulldown]]


==References==
==References==
{{Reflist|30em}}
{{Reflist}}


==External links==
==External links==
Line 90: Line 70:
[[Category:Display technology]]
[[Category:Display technology]]
[[Category:Video processing]]
[[Category:Video processing]]
[[Category:Interpolation]]
[[Category:Video]]
[[Category:Film and video technology]]
[[Category:Film post-production technology]]

Latest revision as of 18:57, 27 October 2024

Comparison of a slow down video without interframe interpolation (left) and with motion interpolation (right)

Motion interpolation or motion-compensated frame interpolation (MCFI) is a form of video processing in which intermediate film, video or animation frames are generated between existing ones by means of interpolation, in an attempt to make animation more fluid, to compensate for display motion blur, and for fake slow motion effects.

Hardware applications

[edit]

Displays

[edit]

Motion interpolation is a common, optional feature of various modern display devices such as HDTVs and video players, aimed at increasing perceived framerate or alleviating display motion blur, a common problem on LCD flat-panel displays.

Difference from display framerate

[edit]

A display's framerate is not always equivalent to that of the content being displayed. In other words, a display capable of or operating at a high framerate does not necessarily mean that it can or must perform motion interpolation. For example, a TV running at 120 Hz and displaying 24 FPS content will simply display each content frame for five of the 120 display frames per second. This has no effect on the picture other than eliminating the need for 3:2 pulldown and thus film judder as a matter of course (since 120 is evenly divisible by 24). Eliminating judder results in motion that is less "jumpy" and which matches that of a theater projector. Motion interpolation can be used to reduce judder, but it is not required in order to do so.[1]

Relationship to advertised display framerate

[edit]

The advertised frame-rate of a specific display may refer to either the maximum number of content frames which may be displayed per second, or the number of times the display is refreshed in some way, irrespective of content. In the latter case, the actual presence or strength of any motion interpolation option may vary. In addition, the ability of a display to show content at a specific framerate does not mean that display is capable of accepting content running at that rate; most consumer displays above 60 Hz do not accept a higher frequency signal, but rather use the extra frame capability to eliminate judder, reduce ghosting, or create interpolated frames.

As an example, a TV may be advertised as "240 Hz", which would mean one of two things:

  1. The TV can natively display 240 frames per second, and perform advanced motion interpolation which inserts between 2 and 8 new frames between existing ones (for content running at 60 FPS to 24 FPS, respectively). For active 3D, this framerate would be halved.
  2. The TV is natively only capable of displaying 120 frames per second, and basic motion interpolation which inserts between 1 and 4 new frames between existing ones. Typically the only difference from a "120 Hz" TV in this case is the addition of a strobing backlight, which flickers on and off at 240 Hz, once after every 120 Hz frame. The intent of a strobing backlight is to increase the apparent response rate and thus reduce ghosting, which results in smoother motion overall. However, this technique has nothing to do with actual framerate. For active 3D, this framerate is halved, and no motion interpolation or pulldown functionality is typically provided. 600 Hz is an oft-advertised figure for plasma TVs, and while technically correct, it only refers to an inter-frame response time of 1.6 milliseconds. This can significantly reduce ghosting and thus improve motion quality, but is unrelated to interpolation and content framerate. There are no consumer films shot at 600 frames per second, nor any TV processors capable of generating 576 interpolated frames per second.

Software applications

[edit]

Video playback software

[edit]

Motion interpolation features are included with several video player applications.

  • WinDVD uses Philips' TrimensionDNM for frame interpolation.[2]
  • PowerDVD uses TrueTheater Motion for interpolation of DVD and video files to up to 72 frame/s.[3]
  • Splash PRO uses Mirillis Motion² technology for up to Full HD video interpolation.[4]
  • DmitriRender uses GPU-oriented frame rate conversion algorithm with native DXVA support for frame interpolation.[5]
  • Bluesky Frame Rate Converter is a DirectShow filter that can convert the frame rate using AMD Fluid Motion.[6]
  • SVP (SmoothVideo Project) comes integrated by default with MPC-HC; paid version can integrate with more players, including VLC.[7]

Video editing software

[edit]

Some video editing software and plugins offer motion interpolation effects to enhance digitally-slowed video. FFmpeg is a free software non-interactive tool with such functionality. Adobe After Effects has this in a feature called "Pixel Motion". AI software company Topaz Labs produces Video AI, a video upscaling application with motion interpolation. The effects plugin "Twixtor" is available for most major video editing suites, and offers similar functionality.

Neural networks

[edit]

Side effects

[edit]

Visual artifacts

[edit]

Motion interpolation on certain brands of TVs is sometimes accompanied by visual anomalies in the picture, described by CNET's David Carnoy as a "little tear or glitch" in the picture, appearing for a fraction of a second. He adds that the effect is most noticeable when the technology suddenly kicks in during a fast camera pan.[1] Television and display manufacturers refer to this phenomenon as a type of digital artifact. Due to the improvement of associated technology over time, such artifacts appear less frequently with modern consumer TVs, though they have yet to be eliminated "the artifacts happens more often when the gap between frames are bigger".[citation needed]

Soap opera effect

[edit]

As a byproduct of the perceived increase in frame rate, motion interpolation may introduce a "video" (versus "film") look. This look is commonly referred to as the "soap opera effect" (SOE), in reference to the distinctive appearance of most broadcast television soap operas or pre 2000s multicam sitcoms, which were typically shot using less expensive 60i video rather than film.[8] Many complain that the soap opera effect ruins the theatrical look of cinematic works, by making it appear as if the viewer is either on set or watching a behind the scenes featurette.[9] Almost all manufacturers provide ways to disable the feature, but because methods and terminology differ, the UHD Alliance proposed that all televisions have a "Filmmaker Mode" button on remote controls to disable motion smoothing.[10]

Motion interpolation so annoys filmmakers that Tom Cruise and Christopher McQuarrie released a public service announcement in 2018 describing the effect and how to disable it.[11] Some sports viewers appreciate motion interpolation,[10] as it can reduce motion blur produced by camera pans and shaky cameras, and thus potentially yield better clarity of such images. It may also be used to increase the apparent framerate of video games for a more realistic feel, although the addition of display lag may be an undesired side effect.[12] This "video look" is created deliberately by the VidFIRE technique to restore archive television programs that only survive as film telerecordings, such as early seasons of the TV series Doctor Who.[13] The main differences between an artificially (interpolated) and naturally (in-camera) high framerate are that in-camera is not subject to any of the aforementioned artifacts, contains more accurate (or "true to life") image data, and requires more storage space and bandwidth, since frames are not produced in real time. [citation needed]

See also

[edit]

References

[edit]
  1. ^ a b Carnoy, David (October 25, 2007). "Six things you need to know about 120 Hz LCD TVs". CNET.com. Retrieved February 2, 2008.
  2. ^ "Black Friday Deals & Savings on Top Corel Products". Corel.com. Retrieved November 30, 2016.
  3. ^ "Video Enhancement – TrueTheater Technology". CyberLink. Retrieved August 24, 2009.
  4. ^ "Picture2". Mirillis.com. July 1, 2010. Retrieved November 30, 2016.
  5. ^ "Home". DmitriRender.ru. Retrieved November 30, 2016.
  6. ^ "Bluesky Frame Rate Converter". Bluesky23.yukishigure.com. Retrieved November 30, 2016.
  7. ^ "SVP - 60 fps / 120 fps HFR motion interpolation for Windows, macOS in mpv, VLC, Plex". SVP-team.com. Retrieved February 6, 2018.
  8. ^ Biggs, John (August 12, 2009). "Help Key: Why 120 Hz looks "weird"". crunchgear.com. Retrieved November 13, 2009.
  9. ^ Moskovciak, Matthew (January 8, 2008). "Vizio adds 120 Hz LCDs to its lineup". CNET.com. Retrieved February 1, 2008.
  10. ^ a b Wouk, Kris (September 21, 2019). "What is the Soap Opera Effect and how can you get rid of it on your TV?". Digital Trends. Retrieved January 31, 2020.
  11. ^ Cruise, Tom; McQuarrie, Christopher (December 6, 2018). Tom Cruise 'Motion Smoothing' PSA. Retrieved June 14, 2024 – via YouTube.
  12. ^ "What is the Soap Opera Effect?". Techtarget.com. Retrieved April 20, 2011.
  13. ^ "VIDFIRE – The Doctor Who Restoration Team". restoration-team.co.uk/. Archived from the original on May 17, 2011. Retrieved May 19, 2011.
[edit]