User:84user/Video tests

From Wikimedia Commons, the free media repository
Jump to: navigation, search

These are video test results and details on how the test videos were made.

VLC 1.03 results[edit]

I tested VLC media player version 1.0.3 Goldeneye on Windows Vista and found no change in its behaviour with my test media. I have added 1.0.3 test results to some of the tables below.

First, some of my casual regression tests:

Test media 1.0.3 results 1.0.1 results difference? Notes
my local link to a BBC Real audio stream no sound no sound UNCHANGED sound in Real Player
pia08262_quality10fr1.ogv, a tiny 15KB video only the middle 1 second I forget forgotten Firefox plays it Ok
Test_avi.vq10.ogv Ok Ok UNCHANGED 6 second audio video test at 221 KB made with ffmpeg2theora
File:Test avi 64kbps video 32kbps audio.ogv Ok forgotten forgotten
File:Prosthemadera_novaeseelandiae_vocalizations.ogg Ok Ok UNCHANGED audio in sync

VLC Goldeneye results[edit]

VLC media player version 1.0.1 Goldeneye - encoding to Theora OGG video. How these videos were made is explained in section "Calibration test videos" below. I added some VLC 1.0.3 results.

Source media VLC converts to OGG? VLC 1.0.1 plays OGG? VLC 1.0.3? Firefox plays OGG? MPC plays OGG?
cal.avi VLC at 800kbps, noaudio YES* YES YES YES YES
cal.avi VLC at 1600kbps, noaudio YES* YES YES YES YES
cal.avi VLC at 3200kbps, noaudio YES* YES YES YES YES
cal_2flip2_click1in4track8secsmono22khz16bit8khzvbr.avi at 3200kbps YES* MISS1 MISS1 YES STATIC
cal_2flip2_click1in4track8secsmono22khz16bit8khzvbr.avi at 800kbps sample rate 11250 YES* MISS1 MISS1 YES STATIC
cal_2flip2click8khzvbr.avi YES* MISS1 - YES YES
YES* means VLC converted AVI to an OGG but of distorted size and of poorer quality than ffmpeg2theora
MISS1 means VLC misses the first part of, or all of, the first audio click
STATIC means MPC showed a static image and played less than 8 audio clicks

Calibration test videos[edit]

This table shows how well or badly various media players performed.

test media Firefox Chrome MPlayer VLC VLC1.0.3 MPC
File:cal_ifps25fr25_q10.ogv YES YES YES NO NO NO
File:cal_4frames_ifps25fr25_q10.ogv YES YES YES NO NO NO
File:cal_2flip_ifps25fr25_q10.ogv YES GLITCH YES NO NO NO
File:vdubtestrgbcube4secs_ifps12fr12_q10.ogv YES YES YES YES YES NOKEYS?
File:Audacity click track one per second for eight seconds mono88khz32bitfloat.ogg YES YES YES CLICKS7 CLICKS7 CLICKS3
File:cal_2flip2click8khzvbr_ifps25fr25_q6aq0.ogv YES OUT OF SYNC OUT OF SYNC OUT OF SYNC* OUT OF SYNC* NO
File:cal_2flip2_click1in4track8secsmono22khz16bit8khzvbr_vlc3.ogv YES YES YES YES* CLICKS7 STATIC
File:cal_2flip2click8khzvbr_vlc.ogv YES FIRSTYES CLICKS9 CLICKS7 CLICKS7 YES
GLITCH means Chrome played at too fast a frame rate
NOKEYS? means MPC plays as if it ignored keyframes (blurry, muddy, pixely, unreadable)
OUT OF SYNC means Google Chrome plays audio out of sync and video at wrong frame rate
OUT OF SYNC* means VLC misses the first click, shows black for 2 seconds and plays audio out of sync
YES* means VLC plays with audio IN SYNC but misses part of the first click
STATIC means MPC showed a static image and played less than 8 audio clicks
FIRSTYES means Chrome plays it correctly the first time but out of sync on replay
CLICKS9 means Mplayer sounds nine clicks instead of the eight clicks in the audio stream (?)
CLICKS7 means VLC misses the first click but otherwise plays the audio in sync
CLICKS3 means MPC half-misses the first click and plays only two more clicks
Firefox is version 3.5.5
Google Chrome is version 3.0.195.32;
MPC is Media Player Classic build 1.3.1249.0, complier VS 2008, FFmpeg compiler GCC 4.3.3
VLC is 1.0.1 Goldeneye
mplayer.exe dated 2006-10-28 is from SUPER 2009.build.36 and identifies itself with:
MPlayer 1.0rc1-3.4.2 (C) 2000-2006 MPlayer Team.
CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 5000+ (Family: 15, Model: 67, Stepping: 2)
CPUflags:  MMX: 1 MMX2: 1 3DNow: 1 3DNow2: 1 SSE: 1 SSE2: 1
Compiled with runtime CPU detection.
I found that when MPC was running, mplayer.exe played audio Ok but played video as a full-green static screen.

MwEmbed Calibration tests[edit]

This table shows how mw:Extension:MwEmbedPlayer played the Calibration test videos on Firefox version 3.5.5. The lack of replay and seeking maybe wikimedia related because I have seen other videos also sometimes fail to replay.

Quick feedback:

  • first play of a newly loaded video page works
  • subtitles work (Commons:Timed Text), both on video and below video options
  • volume control works
  • pause works on first play
  • seek works on first play
  • menu choice download gives full video in new tab and works Ok so far
  • menu choice share provides embedding code, Copy Code button did not work, but manual copy paste looked Ok, I did not test whether the embedding code worked
  • menu choice credits (icon with i in a circle) opens white panel "Credits" above the line and thumbnail plus "Title" and filename below the line
  • once video completes, play button sometimes remains showing the pause symbol and does not respond, until page reloaded
  • once video completes, sometimes seek slider moves but only "seeking" is displayed, video does not respond
  • seek slider sometimes only works on first play as long as video has not finished, but its position appears incorrect
  • how can user disable and re-enable MwEmbed on any one page? Needs a "Classic View" button.
  • MwEmbed layer disables usual context menu from clicking mouse right button
  • problem with thumbnails as Slomox mentioned.
  • video stays static when seek slider moved, unlike Firefox's seek slider which allows user to move video freely back and forth

Detailed test results:

  • newtab = opens full video in new browser tab which is playable, replayable, seekable and downloadable
  • nt = not tested;
  • replays2 = second replay, ie third time click on the play button
  • slow = browser receives a lot of data from prototype.wikimedia.org, maybe related to number of thumbnails on page
  • YES1 = video plays to end Ok, but then play button shows pause icon and does not function until page reload
  • YESBUT = video plays but shows subtitles from previous video (unexpected) while CC menu lists none (as expected)
  • PREVIOUS = shows subtitles from another video when this video has none!
  • ONLY1 = works only on first play, after video completes, seek has no effect
  • misses2 = skips subtitle text entries at one and two seconds
  • noclose = audio files and very small videos: menu opens to cover the close button so cannot be closed.
  • ? = on second attempt MwEmbed interface no longer loads
test media plays? replays? replays2? seeks? info download? reload page? subtitles?
File:cal_ifps25fr25_q10.ogv YES YES YES YES credits newtab slow PREVIOUS
File:cal_4frames_ifps25fr25_q10.ogv nt nt nt nt nt nt nt nt
File:cal_2flip_ifps25fr25_q10.ogv nt nt nt nt nt nt nt nt
File:vdubtestrgbcube4secs_ifps12fr12_q10.ogv YES YES YES YES credits newtab slow
File:vdubtestrgbcube4secs_ifps12fr12_q10.ogv reload  ?  ?  ?  ?  ?  ?  ?  ?
File:Audacity click track one per second for eight seconds mono88khz32bitfloat.ogg YES YES YES YES noclose newtab slow misses2
File:cal_2flip2click8khzvbr_ifps25fr25_q6aq0.ogv YES YES YES YES credits newtab slow
File:cal_2flip2_click1in4track8secsmono22khz16bit8khzvbr_vlc3.ogv YESBUT NO NO NO credits newtab slow PREVIOUS
File:cal_2flip2click8khzvbr_vlc.ogv YES1 NO NO ONLY1 credits newtab slow misses2

-84user (talk) 15:17, 23 December 2009 (UTC)

MwEmbed retests[edit]

I repeated some of the above tests following the rollout of r60370.

test media plays? replays? replays2? seeks? info download? reload page? subtitles?
File:cal_ifps25fr25_q10.ogv YES YES YES YES credits sametab slow PREVIOUS
File:cal_4frames_ifps25fr25_q10.ogv YES YES YES YES credits sametab slow PREVIOUSANDMISSING12
File:cal_2flip_ifps25fr25_q10.ogv YES YES YES YES credits sametab slow PREVIOUSANDMISSING12
File:vdubtestrgbcube4secs_ifps12fr12_q10.ogv NOBUTSECONDYES YES YES NOSEEKONSECOND credits sametab fast CORRECTLYNONE
File:Audacity click track one per second for eight seconds mono88khz32bitfloat.ogg YES YES YES YESBUT noclose sametab fast CORRECT
File:cal_2flip2click8khzvbr_ifps25fr25_q6aq0.ogv NOINTERFACE NOI NOI NOI NOI NOI NOI
File:cal_2flip2_click1in4track8secsmono22khz16bit8khzvbr_vlc3.ogv YESBUT NO NO NO credits sametab slow CORRECTLYNONE
File:cal_2flip2click8khzvbr_vlc.ogv YES1 NO NO ONLY1 credits sametab faster YESALL

NOBUTSECONDYES means the gadget does not appear on the first video rendered on a page but it does on the second. In this case the second rendering was tested. Repeating these tests yet again results in inconsistent behaviour, sometimes no interface appears.

I suspect, without further testing, that the gadget uses the subtitle text of the last video it finds on a page. I.e. when there are two videos on a page with only the second having subtitles, then the gadget uses the second's subtitles when playing the first video. -84user (talk) 14:34, 25 December 2009 (UTC)

I have just now retested all the above videos and subtitles play as expected, ie all correctly play no subtitles except File:cal_2flip2click8khzvbr_vlc.ogv which plays French or German depending on which I select. I tested these on Firefox 3.5.5 on Windows Vista. On Chrome version 3.0.195.38, the video and subtitles play but sometimes with glitches: for File:cal_2flip2click8khzvbr_vlc.ogv subtitles numbered 2 3 and 4 are skipped and sometimes the mwEmbed does not appear at all. On Opera version 10.10, build 1893, only the subtitles text plays, no video. -84user (talk) 13:08, 27 December 2009 (UTC)

Handbrake 0.9.4 tests[edit]

tested HandBrake 0.9.4 on Windows Vista. Version 0.9.3 failed to read OGG files.

Summary: mixed; converts only specific OGV to MP4 with no errors; converts M4V to MKV with codec set to VP3 (Theora) and audio set to Vorbis with no errors; but fails to handle most other OGV, AVI or MPG test files and hangs on MP4. Here is what I did.

  • clicked Download button on HandBrake 0.9.3's dialog window.
  • uninstalled 0.9.3 using Control panel
  • clicked Agree button to license for 0.9.4 on Handbrake 0.9.4 setup window
  • clicked Install button with destination folder field set to "C:\r\progs\HandBrake\"
  • clicked Finish button

Results so far: splash window "Handbrake" announces setting up the GUI..."; another window states "Handbrake has determined your built-in presets are out of date... Thiese presets will now be updated.

  • clicked on OK button of "Preset Update" window

Results so far: splash and "Preset Update" windows disappear and main Handbrake window appears with Presets set to Normal.

  • Start to test Handbrake with my standard set of videos:
    • Source: 135241main_neutronstar4lunch-magic.mov_NASA WebV_Oct3.mpg ; Output Settings: MKV ; Web optimized: click Start
      • => black window appears and disappears; "Encoding finished"; no output seen in destination; warnings in scan log, errors in encode log:



    • Source: cal16x16check_vdnocnoafr1len4.avi ; Output Settings: MKV ; Web optimized: click Start
      • => black window appears and disappears; "Encoding finished"; no output seen in destination; some warnings in the log:


    • Source: cal16x16check_vdnocnoafr1len4.avi ; Output Settings: MP4 ; Web optimized: click Start
      • => black window appears and disappears; "Encoding finished"; no output seen in destination; warnings in scan log, errors in encode log:



Repeat above but with Video tab set to MPEG-4 (FFmpeg) => same errors

I notice Handbrake's options showed VLC path set to a non-existent directory. I changed it to point to where the VLC executable is, and repeated the test => no difference, errors still reported.

    • Source: 1933-04-06_Commander_Describes_Akron_Tragedy_512kb.mp4 ; Output Settings: MKV ; click Start
      • => black window appears and shows "Encoding: task 1 of 1, 2.16 %" and hangs; an empty file named "1933-04-06_Commander_Describes_Akron_Tragedy_512kb-1.mkv" is seen in destination; errors in encode log (example: "[NULL @ 0x24c9db0]insufficient thread locking around avcodec_open/close()":


    • Source: 1933-04-06_Commander_Describes_Akron_Tragedy.ogv ; Output Settings: MP4 ; click Start
      • => SUCCESS! black window appears and shows the Encoding percentage progress: a playable file named "1933-04-06_Commander_Describes_Akron_Tragedy-1.m4v" is seen in destination; "Rip done!" in encode log (no errors):

Conclusions? I suspect Handbrake is for actual DVD files or certain MKV and MP4 files only and not other video formats such as OGV. In each of 0.9.4's presets, the container choices are now only MP4 and MKV.

Update: converts M4V to MK4 with codec set to VP3 (Theora).

    • Source: 1933-04-06_Commander_Describes_Akron_Tragedy-1.m4v ; Output Settings: MP4 ; click Video tab and select VP3 (Theora); click Start
      • => SUCCESS! black window appears and shows the Encoding percentage progress: a playable file named "1933-04-06_Commander_Describes_Akron_Tragedy-1-1.mkv" is seen in destination, containing a Theora video stream with writing library "Xiph.Org libtheora 1.1 20090822 (Thusnelda)" and an audio stream "Advanced Audio Codec" Version 4


I repeated the above test setting the audio codec set to Vorbis, and that worked too.

I posted a note and query at Help talk:Converting video#Handbrake 0.9.4 can convert to Theora and Vorbis inside MKV.

Handbrake re-revisited[edit]

I just retested Handbrake today because I had installed some new codecs since the last test. Generally Handbrake displays the same problems: "No title found." and "Invalid audio input track '1', exiting." being the most common errors. The one successful conversion of M4V to MKV (Theora+Vorbis inside) was probably due to the input M4V being previously created by Handbrake. I probably will not retest Handbrake again unless I see clear evidence that the problems have been resolved. -84user (talk) 21:11, 22 January 2010 (UTC)

Avidemux tests[edit]

I installed Avidemux 2.5.1 (r5429) on Windows Vista.

My quick impression: useful alternative to VirtualDub, but frequent crashes get tedious.

Avidemux can mux streams to a Matroska container.

Avidemux can encode audio to Vorbis.

It cannot transcode video to or from theora.

Avidemux has x264 options.

  • defaults output "Format" to AVI, and you can change it to one of:
    • AVI
    • AVI, dual audio
    • AVI, pack VOP
    • AVI, unpack VOP
    • MEG-PS (A+V)
    • MEG-TS (A+V)
    • MPEG video
    • MP4
    • MP4 (PSP)
    • OGM
    • FLV
    • MKV
    • DUMMY
  • Video output choices are:
    • lots, but no Theora and no Lagarith Lossless
  • Audio output choices are:
    • copy
    • AC3 (Aften)
    • AAC (Faac)
    • MP3 (lame)
    • AC3 (lav)
    • MP2 (lav)
    • PCM
    • MP2 (twolame)
    • Vorbis
  • Window UI is flaky: resize is glitched, crashes or hangs sometimes when Filters button clicked

bitmap sequence[edit]

Unable to produce a correct video from a simple sequence of four 16 x 16 pixel 24-bit colour bitmaps.

  • Failed: PNG format as input -> wrong pixels rendered
  • Failed: RAW format as input -> "Could not open the file"
  • Failed: input BMP format, output AVI MPEG-4 AVC (x264) defaults of Constant Rate Factor -> hangs
  • Failed: input BMP format, output AVI MPEG-4 ASP (lavc) -> crashes
  • Failed: input BMP format, output AVI H.263 (lavc) Constant Bitrate 50 kb/s -> "Only QCIF and subQCIF are allowed for H.263", "Error initializing video filters", "Failed"
  • Part-success: input BMP format, output AVI H.263 (lavc) filter MPlayer resized to 176x144 -> playable video but of course the wrong size and blurry due to the linear upsampling (Avisynth needs a raw resize filter)
  • Part-success: input BMP format, output AVI H.263 (lavc) filter MPlayer resized to 128x96 -> playable video but with same drawbacks as for 176x144
  • Part-success: input BMP format, output AVI MPEG-4 AVC (x264) filter MPlayer resized to 128x96 -> playable video but with same drawbacks as for 176x144
  • Part-success: input BMP format, output MKV MPEG-4 AVC (x264) filter MPlayer resized to 128x96 -> playable video but with same drawbacks as for 176x144
  • success: input BMP format, output MKV MPEG-4 AVC (x264) filter MPlayer resized to 16x16 -> correct video (when further converted to OGV, but most media players get it wrong)

-84user (talk) 21:11, 22 January 2010 (UTC)

ImageMagick[edit]

ImageMagick can be used to do many things, including extracting frames from videos. Following http://www.imagemagick.org/Usage/files/ I extracted frames from assorted small videos:

  • ImageMagick-6.5.7-Q16\convert.exe "mpeg:0800000a.mpg[25]" 0800000a.mpg.frame_25.png
  • ImageMagick-6.5.7-Q16\convert.exe "mpeg:input.avi[100]" input.avi.frame_100.png
  • ImageMagick-6.5.7-Q16\convert.exe "mpeg:theora.ogv[900]" theora.ogv.frame_900.png
  • ImageMagick-6.5.7-Q16\convert.exe "mpeg:haali.mkv[10]" haali.mkv.frame_10.png

Notes:

  • 0800000a.mpg is an 8 second Bikini Atoll test video
  • input.avi is a short video converted from a FRAPS capture
  • theora.ogv is the Theora video stream extracted from 1933-04-06_Commander_Describes_Akron_Tragedy.ogv
  • haali.mkv is converted from a WMV Screen capture using Haali splitter inside GraphEdit

-84user (talk) 21:54, 25 January 2010 (UTC)

ffmpeg2theora version 0.26[edit]

ffmpeg2theora version 0.26 was released on 2010-02-05 so I am starting to create some test videos for it to convert.

converted OGV Firefox Chrome4 MPlayer VLC1.0.3 MPC1.1.796 MPC1.3.1249 SMPlayer
YES TOOFAST YES NO YES YES YES
YES TOOFAST SLOW NO YES YES JITTERS
YES TOOFASTANDOUTOFSYNC LOOPSANDOUTOFSYNC NO YES YES LOOPSANDOUTOFSYNC

All tests made on Vista Home premium with Service Pack 1

Firefox is version 3.5.7
Chrome4 is Google Chrome version 4.0.249.89;
MPC1.1.796 is Media Player Classic - Homecinema build 1.1.796.0, MPC complier VS 2005, FFmpeg compiler GCC 4.3.2
MPC1.3.1249 is Media Player Classic - Homecinema build 1.3.1249.0, MPC complier VS 2008, FFmpeg compiler GCC 4.3.3
VLC1.0.3 is 1.0.3 Goldeneye
SMPlayer is (c) 2006-2008 Ricardo Villalba version 0.6.6 (SVN r2599) Using Qt 4.4.2 (compiled with Qt 4.4.2) Using MPlayer SVN r28126
mplayer.exe dated 2006-10-28 is from SUPER 2010.build.37 and identifies itself with:
MPlayer 1.0rc1-3.4.2 (C) 2000-2006 MPlayer Team.
CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 5000+ (Family: 15, Model: 67, Stepping: 2)
CPUflags:  MMX: 1 MMX2: 1 3DNow: 1 3DNow2: 1 SSE: 1 SSE2: 1
Compiled with runtime CPU detection.

Although MPlayer played the OGV correctly, it also made several reports concerning inability to open codec, and invalid frame duration:


-84user (talk) 22:29, 8 February 2010 (UTC)