Commit Graph

54 Commits

Author SHA1 Message Date
Anton Khirnov
8d18bc550e fate-run: make avconv() properly deal with multiple inputs. 2012-07-09 08:22:38 +02:00
Mans Rullgard
7263cd5544 fate: convert codec-regression.sh to makefile rules
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-29 08:35:41 +01:00
Mans Rullgard
47b5996bb0 fate: allow tests to specify unit size for psnr comparison
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-29 08:27:19 +01:00
Mans Rullgard
11e33402ca fate: use standard diff options
diff -w is not a standard option.  This fixes the reference files
to match what the tests actually output and switches to using the
standard diff -b which is sufficient to handle different line ending
styles.

Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-15 19:47:18 +01:00
Mans Rullgard
0ff0af731c fate: use diff -b in oneline comparison
This is simpler and should take care of any problems with mixed
line ending styles.

Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-05-15 15:23:34 +01:00
Ronald S. Bultje
4bfa67bdad Add probe fate tests to test for regressions in detecting media types.
Signed-off-by: Alex Converse <alex.converse@gmail.com>
2012-05-07 10:14:51 -07:00
Mans Rullgard
40fa14f775 fate: Add oneline comparison method
Signed-off-by: Alex Converse <alex.converse@gmail.com>
2012-05-07 10:14:50 -07:00
Justin Ruggles
9cc338b1de FATE: pass the decoded output format and audio source file to enc_dec_pcm
This will allow decoding to md5 and doing a diff comparison to a reference
checksum instead of a fuzzy stddev or oneoff comparison.

Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-04-18 22:26:56 -04:00
Justin Ruggles
c755b1fbbc FATE: specify the input format when decoding in enc_dec_pcm()
The output format is not always the same as the file extension,
which is sometimes required for correct probing. We can avoid
probing by specifying the format since it is already known.
2012-04-18 22:26:49 -04:00
Mans Rullgard
a56fba502e fate: make compare() function compatible with POSIX bc
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-03-18 18:40:59 +00:00
Mans Rullgard
b1740cb00a fate: fix enc_dec_pcm tests with remote target
Signed-off-by: Mans Rullgard <mans@mansr.com>
2012-03-17 17:28:33 +00:00
Justin Ruggles
90e5b58a53 FATE: add capability for audio encode/decode tests with fuzzy psnr comparison
This allows for testing floating-point audio encoders across different
platforms where exact comparisons are unreliable due to float rounding
differences.
2012-03-15 17:06:17 -04:00
Justin Ruggles
cffd7580bb FATE: allow a tolerance in the size comparison in do_tiny_psnr()
This will allow for comparing decoded output to the original source when the
decoded size is not exactly the same as the original size.
2012-03-15 14:40:31 -04:00
Justin Ruggles
bb6842966e FATE: use absolute difference from a target value in do_tiny_psnr()
This will allow comparison to original pre-encoded content instead of
comparing to expected decoded output.
2012-03-15 14:40:31 -04:00
Justin Ruggles
5ecadc6620 FATE: allow tests to set CMP_SHIFT to pass to tiny_psnr
This will allow adjusting for any encoder or decoder delay when doing
comparisons.
2012-03-15 14:40:24 -04:00
Justin Ruggles
0720d263ea FATE: use $fuzz directly in do_tiny_psnr() instead of passing it around 2012-03-15 12:06:56 -04:00
Anton Khirnov
018f39ef49 FATE: add CPUFLAGS variable, mapping to -cpuflags avconv option. 2012-03-06 15:03:36 +01:00
Mans Rullgard
0836d48a16 fate: run avconv with -nostats flag
Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-10-09 16:53:12 +01:00
Mans Rullgard
dec4b4705f fate: use 'run' helper for seek-test
This is simpler, and the actual seek-test command is printed with V=1.

Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-09-28 02:30:30 +01:00
Anton Khirnov
bc5acfa7af fate: use +frame+slice named constants instead of '3' 2011-09-05 12:11:08 +02:00
Anton Khirnov
6291d7e416 Make a copy of ffmpeg under a new name -- avconv.
It will be further developed with a few incompatible changes.

ffmpeg.c will stay as is for some time, so any scripts using it won't be
broken.
2011-08-12 13:27:30 +02:00
Diego Biurrun
191c5f8ff3 build: move tests/seek_test.c to libavformat and reuse generic build rules 2011-07-13 13:27:15 +02:00
Mans Rullgard
84757de0f5 fate: add 'null' comparison method
Setting CMP=null uses stdout from the test as the diff record in
the report without further inspection.  This can be useful when
the exit status of the test itself determines success while the
output is informative.

Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-07-04 09:54:16 +01:00
Mans Rullgard
ea57502c82 fate: remove output redirections from old regtest scripts
All tests are run through the fate-run.sh script which already
sets up redirections.  Using the outputs set there simplifies
things somewhat.

Signed-off-by: Mans Rullgard <mans@mansr.com>
2011-06-21 12:37:58 +01:00
Ronald S. Bultje
3283f274fd FATE: allow forcing thread-type when doing threaded fate runs.
Signed-off-by: Ronald S. Bultje <rsbultje@gmail.com>
2011-04-21 19:36:45 -04:00
Luca Barbato
7851eb68c6 fate: add support for multithread testing
Add a THREADS variable to fate calls.
2011-03-23 01:17:20 +01:00
Måns Rullgård
c4795e8069 fate: print commands being executed with V=1
Originally committed as revision 25161 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-09-23 09:55:31 +00:00
Måns Rullgård
078ae66b4b fate: set LC_ALL=C to avoid locale interference
Originally committed as revision 24889 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-23 17:34:08 +00:00
Måns Rullgård
b42c483f07 fate-run: use 'run' function in 'ffmpeg' function
Originally committed as revision 24837 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-19 16:51:24 +00:00
Måns Rullgård
91de2c0a73 fate: add -v 0 to ffmpeg flags
Originally committed as revision 24836 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-19 16:51:21 +00:00
Måns Rullgård
dff1fc51b2 fate-run: add helper to run things on target
Originally committed as revision 24694 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-04 06:56:59 +00:00
Måns Rullgård
61a187b081 fate: fix non-standard use of bc
Originally committed as revision 24651 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-01 15:28:42 +00:00
Måns Rullgård
5b60c29339 fate: fix signal name translation
Originally committed as revision 24650 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-08-01 12:29:03 +00:00
Måns Rullgård
4e705a6806 fate: translate exit status to signal name
Originally committed as revision 24623 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-31 16:53:09 +00:00
Måns Rullgård
b82be63688 fate: create report files
Originally committed as revision 24529 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-26 23:44:06 +00:00
Måns Rullgård
8fae6e7c11 Unbreak parallel lavfi testing
Originally committed as revision 24485 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-24 17:13:32 +00:00
Måns Rullgård
157c924176 fate: delete useless artifacts after running each test
Originally committed as revision 24395 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-21 20:49:36 +00:00
Måns Rullgård
bcb0a1546d fate: keep stderr from failing tests
Originally committed as revision 24394 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-21 20:49:34 +00:00
Måns Rullgård
ffe72624e7 fate: run diff even if command fails
The diff may provide useful information even if the command was
unsuccessful.  The test is still treated as failed in this case.

Originally committed as revision 24353 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-20 12:54:43 +00:00
Måns Rullgård
9a3f31efcb fate: allow running regtests through fate frontend
Originally committed as revision 24347 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-20 10:19:28 +00:00
Måns Rullgård
cdaf4b79bb fate: simplify test runner slightly
All tests use the provided helper functions so prepending $target_exec
and using eval is no longer required.

Originally committed as revision 24317 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:46:44 +00:00
Måns Rullgård
2b18c451bd fate: add some helper functions to simplify test rules
Originally committed as revision 24314 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:30 +00:00
Måns Rullgård
f0388cf716 fate: apply TARGET_EXEC only to commands starting with absolute path
Originally committed as revision 24313 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:25 +00:00
Måns Rullgård
d2f33c8021 fate: use our variable names in test rules imported from Mike's db
Originally committed as revision 24312 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:21 +00:00
Måns Rullgård
122a9af76b fate-run: rename some variables consistently with other files
Originally committed as revision 24311 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-18 20:19:16 +00:00
Måns Rullgård
e153cfa867 fate: add stddev comparator
This allows CMP=stddev in test rules.  The test passes if the reported
stddev is <= the FUZZ value (default 1).

Originally committed as revision 24289 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-17 15:02:34 +00:00
Måns Rullgård
26e87a2261 fate: whitespace cosmetics
Originally committed as revision 24288 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-17 15:02:32 +00:00
Måns Rullgård
83b203dc94 fate: ensure file sizes match in oneoff tests
Originally committed as revision 24164 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-10 16:58:00 +00:00
Måns Rullgård
150ef830f5 fate: fail with a sensible error message if reference file is missing
Originally committed as revision 24152 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:55:16 +00:00
Måns Rullgård
7d610af6f2 fate: delete output files from successful tests
Originally committed as revision 24150 to svn://svn.ffmpeg.org/ffmpeg/trunk
2010-07-09 23:36:04 +00:00