Compare commits
108 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
f9fb12b6d2 | ||
|
|
e8f464155b | ||
|
|
fb292fba88 | ||
|
|
eedb556475 | ||
|
|
87c7188a50 | ||
|
|
2a44c29064 | ||
|
|
b0046d9414 | ||
|
|
811a53bc3b | ||
|
|
e4857241da | ||
|
|
e1fdc09426 | ||
|
|
f665ba8ee7 | ||
|
|
f6e9155e3f | ||
|
|
d68dcb9b8d | ||
|
|
8c171bb197 | ||
|
|
5167450443 | ||
|
|
ef25cae756 | ||
|
|
899246f23e | ||
|
|
106ea700a8 | ||
|
|
d1119ab3ec | ||
|
|
e1bc468707 | ||
|
|
137aff0047 | ||
|
|
1620cafc2e | ||
|
|
9d5a60d7fd | ||
|
|
472f45b46f | ||
|
|
70843bc7b5 | ||
|
|
781d435be2 | ||
|
|
c259552dc1 | ||
|
|
99c30505d7 | ||
|
|
2f194a5c6e | ||
|
|
bb7da532c7 | ||
|
|
3bccd77443 | ||
|
|
6fcb962514 | ||
|
|
d719e4aa23 | ||
|
|
c2605245ac | ||
|
|
5dbaac229a | ||
|
|
fd22d6cb09 | ||
|
|
9c96e22e1a | ||
|
|
87478458ed | ||
|
|
331b4722fe | ||
|
|
2c13ab476a | ||
|
|
770b08a804 | ||
|
|
5177940edb | ||
|
|
ebcde81fcd | ||
|
|
3a16f5c9cc | ||
|
|
192d4fe457 | ||
|
|
185fe059d5 | ||
|
|
9015a7f091 | ||
|
|
af4db559fc | ||
|
|
93d7e6dec6 | ||
|
|
f241b9526d | ||
|
|
7b98183724 | ||
|
|
d7cddd4467 | ||
|
|
0f8c1567ab | ||
|
|
e9a40c2f7b | ||
|
|
b1346a1613 | ||
|
|
d9bcf6697c | ||
|
|
a5235fb7e6 | ||
|
|
dea5e68ba7 | ||
|
|
85071272d4 | ||
|
|
811dc854ad | ||
|
|
a1beea2171 | ||
|
|
f3ca2d2105 | ||
|
|
a8f36373e9 | ||
|
|
9146e70166 | ||
|
|
d44c65a62e | ||
|
|
6256e5feaa | ||
|
|
de3909aa1a | ||
|
|
cd59f0a38a | ||
|
|
4106dfcd83 | ||
|
|
02346e5856 | ||
|
|
f9f5ed8606 | ||
|
|
47e535f4a6 | ||
|
|
23807f5691 | ||
|
|
6d5c8c7594 | ||
|
|
c2a4f53ea2 | ||
|
|
63cc840df5 | ||
|
|
6b7e034589 | ||
|
|
58c286c588 | ||
|
|
9824bbea82 | ||
|
|
a52ef0822d | ||
|
|
897d8b865e | ||
|
|
d7034245a5 | ||
|
|
e3b2c2ea2d | ||
|
|
94666eb8ea | ||
|
|
56ee009741 | ||
|
|
d3880d9d3b | ||
|
|
2160259aa3 | ||
|
|
f0365737ae | ||
|
|
b3c9750c3d | ||
|
|
3fc6c47e3e | ||
|
|
61e004c204 | ||
|
|
13165b75ca | ||
|
|
e4ff08476b | ||
|
|
6ebfe5a4f7 | ||
|
|
36de1c9bb5 | ||
|
|
ff47166661 | ||
|
|
cde80b7dbd | ||
|
|
181da5e40f | ||
|
|
5b39fcbe3a | ||
|
|
bce1fb419c | ||
|
|
bae667456f | ||
|
|
5b5acae502 | ||
|
|
29772b1efb | ||
|
|
ee4af66b3b | ||
|
|
35711b58ba | ||
|
|
85070027f1 | ||
|
|
3d8d672818 | ||
|
|
f9c92e3cc3 |
2
AUTHORS
2
AUTHORS
@@ -1,4 +1,4 @@
|
||||
Copyright 2008 - 2021 by Phoronix Media.
|
||||
Copyright 2008 - 2025 by Phoronix Media.
|
||||
|
||||
Lead Architects:
|
||||
|
||||
|
||||
18
ChangeLog
18
ChangeLog
@@ -1,5 +1,23 @@
|
||||
PHORONIX TEST SUITE CHANGE-LOG
|
||||
|
||||
Phoronix Test Suite 10.8.5
|
||||
[GIT]
|
||||
|
||||
pts-core: PHP 8.2/8.3 warning fixes
|
||||
pts-core: Various bug fixes
|
||||
phodevi: Hardware/software detection updates
|
||||
|
||||
Phoronix Test Suite 10.8.4
|
||||
3 July 2022
|
||||
|
||||
pts-core: Allow sub-folders within PTS_EXTRA_SYSTEM_LOGS_DIR when uploading to Phoromatic server
|
||||
pts-core: Fix TOTAL_LOOP_TIME handling
|
||||
pts-core: openSUSE external dependency handling fixes
|
||||
phodevi: Support for reporting video BIOS version
|
||||
phodevi: Budgie desktop version detection
|
||||
phodevi: Avoid deprecated wmic usage on Windows
|
||||
phoromatic: Input sanitization updates in the result viewer
|
||||
|
||||
Phoronix Test Suite 10.8.3
|
||||
23 April 2022
|
||||
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
# Phoronix Test Suite 10.8.3
|
||||
# Phoronix Test Suite 10.8.5
|
||||

|
||||
|
||||
The **Phoronix Test Suite** is the most comprehensive testing and benchmarking
|
||||
|
||||
@@ -75,7 +75,7 @@ $spec_file .= "%{_bindir}/phoronix-test-suite\n";
|
||||
$spec_file .= "%{_datadir}/phoronix-test-suite/*\n";
|
||||
$spec_file .= "%{_datadir}/applications/*\n";
|
||||
$spec_file .= "%{_datadir}/icons/hicolor/*\n";
|
||||
$spec_file .= "%{_datadir}/appdata/%{name}.appdata.xml\n";
|
||||
$spec_file .= "%{_datadir}/metainfo/com.phoronix_test_suite.phoronix_test_suite.metainfo.xml\n";
|
||||
$spec_file .= "%{_datadir}/doc/*\n";
|
||||
$spec_file .= "%{_mandir}/man1/%{name}.1*\n";
|
||||
$spec_file .= "%config(noreplace) %{_sysconfdir}/bash_completion.d\n";
|
||||
|
||||
@@ -1,4 +1,4 @@
|
||||
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "10.8.3"
|
||||
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "10.8.5"
|
||||
.SH NAME
|
||||
phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation.
|
||||
.SH SYNOPSIS
|
||||
@@ -204,6 +204,9 @@ This sub-command provides a verbose look at all tests installed/uninstalled on t
|
||||
.B list-test-usage
|
||||
This option will list various details about installed tests and their usage.
|
||||
.TP
|
||||
.B print-tests [Test | Suite | OpenBenchmarking ID | Test Result] ...
|
||||
This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).
|
||||
.TP
|
||||
.B search
|
||||
This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..
|
||||
.TP
|
||||
@@ -255,7 +258,7 @@ This option can be used for validating a Phoronix Test Suite test suite as being
|
||||
This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.
|
||||
.TP
|
||||
.B compare-results-to-baseline [Test Result] [Test Result]
|
||||
This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
|
||||
This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
|
||||
.TP
|
||||
.B compare-results-two-way [Test Result]
|
||||
This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.
|
||||
@@ -264,7 +267,7 @@ This option will allows you to specify a result file and from there to compare t
|
||||
This option is used if you wish to edit the title and description of an existing result file.
|
||||
.TP
|
||||
.B extract-from-result-file [Test Result]
|
||||
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.
|
||||
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.
|
||||
.TP
|
||||
.B keep-results-in-result-file [Test Result]
|
||||
This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.
|
||||
@@ -272,6 +275,12 @@ This option is the inverse of the remove-results-from-result-file sub-command. I
|
||||
.B merge-results [Test Result] ...
|
||||
This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
|
||||
.TP
|
||||
.B prune-empty-results [Test Result]
|
||||
This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.
|
||||
.TP
|
||||
.B prune-zero-data [Test Result]
|
||||
This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.
|
||||
.TP
|
||||
.B remove-incomplete-results-from-result-file [Test Result]
|
||||
This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.
|
||||
.TP
|
||||
@@ -307,10 +316,10 @@ This option will display a short list of possible Phoronix Test Suite commands.
|
||||
This option is used for testing the distribution-specific dependency handler for external dependencies.
|
||||
.TP
|
||||
.B debug-render-test
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.
|
||||
.TP
|
||||
.B debug-self-test
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.
|
||||
.TP
|
||||
.B help
|
||||
This option will display a list of available Phoronix Test Suite commands and possible parameter types.
|
||||
@@ -335,7 +344,7 @@ This option is used if you wish to analyze a result file by seeing various stati
|
||||
This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
|
||||
.TP
|
||||
.B workload-topology [Test Result]
|
||||
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.
|
||||
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.
|
||||
.TP
|
||||
.SH MODULES
|
||||
.B auto-load-module
|
||||
@@ -358,13 +367,13 @@ This option can be used for easily removing a module from the AutoLoadModules li
|
||||
.TP
|
||||
.SH DEBUGGING
|
||||
.B check-tests [Test]
|
||||
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.
|
||||
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.
|
||||
.TP
|
||||
.B diagnostics
|
||||
This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.
|
||||
.TP
|
||||
.B dump-file-info
|
||||
This option will dump the MD5 / SHA256 hashes and file size for a given file.
|
||||
This option will dump the MD5 / SHA256 checksums and file size for a given file.
|
||||
.TP
|
||||
.B dump-openbenchmarking-indexes
|
||||
This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).
|
||||
@@ -389,7 +398,7 @@ This option will list all available test profiles that are available from the en
|
||||
.TP
|
||||
.SH USER CONFIGURATION
|
||||
.B enterprise-setup
|
||||
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.
|
||||
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.
|
||||
.TP
|
||||
.B network-info
|
||||
This option will print information detected by the Phoronix Test Suite around the system's network configuration.
|
||||
@@ -411,7 +420,7 @@ This option will print all of the official environment variables supported by th
|
||||
This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.
|
||||
.TP
|
||||
.B result-file-to-csv [Test Result]
|
||||
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
|
||||
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
|
||||
.TP
|
||||
.B result-file-to-html [Test Result]
|
||||
This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
|
||||
@@ -448,5 +457,5 @@ https://www.openbenchmarking.org/
|
||||
https://www.phoronix.com/
|
||||
.br
|
||||
.SH AUTHORS
|
||||
Copyright 2008 - 2022 by Phoronix Media, Michael Larabel.
|
||||
Copyright 2008 - 2024 by Phoronix Media, Michael Larabel.
|
||||
.TP
|
||||
|
||||
@@ -377,6 +377,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p>
|
||||
<h3>list-test-usage</h3>
|
||||
<p>This option will list various details about installed tests and their usage.</p>
|
||||
<h3>print-tests<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
|
||||
</h3>
|
||||
<p>This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).</p>
|
||||
<h3>search</h3>
|
||||
<p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p>
|
||||
<h3>test-to-suite-map</h3>
|
||||
@@ -423,7 +426,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<p>This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.</p>
|
||||
<h3>compare-results-to-baseline<em> [Test Result] [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
|
||||
<p>This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
|
||||
<h3>compare-results-two-way<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.</p>
|
||||
@@ -432,13 +435,19 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<p>This option is used if you wish to edit the title and description of an existing result file.</p>
|
||||
<h3>extract-from-result-file<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.</p>
|
||||
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.</p>
|
||||
<h3>keep-results-in-result-file<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.</p>
|
||||
<h3>merge-results<em> [Test Result] ...</em>
|
||||
</h3>
|
||||
<p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
|
||||
<h3>prune-empty-results<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.</p>
|
||||
<h3>prune-zero-data<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.</p>
|
||||
<h3>remove-incomplete-results-from-result-file<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p>
|
||||
@@ -472,9 +481,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<h3>debug-dependency-handler</h3>
|
||||
<p>This option is used for testing the distribution-specific dependency handler for external dependencies.</p>
|
||||
<h3>debug-render-test</h3>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
|
||||
<h3>debug-self-test</h3>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.</p>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.</p>
|
||||
<h3>help</h3>
|
||||
<p>This option will display a list of available Phoronix Test Suite commands and possible parameter types.</p>
|
||||
<h3>version</h3>
|
||||
@@ -497,7 +506,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
|
||||
<h3>workload-topology<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.</p>
|
||||
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.</p>
|
||||
<h1>Modules</h1>
|
||||
<h3>auto-load-module</h3>
|
||||
<p>This option can be used for easily adding a module to the AutoLoadModules list in the Phoronix Test Suite user configuration file. That list controls what PTS modules are automatically loaded on start-up of the Phoronix Test Suite.</p>
|
||||
@@ -517,11 +526,11 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<h1>Debugging</h1>
|
||||
<h3>check-tests<em> [Test]</em>
|
||||
</h3>
|
||||
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.</p>
|
||||
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.</p>
|
||||
<h3>diagnostics</h3>
|
||||
<p>This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.</p>
|
||||
<h3>dump-file-info</h3>
|
||||
<p>This option will dump the MD5 / SHA256 hashes and file size for a given file.</p>
|
||||
<p>This option will dump the MD5 / SHA256 checksums and file size for a given file.</p>
|
||||
<h3>dump-openbenchmarking-indexes</h3>
|
||||
<p>This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).</p>
|
||||
<h3>dump-phodevi-smart-cache</h3>
|
||||
@@ -538,7 +547,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<p>This option will list all available test profiles that are available from the enabled OpenBenchmarking.org repositories but are NOT SUPPORTED on the given hardware/software platform. This is mainly a debugging option for those looking for test profiles to potentially port to new platforms, etc.</p>
|
||||
<h1>User Configuration</h1>
|
||||
<h3>enterprise-setup</h3>
|
||||
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.</p>
|
||||
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.</p>
|
||||
<h3>network-info</h3>
|
||||
<p>This option will print information detected by the Phoronix Test Suite around the system's network configuration.</p>
|
||||
<h3>network-setup</h3>
|
||||
@@ -555,7 +564,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<p>This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.</p>
|
||||
<h3>result-file-to-csv<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
|
||||
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
|
||||
<h3>result-file-to-html<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
|
||||
@@ -580,7 +589,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
|
||||
<hr style="height: 50px; border: 0;"><a name="ModuleOptions"></a><h1>Module Options</h1>
|
||||
<p>The following list is the modules included with the Phoronix Test Suite that are intended to extend the functionality of pts-core. Some of these options have commands that can be run directly in a similar manner to the other Phoronix Test Suite user commands. Some modules are just meant to be loaded directly by adding the module name to the AutoLoadModules tag in ~/.phoronix-test-suite/user-config.xml or via the PTS_MODULES environment variable. A list of available modules is also available by running <em>phoronix-test-suite list-modules.</em></p><hr>
|
||||
<h2>Backup Creation + Restore</h2>
|
||||
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the file-name will be auto-generated with a current time-stamp.</p>
|
||||
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the filename will be auto-generated with a current timestamp.</p>
|
||||
<p><strong>phoronix-test-suite backup.create</strong></p>
|
||||
<p><strong>phoronix-test-suite backup.restore</strong></p>
|
||||
<h2>System Maintenance / Cleanup</h2>
|
||||
@@ -826,7 +835,7 @@ NOTE: Use the "system-sensors" command to see what sensors are available for mon
|
||||
<p>Besides <strong>phoronix-test-suite shell</strong> and <strong>phoronix-test-suite help</strong>, there is also <strong>phoronix-test-suite interactive</strong> for helping new users understand Phoronix Test Suite benchmarking. Long story short, it should be as easy as running <strong>phoronix-test-suite benchmark stockfish</strong> or <strong>phoronix-test-suite benchmark crafty</strong> as some examples for carrying out automated, cross-platform benchmarks in a side-by-side and fully-reproducible manner.</p>
|
||||
<hr style="height: 50px; border: 0;"><a name="ExternalDependencies"></a><h1>External Dependencies</h1>
|
||||
<p>The Phoronix Test Suite has a feature known as "External Dependencies" where the Phoronix Test Suite can attempt to automatically install some of the test-specific dependencies on supported distributions. If running on a distribution where there is currently no External Dependencies profile, the needed package name(s) are listed for manual installation.</p>
|
||||
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.</p><hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>OpenSuSE</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li>
|
||||
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.</p><hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE Enterprise Linux</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li><li>openSUSE</li><li>openSUSE Leap</li><li>openSUSE Tumbleweed</li>
|
||||
<hr style="height: 50px; border: 0;"><a name="Configuration"></a><h1>Configuration</h1>
|
||||
<h1>User Files & Folders</h1>
|
||||
<p>These files/folders are the default locations when running as a non-root Phoronix Test Suite user. When running as root, the paths may appear in standard system paths like <em>/etc/phoronix-test-suite.xml</em>.</p>
|
||||
@@ -889,7 +898,7 @@ NOTE: Use the "system-sensors" command to see what sensors are available for mon
|
||||
|
||||
<h1>Testing Options</h1>
|
||||
<h3>SleepTimeBetweenTests</h3>
|
||||
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>8</em>.</p>
|
||||
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>6</em>.</p>
|
||||
<h3>SaveSystemLogs</h3>
|
||||
<p>If this option is set to <em>TRUE</em>, when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to <em>FALSE</em>, the system details / logs will not be saved by default. The default value is <em>FALSE</em>. When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.</p>
|
||||
<h3>SaveInstallationLogs</h3>
|
||||
@@ -1032,6 +1041,10 @@ The variable is relevant for: test execution / benchmarking.
|
||||
The variable is relevant for: test execution / benchmarking.
|
||||
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
|
||||
</p>
|
||||
<h2>LOG_CLI_OUTPUT</h2>
|
||||
<p><em>[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.</em></p>
|
||||
<p>The value can be of type: boolean (TRUE / FALSE).
|
||||
</p>
|
||||
<h2>MONITOR</h2>
|
||||
<p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p>
|
||||
<p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp)
|
||||
@@ -1402,6 +1415,9 @@ In the event that a test profile fails to install or run, the following general
|
||||
<h3>Solaris Operating System Tests<em> pts/solaris</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
|
||||
<h3>Steam Tests<em> pts/steam</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles having an external dependency on Steam</p>
|
||||
<h3>System Subsystem Tests<em> pts/system</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
|
||||
@@ -1414,9 +1430,6 @@ In the event that a test profile fails to install or run, the following general
|
||||
<h3>Smp Tests<em> pts/smp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
|
||||
<h3>Opencl Tests<em> pts/opencl</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
|
||||
<h3>Cuda Tests<em> pts/cuda</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
|
||||
@@ -1426,12 +1439,18 @@ In the event that a test profile fails to install or run, the following general
|
||||
<h3>Openmp Tests<em> pts/openmp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
|
||||
<h3>Cloud Tests<em> pts/cloud</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
|
||||
<h3>Docker Tests<em> pts/docker</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
|
||||
<h3>Ai Tests<em> pts/ai</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.</p>
|
||||
<h3>Opencl Tests<em> pts/opencl</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
|
||||
<h3>Cloud Tests<em> pts/cloud</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
|
||||
<h3>Go Tests<em> pts/go</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
|
||||
@@ -1528,12 +1547,21 @@ In the event that a test profile fails to install or run, the following general
|
||||
<h3>Smp Tests<em> system/smp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
|
||||
<h3>Openmp Tests<em> system/openmp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
|
||||
<h3>Mpi Tests<em> system/mpi</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
|
||||
<h3>64-bit Arm / AArch64 Tests In git<em> git/aarch64</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.</p>
|
||||
<h3>All Tests in git<em> git/all</em>
|
||||
</h3>
|
||||
<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
|
||||
<h3>Application Tests<em> git/application</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
|
||||
<h3>BSD Operating System Tests<em> git/bsd</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
|
||||
@@ -1552,6 +1580,9 @@ In the event that a test profile fails to install or run, the following general
|
||||
<h3>Rust Tests<em> git/rust</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles having an external dependency on Rust</p>
|
||||
<h3>System Subsystem Tests<em> git/system</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
|
||||
<h3>Utility Tests<em> git/utility</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
|
||||
@@ -1671,7 +1702,7 @@ SUPPORTED OPENBENCHMARKING.ORG REPOSITORIES:<br>
|
||||
<p>If distributing a customized/local copy of the Phoronix Test Suite, the default behavior of the configuration file (in addition to deleting the pts_openbenchmarking_upload file) can be done via the user configuration defaults defined within <em>pts-core/static/user-config-defaults.xml</em>.</p>
|
||||
<hr style="height: 50px; border: 0;"><a name="DevelopmentCredits"></a><h1>Development Credits</h1>
|
||||
<p>The Phoronix Test Suite is based upon the extensive testing and internal tools developed by <a href="http://www.phoronix.com/">Phoronix.com</a> since 2004 along with support from leading tier-one computer hardware and software vendors. The principal architects of the Phoronix Test Suite are <a href="http://www.michaellarabel.com/">Michael Larabel</a> and Matthew Tippett. The phoronix-test-suite, pts_Graph, Phoromatic, Phodevi, and nye_Xml are some of the related open-source projects provided by <a href="http://www.phoronix-media.com/">Phoronix Media</a>.</p>
|
||||
<p style="padding-top: 30px; text-align: center;">Copyright © 2008 - 2022 by Phoronix Media.</p></div>
|
||||
<p style="padding-top: 30px; text-align: center;">Copyright © 2008 - 2024 by Phoronix Media.</p></div>
|
||||
<div id="pts_footer">
|
||||
<div id="pts_footer_logo"><a href="http://www.phoronix-test-suite.com/"><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" viewbox="0 0 76 41" width="76" height="41" preserveaspectratio="xMinYMin meet">
|
||||
<path d="m74 22v9m-5-16v16m-5-28v28m-23-2h12.5c2.485281 0 4.5-2.014719 4.5-4.5s-2.014719-4.5-4.5-4.5h-8c-2.485281 0-4.5-2.014719-4.5-4.5s2.014719-4.5 4.5-4.5h12.5m-21 5h-11m11 13h-2c-4.970563 0-9-4.029437-9-9v-20m-24 40v-20c0-4.970563 4.0294373-9 9-9 4.970563 0 9 4.029437 9 9s-4.029437 9-9 9h-9" stroke="#222" stroke-width="4" fill="none"></path>
|
||||
|
||||
@@ -231,6 +231,9 @@ This sub-command provides a verbose look at all tests installed/uninstalled on t
|
||||
#### list-test-usage
|
||||
This option will list various details about installed tests and their usage.
|
||||
|
||||
#### print-tests [Test | Suite | OpenBenchmarking ID | Test Result] ...
|
||||
This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).
|
||||
|
||||
#### search
|
||||
This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..
|
||||
|
||||
@@ -284,7 +287,7 @@ This option can be used for validating a Phoronix Test Suite test suite as being
|
||||
This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.
|
||||
|
||||
#### compare-results-to-baseline [Test Result] [Test Result]
|
||||
This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
|
||||
This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
|
||||
|
||||
#### compare-results-two-way [Test Result]
|
||||
This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.
|
||||
@@ -293,7 +296,7 @@ This option will allows you to specify a result file and from there to compare t
|
||||
This option is used if you wish to edit the title and description of an existing result file.
|
||||
|
||||
#### extract-from-result-file [Test Result]
|
||||
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.
|
||||
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.
|
||||
|
||||
#### keep-results-in-result-file [Test Result]
|
||||
This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.
|
||||
@@ -301,6 +304,12 @@ This option is the inverse of the remove-results-from-result-file sub-command. I
|
||||
#### merge-results [Test Result] ...
|
||||
This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
|
||||
|
||||
#### prune-empty-results [Test Result]
|
||||
This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.
|
||||
|
||||
#### prune-zero-data [Test Result]
|
||||
This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.
|
||||
|
||||
#### remove-incomplete-results-from-result-file [Test Result]
|
||||
This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.
|
||||
|
||||
@@ -337,10 +346,10 @@ This option will display a short list of possible Phoronix Test Suite commands.
|
||||
This option is used for testing the distribution-specific dependency handler for external dependencies.
|
||||
|
||||
#### debug-render-test
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.
|
||||
|
||||
#### debug-self-test
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.
|
||||
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.
|
||||
|
||||
#### help
|
||||
This option will display a list of available Phoronix Test Suite commands and possible parameter types.
|
||||
@@ -366,7 +375,7 @@ This option is used if you wish to analyze a result file by seeing various stati
|
||||
This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
|
||||
|
||||
#### workload-topology [Test Result]
|
||||
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.
|
||||
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.
|
||||
|
||||
|
||||
## Modules
|
||||
@@ -391,13 +400,13 @@ This option can be used for easily removing a module from the AutoLoadModules li
|
||||
|
||||
## Debugging
|
||||
#### check-tests [Test]
|
||||
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.
|
||||
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.
|
||||
|
||||
#### diagnostics
|
||||
This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.
|
||||
|
||||
#### dump-file-info
|
||||
This option will dump the MD5 / SHA256 hashes and file size for a given file.
|
||||
This option will dump the MD5 / SHA256 checksums and file size for a given file.
|
||||
|
||||
#### dump-openbenchmarking-indexes
|
||||
This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).
|
||||
@@ -423,7 +432,7 @@ This option will list all available test profiles that are available from the en
|
||||
|
||||
## User Configuration
|
||||
#### enterprise-setup
|
||||
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.
|
||||
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.
|
||||
|
||||
#### network-info
|
||||
This option will print information detected by the Phoronix Test Suite around the system's network configuration.
|
||||
@@ -446,7 +455,7 @@ This option will print all of the official environment variables supported by th
|
||||
This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.
|
||||
|
||||
#### result-file-to-csv [Test Result]
|
||||
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
|
||||
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
|
||||
|
||||
#### result-file-to-html [Test Result]
|
||||
This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
|
||||
@@ -481,7 +490,7 @@ The following list is the modules included with the Phoronix Test Suite that are
|
||||
---
|
||||
|
||||
### Backup Creation + Restore
|
||||
This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the file-name will be auto-generated with a current time-stamp.
|
||||
This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the filename will be auto-generated with a current timestamp.
|
||||
|
||||
**phoronix-test-suite backup.create**
|
||||
|
||||
@@ -881,7 +890,7 @@ Below are a list of the operating systems that currently have external dependenc
|
||||
---
|
||||
|
||||
|
||||
Alpine LinuxAmazonAngstromArch LinuxClear LinuxClearOSClearOS Core ServerDebianDragonFlyBSDFedoraGentooLinux Embedded Development EnvironmentLinux MintMac OS XMacPortsMageiaMandrivaMicrosoft WindowsMidnightBSDNetBSDOpenBSDOpenIndianaOpenMandrivaOpenMandrivaLinuxOpenSolarisOpenSuSEOptwareOracle ServerPCLinuxOSPardus LinuxRed Hat EnterpriseRed Hat Enterprise ServerSUSESUSE LinuxScientificScientificSLSolusSolus LinuxTermuxUbuntuVoid LinuxZenwalkmacOS Brew
|
||||
Alpine LinuxAmazonAngstromArch LinuxClear LinuxClearOSClearOS Core ServerDebianDragonFlyBSDFedoraGentooLinux Embedded Development EnvironmentLinux MintMac OS XMacPortsMageiaMandrivaMicrosoft WindowsMidnightBSDNetBSDOpenBSDOpenIndianaOpenMandrivaOpenMandrivaLinuxOpenSolarisOptwareOracle ServerPCLinuxOSPardus LinuxRed Hat EnterpriseRed Hat Enterprise ServerSUSE Enterprise LinuxSUSE LinuxScientificScientificSLSolusSolus LinuxTermuxUbuntuVoid LinuxZenwalkmacOS BrewopenSUSEopenSUSE LeapopenSUSE Tumbleweed
|
||||
# Configuration
|
||||
|
||||
## User Files & Folders
|
||||
@@ -979,7 +988,7 @@ This option sets the directory for the main download cache. The download cache i
|
||||
|
||||
## Testing Options
|
||||
#### SleepTimeBetweenTests
|
||||
This option sets the time (in seconds) to sleep between running tests. The default value is *8* .
|
||||
This option sets the time (in seconds) to sleep between running tests. The default value is *6* .
|
||||
|
||||
#### SaveSystemLogs
|
||||
If this option is set to *TRUE* , when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to *FALSE* , the system details / logs will not be saved by default. The default value is *FALSE* . When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.
|
||||
@@ -1183,6 +1192,12 @@ The variable is relevant for: test execution / benchmarking.
|
||||
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
|
||||
|
||||
|
||||
### LOG_CLI_OUTPUT
|
||||
*[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.*
|
||||
|
||||
The value can be of type: boolean (TRUE / FALSE).
|
||||
|
||||
|
||||
### MONITOR
|
||||
*This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).*
|
||||
|
||||
@@ -1683,6 +1698,9 @@ This is a collection of test profiles that have been detected to be single-threa
|
||||
#### Solaris Operating System Tests pts/solaris
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.
|
||||
|
||||
#### Steam Tests pts/steam
|
||||
This is a collection of test profiles having an external dependency on Steam
|
||||
|
||||
#### System Subsystem Tests pts/system
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
|
||||
|
||||
@@ -1695,9 +1713,6 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
|
||||
#### Smp Tests pts/smp
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
|
||||
|
||||
#### Opencl Tests pts/opencl
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
|
||||
|
||||
#### Cuda Tests pts/cuda
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.
|
||||
|
||||
@@ -1707,12 +1722,18 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
|
||||
#### Openmp Tests pts/openmp
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.
|
||||
|
||||
#### Cloud Tests pts/cloud
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.
|
||||
|
||||
#### Docker Tests pts/docker
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.
|
||||
|
||||
#### Ai Tests pts/ai
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.
|
||||
|
||||
#### Opencl Tests pts/opencl
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
|
||||
|
||||
#### Cloud Tests pts/cloud
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.
|
||||
|
||||
#### Go Tests pts/go
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.
|
||||
|
||||
@@ -1809,12 +1830,21 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
|
||||
#### Smp Tests system/smp
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
|
||||
|
||||
#### Openmp Tests system/openmp
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.
|
||||
|
||||
#### Mpi Tests system/mpi
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.
|
||||
|
||||
#### 64-bit Arm / AArch64 Tests In git git/aarch64
|
||||
This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
|
||||
|
||||
#### All Tests in git git/all
|
||||
This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
|
||||
|
||||
#### Application Tests git/application
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.
|
||||
|
||||
#### BSD Operating System Tests git/bsd
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
|
||||
|
||||
@@ -1833,6 +1863,9 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
|
||||
#### Rust Tests git/rust
|
||||
This is a collection of test profiles having an external dependency on Rust
|
||||
|
||||
#### System Subsystem Tests git/system
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
|
||||
|
||||
#### Utility Tests git/utility
|
||||
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.
|
||||
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
@@ -164,6 +164,9 @@
|
||||
<p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p>
|
||||
<h3>list-test-usage</h3>
|
||||
<p>This option will list various details about installed tests and their usage.</p>
|
||||
<h3>print-tests<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
|
||||
</h3>
|
||||
<p>This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).</p>
|
||||
<h3>search</h3>
|
||||
<p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p>
|
||||
<h3>test-to-suite-map</h3>
|
||||
@@ -210,7 +213,7 @@
|
||||
<p>This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.</p>
|
||||
<h3>compare-results-to-baseline<em> [Test Result] [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
|
||||
<p>This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
|
||||
<h3>compare-results-two-way<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.</p>
|
||||
@@ -219,13 +222,19 @@
|
||||
<p>This option is used if you wish to edit the title and description of an existing result file.</p>
|
||||
<h3>extract-from-result-file<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.</p>
|
||||
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.</p>
|
||||
<h3>keep-results-in-result-file<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.</p>
|
||||
<h3>merge-results<em> [Test Result] ...</em>
|
||||
</h3>
|
||||
<p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
|
||||
<h3>prune-empty-results<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.</p>
|
||||
<h3>prune-zero-data<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.</p>
|
||||
<h3>remove-incomplete-results-from-result-file<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p>
|
||||
@@ -259,9 +268,9 @@
|
||||
<h3>debug-dependency-handler</h3>
|
||||
<p>This option is used for testing the distribution-specific dependency handler for external dependencies.</p>
|
||||
<h3>debug-render-test</h3>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
|
||||
<h3>debug-self-test</h3>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.</p>
|
||||
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.</p>
|
||||
<h3>help</h3>
|
||||
<p>This option will display a list of available Phoronix Test Suite commands and possible parameter types.</p>
|
||||
<h3>version</h3>
|
||||
@@ -284,7 +293,7 @@
|
||||
<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
|
||||
<h3>workload-topology<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.</p>
|
||||
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.</p>
|
||||
<h1>Modules</h1>
|
||||
<h3>auto-load-module</h3>
|
||||
<p>This option can be used for easily adding a module to the AutoLoadModules list in the Phoronix Test Suite user configuration file. That list controls what PTS modules are automatically loaded on start-up of the Phoronix Test Suite.</p>
|
||||
@@ -304,11 +313,11 @@
|
||||
<h1>Debugging</h1>
|
||||
<h3>check-tests<em> [Test]</em>
|
||||
</h3>
|
||||
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.</p>
|
||||
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.</p>
|
||||
<h3>diagnostics</h3>
|
||||
<p>This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.</p>
|
||||
<h3>dump-file-info</h3>
|
||||
<p>This option will dump the MD5 / SHA256 hashes and file size for a given file.</p>
|
||||
<p>This option will dump the MD5 / SHA256 checksums and file size for a given file.</p>
|
||||
<h3>dump-openbenchmarking-indexes</h3>
|
||||
<p>This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).</p>
|
||||
<h3>dump-phodevi-smart-cache</h3>
|
||||
@@ -325,7 +334,7 @@
|
||||
<p>This option will list all available test profiles that are available from the enabled OpenBenchmarking.org repositories but are NOT SUPPORTED on the given hardware/software platform. This is mainly a debugging option for those looking for test profiles to potentially port to new platforms, etc.</p>
|
||||
<h1>User Configuration</h1>
|
||||
<h3>enterprise-setup</h3>
|
||||
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.</p>
|
||||
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.</p>
|
||||
<h3>network-info</h3>
|
||||
<p>This option will print information detected by the Phoronix Test Suite around the system's network configuration.</p>
|
||||
<h3>network-setup</h3>
|
||||
@@ -342,7 +351,7 @@
|
||||
<p>This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.</p>
|
||||
<h3>result-file-to-csv<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
|
||||
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
|
||||
<h3>result-file-to-html<em> [Test Result]</em>
|
||||
</h3>
|
||||
<p>This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
|
||||
|
||||
@@ -6,7 +6,7 @@
|
||||
<body>
|
||||
<p>The following list is the modules included with the Phoronix Test Suite that are intended to extend the functionality of pts-core. Some of these options have commands that can be run directly in a similar manner to the other Phoronix Test Suite user commands. Some modules are just meant to be loaded directly by adding the module name to the AutoLoadModules tag in ~/.phoronix-test-suite/user-config.xml or via the PTS_MODULES environment variable. A list of available modules is also available by running <em>phoronix-test-suite list-modules.</em><hr></p>
|
||||
<h2>Backup Creation + Restore</h2>
|
||||
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the file-name will be auto-generated with a current time-stamp.</p>
|
||||
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the filename will be auto-generated with a current timestamp.</p>
|
||||
<p><strong>phoronix-test-suite backup.create</strong></p>
|
||||
<p><strong>phoronix-test-suite backup.restore</strong></p>
|
||||
<h2>System Maintenance / Cleanup</h2>
|
||||
|
||||
@@ -5,6 +5,6 @@
|
||||
</head>
|
||||
<body>
|
||||
<p>The Phoronix Test Suite has a feature known as "External Dependencies" where the Phoronix Test Suite can attempt to automatically install some of the test-specific dependencies on supported distributions. If running on a distribution where there is currently no External Dependencies profile, the needed package name(s) are listed for manual installation.</p>
|
||||
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.<hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>OpenSuSE</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li></p>
|
||||
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.<hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE Enterprise Linux</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li><li>openSUSE</li><li>openSUSE Leap</li><li>openSUSE Tumbleweed</li></p>
|
||||
</body>
|
||||
</html>
|
||||
|
||||
@@ -45,7 +45,7 @@
|
||||
|
||||
<h1>Testing Options</h1>
|
||||
<h3>SleepTimeBetweenTests</h3>
|
||||
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>8</em>.</p>
|
||||
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>6</em>.</p>
|
||||
<h3>SaveSystemLogs</h3>
|
||||
<p>If this option is set to <em>TRUE</em>, when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to <em>FALSE</em>, the system details / logs will not be saved by default. The default value is <em>FALSE</em>. When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.</p>
|
||||
<h3>SaveInstallationLogs</h3>
|
||||
|
||||
@@ -66,6 +66,10 @@ The variable is relevant for: test execution / benchmarking.
|
||||
The variable is relevant for: test execution / benchmarking.
|
||||
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
|
||||
</p>
|
||||
<h2>LOG_CLI_OUTPUT</h2>
|
||||
<p><em>[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.</em></p>
|
||||
<p>The value can be of type: boolean (TRUE / FALSE).
|
||||
</p>
|
||||
<h2>MONITOR</h2>
|
||||
<p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p>
|
||||
<p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp)
|
||||
|
||||
@@ -111,6 +111,9 @@
|
||||
<h3>Solaris Operating System Tests<em> pts/solaris</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
|
||||
<h3>Steam Tests<em> pts/steam</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles having an external dependency on Steam</p>
|
||||
<h3>System Subsystem Tests<em> pts/system</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
|
||||
@@ -123,9 +126,6 @@
|
||||
<h3>Smp Tests<em> pts/smp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
|
||||
<h3>Opencl Tests<em> pts/opencl</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
|
||||
<h3>Cuda Tests<em> pts/cuda</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
|
||||
@@ -135,12 +135,18 @@
|
||||
<h3>Openmp Tests<em> pts/openmp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
|
||||
<h3>Cloud Tests<em> pts/cloud</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
|
||||
<h3>Docker Tests<em> pts/docker</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
|
||||
<h3>Ai Tests<em> pts/ai</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.</p>
|
||||
<h3>Opencl Tests<em> pts/opencl</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
|
||||
<h3>Cloud Tests<em> pts/cloud</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
|
||||
<h3>Go Tests<em> pts/go</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
|
||||
@@ -237,12 +243,21 @@
|
||||
<h3>Smp Tests<em> system/smp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
|
||||
<h3>Openmp Tests<em> system/openmp</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
|
||||
<h3>Mpi Tests<em> system/mpi</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
|
||||
<h3>64-bit Arm / AArch64 Tests In git<em> git/aarch64</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.</p>
|
||||
<h3>All Tests in git<em> git/all</em>
|
||||
</h3>
|
||||
<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
|
||||
<h3>Application Tests<em> git/application</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
|
||||
<h3>BSD Operating System Tests<em> git/bsd</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
|
||||
@@ -261,6 +276,9 @@
|
||||
<h3>Rust Tests<em> git/rust</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles having an external dependency on Rust</p>
|
||||
<h3>System Subsystem Tests<em> git/system</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
|
||||
<h3>Utility Tests<em> git/utility</em>
|
||||
</h3>
|
||||
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
|
||||
|
||||
@@ -50,7 +50,7 @@ rm -rf $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/
|
||||
rm -rf $DESTDIR$INSTALL_PREFIX/share/doc/phoronix-test-suite/
|
||||
|
||||
mkdir -p $DESTDIR$INSTALL_PREFIX/bin/
|
||||
mkdir -p $DESTDIR$INSTALL_PREFIX/share/appdata/
|
||||
mkdir -p $DESTDIR$INSTALL_PREFIX/share/metainfo/
|
||||
mkdir -p $DESTDIR$INSTALL_PREFIX/share/applications/
|
||||
mkdir -p $DESTDIR$INSTALL_PREFIX/share/icons/hicolor/48x48/apps/
|
||||
mkdir -p $DESTDIR$INSTALL_PREFIX/share/man/man1/
|
||||
@@ -74,7 +74,7 @@ cp pts-core/static/bash_completion $DESTDIR$INSTALL_PREFIX/../etc/bash_completio
|
||||
cp pts-core/static/images/phoronix-test-suite.png $DESTDIR$INSTALL_PREFIX/share/icons/hicolor/48x48/apps/phoronix-test-suite.png
|
||||
cp pts-core/static/phoronix-test-suite.desktop $DESTDIR$INSTALL_PREFIX/share/applications/
|
||||
cp pts-core/static/phoronix-test-suite-launcher.desktop $DESTDIR$INSTALL_PREFIX/share/applications/
|
||||
cp pts-core/static/phoronix-test-suite.appdata.xml $DESTDIR$INSTALL_PREFIX/share/appdata/
|
||||
cp pts-core/static/com.phoronix_test_suite.phoronix_test_suite.metainfo.xml $DESTDIR$INSTALL_PREFIX/share/metainfo/
|
||||
|
||||
mkdir -p $DESTDIR$INSTALL_PREFIX/../usr/lib/systemd/system/
|
||||
cp deploy/*-systemd/*.service $DESTDIR$INSTALL_PREFIX/../usr/lib/systemd/system/
|
||||
|
||||
@@ -51,7 +51,6 @@ rm -rf "$DESTDIR$INSTALL_PREFIX"/share/phoronix-test-suite/
|
||||
rm -rf "$DESTDIR$INSTALL_PREFIX"/share/doc/phoronix-test-suite/
|
||||
|
||||
mkdir -p "$DESTDIR$INSTALL_PREFIX"/bin/
|
||||
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/appdata/
|
||||
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/applications/
|
||||
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/icons/hicolor/48x48/apps/
|
||||
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/man/man1/
|
||||
@@ -75,7 +74,6 @@ cp pts-core/static/bash_completion "$DESTDIR$INSTALL_PREFIX"/../etc/bash_complet
|
||||
cp pts-core/static/images/phoronix-test-suite.png "$DESTDIR$INSTALL_PREFIX"/share/icons/hicolor/48x48/apps/phoronix-test-suite.png
|
||||
cp pts-core/static/phoronix-test-suite.desktop "$DESTDIR$INSTALL_PREFIX"/share/applications/
|
||||
cp pts-core/static/phoronix-test-suite-launcher.desktop "$DESTDIR$INSTALL_PREFIX"/share/applications/
|
||||
cp pts-core/static/phoronix-test-suite.appdata.xml "$DESTDIR$INSTALL_PREFIX"/share/appdata/
|
||||
|
||||
mkdir -p "$DESTDIR$INSTALL_PREFIX"/../usr/lib/systemd/system/
|
||||
cp deploy/*-systemd/*.service "$DESTDIR$INSTALL_PREFIX"/../usr/lib/systemd/system/
|
||||
@@ -95,7 +93,7 @@ rm -f "$DESTDIR$INSTALL_PREFIX"/share/phoronix-test-suite/pts-core/static/images
|
||||
rm -f "$DESTDIR$INSTALL_PREFIX"/share/phoronix-test-suite/pts-core/static/images/%phoronix-test-suite.png
|
||||
|
||||
|
||||
sed -e 's:export PTS_DIR=$(actualpath "$(dirname "$0")"):export PTS_DIR='"$INSTALL_PREFIX"'\/share\/phoronix-test-suite:g'
|
||||
sed -e 's:export PTS_DIR=$(actualpath "$(dirname "$0")"):export PTS_DIR='"$INSTALL_PREFIX"'\/share\/phoronix-test-suite:g' phoronix-test-suite > $DESTDIR$INSTALL_PREFIX/bin/phoronix-test-suite
|
||||
chmod +x "$DESTDIR$INSTALL_PREFIX"/bin/phoronix-test-suite
|
||||
|
||||
# sed 's:\$url = PTS_PATH . \"documentation\/index.html\";:\$url = \"'"$INSTALL_PREFIX"'\/share\/doc\/packages\/phoronix-test-suite\/index.html\";:g' pts-core/commands/gui_gtk.php > $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core/commands/gui_gtk.php
|
||||
|
||||
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
@@ -1 +1 @@
|
||||
{"overview":{"244a0e9a456f6a8561ce62689c1c96b783484955":{"description":"AV1 Video Encoding","test_version":"1.1.x","app_version":"Git","unit":"Frames Per Second","samples":40,"timing_samples":39,"hib":1,"first_appeared":1552068371,"last_appeared":1636695960,"run_time_avg":1618,"stddev_avg":0.02,"percentiles":[0.01,0.01,0.01,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.03,0.03,0.03,0.03,0.03,0.05,0.05,0.05,0.05,0.05,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.08,0.08,0.08,0.13,0.13,0.13,0.13,0.13,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.15,0.15,0.15,0.15,0.15,0.23,0.23,0.23,0.3,0.3,3.56,3.56,3.56,5.87,5.87],"run_time_percentiles":[10,10,10,17,17,17,200,200,263,263,263,390,390,396,396,396,438,438,438,438,438,439,439,439,439,439,440,440,440,442,442,442,442,442,779,779,822,822,822,847,847,847,851,851,852,852,852,893,893,1162,1162,1162,1173,1173,1761,1761,1761,1791,1791,1802,1802,1802,2300,2300,2300,2643,2643,3111,3111,3111,3113,3113,3116,3116,3116,3121,3121,3123,3123,3123,3123,3123,3123,3133,3133,3140,3140,3140,3173,3173,3207,3207,3207,3225,3225,3236,3236,3236,3262,3262],"tested_archs":["x86_64","aarch64"]}}}
|
||||
{"overview":{"244a0e9a456f6a8561ce62689c1c96b783484955":{"description":"AV1 Video Encoding","test_version":"1.1.x","app_version":"Git","unit":"Frames Per Second","samples":48,"timing_samples":47,"hib":1,"first_appeared":1552068371,"last_appeared":1681404639,"run_time_avg":1344,"stddev_avg":0.45,"percentiles":[0.01,0.01,0.01,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.03,0.03,0.03,0.03,0.05,0.05,0.05,0.05,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.08,0.08,0.08,0.13,0.13,0.13,0.13,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.15,0.15,0.15,0.15,0.23,0.23,0.23,0.3,0.3,3.56,3.56,4.55,4.55,5.87,5.87,16.14,16.14,69.08,69.08,70.89,70.89,71.24,71.24,71.41,71.41,73.11,73.11,136.37,136.37],"run_time_percentiles":[2.5100000000000002,2.5100000000000002,2.5100000000000002,4.449999999999999,4.449999999999999,4.56,4.56,4.58,4.58,4.640000000000001,4.640000000000001,4.719999999999999,4.719999999999999,10,10,13,13,13,15,15,17,17,200,200,263,263,390,390,396,396,438,438,438,438,438,439,439,439,439,440,440,442,442,442,442,779,779,822,822,847,847,847,851,851,852,852,893,893,1162,1162,1173,1173,1761,1761,1791,1791,1802,1802,1802,2300,2300,2643,2643,3111,3111,3113,3113,3116,3116,3121,3121,3123,3123,3123,3123,3123,3133,3133,3140,3140,3173,3173,3207,3207,3225,3225,3236,3236,3262,3262],"tested_archs":["x86_64","aarch64"]}}}
|
||||
@@ -0,0 +1 @@
|
||||
{"1.0.0":{"last_updated":"1673526602","commit_description":"Git-based ClickHouse test profile for QPL testing."}}
|
||||
20
ob-cache/test-profiles/git/clickhouse-1.0.0/downloads.xml
Normal file
20
ob-cache/test-profiles/git/clickhouse-1.0.0/downloads.xml
Normal file
@@ -0,0 +1,20 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>https://datasets.clickhouse.com/hits_compatible/hits.tsv.gz</URL>
|
||||
<MD5>de2f86030d1c86fd39d03468bd90a911</MD5>
|
||||
<SHA256>bd500f777ef0eb55dc9d4f0eb245870351cc44a44d72a56395048d5c15f09fe2</SHA256>
|
||||
<FileName>hits.tsv.gz</FileName>
|
||||
<FileSize>16298506510</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>https://github.com/ClickHouse/ClickBench/archive/d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0.zip</URL>
|
||||
<MD5>c9e554e017403f399f3175258e12befa</MD5>
|
||||
<SHA256>6ab8955c8fc0af8946f2b6d5dfdef708eafd89826e3ffa7204f664f256240238</SHA256>
|
||||
<FileName>ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0.zip</FileName>
|
||||
<FileSize>627752</FileSize>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1 @@
|
||||
{"overview":[]}
|
||||
91
ob-cache/test-profiles/git/clickhouse-1.0.0/install.sh
Normal file
91
ob-cache/test-profiles/git/clickhouse-1.0.0/install.sh
Normal file
@@ -0,0 +1,91 @@
|
||||
#!/bin/bash
|
||||
git clone --recursive https://github.com/ClickHouse/ClickHouse.git clickhouse-git
|
||||
mkdir build
|
||||
cd build
|
||||
EXTRA_FLAGS="-DCMAKE_BUILD_TYPE=Release "
|
||||
if grep avx /proc/cpuinfo > /dev/null
|
||||
then
|
||||
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_AVX=ON "
|
||||
fi
|
||||
if grep bmi /proc/cpuinfo > /dev/null
|
||||
then
|
||||
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_BMI=ON "
|
||||
fi
|
||||
if grep avx2 /proc/cpuinfo > /dev/null
|
||||
then
|
||||
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_AVX2=ON "
|
||||
if grep avx512 /proc/cpuinfo > /dev/null
|
||||
then
|
||||
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_AVX512=ON -DENABLE_AVX512_FOR_SPEC_OP=ON "
|
||||
if type accel-config > /dev/null
|
||||
then
|
||||
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_QPL=ON "
|
||||
fi
|
||||
fi
|
||||
fi
|
||||
echo "Clickhouse CMake build configuration: $EXTRA_FLAGS"
|
||||
cmake ../clickhouse-git $EXTRA_FLAGS
|
||||
ninja
|
||||
echo $? > ~/install-exit-status
|
||||
cd ~
|
||||
./build/programs/clickhouse server --version > ~/install-footnote 2>&1
|
||||
unzip -o ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0.zip
|
||||
gzip -d -k hits.tsv.gz
|
||||
cp ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0/clickhouse/queries.sql queries.sql
|
||||
mkdir config.d
|
||||
echo "<clickhouse>
|
||||
<profiles>
|
||||
<default>
|
||||
<allow_experimental_codecs>1</allow_experimental_codecs>
|
||||
</default>
|
||||
</profiles>
|
||||
<compression>
|
||||
<case>
|
||||
<method>deflate_qpl</method>
|
||||
</case>
|
||||
</compression>
|
||||
</clickhouse>" > config.d/qpl.xml
|
||||
CLICKHOUSE_CLIENT=build/programs/clickhouse
|
||||
echo "#!/bin/bash
|
||||
rm -rf d*
|
||||
rm -rf f*
|
||||
rm -rf m*
|
||||
rm -rf n*
|
||||
rm -rf preprocessed_configs
|
||||
rm -rf s*
|
||||
rm -rf tmp
|
||||
rm -rf u*
|
||||
|
||||
TRIES=3
|
||||
./$CLICKHOUSE_CLIENT server 2>/dev/null &
|
||||
SERVER_PID=\$!
|
||||
sleep 5
|
||||
./$CLICKHOUSE_CLIENT client < ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0/clickhouse/create-tuned.sql
|
||||
./$CLICKHOUSE_CLIENT client --time --query \"INSERT INTO hits FORMAT TSV\" < hits.tsv
|
||||
echo \$? > ~/test-exit-status
|
||||
cat queries.sql | while read query; do
|
||||
sync
|
||||
echo \"QUERY: \$query\" >> \$LOG_FILE
|
||||
for i in \$(seq 1 \$TRIES); do
|
||||
echo -n \"Clickhouse Query Time \$i: \" >> \$LOG_FILE
|
||||
./$CLICKHOUSE_CLIENT client --time --format=Null --max_memory_usage=100G --max_threads=\$NUM_CPU_CORES --query=\"\$query\" --progress 0 >> \$LOG_FILE 2>&1
|
||||
retval=\$?
|
||||
if [ \$retval -ne 0 ]; then
|
||||
echo \$retval > ~/test-exit-status
|
||||
kill -9 \$SERVER_PID
|
||||
sleep 3
|
||||
exit
|
||||
fi
|
||||
done
|
||||
done
|
||||
kill -9 \$SERVER_PID
|
||||
sleep 2
|
||||
rm -rf d*
|
||||
rm -rf f*
|
||||
rm -rf m*
|
||||
rm -rf n*
|
||||
rm -rf preprocessed_configs
|
||||
rm -rf s*
|
||||
rm -rf tmp
|
||||
rm -rf u*" > clickhouse
|
||||
chmod +x clickhouse
|
||||
@@ -0,0 +1,25 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Clickhouse Query Time 1: #_RESULT_#</OutputTemplate>
|
||||
<LineHint>Clickhouse Query Time 1:</LineHint>
|
||||
<MultiMatch>GEOMETRIC_MEAN</MultiMatch>
|
||||
<DivideResultDivisor>60</DivideResultDivisor>
|
||||
<ArgumentsDescription>100M Rows Hits Dataset, First Run / Cold Cache</ArgumentsDescription>
|
||||
</ResultsParser>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Clickhouse Query Time 2: #_RESULT_#</OutputTemplate>
|
||||
<LineHint>Clickhouse Query Time 2:</LineHint>
|
||||
<MultiMatch>GEOMETRIC_MEAN</MultiMatch>
|
||||
<DivideResultDivisor>60</DivideResultDivisor>
|
||||
<ArgumentsDescription>100M Rows Hits Dataset, Second Run</ArgumentsDescription>
|
||||
</ResultsParser>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Clickhouse Query Time 3: #_RESULT_#</OutputTemplate>
|
||||
<LineHint>Clickhouse Query Time 3:</LineHint>
|
||||
<MultiMatch>GEOMETRIC_MEAN</MultiMatch>
|
||||
<DivideResultDivisor>60</DivideResultDivisor>
|
||||
<ArgumentsDescription>100M Rows Hits Dataset, Third Run</ArgumentsDescription>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1,25 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>ClickHouse</Title>
|
||||
<Description>ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. This test profile is currently an experimental build of ClickHouse from Git and setup for Intel QPL accelerator use.</Description>
|
||||
<ResultScale>Queries Per Minute, Geo Mean</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>1.0.0</Version>
|
||||
<SupportedPlatforms>Linux</SupportedPlatforms>
|
||||
<SoftwareType>Application</SoftwareType>
|
||||
<TestType>System</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Experimental</Status>
|
||||
<ExternalDependencies>build-utilities, cmake, nasm, git, clang</ExternalDependencies>
|
||||
<EnvironmentSize>91900</EnvironmentSize>
|
||||
<ProjectURL>https://clickhouse.com/</ProjectURL>
|
||||
<RepositoryURL>https://github.com/ClickHouse/ClickHouse</RepositoryURL>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
<SystemDependencies>ninja, lld</SystemDependencies>
|
||||
</TestProfile>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/git/dav1d-1.1.0/changelog.json
Normal file
1
ob-cache/test-profiles/git/dav1d-1.1.0/changelog.json
Normal file
@@ -0,0 +1 @@
|
||||
{"1.1.0":{"last_updated":"1647888021","commit_description":"Update download links, adjust for v1.0+ that have changed CLI options, add threads\/framedelay options."},"1.0.1":{"last_updated":"1579721829","commit_description":"Ensure dav1d-git build folder is cleaned on reinstall."},"1.0.0":{"last_updated":"1579697045","commit_description":"Add a Git version of dav1d benchmark."}}
|
||||
42
ob-cache/test-profiles/git/dav1d-1.1.0/downloads.xml
Normal file
42
ob-cache/test-profiles/git/dav1d-1.1.0/downloads.xml
Normal file
@@ -0,0 +1,42 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.2-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>http://ffmpeg.org/releases/ffmpeg-4.4.tar.xz</URL>
|
||||
<MD5>7b9d5b652d20e8c5405304ad72636d4a</MD5>
|
||||
<SHA256>06b10a183ce5371f915c6bb15b7b1fffbe046e8275099c96affc29e17645d909</SHA256>
|
||||
<FileName>ffmpeg-4.4.tar.xz</FileName>
|
||||
<FileSize>9557868</FileSize>
|
||||
<PlatformSpecific>Linux, BSD</PlatformSpecific>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/Stream2_AV1_HD_6.8mbps.webm</URL>
|
||||
<MD5>5e4c83cf494cbe6dc1668cbbd7ff774c</MD5>
|
||||
<SHA256>2f23d29750a0663a6df656e8137cf934bddfc96b31e5088db2c3624f19ed14d4</SHA256>
|
||||
<FileName>Stream2_AV1_HD_6.8mbps.webm</FileName>
|
||||
<FileSize>122378926</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/Stream2_AV1_4K_22.7mbps.webm</URL>
|
||||
<MD5>8acc9c60c10a37bf4e568b465b03e35a</MD5>
|
||||
<SHA256>52f3aa1d4b4487af62d37b0f295aabbc4b57f03fdc4c76402c6358193e4aa490</SHA256>
|
||||
<FileName>Stream2_AV1_4K_22.7mbps.webm</FileName>
|
||||
<FileSize>409458359</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://download.opencontent.netflix.com.s3.amazonaws.com/AV1/Chimera/Old/Chimera-AV1-8bit-1920x1080-6736kbps.mp4</URL>
|
||||
<MD5>d444e11f8b049de2a9739899a9c0b4f6</MD5>
|
||||
<SHA256>d566d294e2c18bb274a54aad03352c92312a62c393656d38e1f7dda10c0bf10c</SHA256>
|
||||
<FileName>Chimera-AV1-8bit-1920x1080-6736kbps.mp4</FileName>
|
||||
<FileSize>313490236</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://download.opencontent.netflix.com.s3.amazonaws.com/AV1/Chimera/Old/Chimera-AV1-10bit-1920x1080-6191kbps.mp4</URL>
|
||||
<MD5>4c0f24bac42ddcda3d46087a36492ce4</MD5>
|
||||
<SHA256>df2080fd77e0dbd9138bd4f172bf008d2ade17da7ab4532fba54ceccf40a9439</SHA256>
|
||||
<FileName>Chimera-AV1-10bit-1920x1080-6191kbps.mp4</FileName>
|
||||
<FileSize>288122748</FileSize>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/git/dav1d-1.1.0/generated.json
Normal file
1
ob-cache/test-profiles/git/dav1d-1.1.0/generated.json
Normal file
File diff suppressed because one or more lines are too long
36
ob-cache/test-profiles/git/dav1d-1.1.0/install.sh
Normal file
36
ob-cache/test-profiles/git/dav1d-1.1.0/install.sh
Normal file
@@ -0,0 +1,36 @@
|
||||
#!/bin/sh
|
||||
|
||||
# FFmpeg install to demux AV1 WebM to IVF that can then be consumed by dav1d...
|
||||
tar -xf ffmpeg-4.4.tar.xz
|
||||
mkdir ffmpeg_/
|
||||
|
||||
cd ffmpeg-4.4
|
||||
./configure --disable-zlib --disable-doc --prefix=$HOME/ffmpeg_/
|
||||
make -j $NUM_CPU_CORES
|
||||
echo $? > ~/install-exit-status
|
||||
make install
|
||||
cd ~/
|
||||
|
||||
./ffmpeg_/bin/ffmpeg -i Stream2_AV1_HD_6.8mbps.webm -vcodec copy -an -f ivf summer_nature_1080p.ivf
|
||||
./ffmpeg_/bin/ffmpeg -i Stream2_AV1_4K_22.7mbps.webm -vcodec copy -an -f ivf summer_nature_4k.ivf
|
||||
./ffmpeg_/bin/ffmpeg -i Chimera-AV1-8bit-1920x1080-6736kbps.mp4 -vcodec copy -an -f ivf chimera_8b_1080p.ivf
|
||||
./ffmpeg_/bin/ffmpeg -i Chimera-AV1-10bit-1920x1080-6191kbps.mp4 -vcodec copy -an -f ivf chimera_10b_1080p.ivf
|
||||
|
||||
rm -rf ffmpeg-4.2.1
|
||||
rm -rf ffmpeg_
|
||||
|
||||
# Build Dav1d
|
||||
rm -rf dav1d-git
|
||||
git clone https://code.videolan.org/videolan/dav1d.git dav1d-git
|
||||
cd dav1d-git
|
||||
git rev-parse --short HEAD > ~/install-footnote
|
||||
mkdir build
|
||||
meson build --buildtype release
|
||||
ninja -C build
|
||||
echo $? > ~/install-exit-status
|
||||
|
||||
cd ~
|
||||
echo "#!/bin/sh
|
||||
./dav1d-git/build/tools/dav1d \$@ > \$LOG_FILE 2>&1
|
||||
echo \$? > ~/test-exit-status" > dav1d
|
||||
chmod +x dav1d
|
||||
@@ -0,0 +1,9 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.2-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Decoded 8929 8929 frames (100.0%) - #_RESULT_# 25 fps (9.20x)</OutputTemplate>
|
||||
<LineHint>fps</LineHint>
|
||||
<TurnCharsToSpace>/</TurnCharsToSpace>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
140
ob-cache/test-profiles/git/dav1d-1.1.0/test-definition.xml
Normal file
140
ob-cache/test-profiles/git/dav1d-1.1.0/test-definition.xml
Normal file
@@ -0,0 +1,140 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.2-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>dav1d</Title>
|
||||
<AppVersion>Git</AppVersion>
|
||||
<Description>Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. The git/dav1d test profile builds against current dav1d Git, for the static version use the pts/dav1d test profile.</Description>
|
||||
<ResultScale>FPS</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>1.1.0</Version>
|
||||
<SupportedPlatforms>Linux, BSD</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>Processor</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>build-utilities, yasm, meson, git</ExternalDependencies>
|
||||
<EnvironmentSize>1200</EnvironmentSize>
|
||||
<ProjectURL>https://www.videolan.org/projects/dav1d.html</ProjectURL>
|
||||
<RepositoryURL>http://code.videolan.org/videolan/dav1d</RepositoryURL>
|
||||
<InternalTags>SMP</InternalTags>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>--muxer null </Arguments>
|
||||
</Default>
|
||||
<Option>
|
||||
<DisplayName>Video Input</DisplayName>
|
||||
<Identifier>video</Identifier>
|
||||
<ArgumentPrefix>-i </ArgumentPrefix>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Summer Nature 1080p</Name>
|
||||
<Value>summer_nature_1080p.ivf</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Summer Nature 4K</Name>
|
||||
<Value>summer_nature_4k.ivf</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Chimera 1080p</Name>
|
||||
<Value>chimera_8b_1080p.ivf</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Chimera 1080p 10-bit</Name>
|
||||
<Value>chimera_10b_1080p.ivf</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
<Option>
|
||||
<DisplayName>Threads</DisplayName>
|
||||
<Identifier>threads</Identifier>
|
||||
<ArgumentPrefix>--threads </ArgumentPrefix>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>1</Name>
|
||||
<Value>1</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>4</Name>
|
||||
<Value>4</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>8</Name>
|
||||
<Value>8</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>16</Name>
|
||||
<Value>16</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>32</Name>
|
||||
<Value>32</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>64</Name>
|
||||
<Value>64</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>128</Name>
|
||||
<Value>128</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>160</Name>
|
||||
<Value>160</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>256</Name>
|
||||
<Value>256</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>384</Name>
|
||||
<Value>384</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
<Option>
|
||||
<DisplayName>Frame Delay</DisplayName>
|
||||
<Identifier>frame-delay</Identifier>
|
||||
<ArgumentPrefix>--framedelay </ArgumentPrefix>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>1</Name>
|
||||
<Value>1</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>4</Name>
|
||||
<Value>4</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>8</Name>
|
||||
<Value>8</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>12</Name>
|
||||
<Value>12</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>16</Name>
|
||||
<Value>16</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>24</Name>
|
||||
<Value>24</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>32</Name>
|
||||
<Value>32</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>64</Name>
|
||||
<Value>64</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
@@ -1 +1 @@
|
||||
{"overview":{"622f5f75d068059e83e0f1d74060a7bd53ef41a5":{"description":"1080p 8-bit YUV To HEVC Video Encode","test_version":"1.0.x","app_version":"Git","unit":"Frames Per Second","samples":74,"timing_samples":73,"hib":1,"first_appeared":1552068371,"last_appeared":1641941673,"run_time_avg":182,"stddev_avg":2.28,"percentiles":[0.25,0.25,0.38,1.14,1.14,1.54,4.24,5.3,5.3,5.6,7.38,7.39,7.39,40.35,54.7,76.93,76.93,77.43,77.81,81.94,81.94,87.12,87.4,95.85,95.85,96.04,97.06,97.06,97.57,97.6,97.69,97.69,98.56,98.75,98.79,98.79,98.94,99.35,99.44,99.44,99.71,99.92,100.38,100.38,100.8,100.85,101.11,101.11,101.36,101.53,102.89,102.89,104.36,106.75,106.75,107.56,108.22,108.71,108.71,115.3,120.2,125.26,125.26,125.66,126.55,137.89,137.89,142.12,146.55,147.65,147.65,149.46,150.38,150.6,150.6,151,151.06,151.06,152.13,174.42,196.71,196.71,203.28,210.13,228.72,228.72,253,257.61,257.9,257.9,261,261.08,265.85,265.85,277.69,298.36,343.67,343.67,363,363.18],"run_time_percentiles":[7.28,7.28,8.43,8.89,8.89,9.36,9.85,10,10,12,13,13,13,13,14,14,14,14,15,15,16,17,18,18,18,18,18,18,18,18,18,18,18,19,19,19,19,19,19,19,19,19,20,20,20,20,21,22,22,22,24,24,24,24,25,25,25,25,26,31,31,34,39,39,41,43,43,43,43,45,45,45,46,51,51,51,60,65,65,80,94,95,95,96,96,97,97,98,126,126,247,247,325,325,342,430,1577,1577,3211,4760],"tested_archs":["x86_64"]}}}
|
||||
{"overview":{"622f5f75d068059e83e0f1d74060a7bd53ef41a5":{"description":"1080p 8-bit YUV To HEVC Video Encode","test_version":"1.0.x","app_version":"Git","unit":"Frames Per Second","samples":85,"timing_samples":84,"hib":1,"first_appeared":1552068371,"last_appeared":1689666386,"run_time_avg":167,"stddev_avg":2.37,"percentiles":[0.25,0.25,0.38,1.14,1.54,4.24,4.65,4.65,5.3,5.6,7.38,7.39,40.35,40.5,40.5,51.32,51.33,54.7,76.93,77.43,77.81,77.81,81.94,83.56,84.12,87.12,87.4,87.4,95.85,96.04,97.06,97.57,97.6,97.69,97.69,98.56,98.75,98.79,98.94,99.35,99.44,99.44,99.71,99.92,100.38,100.8,100.85,100.85,101.11,101.36,101.53,102.89,104.36,106.75,106.75,107.56,108.22,108.71,115.3,120.2,125.26,125.26,125.66,126.55,137.89,142.12,146.55,146.55,147.65,147.88,149.46,150.38,150.6,151,151,151.06,152.13,174.42,184.3,185.29,196.71,196.71,203.28,210.13,228.72,249.59,253,253,257.61,257.9,261,261.08,265.85,277.69,277.69,292.81,298.36,343.67,363,363.18],"run_time_percentiles":[7.28,7.28,8.18,8.43,8.89,9.36,9.85,9.85,10,10,11,12,13,13,13,13,13,14,14,14,14,15,16,17,18,18,18,18,18,18,18,18,18,18,19,19,19,19,19,19,19,20,20,20,20,21,22,22,24,24,24,24,25,25,25,26,28,28,31,34,37,37,39,39,41,43,43,43,45,45,45,45,46,46,51,51,51,60,65,80,92,94,94,95,96,96,97,98,98,126,247,247,325,342,342,391,430,1577,3211,4760],"tested_archs":["x86_64"]}}}
|
||||
1
ob-cache/test-profiles/pts/3dmark-1.0.0/changelog.json
Normal file
1
ob-cache/test-profiles/pts/3dmark-1.0.0/changelog.json
Normal file
@@ -0,0 +1 @@
|
||||
{"1.0.0":{"last_updated":"1683925273","commit_description":"Allow automating 3DMark benchmark if you have the necessary licensed files already on your system."}}
|
||||
10
ob-cache/test-profiles/pts/3dmark-1.0.0/downloads.xml
Normal file
10
ob-cache/test-profiles/pts/3dmark-1.0.0/downloads.xml
Normal file
@@ -0,0 +1,10 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<FileName>3dmark-attan-extreme-1.1.2.1-workload-bin.zip</FileName>
|
||||
<FileSize>277469377</FileSize>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/3dmark-1.0.0/generated.json
Normal file
1
ob-cache/test-profiles/pts/3dmark-1.0.0/generated.json
Normal file
File diff suppressed because one or more lines are too long
23
ob-cache/test-profiles/pts/3dmark-1.0.0/install.sh
Normal file
23
ob-cache/test-profiles/pts/3dmark-1.0.0/install.sh
Normal file
@@ -0,0 +1,23 @@
|
||||
#!/bin/sh
|
||||
unzip -o 3dmark-attan-extreme-1.1.2.1-workload-bin.zip
|
||||
chmod +x bin/linux/x64/workload
|
||||
echo "#!/bin/sh
|
||||
echo \"{
|
||||
\\\"workload_name\\\": \\\"WildLifeGt1XC\\\",
|
||||
\\\"rendering_resolution\\\": [\$1, \$2],
|
||||
\\\"asset_root\\\": \\\"assets_desktop\\\",
|
||||
\\\"timeline\\\": \\\"timelines_heavy/attan_gt1_heavy_timeline.txt\\\",
|
||||
\\\"fullscreen\\\": true,
|
||||
\\\"debug_api\\\": false,
|
||||
\\\"enable_debug_log\\\": false,
|
||||
\\\"base_log_path\\\": \\\"\\\",
|
||||
\\\"threads\\\": 0,
|
||||
\\\"vsync\\\": false,
|
||||
\\\"loop\\\": false,
|
||||
\\\"loop_count\\\": 0
|
||||
}\" > settings/pts.json
|
||||
rm -f result.json
|
||||
./bin/linux/x64/workload --in=settings/pts.json --out=result.json
|
||||
echo \$? > ~/test-exit-status
|
||||
cat result.json > \$LOG_FILE" > 3dmark
|
||||
chmod +x 3dmark
|
||||
23
ob-cache/test-profiles/pts/3dmark-1.0.0/install_windows.sh
Normal file
23
ob-cache/test-profiles/pts/3dmark-1.0.0/install_windows.sh
Normal file
@@ -0,0 +1,23 @@
|
||||
#!/bin/sh
|
||||
unzip -o 3dmark-attan-extreme-1.1.2.1-workload-bin.zip
|
||||
chmod +x bin/windows/x64/workload.exe
|
||||
echo "#!/bin/sh
|
||||
echo \"{
|
||||
\\\"workload_name\\\": \\\"WildLifeGt1XC\\\",
|
||||
\\\"rendering_resolution\\\": [\$1, \$2],
|
||||
\\\"asset_root\\\": \\\"assets_desktop\\\",
|
||||
\\\"timeline\\\": \\\"timelines_heavy/attan_gt1_heavy_timeline.txt\\\",
|
||||
\\\"fullscreen\\\": true,
|
||||
\\\"debug_api\\\": false,
|
||||
\\\"enable_debug_log\\\": false,
|
||||
\\\"base_log_path\\\": \\\"\\\",
|
||||
\\\"threads\\\": 0,
|
||||
\\\"vsync\\\": false,
|
||||
\\\"loop\\\": false,
|
||||
\\\"loop_count\\\": 0
|
||||
}\" > settings/pts.json
|
||||
rm -f result.json
|
||||
./bin/windows/x64/workload.exe --in=settings/pts.json --out=result.json
|
||||
echo \$? > ~/test-exit-status
|
||||
cat result.json > \$LOG_FILE" > 3dmark
|
||||
chmod +x 3dmark
|
||||
@@ -0,0 +1,7 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate> "value": #_RESULT_#</OutputTemplate>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
38
ob-cache/test-profiles/pts/3dmark-1.0.0/test-definition.xml
Normal file
38
ob-cache/test-profiles/pts/3dmark-1.0.0/test-definition.xml
Normal file
@@ -0,0 +1,38 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>3DMark Wild Life Extreme</Title>
|
||||
<AppVersion>1.1.2.1</AppVersion>
|
||||
<Description>This test profile only automates the vendor build of 3DMark with its command-line / JSON support. If you do not have a licensed copy of the necessary 3DMark binaries in your Phoronix Test Suite download cache on your system, this test profile will not do anything and simply fail. You must have already obtained the proper licensed binaries from UL for this test profile to work -- this test profile simply automates the firing of the 3DMark benchmark at your desired resolution and capturing the results within the Phoronix Test Suite while you must already have the necessary 3DMark files on your system.</Description>
|
||||
<ResultScale>Frames Per Second</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
<PreInstallMessage>This test profile only automates the vendor build of 3DMark with its command-line / JSON support. If you do not have a licensed copy of the necessary 3DMark binaries in your Phoronix Test Suite download cache on your system, this test profile will not do anything and simply fail. You must have already obtained the proper licensed binaries from UL for this test profile to work -- this test profile simply automates the firing of the 3DMark benchmark at your desired resolution and capturing the results within the Phoronix Test Suite while you must already have the necessary 3DMark files on your system.</PreInstallMessage>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>1.0.0</Version>
|
||||
<SupportedPlatforms>Linux, Windows</SupportedPlatforms>
|
||||
<SoftwareType>Game</SoftwareType>
|
||||
<TestType>Graphics</TestType>
|
||||
<License>Restricted</License>
|
||||
<Status>Experimental</Status>
|
||||
<SupportedArchitectures>x86_64</SupportedArchitectures>
|
||||
<RequiresDisplay>TRUE</RequiresDisplay>
|
||||
<EnvironmentSize>598</EnvironmentSize>
|
||||
<ProjectURL>https://www.3dmark.com/</ProjectURL>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Option>
|
||||
<DisplayName>Resolution</DisplayName>
|
||||
<Identifier>auto-resolution</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>$VIDEO_WIDTH x $VIDEO_HEIGHT</Name>
|
||||
<Value>$VIDEO_WIDTH $VIDEO_HEIGHT</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1 @@
|
||||
{"1.0.2":{"last_updated":"1658252311","commit_description":"Update tensorflow pip dependency so it works on newer distributuions."},"1.0.1":{"last_updated":"1605138215","commit_description":"Fix for macOS support."},"1.0.0":{"last_updated":"1594232753","commit_description":"Initial commit of AI Benchmark Alpha."}}
|
||||
@@ -0,0 +1 @@
|
||||
{"overview":{"6ca1d493839e7acaaacdd66d2ed4166cbcc71052":{"description":"Device Inference Score","test_version":"1.0.x","app_version":"0.1.2","unit":"Score","samples":1164,"timing_samples":1149,"hib":1,"first_appeared":1594236431,"last_appeared":1705438847,"run_time_avg":1206,"stddev_avg":0,"percentiles":[46,236,370,417,465,511,536,569,581,627,640,660,665,673,681,703,728,735,745,756,769,815,863,889,936,955,986,1020,1029,1041,1060,1077,1090,1102,1120,1128,1162,1173,1183,1245,1268,1284,1294,1306,1321,1352,1373,1392,1412,1428,1454,1464,1481,1502,1533,1569,1580,1605,1619,1638,1654,1660,1711,1735,1768,1788,1811,1825,1837,1843,1854,1861,1879,1894,1906,1912,1921,1928,1936,1952,1968,1983,2007,2026,2042,2054,2079,2100,2125,2159,2232,2288,2324,2343,2508,2857,3341,3995,4700,18696],"run_time_percentiles":[379,560,646,705,734,798,859,865,952,979,983,1007,1020,1033,1035,1042,1048,1056,1060,1063,1071,1074,1075,1079,1083,1085,1087,1091,1093,1098,1103,1105,1108,1114,1119,1121,1125,1129,1131,1133,1136,1141,1146,1147,1150,1154,1157,1159,1163,1167,1170,1174,1177,1182,1187,1188,1197,1201,1206,1211,1217,1223,1226,1230,1235,1241,1253,1259,1269,1279,1287,1295,1299,1307,1315,1322,1329,1338,1350,1360,1370,1382,1390,1403,1418,1428,1434,1447,1468,1478,1496,1512,1520,1528,1537,1582,1616,1658,1762,2199],"tested_archs":["x86_64","aarch64","arm64"]},"18d0ce5cc395e59249172d7c8c5cd0ae47d30c7e":{"description":"Device AI Score","test_version":"1.0.x","app_version":"0.1.2","unit":"Score","samples":1163,"timing_samples":1149,"hib":1,"first_appeared":1594236431,"last_appeared":1705438847,"run_time_avg":1206,"stddev_avg":0,"percentiles":[74,487,785,930,1034,1118,1152,1200,1256,1272,1288,1318,1349,1372,1391,1424,1512,1546,1598,1636,1689,1722,1737,1765,1825,1910,1943,1965,1982,1996,2053,2111,2150,2206,2215,2221,2236,2277,2303,2340,2374,2401,2445,2464,2486,2527,2562,2586,2612,2621,2654,2673,2686,2714,2734,2771,2792,2855,2898,2908,2925,2932,2998,3018,3045,3072,3113,3124,3153,3176,3205,3251,3279,3333,3352,3390,3411,3439,3472,3495,3518,3545,3572,3611,3672,3730,3781,3886,3992,4176,4189,4521,4778,5532,5574,6548,7522,9310,10315,38200],"run_time_percentiles":[379,560,646,705,734,798,859,865,952,979,983,1007,1020,1033,1035,1042,1048,1056,1060,1063,1071,1074,1075,1079,1083,1085,1087,1091,1093,1098,1103,1105,1108,1114,1119,1121,1125,1129,1131,1133,1136,1141,1146,1147,1150,1154,1157,1159,1163,1167,1170,1174,1177,1182,1187,1188,1197,1201,1206,1211,1217,1223,1226,1230,1235,1241,1253,1259,1269,1279,1287,1295,1299,1307,1315,1322,1329,1338,1350,1360,1370,1382,1390,1403,1418,1428,1434,1447,1468,1478,1496,1512,1520,1528,1537,1582,1616,1658,1762,2199],"tested_archs":["x86_64","aarch64","arm64"]},"5a3d50e3e91837d6f813a215ecd471122e41fbda":{"description":"Device Training Score","test_version":"1.0.x","app_version":"0.1.2","unit":"Score","samples":1162,"timing_samples":1148,"hib":1,"first_appeared":1594236431,"last_appeared":1705438847,"run_time_avg":1206,"stddev_avg":0,"percentiles":[28,260,421,491,548,574,596,603,611,625,638,677,687,691,706,731,751,776,785,790,818,839,853,861,870,883,897,910,924,949,964,974,986,992,1002,1025,1038,1044,1051,1059,1062,1066,1074,1079,1086,1094,1104,1109,1125,1130,1133,1135,1145,1160,1173,1179,1185,1197,1216,1226,1249,1263,1277,1282,1288,1307,1319,1338,1348,1362,1391,1407,1428,1446,1456,1466,1478,1490,1503,1518,1534,1553,1606,1634,1720,1790,1841,1878,2020,2306,2496,2612,2811,3222,3508,3691,4163,5090,5648,19122],"run_time_percentiles":[379,560,646,705,734,798,859,865,952,979,983,1007,1020,1033,1035,1042,1048,1056,1060,1063,1071,1074,1075,1079,1083,1085,1087,1091,1093,1097,1103,1105,1108,1113,1119,1121,1125,1129,1131,1133,1136,1141,1146,1147,1150,1154,1157,1159,1163,1167,1170,1174,1177,1182,1187,1188,1197,1201,1205,1211,1216,1223,1226,1230,1234,1241,1251,1259,1269,1279,1286,1295,1298,1307,1315,1322,1329,1337,1350,1360,1369,1381,1390,1401,1418,1428,1434,1447,1468,1478,1496,1512,1520,1528,1537,1582,1616,1658,1762,2199],"tested_archs":["x86_64","aarch64","arm64"]}}}
|
||||
25
ob-cache/test-profiles/pts/ai-benchmark-1.0.2/install.sh
Normal file
25
ob-cache/test-profiles/pts/ai-benchmark-1.0.2/install.sh
Normal file
@@ -0,0 +1,25 @@
|
||||
#!/bin/bash
|
||||
|
||||
if which pip3 >/dev/null 2>&1 ;
|
||||
then
|
||||
echo 0 > ~/install-exit-status
|
||||
else
|
||||
echo "ERROR: Python pip3 is not found on the system! This test profile needs Python pip3 to proceed."
|
||||
echo 2 > ~/install-exit-status
|
||||
fi
|
||||
|
||||
pip3 install --user tensorflow==2.9.1
|
||||
pip3 install --user ai-benchmark==0.1.2
|
||||
|
||||
if [[ ! -f "$HOME/.local/bin/ai-benchmark" ]]
|
||||
then
|
||||
echo "ERROR: AI-Benchmark failed to install on the system!"
|
||||
echo 2 > ~/install-exit-status
|
||||
fi
|
||||
|
||||
echo "#!/bin/bash
|
||||
|
||||
cd \$HOME/.local/bin/
|
||||
python3 ./ai-benchmark > \$LOG_FILE 2>&1
|
||||
echo \$? > ~/test-exit-status" > ai-benchmark
|
||||
chmod +x ai-benchmark
|
||||
@@ -0,0 +1,25 @@
|
||||
#!/bin/bash
|
||||
|
||||
if which pip3 >/dev/null 2>&1 ;
|
||||
then
|
||||
echo 0 > ~/install-exit-status
|
||||
else
|
||||
echo "ERROR: Python pip3 is not found on the system! This test profile needs Python pip3 to proceed."
|
||||
echo 2 > ~/install-exit-status
|
||||
fi
|
||||
|
||||
pip3 install --user tensorflow==2.9.1
|
||||
pip3 install --user ai-benchmark==0.1.2
|
||||
|
||||
if [[ ! -f "$HOME/.local/bin/ai-benchmark" ]]
|
||||
then
|
||||
echo "ERROR: AI-Benchmark failed to install on the system!"
|
||||
echo 2 > ~/install-exit-status
|
||||
fi
|
||||
|
||||
echo "#!/bin/bash
|
||||
|
||||
cd \$HOME/Library/Python/3.*/bin/
|
||||
python3 ./ai-benchmark > \$LOG_FILE 2>&1
|
||||
echo \$? > ~/test-exit-status" > ai-benchmark
|
||||
chmod +x ai-benchmark
|
||||
@@ -0,0 +1,16 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Device Inference Score: #_RESULT_#</OutputTemplate>
|
||||
<ArgumentsDescription>Device Inference Score</ArgumentsDescription>
|
||||
</ResultsParser>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Device Training Score: #_RESULT_#</OutputTemplate>
|
||||
<ArgumentsDescription>Device Training Score</ArgumentsDescription>
|
||||
</ResultsParser>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Device AI Score: #_RESULT_#</OutputTemplate>
|
||||
<ArgumentsDescription>Device AI Score</ArgumentsDescription>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1,25 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>AI Benchmark Alpha</Title>
|
||||
<AppVersion>0.1.2</AppVersion>
|
||||
<Description>AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library.</Description>
|
||||
<ResultScale>Score</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>1</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>1.0.2</Version>
|
||||
<SupportedPlatforms>Linux, BSD, MacOSX</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>System</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>python</ExternalDependencies>
|
||||
<RequiresInternet>TRUE</RequiresInternet>
|
||||
<EnvironmentSize>10</EnvironmentSize>
|
||||
<ProjectURL>http://ai-benchmark.com/alpha</ProjectURL>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1 @@
|
||||
{"1.1.3":{"last_updated":"1659825851","commit_description":"This test is still deprecated and not useful when there are tests like FIO, but update download link so at least mirror is serving for those wanting it..."},"1.1.2":{"last_updated":"1601214674","commit_description":"Deprecate aio-stress."},"1.1.1":{"last_updated":"1376422733","commit_description":"Fix aio-stress compilation."},"1.1.0":{"last_updated":"1291658419","commit_description":"Initial import into OpenBenchmarking.org"}}
|
||||
12
ob-cache/test-profiles/pts/aio-stress-1.1.3/downloads.xml
Normal file
12
ob-cache/test-profiles/pts/aio-stress-1.1.3/downloads.xml
Normal file
@@ -0,0 +1,12 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/aio-stress.c</URL>
|
||||
<MD5>727e5fc3566837b3ea72f887d048769b</MD5>
|
||||
<FileName>aio-stress.c</FileName>
|
||||
<FileSize>39513</FileSize>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1 @@
|
||||
{"overview":{"2829059a4752865dce3ac12c01497347a3b14174":{"description":"Test: Random Write","test_version":"1.1.x","app_version":"0.21","unit":"MB\/s","samples":6263,"timing_samples":741,"hib":1,"first_appeared":1298700000,"last_appeared":1708096136,"run_time_avg":148,"stddev_avg":9.39,"percentiles":[0.11,2.49,5.07,7.07,8.8,10.36,11.54,12.61,13.42,14.63,16.12,17.68,18.77,20.7,22.1,24.26,25.84,28.12,29.79,30.97,32.99,35.83,39.02,42.52,47.72,51.34,55.4,58.65,62.07,68.01,74.49,82.1,91.68,99.98,111.33,122.4,135.18,139.05,144.71,157.22,174.46,188.49,203.64,222.5,242.34,261.19,284.98,313.32,341.25,372.3,396.39,429.8,461.2,497.2,538.38,581.94,630.45,680.19,721.47,771.65,837.14,895.04,938.05,991.19,1029.66,1072.45,1122.99,1180.32,1252.77,1319.31,1374.3,1416.16,1479.2,1531.54,1596.17,1637.39,1678.38,1745.03,1790.89,1848.82,1917.18,1997.51,2070.08,2151.41,2166.72,2197.63,2284.9,2376.22,2439.56,2571.14,2679.23,2820.7,2958.07,3057.58,3209.87,3446.23,3552,3638.31,3828.9,4269.57],"run_time_percentiles":[1.7200000000000002,2.8499999999999996,3.34,3.7199999999999998,3.84,4,4.27,4.48,4.73,5.09,5.41,5.72,5.99,6.379999999999999,6.52,7.18,8.52,9.55,10,10,11,11,11,12,12,13,14,15,16,17,17,17,20,22,23,24,24,26,28,30,31,31,32,33,34,34,35,37,38,42,45,48,50,52,55,56,58,61,62,63,65,70,72,73,77,79,81,83,86,88,96,101,106,112,116,124,130,136,148,163,186,203,215,233,242,254,268,293,352,372,426,446,480,531,586,724,894,1060,1218,1525],"tested_archs":["x86_64","i686","ppc64le","armv7l","mips64","ppc64","aarch64","armv6l","mips64el"]},"f4f9a92cea869281661787dedbabbf000d252bea":{"description":"Random Write","test_version":"1.1.x","app_version":"0.21","unit":"MB\/s","samples":2960,"timing_samples":262,"hib":1,"first_appeared":1298700000,"last_appeared":1707157794,"run_time_avg":95,"stddev_avg":6.43,"percentiles":[0.53,3.63,6.15,8.48,10.05,12.33,13.36,15.39,17.85,20.53,23.46,25.41,29.18,33.9,37.82,42.48,46.21,49.52,56.28,62.72,70.8,80.35,88.55,101.07,113.84,129.52,149.09,173.31,191.48,210.56,233.5,267.63,300.94,340.51,391.16,446.19,497.76,550.9,606.8,649.4,682.41,727,779,810.99,835.06,861.85,898.34,934.16,976.06,1025.64,1054.05,1093.77,1131.8,1168,1212.77,1275,1331.53,1373.41,1398.13,1429.7,1464.03,1488,1523.91,1558.14,1592.18,1629.13,1684.41,1728.83,1776.49,1820.27,1862.01,1899.03,1923.76,1944.38,1979.05,2011.05,2042.17,2068.85,2105.32,2149.79,2183.86,2215.6,2253.16,2292.94,2340.76,2373.33,2421.18,2467.18,2503.61,2540.16,2591.14,2645.37,2732.25,2798.48,2885.71,3042.85,3144.34,3344.46,3599.46,3910.81],"run_time_percentiles":[2.07,3.54,4.2,4.359999999999999,4.52,4.5600000000000005,5.2299999999999995,5.81,6.09,6.19,6.369999999999999,6.57,7.039999999999999,7.4399999999999995,7.449999999999999,8.07,8.15,8.26,8.59,8.66,8.93,9.02,9.16,9.51,9.61,9.69,9.74,9.959999999999999,10,10,11,11,11,12,12,13,13,14,17,18,18,19,20,20,21,21,23,25,26,26,27,28,29,30,31,31,31,32,35,37,39,42,44,46,47,48,49,53,56,57,61,63,63,69,71,73,79,79,82,88,94,108,117,129,139,143,164,168,193,212,243,249,299,325,411,448,489,596,808,1240],"tested_archs":["x86_64","i686","ppc","armv7l","armv5tel","armv6l","sparc64","aarch64","ppc64","ppc64le"]},"f741d1daf21b100843b4f58c3dfcd4ef82391acd":{"description":"","test_version":"1.1.x","app_version":"0.21","unit":"MB\/s","samples":20,"timing_samples":13,"hib":1,"first_appeared":1519443538,"last_appeared":1558024404,"run_time_avg":112,"stddev_avg":1.68,"percentiles":[874.72,874.72,874.72,874.72,874.72,1145.51,1145.51,1145.51,1145.51,1145.51,1726.03,1726.03,1726.03,1726.03,1726.03,1779.25,1779.25,1779.25,1779.25,1779.25,2137.06,2137.06,2137.06,2137.06,2137.06,2168.91,2168.91,2168.91,2168.91,2168.91,2417.96,2417.96,2417.96,2417.96,2417.96,3259.43,3259.43,3259.43,3259.43,3259.43,3529.37,3529.37,3529.37,3529.37,3529.37,4029.93,4029.93,4029.93,4029.93,4029.93,4053,4053,4053,4053,4053,4254,4254,4254,4254,4254,4315.17,4315.17,4315.17,4315.17,4315.17,4342,4342,4342,4342,4342,4454.4,4454.4,4454.4,4454.4,4454.4,4502.18,4502.18,4502.18,4502.18,4502.18,4511.63,4511.63,4511.63,4511.63,4511.63,4516.85,4516.85,4516.85,4516.85,4516.85,4675.08,4675.08,4675.08,4675.08,4675.08,5109.61,5109.61,5109.61,5109.61,5109.61],"run_time_percentiles":[74,74,74,74,74,74,74,74,76,76,76,76,76,76,76,76,81,81,81,81,81,81,81,81,104,104,104,104,104,104,104,105,105,105,105,105,105,105,105,105,105,105,105,105,105,105,105,115,115,115,115,115,115,115,127,127,127,127,127,127,127,127,129,129,129,129,129,129,129,129,130,130,130,130,130,130,130,134,134,134,134,134,134,134,134,136,136,136,136,136,136,136,136,137,137,137,137,137,137,137],"tested_archs":["x86_64"]}}}
|
||||
11
ob-cache/test-profiles/pts/aio-stress-1.1.3/install.sh
Normal file
11
ob-cache/test-profiles/pts/aio-stress-1.1.3/install.sh
Normal file
@@ -0,0 +1,11 @@
|
||||
#!/bin/sh
|
||||
|
||||
cc -Wall -O3 -pthread -o aio-stress-bin aio-stress.c -laio
|
||||
echo $? > ~/install-exit-status
|
||||
|
||||
# add support for allowing aio-test-file to be on removable media devices
|
||||
echo "#!/bin/sh
|
||||
./aio-stress-bin \$@ aio-test-file > \$LOG_FILE 2>&1
|
||||
echo \$? > ~/test-exit-status
|
||||
rm -f aio-test-file" > aio-stress
|
||||
chmod +x aio-stress
|
||||
@@ -0,0 +1,16 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>adding stage random write
|
||||
dropping thread count to the number of contexts 1
|
||||
starting with random write
|
||||
file size 1024MB, record size 64KB, depth 64, ios per iteration 8
|
||||
max io_submit 8, buffer alignment set to 4KB
|
||||
threads 1 files 1 contexts 1 context offset 2MB verification off
|
||||
random write on aio-test-file (#_RESULT_# MB/s) 1024.00 MB in 3.84s
|
||||
thread 0 random write totals (63.36 MB/s) 1024.00 MB in 16.16s
|
||||
Running single thread version</OutputTemplate>
|
||||
<LineHint>random write on aio-test-file</LineHint>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1,40 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>AIO-Stress</Title>
|
||||
<AppVersion>0.21</AppVersion>
|
||||
<Description>AIO-Stress is an a-synchronous I/O benchmark created by SuSE. Current this profile uses a 2048MB test file and a 64KB record size.</Description>
|
||||
<ResultScale>MB/s</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>1.1.3</Version>
|
||||
<SupportedPlatforms>Linux</SupportedPlatforms>
|
||||
<SoftwareType>Benchmark</SoftwareType>
|
||||
<TestType>Disk</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Deprecated</Status>
|
||||
<ExternalDependencies>build-utilities, libaio-development</ExternalDependencies>
|
||||
<EnvironmentSize>0.5</EnvironmentSize>
|
||||
<EnvironmentTestingSize>1024</EnvironmentTestingSize>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>-s 2g -r 64k -t 3</Arguments>
|
||||
</Default>
|
||||
<Option>
|
||||
<DisplayName>Test</DisplayName>
|
||||
<Identifier>test</Identifier>
|
||||
<ArgumentPrefix>-o </ArgumentPrefix>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Random Write</Name>
|
||||
<Value>2</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
@@ -1 +1 @@
|
||||
{"1.2.1":{"last_updated":"1587821615","commit_description":"Build fix for GCC 10 over -fcommon."},"1.2.0":{"last_updated":"1578702218","commit_description":"Update against aircrack-ng 1.5.2 upstream."},"1.1.2":{"last_updated":"1544204113","commit_description":"Add FreeBSD support - https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/49"},"1.1.1":{"last_updated":"1534766496","commit_description":"Libtool is a needed external dependency."},"1.1.0":{"last_updated":"1534764076","commit_description":"Just default to the program selection of optimal SIMD mode for given CPU than punting it out as a test option."},"1.0.0":{"last_updated":"1534721886","commit_description":"Initial commit of aircrack-ng."}}
|
||||
{"1.3.0":{"last_updated":"1658341022","commit_description":"Update against aircrack-ng 1.7 upstream."},"1.2.1":{"last_updated":"1587821615","commit_description":"Build fix for GCC 10 over -fcommon."},"1.2.0":{"last_updated":"1578702218","commit_description":"Update against aircrack-ng 1.5.2 upstream."},"1.1.2":{"last_updated":"1544204113","commit_description":"Add FreeBSD support - https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/49"},"1.1.1":{"last_updated":"1534766496","commit_description":"Libtool is a needed external dependency."},"1.1.0":{"last_updated":"1534764076","commit_description":"Just default to the program selection of optimal SIMD mode for given CPU than punting it out as a test option."},"1.0.0":{"last_updated":"1534721886","commit_description":"Initial commit of aircrack-ng."}}
|
||||
@@ -1 +1 @@
|
||||
{"overview":{"d2d7056061e60fa2028ce3c43a2c5b9ef1054d15":{"description":"","test_version":"1.2.x","app_version":"1.5.2","unit":"k\/s","samples":1239,"timing_samples":1084,"hib":1,"first_appeared":1298700000,"last_appeared":1644671738,"run_time_avg":91,"stddev_avg":0.35,"percentiles":[21.301,564.86,732.609,859.239,1135.158,1312.751,2374.469,2988.239,4528.306,5530.121,6080.323,7097.289,9816.583,10871.199,11782.264,12645.586,14110.899,15308.778,16315.864,21261.418,22510.359,23406.397,23578.213,24041.231,25302.454,26000.194,28094.217,29153.007,30745.605,31941.767,32820.82,34428.901,35831.751,36549.701,39171.317,41967.424,42837.239,43380.448,44509.906,45816.605,46017.203,46918.01,48195.792,49602.012,49828.659,51441.775,56060.484,56987.685,58522.66,61096.182,61777.853,63293.533,67285.917,70179.706,71372.792,73241.349,74570.422,74867.396,75232.563,76600.156,78155.112,81288.125,85859.643,87239.099,89544.31,91122.013,93309.013,95752.747,102066.641,105477.352,112289.3,114487.602,117948.081,119683.651,121307.56,122135.474,123965.623,136235.312,140660.365,143169.12,147145.813,150246.589,153409.854,154391.141,158501.557,171180.016,176411.323,183954.51,187755.724,191463.005,208055.63,210157.651,212825.677,235281.64,269072.198,279013.979,305708.052,342733.521,369565.886,411439.698],"run_time_percentiles":[90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,91,91,91,91,91,91,91,91,91,91,91,91,91,91],"tested_archs":["alpha","s390x","aarch64","x86_64","i686","ppc64le","armv7l","armv6l"]}},"capabilities":{"shared_libraries":["libsqlite3.so.0","libcrypto.so.3","libhwloc.so.15","libc.so.6","libm.so.6","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}
|
||||
{"overview":{"d2d7056061e60fa2028ce3c43a2c5b9ef1054d15":{"description":"","test_version":"1.2.x","app_version":"1.5.2","unit":"k\/s","samples":1096,"timing_samples":918,"hib":1,"first_appeared":1298700000,"last_appeared":1685944538,"run_time_avg":91,"stddev_avg":0.43,"percentiles":[21.301,332.595,647.897,777.105,938.198,1156.666,1312.751,1641.83,2457.92,2919.638,4043.208,4950.609,5682.671,6215.89,7331.648,9816.583,10871.199,11773.423,12412.329,13567.158,14380.628,15542.016,17014.166,21410.086,22528.883,23406.397,23857.538,25302.454,26000.194,28138.343,29153.007,30569.77,31725.17,32502.932,33230.017,35086.951,36381.721,37038.971,41283.053,42027.096,42773.974,43380.448,44185.456,44989.962,45911.889,46844.139,48284.826,50066.117,54172.197,57070.345,58522.66,60814.93,61777.853,63293.533,67381.812,71372.792,72583.789,74312.841,74674.698,74876.414,75278.799,75955.109,78991.187,82555.857,86054.253,87391.794,89843.268,92662.643,93833.212,96854.951,102274.19,105842.414,113476.435,115023.461,118324.172,120042.941,121945.805,123965.623,134900.094,136964.25,143877.719,147145.813,149434.375,153749.041,155994.026,173042.464,178112.75,183954.51,188211.141,191730.766,206728.807,209353.656,211019.99,234676.412,269132.531,278601.802,309044.362,360016.052,399462.01,412355.927],"run_time_percentiles":[90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,91,91,91,91,91,91,91,91,91,91,91,91,91,91,92],"tested_archs":["alpha","s390x","aarch64","loongarch64","i686","x86_64","riscv64","ppc64le","armv7l","armv6l"]}},"capabilities":{"shared_libraries":["libsqlite3.so.0","libcrypto.so.3","libhwloc.so.15","libc.so.6","libm.so.6","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}
|
||||
@@ -0,0 +1 @@
|
||||
{"1.3.0":{"last_updated":"1658341022","commit_description":"Update against aircrack-ng 1.7 upstream."},"1.2.1":{"last_updated":"1587821615","commit_description":"Build fix for GCC 10 over -fcommon."},"1.2.0":{"last_updated":"1578702218","commit_description":"Update against aircrack-ng 1.5.2 upstream."},"1.1.2":{"last_updated":"1544204113","commit_description":"Add FreeBSD support - https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/49"},"1.1.1":{"last_updated":"1534766496","commit_description":"Libtool is a needed external dependency."},"1.1.0":{"last_updated":"1534764076","commit_description":"Just default to the program selection of optimal SIMD mode for given CPU than punting it out as a test option."},"1.0.0":{"last_updated":"1534721886","commit_description":"Initial commit of aircrack-ng."}}
|
||||
22
ob-cache/test-profiles/pts/aircrack-ng-1.3.0/downloads.xml
Normal file
22
ob-cache/test-profiles/pts/aircrack-ng-1.3.0/downloads.xml
Normal file
@@ -0,0 +1,22 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>https://download.aircrack-ng.org/aircrack-ng-1.7.tar.gz</URL>
|
||||
<MD5>a918ea7146f91d8c799fb770c38f4bec</MD5>
|
||||
<SHA256>05a704e3c8f7792a17315080a21214a4448fd2452c1b0dd5226a3a55f90b58c3</SHA256>
|
||||
<FileName>aircrack-ng-1.7.tar.gz</FileName>
|
||||
<FileSize>7740634</FileSize>
|
||||
<PlatformSpecific>Linux, BSD</PlatformSpecific>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>https://download.aircrack-ng.org/aircrack-ng-1.7-win.zip</URL>
|
||||
<MD5>37af71e78813e897297cca59cc0f70b7</MD5>
|
||||
<SHA256>767a456bf0675032d37d3c8caf05e2e5dcb105c218614b2e4e42b51370d05205</SHA256>
|
||||
<FileName>aircrack-ng-1.7-win.zip</FileName>
|
||||
<FileSize>12187975</FileSize>
|
||||
<PlatformSpecific>Windows</PlatformSpecific>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1 @@
|
||||
{"overview":{"3410d84ae27222a43194d8f23ebe47214f5f0a4c":{"description":"","test_version":"1.3.x","app_version":"1.7","unit":"k\/s","samples":660,"timing_samples":472,"hib":1,"first_appeared":1658341083,"last_appeared":1708030825,"run_time_avg":121,"stddev_avg":0.57,"percentiles":[185.712,717.452,1056.863,1533.028,1554.702,2828.087,4511.38,5679.547,6330.689,8308.58,10845.705,10853.684,12327.782,13177.493,13901.608,14278.955,15240.032,15861.852,17059.544,19692.105,20926.953,22985.176,22997.307,23015.182,23361.854,23834.895,24326.692,25600.648,26385.408,26808.277,27168.783,28607.353,28988.186,29282.41,29537.933,30167.784,30980.769,31809.872,32138.42,32420.542,33339.81,33647.548,34813.75,35752.578,36348.24,37546.297,37882.18,38549.703,39568.315,40095.85,40912.359,40936.625,41097.704,41961.466,42058.29,43648.758,44347.105,45575.689,46300.818,46726.076,47149.558,49448.236,50609.276,51494.668,52401.87,53055.453,58566.391,61211.798,61373.603,61653.867,62268.641,66599.039,69849.534,69948.187,70092.234,72763.094,74001.531,76103.367,85231.198,85791.701,87842.211,88343.224,88764.997,88889.464,90173.539,99753.68,115236.185,118827.708,119800.427,127694.852,130573.645,140142.057,149298.135,149778.797,154271.743,159452.823,165289.688,174395.482,177255.708,277535.281],"run_time_percentiles":[90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,92,92,93,93,120,121,121,151,181,302,363,427,453,453,453,453,453],"tested_archs":["aarch64","x86_64","i686","ppc64","loongarch64"]}},"capabilities":{"shared_libraries":["libsqlite3.so.0","libcrypto.so.3","libhwloc.so.15","libc.so.6","libm.so.6","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}
|
||||
26
ob-cache/test-profiles/pts/aircrack-ng-1.3.0/install.sh
Normal file
26
ob-cache/test-profiles/pts/aircrack-ng-1.3.0/install.sh
Normal file
@@ -0,0 +1,26 @@
|
||||
#!/bin/sh
|
||||
tar -xf aircrack-ng-1.7.tar.gz
|
||||
cd aircrack-ng-1.7
|
||||
export CFLAGS="-O3 -fcommon $CFLAGS"
|
||||
export CXXFLAGS="-O3 -fcommon $CXFLAGS"
|
||||
if [ "$OS_TYPE" = "BSD" ]
|
||||
then
|
||||
if [ -e /usr/local/lib/libcrypto.so ]
|
||||
then
|
||||
env MAKE=gmake CFLAGS=-I/usr/local/include LDFLAGS=-L/usr/local/lib ./autogen.sh
|
||||
else
|
||||
env MAKE=gmake ./autogen.sh
|
||||
fi
|
||||
gmake -j $NUM_CPU_CORES
|
||||
else
|
||||
./autogen.sh
|
||||
make -j $NUM_CPU_CORES
|
||||
fi
|
||||
echo $? > ~/install-exit-status
|
||||
|
||||
cd ~
|
||||
echo "#!/bin/sh
|
||||
cd aircrack-ng-1.7
|
||||
./aircrack-ng -p \$NUM_CPU_CORES \$@ 2>&1 | tr '\\r' '\\n' | awk -v max=0 '{if(\$1>max){max=\$1}}END{print max \" k/s\"}' > \$LOG_FILE
|
||||
echo \$? > ~/test-exit-status" > aircrack-ng
|
||||
chmod +x aircrack-ng
|
||||
@@ -0,0 +1,8 @@
|
||||
#!/bin/sh
|
||||
unzip -o aircrack-ng-1.7-win.zip
|
||||
|
||||
echo "#!/bin/sh
|
||||
cd aircrack-ng-1.7-win/bin
|
||||
./aircrack-ng.exe \$@ 2>&1 | tr '\\r' '\\n' | awk -v max=0 '{if(\$1>max){max=\$1}}END{print max \" k/s\"}' > \$LOG_FILE
|
||||
echo \$? > ~/test-exit-status" > aircrack-ng
|
||||
chmod +x aircrack-ng
|
||||
@@ -0,0 +1,7 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>#_RESULT_# k/s</OutputTemplate>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
@@ -0,0 +1,31 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>Aircrack-ng</Title>
|
||||
<AppVersion>1.7</AppVersion>
|
||||
<Description>Aircrack-ng is a tool for assessing WiFi/WLAN network security.</Description>
|
||||
<ResultScale>k/s</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>1.3.0</Version>
|
||||
<SupportedPlatforms>Linux, BSD, Windows</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>Processor</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>build-utilities, openssl-development, libtool</ExternalDependencies>
|
||||
<EnvironmentSize>25</EnvironmentSize>
|
||||
<ProjectURL>https://www.aircrack-ng.org/</ProjectURL>
|
||||
<RepositoryURL>https://github.com/aircrack-ng/aircrack-ng</RepositoryURL>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
<SystemDependencies>libnl-genl-3.so</SystemDependencies>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>-S -Z 30</Arguments>
|
||||
</Default>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
@@ -1 +1 @@
|
||||
{"overview":{"69526d521378438e5f655dcb6fb765bcc0a1f739":{"description":"","test_version":"1.1.x","app_version":"1.2","unit":"Figure Of Merit","samples":803,"timing_samples":674,"hib":1,"first_appeared":1610314372,"last_appeared":1644614345,"run_time_avg":76,"stddev_avg":0.38,"percentiles":[11598791,48455720,79329519,100256967,104900300,111657933,118125933,122317033,126339000,135503067,142650533,151352533,158158533,162813667,171060000,178649867,180582833,182989900,187064700,190828733,197095100,197783100,203466800,206211667,207396300,209751500,211532933,212380367,213491533,215459633,218828933,220939167,223191833,225469833,226736933,233286800,234747267,236594433,237665667,237882700,239904300,246834133,248944067,252787967,258316567,259622700,263139500,269008333,274539633,279353800,284822367,302617633,306343067,333464900,362705800,388631100,405894633,423545833,449916460,455725033,455987533,461967333,555149067,569584800,643180925,698523743,715046633,766191002,774304800,776102500,778528698,788266875,828037633,856893400,862041616,880998567,892248833,909532667,994860367,1008908000,1015392664,1028804667,1082117000,1084411667,1174487333,1251105333,1437771333,1448026333,1469068333,1477345667,1513203000,1641018330,1682638000,1886144333,1908343333,1915276000,1925810000,1942166475,2056553667,2169275000],"run_time_percentiles":[19,25,30,30,32,33,34,35,35,35,36,37,38,39,40,40,41,42,42,42,43,44,44,45,46,47,48,49,49,50,50,50,51,52,53,53,54,54,55,55,56,56,57,58,58,59,59,59,59,60,60,60,61,62,62,63,64,65,66,67,67,68,68,69,71,71,72,74,77,78,82,83,85,88,93,96,97,102,106,106,110,113,120,121,122,123,124,125,125,126,128,130,131,137,145,148,169,176,228,294],"tested_archs":["x86_64","aarch64","ppc64le","loongarch64"]}},"capabilities":{"shared_libraries":["libm.so.6","libmpi.so.40","libgomp.so.1","libc.so.6","libopen-rte.so.40","libopen-pal.so.40","libhwloc.so.15","libz.so.1","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}
|
||||
{"overview":{"69526d521378438e5f655dcb6fb765bcc0a1f739":{"description":"","test_version":"1.1.x","app_version":"1.2","unit":"Figure Of Merit","samples":1937,"timing_samples":1572,"hib":1,"first_appeared":1610314372,"last_appeared":1708306443,"run_time_avg":96,"stddev_avg":0.34,"percentiles":[5399313,47416048,79989370,97335947,105854833,117077667,126186033,141639567,153946400,162645667,171020687,180576900,186550500,190611300,196063733,203466800,207396300,209997300,212790133,216410733,221044600,224467600,226736933,232651900,236364233,236840200,238166033,243764700,249308100,254272900,259411100,265467500,269210500,275577975,283664715,293931600,305828500,318448533,356193300,360396650,368590800,373158700,377134100,385110420,387234000,396403133,413901867,421885375,431857267,439998067,453791600,455987533,526662133,569326033,628017667,695048500,763136167,776102500,790178362,856893400,883735200,910060867,926684567,1007308000,1012765000,1016181000,1028805333,1044983000,1057050667,1065483667,1082117000,1110140000,1242423333,1386811000,1466522667,1495535333,1611826000,1641018330,1675197000,1718826333,1818800333,1889431000,1911925333,1917570000,1926452000,1935317000,1988543333,1998897333,2038989000,2065741000,2119944667,2209036667,2332743667,2355505667,2872242308,3174538667,3830123000,4255809000,4358309667,4545229333],"run_time_percentiles":[15,24,28,30,32,34,35,36,37,38,40,41,42,43,44,45,46,47,48,49,49,50,50,51,51,52,52,53,53,54,54,55,55,56,56,57,58,58,59,59,60,60,60,61,62,63,63,63,64,65,66,66,67,67,68,68,70,70,71,71,72,74,76,78,79,82,84,85,87,89,93,96,97,101,102,104,106,108,108,111,112,115,116,121,122,124,125,126,128,135,144,148,155,173,210,216,231,272,364,559],"tested_archs":["loongarch64","aarch64","i686","x86_64","ppc64le"]}},"capabilities":{"shared_libraries":["libm.so.6","libmpi.so.40","libgomp.so.1","libc.so.6","libopen-rte.so.40","libopen-pal.so.40","libhwloc.so.15","libz.so.1","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}
|
||||
@@ -1 +1 @@
|
||||
{"overview":{"bd9b448de8b7bbc2ad9a76a226264c6d6c2c7f7d":{"description":"Size: 2048 x 2048 - Total Time","test_version":"1.0.x","app_version":"","unit":"Seconds","samples":3272,"timing_samples":2587,"hib":0,"first_appeared":1517180843,"last_appeared":2147512538,"run_time_avg":275,"stddev_avg":1.04,"percentiles":[19.107,21.537,24.412,26.059,27.119,27.788,28.411,28.886,29.391,29.991,30.674,31.11,31.48,31.95,32.43,33.16,33.463,34.02,34.6,35.13,35.53,36.05,36.61,36.889,37.649,38.12,38.61,38.79,39.08,39.278,39.402,39.74,40.01,40.21,40.4,40.565,40.75,41,41.256,41.58,42.03,42.44,42.83,43.46,44.14,44.53,45.1,46.14,46.76,47.36,48.08,48.99,49.86,50.774,51.49,52.63,53.88,54.79,55.52,56.56,57.78,58.8,60.02,61.97,62.834,64.11,65.71,67.19,68.13,70.44,73.08,75.08,76.34,77.828,79.716,81.98,85.16,88.81,92.16,94.62,100.03,106.8,111.185,120.36,124.578,137.3,146,153,162.67,172.46,180.46,192,235.31,261.3,285.13,296.34,334,385.64,490.316,649.38],"run_time_percentiles":[57,65,73,77,81,82,85,86,87,89,91,93,94,95,96,97,100,100,102,104,105,106,108,109,111,111,114,115,116,116,117,118,118,119,120,120,121,121,122,122,123,124,124,126,127,129,132,134,137,139,142,143,146,149,152,154,159,162,166,170,176,178,183,189,194,199,205,218,226,232,237,243,250,263,269,278,286,304,323,349,372,401,431,446,466,487,517,519,549,578,685,760,819,856,898,976,1083,1170,1371,1577],"tested_archs":["x86_64","ppc64le","s390x","aarch64","sparc64","alpha","riscv64","i686","armv7l","arm64","ppc","mips64","e2k","armv8l","armv6l","arm","loongarch64"]}},"capabilities":{"shared_libraries":["libm.so.6","libc.so.6"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2","AVX","FMA","AVX512"],"honors_cflags":"1","scales_cpu_cores":"0"}}
|
||||
{"overview":{"bd9b448de8b7bbc2ad9a76a226264c6d6c2c7f7d":{"description":"Size: 2048 x 2048 - Total Time","test_version":"1.0.x","app_version":"","unit":"Seconds","samples":3791,"timing_samples":3144,"hib":0,"first_appeared":1298700000,"last_appeared":2147512538,"run_time_avg":317,"stddev_avg":1.05,"percentiles":[15.624,21.284,22.731,24.676,26.147,27.02,27.674,28.31,28.8,29.32,29.745,30.435,30.872,31.232,31.547,31.982,32.321,32.94,33.402,33.868,34.421,35.078,35.48,35.978,36.212,36.68,37.011,37.678,38.132,38.6,38.79,39.11,39.312,39.48,39.88,40.168,40.36,40.54,40.721,41.091,41.37,41.75,42.337,42.72,43.34,43.88,44.197,44.39,44.86,45.54,46.16,47.022,47.515,48.46,49.361,50.46,51.47,52.703,54.001,54.81,55.53,56.18,57.57,58.83,60.553,61.985,62.7,64.01,65.71,67.28,68.48,71.05,73.758,75.5,76.839,78.887,80.915,83.69,87.62,90.61,94.202,99.714,104.94,110.943,119.78,124.511,140,147.1,156,169.64,173.13,187.36,211.91,251.64,273,287.64,329.472,368.838,473.927,601.7],"run_time_percentiles":[47,65,69,74,79,81,83,85,86,87,90,91,93,94,95,96,97,99,100,101,103,105,106,107,108,109,111,111,113,115,116,116,117,118,118,119,120,121,121,122,123,124,125,127,129,131,133,133,135,137,139,142,144,147,151,154,159,163,166,168,175,178,184,187,192,198,204,215,225,231,237,244,253,266,276,283,300,316,338,362,393,431,449,468,494,517,523,569,640,738,779,841,867,936,1035,1143,1300,1577,1897,2143],"tested_archs":["x86_64","ppc64le","s390x","loongarch64","aarch64","sparc64","alpha","riscv64","i686","armv7l","arm64","ppc","mips64","e2k","armv8l","armv6l","arm"]}},"capabilities":{"shared_libraries":["libm.so.6","libc.so.6"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2","AVX","FMA","AVX512"],"honors_cflags":"1","scales_cpu_cores":"0"}}
|
||||
1
ob-cache/test-profiles/pts/aom-av1-3.4.0/changelog.json
Normal file
1
ob-cache/test-profiles/pts/aom-av1-3.4.0/changelog.json
Normal file
@@ -0,0 +1 @@
|
||||
{"3.4.0":{"last_updated":"1655544139","commit_description":"Update against AOM v3.4 upstream."},"3.3.0":{"last_updated":"1645125446","commit_description":"Update against AOM-AV1 3.3 upstream."},"3.2.0":{"last_updated":"1634254352","commit_description":"Update against upstream libaom v3.2.0 release, drop Windows support for now since the Appveyor builds stopped, also unify versioning."},"2.4.0":{"last_updated":"1620318386","commit_description":"Update against libaom 3.1 upstream."},"2.3.0":{"last_updated":"1616591956","commit_description":"Update against v3.0 upstream, add 4K video option too now that libaom is faster than before..."},"2.2.0":{"last_updated":"1615556384","commit_description":"Update against libaom 2.1-rc1 Git state, increase tile settings."},"2.1.2":{"last_updated":"1599928929","commit_description":"Speedup installation per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/158"},"2.1.1":{"last_updated":"1589911361","commit_description":"Update argument options."},"2.1.0":{"last_updated":"1589893519","commit_description":"Update against libaom 2.0.0."},"2.0.2":{"last_updated":"1578683006","commit_description":"Cap number of threads for AOM encoding to 64 threads, otherwise the program errors out due to its MAX_NUM_THREADS."},"2.0.1":{"last_updated":"1578682331","commit_description":"Add Windows support."},"2.0.0":{"last_updated":"1578680871","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/112 plus also rebase to latest AOM Git."},"1.2.0":{"last_updated":"1568659804","commit_description":"Update per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/101 re-base to AOM Git as of 2019-09-16."},"1.1.0":{"last_updated":"1549915618","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/58 plus fixing FPS reporting, switch to using AOM AV1 Git as of today, multi-threading is used by default by upstream aomenc already, and other changes."},"1.0.0":{"last_updated":"1522420880","commit_description":"Initial work on the AOM AV1 video encode test profile, but not too practical yet given the current extremely slow speed of the encoder, etc. So mostly a placeholder until that code is in better shape."}}
|
||||
35
ob-cache/test-profiles/pts/aom-av1-3.4.0/downloads.xml
Normal file
35
ob-cache/test-profiles/pts/aom-av1-3.4.0/downloads.xml
Normal file
@@ -0,0 +1,35 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.3-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
|
||||
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
|
||||
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>676792531</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
|
||||
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
|
||||
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>2804470345</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-340.tar.xz</URL>
|
||||
<MD5>1fb6341b4cf686d066d52ada5bdf581f</MD5>
|
||||
<SHA256>a7552aae8d6e659326d2b1be7f41bac996c95723d3e77f1804143aac3c584d96</SHA256>
|
||||
<FileName>aom-340.tar.xz</FileName>
|
||||
<FileSize>3678784</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-310-win64.zip</URL>
|
||||
<MD5>7b7aa1f8d64f8a9e0f83cbef82370f82</MD5>
|
||||
<SHA256>eb2765db33fcbca79466d8f29f28be6b95f1a7d2ade0ee67f0ebaf190f73dfd8</SHA256>
|
||||
<FileName>aom-310-win64.zip</FileName>
|
||||
<FileSize>4113883</FileSize>
|
||||
<PlatformSpecific>Windows</PlatformSpecific>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/aom-av1-3.4.0/generated.json
Normal file
1
ob-cache/test-profiles/pts/aom-av1-3.4.0/generated.json
Normal file
File diff suppressed because one or more lines are too long
25
ob-cache/test-profiles/pts/aom-av1-3.4.0/install.sh
Normal file
25
ob-cache/test-profiles/pts/aom-av1-3.4.0/install.sh
Normal file
@@ -0,0 +1,25 @@
|
||||
#!/bin/sh
|
||||
|
||||
tar -xf aom-340.tar.xz
|
||||
cd aom/build
|
||||
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
|
||||
make -j $NUM_CPU_CORES
|
||||
echo $? > ~/install-exit-status
|
||||
cd ~
|
||||
|
||||
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
|
||||
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
|
||||
|
||||
echo "#!/bin/sh
|
||||
|
||||
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
|
||||
NUM_CPU_CORES=64
|
||||
fi
|
||||
|
||||
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
|
||||
echo \$? > ~/test-exit-status
|
||||
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
|
||||
rm -f test.av1" > aom-av1
|
||||
chmod +x aom-av1
|
||||
19
ob-cache/test-profiles/pts/aom-av1-3.4.0/install_windows.sh
Normal file
19
ob-cache/test-profiles/pts/aom-av1-3.4.0/install_windows.sh
Normal file
@@ -0,0 +1,19 @@
|
||||
#!/bin/sh
|
||||
|
||||
unzip -o aom-310-win64.zip
|
||||
chmod +x aomenc.exe
|
||||
|
||||
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
|
||||
echo "#!/bin/sh
|
||||
|
||||
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
|
||||
NUM_CPU_CORES=64
|
||||
fi
|
||||
|
||||
./aomenc.exe --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
|
||||
echo \$? > ~/test-exit-status
|
||||
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
|
||||
rm -f test.av1" > aom-av1
|
||||
chmod +x aom-av1
|
||||
@@ -0,0 +1,9 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.3-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
|
||||
<LineHint>fps</LineHint>
|
||||
<TurnCharsToSpace>(</TurnCharsToSpace>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
80
ob-cache/test-profiles/pts/aom-av1-3.4.0/test-definition.xml
Normal file
80
ob-cache/test-profiles/pts/aom-av1-3.4.0/test-definition.xml
Normal file
@@ -0,0 +1,80 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.3-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>AOM AV1</Title>
|
||||
<AppVersion>3.4</AppVersion>
|
||||
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
|
||||
<ResultScale>Frames Per Second</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>3.4.0</Version>
|
||||
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>Processor</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
|
||||
<EnvironmentSize>1950</EnvironmentSize>
|
||||
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
|
||||
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
|
||||
<InternalTags>SMP</InternalTags>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>--tile-columns=2 --tile-rows=2 --row-mt=1</Arguments>
|
||||
</Default>
|
||||
<Option>
|
||||
<DisplayName>Encoder Mode</DisplayName>
|
||||
<Identifier>enc-mode</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Speed 10 Realtime</Name>
|
||||
<Value>--cpu-used=10 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 9 Realtime</Name>
|
||||
<Value>--cpu-used=9 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 8 Realtime</Name>
|
||||
<Value>--cpu-used=8 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Realtime</Name>
|
||||
<Value>--cpu-used=6 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Two-Pass</Name>
|
||||
<Value>--cpu-used=6</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 4 Two-Pass</Name>
|
||||
<Value>--cpu-used=4</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 0 Two-Pass</Name>
|
||||
<Value>--cpu-used=0 --limit=20</Value>
|
||||
<Message>Slowest</Message>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
<Option>
|
||||
<DisplayName>Input</DisplayName>
|
||||
<Identifier>input</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Bosphorus 1080p</Name>
|
||||
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Bosphorus 4K</Name>
|
||||
<Value>Bosphorus_3840x2160.y4m</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
35
ob-cache/test-profiles/pts/aom-av1-3.5.0/downloads.xml
Normal file
35
ob-cache/test-profiles/pts/aom-av1-3.5.0/downloads.xml
Normal file
@@ -0,0 +1,35 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
|
||||
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
|
||||
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>676792531</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
|
||||
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
|
||||
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>2804470345</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-350.tar.xz</URL>
|
||||
<MD5>4bad477efe71208b0a190efd1fc5da8b</MD5>
|
||||
<SHA256>7d4d88d2b0cea58243aa422f5ee4656a676b8a74170fbc29a2f36eb310446740</SHA256>
|
||||
<FileName>aom-350.tar.xz</FileName>
|
||||
<FileSize>3690192</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-310-win64.zip</URL>
|
||||
<MD5>7b7aa1f8d64f8a9e0f83cbef82370f82</MD5>
|
||||
<SHA256>eb2765db33fcbca79466d8f29f28be6b95f1a7d2ade0ee67f0ebaf190f73dfd8</SHA256>
|
||||
<FileName>aom-310-win64.zip</FileName>
|
||||
<FileSize>4113883</FileSize>
|
||||
<PlatformSpecific>Windows</PlatformSpecific>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
20
ob-cache/test-profiles/pts/aom-av1-3.5.0/install.sh
Normal file
20
ob-cache/test-profiles/pts/aom-av1-3.5.0/install.sh
Normal file
@@ -0,0 +1,20 @@
|
||||
#!/bin/sh
|
||||
tar -xf aom-350.tar.xz
|
||||
cd aom/build
|
||||
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
|
||||
make -j $NUM_CPU_CORES
|
||||
echo $? > ~/install-exit-status
|
||||
cd ~
|
||||
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
|
||||
echo "#!/bin/sh
|
||||
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
|
||||
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
|
||||
NUM_CPU_CORES=64
|
||||
fi
|
||||
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
|
||||
echo \$? > ~/test-exit-status
|
||||
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
|
||||
rm -f test.av1" > aom-av1
|
||||
chmod +x aom-av1
|
||||
14
ob-cache/test-profiles/pts/aom-av1-3.5.0/install_windows.sh
Normal file
14
ob-cache/test-profiles/pts/aom-av1-3.5.0/install_windows.sh
Normal file
@@ -0,0 +1,14 @@
|
||||
#!/bin/sh
|
||||
unzip -o aom-310-win64.zip
|
||||
chmod +x aomenc.exe
|
||||
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
echo "#!/bin/sh
|
||||
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
|
||||
NUM_CPU_CORES=64
|
||||
fi
|
||||
./aomenc.exe --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
|
||||
echo \$? > ~/test-exit-status
|
||||
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
|
||||
rm -f test.av1" > aom-av1
|
||||
chmod +x aom-av1
|
||||
@@ -0,0 +1,9 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
|
||||
<LineHint>fps</LineHint>
|
||||
<TurnCharsToSpace>(</TurnCharsToSpace>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
81
ob-cache/test-profiles/pts/aom-av1-3.5.0/test-definition.xml
Normal file
81
ob-cache/test-profiles/pts/aom-av1-3.5.0/test-definition.xml
Normal file
@@ -0,0 +1,81 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>AOM AV1</Title>
|
||||
<AppVersion>3.5</AppVersion>
|
||||
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
|
||||
<ResultScale>Frames Per Second</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>3.5.0</Version>
|
||||
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>Processor</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
|
||||
<EnvironmentSize>1950</EnvironmentSize>
|
||||
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
|
||||
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
|
||||
<InternalTags>SMP</InternalTags>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>--tile-columns=4 --tile-rows=2 --row-mt=1 --fp-mt=1</Arguments>
|
||||
</Default>
|
||||
<Option>
|
||||
<DisplayName>Encoder Mode</DisplayName>
|
||||
<Identifier>enc-mode</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Speed 10 Realtime</Name>
|
||||
<Value>--cpu-used=10 --rt</Value>
|
||||
<Message>Fastest</Message>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 9 Realtime</Name>
|
||||
<Value>--cpu-used=9 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 8 Realtime</Name>
|
||||
<Value>--cpu-used=8 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Realtime</Name>
|
||||
<Value>--cpu-used=6 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Two-Pass</Name>
|
||||
<Value>--cpu-used=6</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 4 Two-Pass</Name>
|
||||
<Value>--cpu-used=4</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 0 Two-Pass</Name>
|
||||
<Value>--cpu-used=0 --limit=20</Value>
|
||||
<Message>Slowest</Message>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
<Option>
|
||||
<DisplayName>Input</DisplayName>
|
||||
<Identifier>input</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Bosphorus 1080p</Name>
|
||||
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Bosphorus 4K</Name>
|
||||
<Value>Bosphorus_3840x2160.y4m</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/aom-av1-3.6.0/changelog.json
Normal file
1
ob-cache/test-profiles/pts/aom-av1-3.6.0/changelog.json
Normal file
@@ -0,0 +1 @@
|
||||
{"3.6.0":{"last_updated":"1675812855","commit_description":"Update against upstream AOM v3.6 release."},"3.5.0":{"last_updated":"1663855054","commit_description":"Update against AOM-AV1 3.5, tune parameters too."},"3.4.0":{"last_updated":"1655544139","commit_description":"Update against AOM v3.4 upstream."},"3.3.0":{"last_updated":"1645125446","commit_description":"Update against AOM-AV1 3.3 upstream."},"3.2.0":{"last_updated":"1634254352","commit_description":"Update against upstream libaom v3.2.0 release, drop Windows support for now since the Appveyor builds stopped, also unify versioning."},"2.4.0":{"last_updated":"1620318386","commit_description":"Update against libaom 3.1 upstream."},"2.3.0":{"last_updated":"1616591956","commit_description":"Update against v3.0 upstream, add 4K video option too now that libaom is faster than before..."},"2.2.0":{"last_updated":"1615556384","commit_description":"Update against libaom 2.1-rc1 Git state, increase tile settings."},"2.1.2":{"last_updated":"1599928929","commit_description":"Speedup installation per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/158"},"2.1.1":{"last_updated":"1589911361","commit_description":"Update argument options."},"2.1.0":{"last_updated":"1589893519","commit_description":"Update against libaom 2.0.0."},"2.0.2":{"last_updated":"1578683006","commit_description":"Cap number of threads for AOM encoding to 64 threads, otherwise the program errors out due to its MAX_NUM_THREADS."},"2.0.1":{"last_updated":"1578682331","commit_description":"Add Windows support."},"2.0.0":{"last_updated":"1578680871","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/112 plus also rebase to latest AOM Git."},"1.2.0":{"last_updated":"1568659804","commit_description":"Update per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/101 re-base to AOM Git as of 2019-09-16."},"1.1.0":{"last_updated":"1549915618","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/58 plus fixing FPS reporting, switch to using AOM AV1 Git as of today, multi-threading is used by default by upstream aomenc already, and other changes."},"1.0.0":{"last_updated":"1522420880","commit_description":"Initial work on the AOM AV1 video encode test profile, but not too practical yet given the current extremely slow speed of the encoder, etc. So mostly a placeholder until that code is in better shape."}}
|
||||
27
ob-cache/test-profiles/pts/aom-av1-3.6.0/downloads.xml
Normal file
27
ob-cache/test-profiles/pts/aom-av1-3.6.0/downloads.xml
Normal file
@@ -0,0 +1,27 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
|
||||
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
|
||||
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>676792531</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
|
||||
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
|
||||
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>2804470345</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-360.tar.xz</URL>
|
||||
<MD5>aeea2fe982060b2e99320febae96e430</MD5>
|
||||
<SHA256>bc774bbc17364974262c39b3130567dc0fec23c7540cd42bfbacf7685985aa4d</SHA256>
|
||||
<FileName>aom-360.tar.xz</FileName>
|
||||
<FileSize>3721800</FileSize>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/aom-av1-3.6.0/generated.json
Normal file
1
ob-cache/test-profiles/pts/aom-av1-3.6.0/generated.json
Normal file
File diff suppressed because one or more lines are too long
19
ob-cache/test-profiles/pts/aom-av1-3.6.0/install.sh
Normal file
19
ob-cache/test-profiles/pts/aom-av1-3.6.0/install.sh
Normal file
@@ -0,0 +1,19 @@
|
||||
#!/bin/sh
|
||||
tar -xf aom-360.tar.xz
|
||||
cd aom/build
|
||||
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
|
||||
make -j $NUM_CPU_CORES
|
||||
echo $? > ~/install-exit-status
|
||||
cd ~
|
||||
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
echo "#!/bin/sh
|
||||
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
|
||||
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
|
||||
NUM_CPU_CORES=64
|
||||
fi
|
||||
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
|
||||
echo \$? > ~/test-exit-status
|
||||
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
|
||||
rm -f test.av1" > aom-av1
|
||||
chmod +x aom-av1
|
||||
@@ -0,0 +1,9 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
|
||||
<LineHint>fps</LineHint>
|
||||
<TurnCharsToSpace>(</TurnCharsToSpace>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
81
ob-cache/test-profiles/pts/aom-av1-3.6.0/test-definition.xml
Normal file
81
ob-cache/test-profiles/pts/aom-av1-3.6.0/test-definition.xml
Normal file
@@ -0,0 +1,81 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>AOM AV1</Title>
|
||||
<AppVersion>3.6</AppVersion>
|
||||
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
|
||||
<ResultScale>Frames Per Second</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>3.6.0</Version>
|
||||
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>Processor</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
|
||||
<EnvironmentSize>1950</EnvironmentSize>
|
||||
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
|
||||
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
|
||||
<InternalTags>SMP</InternalTags>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>--tile-columns=4 --tile-rows=2 --row-mt=1 --fp-mt=1</Arguments>
|
||||
</Default>
|
||||
<Option>
|
||||
<DisplayName>Encoder Mode</DisplayName>
|
||||
<Identifier>enc-mode</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Speed 10 Realtime</Name>
|
||||
<Value>--cpu-used=10 --rt</Value>
|
||||
<Message>Fastest</Message>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 9 Realtime</Name>
|
||||
<Value>--cpu-used=9 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 8 Realtime</Name>
|
||||
<Value>--cpu-used=8 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Realtime</Name>
|
||||
<Value>--cpu-used=6 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Two-Pass</Name>
|
||||
<Value>--cpu-used=6</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 4 Two-Pass</Name>
|
||||
<Value>--cpu-used=4</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 0 Two-Pass</Name>
|
||||
<Value>--cpu-used=0 --limit=20</Value>
|
||||
<Message>Slowest</Message>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
<Option>
|
||||
<DisplayName>Input</DisplayName>
|
||||
<Identifier>input</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Bosphorus 1080p</Name>
|
||||
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Bosphorus 4K</Name>
|
||||
<Value>Bosphorus_3840x2160.y4m</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/aom-av1-3.7.0/changelog.json
Normal file
1
ob-cache/test-profiles/pts/aom-av1-3.7.0/changelog.json
Normal file
@@ -0,0 +1 @@
|
||||
{"3.7.0":{"last_updated":"1693774819","commit_description":"Update against libaom 3.7 upstream."},"3.6.0":{"last_updated":"1675812855","commit_description":"Update against upstream AOM v3.6 release."},"3.5.0":{"last_updated":"1663855054","commit_description":"Update against AOM-AV1 3.5, tune parameters too."},"3.4.0":{"last_updated":"1655544139","commit_description":"Update against AOM v3.4 upstream."},"3.3.0":{"last_updated":"1645125446","commit_description":"Update against AOM-AV1 3.3 upstream."},"3.2.0":{"last_updated":"1634254352","commit_description":"Update against upstream libaom v3.2.0 release, drop Windows support for now since the Appveyor builds stopped, also unify versioning."},"2.4.0":{"last_updated":"1620318386","commit_description":"Update against libaom 3.1 upstream."},"2.3.0":{"last_updated":"1616591956","commit_description":"Update against v3.0 upstream, add 4K video option too now that libaom is faster than before..."},"2.2.0":{"last_updated":"1615556384","commit_description":"Update against libaom 2.1-rc1 Git state, increase tile settings."},"2.1.2":{"last_updated":"1599928929","commit_description":"Speedup installation per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/158"},"2.1.1":{"last_updated":"1589911361","commit_description":"Update argument options."},"2.1.0":{"last_updated":"1589893519","commit_description":"Update against libaom 2.0.0."},"2.0.2":{"last_updated":"1578683006","commit_description":"Cap number of threads for AOM encoding to 64 threads, otherwise the program errors out due to its MAX_NUM_THREADS."},"2.0.1":{"last_updated":"1578682331","commit_description":"Add Windows support."},"2.0.0":{"last_updated":"1578680871","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/112 plus also rebase to latest AOM Git."},"1.2.0":{"last_updated":"1568659804","commit_description":"Update per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/101 re-base to AOM Git as of 2019-09-16."},"1.1.0":{"last_updated":"1549915618","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/58 plus fixing FPS reporting, switch to using AOM AV1 Git as of today, multi-threading is used by default by upstream aomenc already, and other changes."},"1.0.0":{"last_updated":"1522420880","commit_description":"Initial work on the AOM AV1 video encode test profile, but not too practical yet given the current extremely slow speed of the encoder, etc. So mostly a placeholder until that code is in better shape."}}
|
||||
27
ob-cache/test-profiles/pts/aom-av1-3.7.0/downloads.xml
Normal file
27
ob-cache/test-profiles/pts/aom-av1-3.7.0/downloads.xml
Normal file
@@ -0,0 +1,27 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
|
||||
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
|
||||
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>676792531</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
|
||||
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
|
||||
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
|
||||
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
|
||||
<FileSize>2804470345</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-370.tar.xz</URL>
|
||||
<MD5>ff2800504e33fcb07469d5a3ce21e02b</MD5>
|
||||
<SHA256>09426a65168a77317e52923ef4e4d73f1e644cc7ac5e1d4660d9fbd06b04852d</SHA256>
|
||||
<FileName>aom-370.tar.xz</FileName>
|
||||
<FileSize>3781644</FileSize>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/aom-av1-3.7.0/generated.json
Normal file
1
ob-cache/test-profiles/pts/aom-av1-3.7.0/generated.json
Normal file
File diff suppressed because one or more lines are too long
19
ob-cache/test-profiles/pts/aom-av1-3.7.0/install.sh
Normal file
19
ob-cache/test-profiles/pts/aom-av1-3.7.0/install.sh
Normal file
@@ -0,0 +1,19 @@
|
||||
#!/bin/sh
|
||||
tar -xf aom-370.tar.xz
|
||||
cd aom/build
|
||||
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
|
||||
make -j $NUM_CPU_CORES
|
||||
echo $? > ~/install-exit-status
|
||||
cd ~
|
||||
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
|
||||
echo "#!/bin/sh
|
||||
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
|
||||
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
|
||||
NUM_CPU_CORES=64
|
||||
fi
|
||||
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
|
||||
echo \$? > ~/test-exit-status
|
||||
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
|
||||
rm -f test.av1" > aom-av1
|
||||
chmod +x aom-av1
|
||||
@@ -0,0 +1,9 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
|
||||
<LineHint>fps</LineHint>
|
||||
<TurnCharsToSpace>(</TurnCharsToSpace>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
85
ob-cache/test-profiles/pts/aom-av1-3.7.0/test-definition.xml
Normal file
85
ob-cache/test-profiles/pts/aom-av1-3.7.0/test-definition.xml
Normal file
@@ -0,0 +1,85 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.4-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>AOM AV1</Title>
|
||||
<AppVersion>3.7</AppVersion>
|
||||
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
|
||||
<ResultScale>Frames Per Second</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>3.7.0</Version>
|
||||
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>Processor</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
|
||||
<EnvironmentSize>1950</EnvironmentSize>
|
||||
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
|
||||
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
|
||||
<InternalTags>SMP</InternalTags>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>--tile-columns=4 --tile-rows=2 --row-mt=1 --fp-mt=1</Arguments>
|
||||
</Default>
|
||||
<Option>
|
||||
<DisplayName>Encoder Mode</DisplayName>
|
||||
<Identifier>enc-mode</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Speed 11 Realtime</Name>
|
||||
<Value>--cpu-used=11 --rt</Value>
|
||||
<Message>Fastest</Message>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 10 Realtime</Name>
|
||||
<Value>--cpu-used=10 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 9 Realtime</Name>
|
||||
<Value>--cpu-used=9 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 8 Realtime</Name>
|
||||
<Value>--cpu-used=8 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Realtime</Name>
|
||||
<Value>--cpu-used=6 --rt</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 6 Two-Pass</Name>
|
||||
<Value>--cpu-used=6</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 4 Two-Pass</Name>
|
||||
<Value>--cpu-used=4</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Speed 0 Two-Pass</Name>
|
||||
<Value>--cpu-used=0 --limit=20</Value>
|
||||
<Message>Slowest</Message>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
<Option>
|
||||
<DisplayName>Input</DisplayName>
|
||||
<Identifier>input</Identifier>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>Bosphorus 1080p</Name>
|
||||
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>Bosphorus 4K</Name>
|
||||
<Value>Bosphorus_3840x2160.y4m</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/apache-1.6.1/changelog.json
Normal file
1
ob-cache/test-profiles/pts/apache-1.6.1/changelog.json
Normal file
@@ -0,0 +1 @@
|
||||
{"3.0.0":{"last_updated":"1679778582","commit_description":"Update Apache for GCC 13 compiler fix, switch to using wrk for better scaling."},"2.0.1":{"last_updated":"1650407028","commit_description":"Support for using go install for Go 1.17+ support."},"2.0.0":{"last_updated":"1628809739","commit_description":"Update against Apache HTTPD 2.4.48, switch to Bombardier for load testingm, add concurrent request option."},"1.7.2":{"last_updated":"1559340501","commit_description":"Add expat as external dependency per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/82 and also update one broken download link..."},"1.7.1":{"last_updated":"1519950827","commit_description":"Add Windows support for Apache test."},"1.7.0":{"last_updated":"1518023217","commit_description":"Update against HTTPD 2.4.29 and latest APR \/ APR-Util packages."},"1.6.1":{"last_updated":"1396227113","commit_description":"Update download links, add pcre external dependency rather than just relying upon perl external dependency."},"1.6.0":{"last_updated":"1386105148","commit_description":"Update upstream packages, up the run count to one million requests."},"1.5.2":{"last_updated":"1359422378","commit_description":"Apache test profile works on PC-BSD 9.1."},"1.5.1":{"last_updated":"1358635876","commit_description":"Add perl as external dependency to Apache so pcre-devel is obtained on distributions where needed. Also fix a broken download link in downloads.xml."},"1.5.0":{"last_updated":"1349325922","commit_description":"Update against upstream Apache HTTPD 2.4.3 release."},"1.4.0":{"last_updated":"1327870087","commit_description":"Update against upstream Apache HTTPD 2.2.21."},"1.3.1":{"last_updated":"1327851329","commit_description":"Update download links for upstream Apache HTTPD. No other changes."},"1.3.0":{"last_updated":"1291663084","commit_description":"Initial import into OpenBenchmarking.org"}}
|
||||
1
ob-cache/test-profiles/pts/apache-1.6.1/generated.json
Normal file
1
ob-cache/test-profiles/pts/apache-1.6.1/generated.json
Normal file
@@ -0,0 +1 @@
|
||||
{"overview":{"eaf16ef4d48329890775e5e99d2c1980f17c16b9":{"description":"Static Web Page Serving","test_version":"1.6.x","app_version":"2.4.7","unit":"Requests Per Second","samples":14790,"timing_samples":170,"hib":1,"first_appeared":1298700000,"last_appeared":1707157794,"run_time_avg":232,"stddev_avg":1.54,"percentiles":[93.05,758,1168.06,1607.89,1928.62,2215.32,2456.49,2743.37,3070.03,3352.82,3588.85,3826.96,4046.66,4297.17,4551.29,4826.21,5143.48,5433.67,5681.07,5862.23,6039.43,6230.45,6455.85,6614.93,6808.54,7019.52,7234.81,7448.04,7734.11,8028.4,8331.72,8576.87,8824.12,9125.39,9407.38,9753.28,10086.21,10388.26,10658.71,10920.89,11147.2,11399.13,11687.26,12006.24,12230.43,12525.46,12872.21,13186.22,13436.96,13649.21,14016.23,14360.42,14674.38,14988.96,15222.27,15517.35,15822.96,16139.06,16467.44,16733.86,17047.96,17352.14,17604.3,17873.48,18268.96,18629.25,18939.79,19242.35,19500.41,19803.74,20162.37,20558.78,20943.48,21386.65,21897.03,22324.69,22734.69,23280.61,23772.71,24293.32,24989.82,25617.7,26396.76,27108.43,27960.06,28747.95,29821.48,30625.24,31686.5,33054.07,34251.27,35399.82,37462.49,39421.48,40998.65,42677.59,44153.7,46624.19,49330.27,52331.33],"run_time_percentiles":[55,62,62,63,63,73,74,75,75,77,77,77,80,84,84,86,88,89,91,99,100,100,101,102,103,103,105,107,108,112,114,115,117,117,118,118,119,119,119,125,125,125,128,130,131,135,138,139,141,142,146,147,147,148,151,152,154,154,164,166,172,178,197,214,218,227,263,265,266,267,268,269,270,272,273,273,274,281,314,324,366,372,449,493,508,510,516,517,518,518,522,523,524,528,530,559,573,762,861,916],"tested_archs":["arm","aarch64","sparc64","mips64","ppc64","ppc64le","x86_64","i686","armv7l","armv6l","i386","ppc","mips"]}},"capabilities":{"shared_libraries":["libm.so.6","libc.so.6"],"default_instructions":["MMX","SSE","SSE2","SSSE3","SSE4_1","AVX","AVX2","AES","AVX512","VAES"],"max_instructions":["MMX","SSE","SSE2","SSSE3","SSE4_1","AVX","AVX2","AES","AVX512","VAES"],"honors_cflags":"0","scales_cpu_cores":"0"}}
|
||||
1
ob-cache/test-profiles/pts/apache-2.0.1/changelog.json
Normal file
1
ob-cache/test-profiles/pts/apache-2.0.1/changelog.json
Normal file
@@ -0,0 +1 @@
|
||||
{"2.0.1":{"last_updated":"1650407028","commit_description":"Support for using go install for Go 1.17+ support."},"2.0.0":{"last_updated":"1628809739","commit_description":"Update against Apache HTTPD 2.4.48, switch to Bombardier for load testingm, add concurrent request option."},"1.7.2":{"last_updated":"1559340501","commit_description":"Add expat as external dependency per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/82 and also update one broken download link..."},"1.7.1":{"last_updated":"1519950827","commit_description":"Add Windows support for Apache test."},"1.7.0":{"last_updated":"1518023217","commit_description":"Update against HTTPD 2.4.29 and latest APR \/ APR-Util packages."},"1.6.1":{"last_updated":"1396227113","commit_description":"Update download links, add pcre external dependency rather than just relying upon perl external dependency."},"1.6.0":{"last_updated":"1386105148","commit_description":"Update upstream packages, up the run count to one million requests."},"1.5.2":{"last_updated":"1359422378","commit_description":"Apache test profile works on PC-BSD 9.1."},"1.5.1":{"last_updated":"1358635876","commit_description":"Add perl as external dependency to Apache so pcre-devel is obtained on distributions where needed. Also fix a broken download link in downloads.xml."},"1.5.0":{"last_updated":"1349325922","commit_description":"Update against upstream Apache HTTPD 2.4.3 release."},"1.4.0":{"last_updated":"1327870087","commit_description":"Update against upstream Apache HTTPD 2.2.21."},"1.3.1":{"last_updated":"1327851329","commit_description":"Update download links for upstream Apache HTTPD. No other changes."},"1.3.0":{"last_updated":"1291663084","commit_description":"Initial import into OpenBenchmarking.org"}}
|
||||
34
ob-cache/test-profiles/pts/apache-2.0.1/downloads.xml
Normal file
34
ob-cache/test-profiles/pts/apache-2.0.1/downloads.xml
Normal file
@@ -0,0 +1,34 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.2-->
|
||||
<PhoronixTestSuite>
|
||||
<Downloads>
|
||||
<Package>
|
||||
<URL>http://archive.apache.org/dist/httpd/httpd-2.4.48.tar.bz2, http://ftp.bit.nl/apache/httpd-2.4.48.tar.bz2</URL>
|
||||
<MD5>a7088cec171b0d00bf43394ce64d3909</MD5>
|
||||
<SHA256>1bc826e7b2e88108c7e4bf43c026636f77a41d849cfb667aa7b5c0b86dbf966c</SHA256>
|
||||
<FileName>httpd-2.4.48.tar.bz2</FileName>
|
||||
<FileSize>7194385</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.phoronix-test-suite.com/benchmark-files/http-test-files-1.tar.xz</URL>
|
||||
<MD5>b86f3e8f5bc9d0014818c5122a6f784d</MD5>
|
||||
<SHA256>9d6eace9544c59b910ea403a4693338efc12a6b0915fe227aed86c971b82d3dd</SHA256>
|
||||
<FileName>http-test-files-1.tar.xz</FileName>
|
||||
<FileSize>2346324</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>https://ftp.osuosl.org/pub/blfs/conglomeration/apr/apr-1.7.0.tar.bz2, http://archive.apache.org/dist/apr/apr-1.7.0.tar.bz2</URL>
|
||||
<MD5>7a14a83d664e87599ea25ff4432e48a7</MD5>
|
||||
<SHA256>e2e148f0b2e99b8e5c6caa09f6d4fb4dd3e83f744aa72a952f94f5a14436f7ea</SHA256>
|
||||
<FileName>apr-1.7.0.tar.bz2</FileName>
|
||||
<FileSize>872238</FileSize>
|
||||
</Package>
|
||||
<Package>
|
||||
<URL>http://www.apache.org/dist/apr/apr-util-1.6.1.tar.bz2, http://apache.cs.utah.edu//apr/apr-util-1.6.1.tar.bz2, http://archive.apache.org/dist/apr/apr-util-1.6.1.tar.bz2</URL>
|
||||
<MD5>8ff5dc36fa39a2a3db1df196d3ed6086</MD5>
|
||||
<SHA256>d3e12f7b6ad12687572a3a39475545a072608f4ba03a6ce8a3778f607dd0035b</SHA256>
|
||||
<FileName>apr-util-1.6.1.tar.bz2</FileName>
|
||||
<FileSize>428595</FileSize>
|
||||
</Package>
|
||||
</Downloads>
|
||||
</PhoronixTestSuite>
|
||||
1
ob-cache/test-profiles/pts/apache-2.0.1/generated.json
Normal file
1
ob-cache/test-profiles/pts/apache-2.0.1/generated.json
Normal file
File diff suppressed because one or more lines are too long
59
ob-cache/test-profiles/pts/apache-2.0.1/install.sh
Normal file
59
ob-cache/test-profiles/pts/apache-2.0.1/install.sh
Normal file
@@ -0,0 +1,59 @@
|
||||
#!/bin/bash
|
||||
|
||||
mkdir $HOME/httpd_
|
||||
|
||||
tar -xf http-test-files-1.tar.xz
|
||||
tar -xf httpd-2.4.48.tar.bz2
|
||||
tar -xf apr-util-1.6.1.tar.bz2
|
||||
tar -xf apr-1.7.0.tar.bz2
|
||||
mv apr-1.7.0 httpd-2.4.48/srclib/apr
|
||||
mv apr-util-1.6.1 httpd-2.4.48/srclib/apr-util
|
||||
|
||||
cd httpd-2.4.48/
|
||||
./configure --prefix=$HOME/httpd_ --with-included-apr
|
||||
|
||||
if [ "$OS_TYPE" = "BSD" ]
|
||||
then
|
||||
gmake -j $NUM_CPU_CORES
|
||||
gmake install
|
||||
echo $? > ~/install-exit-status
|
||||
else
|
||||
make -j $NUM_CPU_CORES
|
||||
make install
|
||||
echo $? > ~/install-exit-status
|
||||
fi
|
||||
|
||||
cd ~
|
||||
rm -rf httpd-2.4.48/
|
||||
rm -rf httpd_/manual/
|
||||
|
||||
mv -f http-test-files/* httpd_/htdocs/
|
||||
|
||||
echo "
|
||||
--- httpd_/conf/httpd.conf.orig 2009-05-05 11:45:32.000000000 -0400
|
||||
+++ httpd_/conf/httpd.conf 2009-05-05 11:46:09.000000000 -0400
|
||||
@@ -37,7 +37,7 @@
|
||||
# prevent Apache from glomming onto all bound IP addresses.
|
||||
#
|
||||
#Listen 12.34.56.78:80
|
||||
-Listen 80
|
||||
+Listen 8088
|
||||
|
||||
#
|
||||
# Dynamic Shared Object (DSO) Support
|
||||
" > CHANGE-PORT.patch
|
||||
|
||||
patch -p0 < CHANGE-PORT.patch
|
||||
|
||||
go get -u github.com/codesenberg/bombardier
|
||||
if [ $? -ne 0 ]
|
||||
then
|
||||
# Go 1.17+ path
|
||||
go install github.com/codesenberg/bombardier@latest
|
||||
fi
|
||||
|
||||
echo "#!/bin/sh
|
||||
~/go/bin/bombardier \$@ > \$LOG_FILE 2>&1
|
||||
echo \$? > ~/test-exit-status" > apache
|
||||
|
||||
chmod +x apache
|
||||
4
ob-cache/test-profiles/pts/apache-2.0.1/post.sh
Normal file
4
ob-cache/test-profiles/pts/apache-2.0.1/post.sh
Normal file
@@ -0,0 +1,4 @@
|
||||
#!/bin/sh
|
||||
./httpd_/bin/apachectl -k stop
|
||||
rm -f httpd_/logs/*
|
||||
sleep 3
|
||||
3
ob-cache/test-profiles/pts/apache-2.0.1/pre.sh
Normal file
3
ob-cache/test-profiles/pts/apache-2.0.1/pre.sh
Normal file
@@ -0,0 +1,3 @@
|
||||
#!/bin/sh
|
||||
./httpd_/bin/apachectl -k start -f $HOME/httpd_/conf/httpd.conf
|
||||
sleep 5
|
||||
4
ob-cache/test-profiles/pts/apache-2.0.1/pre_windows.sh
Normal file
4
ob-cache/test-profiles/pts/apache-2.0.1/pre_windows.sh
Normal file
@@ -0,0 +1,4 @@
|
||||
#!/bin/sh
|
||||
cd Apache24/bin
|
||||
./httpd.exe &
|
||||
sleep 10
|
||||
@@ -0,0 +1,7 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.2-->
|
||||
<PhoronixTestSuite>
|
||||
<ResultsParser>
|
||||
<OutputTemplate> Reqs/sec #_RESULT_# 25659.25 589863.96</OutputTemplate>
|
||||
</ResultsParser>
|
||||
</PhoronixTestSuite>
|
||||
64
ob-cache/test-profiles/pts/apache-2.0.1/test-definition.xml
Normal file
64
ob-cache/test-profiles/pts/apache-2.0.1/test-definition.xml
Normal file
@@ -0,0 +1,64 @@
|
||||
<?xml version="1.0"?>
|
||||
<!--Phoronix Test Suite v10.8.2-->
|
||||
<PhoronixTestSuite>
|
||||
<TestInformation>
|
||||
<Title>Apache HTTP Server</Title>
|
||||
<AppVersion>2.4.48</AppVersion>
|
||||
<Description>This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients.</Description>
|
||||
<ResultScale>Requests Per Second</ResultScale>
|
||||
<Proportion>HIB</Proportion>
|
||||
<TimesToRun>3</TimesToRun>
|
||||
</TestInformation>
|
||||
<TestProfile>
|
||||
<Version>2.0.1</Version>
|
||||
<SupportedPlatforms>Linux, Solaris, BSD, MacOSX</SupportedPlatforms>
|
||||
<SoftwareType>Utility</SoftwareType>
|
||||
<TestType>System</TestType>
|
||||
<License>Free</License>
|
||||
<Status>Verified</Status>
|
||||
<ExternalDependencies>build-utilities, perl, pcre, expat, golang</ExternalDependencies>
|
||||
<InstallRequiresInternet>TRUE</InstallRequiresInternet>
|
||||
<EnvironmentSize>208</EnvironmentSize>
|
||||
<ProjectURL>https://httpd.apache.org/</ProjectURL>
|
||||
<RepositoryURL>https://github.com/apache/httpd</RepositoryURL>
|
||||
<InternalTags>SMP</InternalTags>
|
||||
<Maintainer>Michael Larabel</Maintainer>
|
||||
</TestProfile>
|
||||
<TestSettings>
|
||||
<Default>
|
||||
<Arguments>-d 90s </Arguments>
|
||||
<PostArguments> http://127.0.0.1:8088/test.html</PostArguments>
|
||||
</Default>
|
||||
<Option>
|
||||
<DisplayName>Concurrent Requests</DisplayName>
|
||||
<Identifier>concurrent</Identifier>
|
||||
<ArgumentPrefix>-c </ArgumentPrefix>
|
||||
<Menu>
|
||||
<Entry>
|
||||
<Name>1</Name>
|
||||
<Value>1</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>20</Name>
|
||||
<Value>20</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>100</Name>
|
||||
<Value>100</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>200</Name>
|
||||
<Value>200</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>500</Name>
|
||||
<Value>500</Value>
|
||||
</Entry>
|
||||
<Entry>
|
||||
<Name>1000</Name>
|
||||
<Value>1000</Value>
|
||||
</Entry>
|
||||
</Menu>
|
||||
</Option>
|
||||
</TestSettings>
|
||||
</PhoronixTestSuite>
|
||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user