Compare commits

...

108 Commits

Author SHA1 Message Date
Michael Larabel
f9fb12b6d2 pts-core: PHP 8.5 warning fixes 2025-11-30 04:42:41 -06:00
Michael Larabel
e8f464155b pts-core: Couple small fixes 2025-11-09 06:02:58 -06:00
Michael Larabel
fb292fba88 pts-core: Various fixes 2025-09-14 05:28:07 -05:00
Michael Larabel
eedb556475 pts-core: Various fixes, PHP 8.5 compatibility updates 2025-08-17 10:59:50 -05:00
Michael Larabel
87c7188a50 pts-core: Minor fixes over time 2025-06-14 19:56:14 -05:00
Michael Larabel
2a44c29064 phodevi: Few fixes 2025-05-25 07:40:10 -05:00
Aleksei Savin
b0046d9414 Make PNG background transparent. It's black by default 2025-04-27 05:11:00 -05:00
Srinivas Pandruvada
811a53bc3b pts-core: Parsing result format with ":#_RESULT_#"
Some benchmark output reports are in the format:
xyz score:XYZ

Here there is no space between ':' and actual result.

To parse such format create a template something like this:
<OutputTemplate>xxx:#_RESULT_#</OutputTemplate>

This type of the format can't be parsed correctly.

The current implementation expects a "space" after column.
For example:
In test-profiles/system/selenium-1.0.18/results-definition.xml
<ResultsParser>
  <OutputTemplate>WEBXPRT SCORE RESULT: #_RESULT_#</OutputTemplate>

To be able to parse when there is no space between ":" and "#" add a
a space character in the template line.

Signed-off-by: Srinivas Pandruvada <srinivas.pandruvada@linux.intel.com>
2025-04-27 05:10:24 -05:00
Michael Larabel
e4857241da pts-core: PHP 8.4 warning fixes and other small fixes/improvements 2025-03-29 06:21:22 -05:00
Michael Larabel
e1fdc09426 pts-core: Few fixes and NPU detection 2025-01-26 06:39:07 -06:00
Mingcong Bai
f665ba8ee7 phodevi_cpu: add LoongArch processor detection support
LoongArch processors uses the "Model Name:" field in /proc/cpuinfo to
denote the processor model, a snippet below:

processor               : 31
package                 : 0
core                    : 31
global_id               : 31
CPU Family              : Loongson-64bit
Model Name              : Loongson-3C6000
CPU Revision            : 0x10
FPU Revision            : 0x00
CPU MHz                 : 2200.00
BogoMIPS                : 4400.00
TLB Entries             : 2112
Address Sizes           : 48 bits physical, 48 bits virtual
ISA                     : loongarch32r loongarch32s loongarch64
Features                : cpucfg lam ual fpu lsx lasx crc32 complex crypto lspw lvz lbt_x86 lbt_arm lbt_mips
Hardware Watchpoint     : yes, iwatch count: 8, dwatch count: 4

Add "Model Name" to the array of patterns to define $cpu_strings via
phodevi_linux_parser::read_cpuinfo().

Signed-off-by: Mingcong Bai <jeffbai@aosc.io>
2024-12-01 05:19:52 -06:00
Greg Gant
f6e9155e3f Update pts_external_dependencies.php - ARM64 Homebrew dependency fix
This fix adds in the /opt/ directories to search for dependencies when using Homebrew installed natively on ARM64 macOS
2024-12-01 05:18:21 -06:00
Michael Larabel
d68dcb9b8d pts-core: Few fixes 2024-12-01 05:16:24 -06:00
Michael Larabel
8c171bb197 pts-core: Few fixes 2024-11-24 07:54:36 -06:00
Michael Larabel
5167450443 pts-core: PHP 8.4 warning fixes and optimizations 2024-11-24 05:42:04 -06:00
Michael Larabel
ef25cae756 pts-core: Rework the sensor code 2024-11-24 05:02:58 -06:00
Michael Larabel
899246f23e pts-cor: Few fixes 2024-11-10 05:14:33 -06:00
Michael Larabel
106ea700a8 pts-core: Couple fixes 2024-10-05 05:56:29 -05:00
Srinivas Pandruvada
d1119ab3ec Ignore psys domain for CPU power sensor
psys domain is a system domain which aggregates all system power. This requires
hardware support and configuration by OEMs. There can be multiple psys domains
in servers. psys domains are present at the same level as package domains in the
powercap/intel-rapl sysfs. This is not just CPU related power.

For CPU power sensor just use package level without adding energy values from
psys domains. So, skip adding psys energy value to $total_energy.
2024-09-29 05:28:49 -05:00
Michael Larabel
e1bc468707 pts-core: Fixes for running on openSUSE 2024-09-14 18:14:53 -05:00
Michael Larabel
137aff0047 pts-core: Add back EXECUTE_BINARY_PREPEND support
Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/807
2024-09-14 18:14:21 -05:00
Ettore Chimenti
1620cafc2e phodevi: check if test supports extra host arch
Marking test as compatible if optional HOST_EXTRA_COMPATIBLE_ARCH
environmental variable is matching one of the supported architectures.

Signed-off-by: Ettore Chimenti <ettore.chimenti@linaro.org>
2024-09-08 05:29:05 -05:00
Ettore Chimenti
9d5a60d7fd pts-env: add option for extra architecture support
This option allows to specify additional architecture support to being
able to install tests that supports specific architectures only. It can
be useful in systems where is available an user-space emulator (e.g.
FEX-EMU for x86_64 applications on aarch64) to run binary tests that
cannot be compiled natively.

The introduced environment variable is HOST_EXTRA_COMPATIBLE_ARCH.

Signed-off-by: Ettore Chimenti <ettore.chimenti@linaro.org>
2024-09-08 05:29:05 -05:00
Michael Larabel
472f45b46f pts-core: A few fixes 2024-09-08 05:28:32 -05:00
Michael Larabel
70843bc7b5 pts-core: Fixes accumulated for the result viewer 2024-08-24 10:35:49 -05:00
Michael Larabel
781d435be2 pts-core: Fix various typos in correct source locations, rebuild docs
Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/804
2024-08-17 20:05:21 -05:00
Michael Larabel
c259552dc1 phodevi: Various fixes 2024-08-17 20:04:19 -05:00
Michael Larabel
99c30505d7 phodevi: Various fixes 2024-06-15 06:05:20 -05:00
Michael Larabel
2f194a5c6e Merge branch 'master' of github.com:phoronix-test-suite/phoronix-test-suite 2024-05-05 05:00:31 -05:00
Michael Larabel
bb7da532c7 phodevi: Couple minor fixes 2024-05-05 04:59:54 -05:00
Colin
3bccd77443 Restore sed argument
Restore argument to `sed` that was removed in #469. `install_macos` never completes without the argument.
2024-04-21 05:16:30 -05:00
Michael Larabel
6fcb962514 Rebuild ob-cache for 10.8.5 point release 2024-04-20 19:23:38 -05:00
Michael Larabel
d719e4aa23 phodevi: Bug fixes 2024-03-24 14:10:15 -05:00
Michael Larabel
c2605245ac Bump to 10.8.5 2024-03-24 05:34:17 -05:00
Michael Larabel
5dbaac229a Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/774 2024-03-02 05:52:41 -06:00
Michael Larabel
fd22d6cb09 phodevi: Various hardware fixes 2024-02-26 18:56:37 -06:00
Michael Larabel
9c96e22e1a Rebuild ob-cache 2024-02-18 19:31:20 -06:00
Michael Larabel
87478458ed phodevi: Various fixes 2024-01-28 07:59:31 -06:00
Michael Larabel
331b4722fe pts-core: PHP warning fixes and other random fixes 2024-01-14 05:50:31 -06:00
Michael Larabel
2c13ab476a phodevi: Few fixes 2024-01-08 19:18:15 -06:00
Michael Larabel
770b08a804 pts-core: Couple minor fixes 2024-01-01 15:58:57 -06:00
Michael Larabel
5177940edb phodevi: Fix detecting latest CPUs 2023-12-10 04:52:24 -06:00
Ken-ichi Mito
ebcde81fcd fix: 'Automatic conversion of false to array is deprecated' warning 2023-11-26 05:28:27 -06:00
Ken-ichi Mito
3a16f5c9cc use fixed is_proxy_setup() instead of directly comparing return value of get_network_proxy() 2023-11-26 05:28:27 -06:00
Ken-ichi Mito
192d4fe457 fix: is_proxy_setup() should return 'true' if the proxy is set
pts_network::is_proxy_setup() was introduced in e36e865 for the reason
"Don't use HTTPS on proxies when connecting to OpenBenchmarking.org",
however, in reality, HTTPS is only used if a proxy is configured.

is_proxy_setup() returns TRUE if no proxy is set, which seems the
opposite of the expected return value from the function name,
unlike other functions starting with is_*().
2023-11-26 05:28:27 -06:00
Piraty
185fe059d5 pts-core: Void switched to openssl 2023-11-26 05:28:03 -06:00
Michael Larabel
9015a7f091 pts-core: PHP 8.3 compatibility updates/fixes 2023-11-26 05:12:39 -06:00
Michael Larabel
af4db559fc pts-core: Few random fixes 2023-11-19 08:15:25 -06:00
Michael Larabel
93d7e6dec6 pts-core: Few random fixes 2023-11-04 13:50:48 -05:00
Michael Larabel
f241b9526d pts-core / phoevi: Few minor fixes 2023-08-19 20:45:53 -05:00
Michael Larabel
7b98183724 pts-core: Properly restore SleepTimeBetweenTests option
Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/722
Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/713
2023-08-19 20:43:57 -05:00
Michael Larabel
d7cddd4467 pts-core: Couple small fixes 2023-07-30 05:35:15 -05:00
Michael Larabel
0f8c1567ab pts-core: Add some old logging code 2023-07-16 16:49:25 -05:00
Michael Larabel
e9a40c2f7b Rebuild ob-cache 2023-06-25 19:02:35 -05:00
Michael Larabel
b1346a1613 pts-core: Couple accumulated fixes 2023-06-17 06:52:38 -05:00
Michael Larabel
d9bcf6697c pts-core: Fix some PHP deprecation warnings
Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/720
2023-05-27 18:55:47 -05:00
Michael Larabel
a5235fb7e6 pts-core: Add a simple print-tests sub-command helper to print test identifiers...
Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/708
2023-03-25 17:18:20 -05:00
Michael Larabel
dea5e68ba7 pts-core: Workaround new Ubuntu/Debian breaking Python pip user usage... 2023-03-25 05:32:08 -05:00
Michael Larabel
85071272d4 phodevi: Couple minor fixes 2023-03-25 05:30:07 -05:00
Michael Larabel
811dc854ad phodevi: CPU identification improvements 2023-03-18 20:14:44 -05:00
Michael Larabel
a1beea2171 pts-core: Few random small fixes/changes building up locally 2023-03-18 20:13:22 -05:00
Michael Larabel
f3ca2d2105 Rebuild OpenBenchmarking.org cache for next PTS point release soon... 2023-02-18 11:12:51 -06:00
Michael Larabel
a8f36373e9 pts-core: Result viewer fixes 2023-02-18 06:33:29 -06:00
Michael Larabel
9146e70166 Cleanup https://github.com/phoronix-test-suite/phoronix-test-suite/pull/699
The install on macOS having AppStream file was superfluous and no point in installing the XML to the modern "metainfo" location if the existing AppStream data wasn't even valid against their modern standards

Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/699
2023-02-18 05:34:49 -06:00
Michael Larabel
d44c65a62e pts-core: Couple FreeBSD fixes on PHP 8.2 2023-01-22 06:55:42 -06:00
Michael Larabel
6256e5feaa windows: Update to PHP 8.2 build rather than EOL PHP 7.4 2023-01-21 05:44:54 -06:00
Michael Larabel
de3909aa1a phodevi: DG2 power monitoring support 2023-01-16 08:04:52 -06:00
Michael Larabel
cd59f0a38a pts-core: PHP 8.2 compatibility/warning fixes 2023-01-07 08:51:55 -06:00
Michael Larabel
4106dfcd83 pts-core: Various external dependency updates
Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/688
2023-01-07 08:47:52 -06:00
Michael Larabel
02346e5856 pts-core: Cleanup the finish-run handling for incompleted test results so it's more robust 2022-12-10 10:06:04 -06:00
Michael Larabel
f9f5ed8606 pts-core: PHP 8.2 warning fixes 2022-12-03 05:32:12 -06:00
Michael Larabel
47e535f4a6 pts-core: Deduplicate random network port picker code 2022-12-03 05:23:07 -06:00
Michael Larabel
23807f5691 phodevi: CPU identification improvements 2022-10-30 05:26:05 -05:00
Michael Larabel
6d5c8c7594 pts-core: Result viewer sorting improvement tweaks 2022-10-30 05:23:45 -05:00
Michael Larabel
c2a4f53ea2 pts-core: Drop PHP8 ZIP workaround that appears to no longer be needed with latest point releases and will now fail otherwise...
Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/679
2022-10-15 04:34:45 -05:00
Michael Larabel
63cc840df5 phodevi: More CPU core names 2022-10-15 04:33:57 -05:00
Michael Larabel
6b7e034589 pts-core: Couple minor random fixes 2022-10-09 15:35:21 -05:00
Michael Larabel
58c286c588 phoromatic: Add additional logging around test cache operations 2022-10-08 03:42:26 -05:00
Michael Larabel
9824bbea82 pts-core: Local result viewer cleanups / improvement 2022-10-02 06:36:13 -05:00
Michael Larabel
a52ef0822d pts-core: Couple minor fixes 2022-10-02 06:32:39 -05:00
Michael Larabel
897d8b865e phodevi: Additional CPU core names 2022-09-24 05:00:17 -05:00
Michael Larabel
d7034245a5 pts-core: Fix https://github.com/phoronix-test-suite/phoronix-test-suite/pull/676
But rather than just duplicating the code, make a new function to handle any post-processing to clean the result line and avoid forgetting about that fallback path in the future...

Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/676
2022-09-24 04:56:37 -05:00
Michael Larabel
e3b2c2ea2d pts-core: Minor result viewer embed fixes
Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/660

Check for at least 2 characters to be more effective since 1 character searching is rather limited. Simply checking for variable type string may be problematic for some number searching, so just check length instead for working around original problem.

Also fix another possible cornercase with HTML dropdown menus in the result viewer
2022-08-20 14:37:19 -05:00
Michael Larabel
94666eb8ea pts-core: Deduplicate the same error string from appearing for each repeated run 2022-08-20 14:36:58 -05:00
Michael Larabel
56ee009741 phodevi: Additional CPU core names 2022-08-05 18:27:09 -05:00
Michael Larabel
d3880d9d3b phoromatic: Explicitly check both $_GET abd $_POST in phoromatic_quit_if_invalid_input_found()
Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/650#issuecomment-1193116678
2022-07-23 07:32:43 -05:00
Michael Larabel
2160259aa3 pts-core: Additional PHP 8.1 warning fixes 2022-07-15 18:19:58 -05:00
Michael Larabel
f0365737ae Rebuild local OB cache for PTS 10.8.4 2022-07-03 05:17:29 -05:00
Michael Larabel
b3c9750c3d Prepare for Phoronix Test Suite 10.8.4 2022-07-03 04:30:01 -05:00
Michael Larabel
3fc6c47e3e pts-core: Couple small last minute tweaks 2022-07-03 04:26:50 -05:00
Michael Larabel
61e004c204 pts-core: Local result viewer filter out any excess characters passed to comparison ID forwarder 2022-06-26 15:12:27 -05:00
Michael Larabel
13165b75ca Work on change-log for next point release soon 2022-06-25 05:31:23 -05:00
Michael Larabel
e4ff08476b phoromatic: Additional input sanitization / safety checks 2022-06-25 05:20:53 -05:00
Michael Larabel
6ebfe5a4f7 pts-core: Allow the test result definitions to indicate less important metrics 2022-06-25 04:54:50 -05:00
Michael Larabel
36de1c9bb5 phodevi: CPU core name additions based on latest Linux kernel patches 2022-06-25 04:43:37 -05:00
Michael Larabel
ff47166661 pts-core: External dependency updates 2022-06-25 04:40:42 -05:00
Michael Larabel
cde80b7dbd phodevi: Budgie version detection 2022-06-18 04:03:25 -05:00
Michael Larabel
181da5e40f pts-core: Don't show macOS or Radeon options on non-macOS/Radeon systems
Useful for latest blender test profile
2022-06-11 05:58:31 -05:00
Michael Larabel
5b39fcbe3a pts-core: Another input sanitization update for just the local result viewer 2022-06-11 05:54:07 -05:00
Michael Larabel
bce1fb419c pts-core: Additional input sanitization work in the result viewer code for those using Phoromatic or those changing the default setting for opting for non-local access to the local result viewer 2022-06-11 05:52:47 -05:00
Michael Larabel
bae667456f pts-core: Two empty() checks needed to address a possible error and warning
And a missing space between title/version in result output
2022-06-04 05:21:02 -05:00
Michael Larabel
5b5acae502 pts-core: External dependency handling fixes on openSUSE 2022-05-14 05:38:51 -05:00
Michael Larabel
29772b1efb phodevi: Avoid wmic usage on Windows as it's deprecated by Microsoft 2022-05-14 05:30:44 -05:00
Michael Larabel
ee4af66b3b pts-core: Allow uploading sub-folders within PTS_EXTRA_SYSTEM_LOGS_DIR to Phoromatic
Also viewer side support for recursive log file and add some debugging details to the log

Closes: https://github.com/phoronix-test-suite/phoronix-test-suite/pull/623
Closes: https://github.com/phoronix-test-suite/phoronix-support-issues/issues/48
2022-05-07 06:01:04 -05:00
Matthew Tippett
35711b58ba phodevi: Remove mode ratio calculation
Remove $this_ratio calculation that would cause divide by zero errors.  Does not appear to be used
anywhere and causes errors when the GPU provides only one mode.

Unreproduced failure, but appears safe.
2022-05-07 05:36:33 -05:00
Michael Larabel
85070027f1 pts-core: Don't show x86_64 test options on non-x86_64 systems
Such as with pts/stress-ng-1.5 where RdRand option now labeled "x86_64 RdRand" for filtering out options only relevant to that arch

Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/626
2022-05-07 04:47:34 -05:00
Michael Larabel
3d8d672818 pts-core: Fix TOTAL_LOOP_TIME handling
And also drop artificial 9 minute limit minimum for it

Fixes: https://github.com/phoronix-test-suite/phoronix-test-suite/issues/625
2022-05-07 04:08:16 -05:00
Michael Larabel
f9c92e3cc3 phodevi: Report vBIOS version if available for help in tracking down Linux driver issues 2022-05-07 03:49:26 -05:00
3287 changed files with 60456 additions and 4168 deletions

View File

@@ -1,4 +1,4 @@
Copyright 2008 - 2021 by Phoronix Media.
Copyright 2008 - 2025 by Phoronix Media.
Lead Architects:

View File

@@ -1,5 +1,23 @@
PHORONIX TEST SUITE CHANGE-LOG
Phoronix Test Suite 10.8.5
[GIT]
pts-core: PHP 8.2/8.3 warning fixes
pts-core: Various bug fixes
phodevi: Hardware/software detection updates
Phoronix Test Suite 10.8.4
3 July 2022
pts-core: Allow sub-folders within PTS_EXTRA_SYSTEM_LOGS_DIR when uploading to Phoromatic server
pts-core: Fix TOTAL_LOOP_TIME handling
pts-core: openSUSE external dependency handling fixes
phodevi: Support for reporting video BIOS version
phodevi: Budgie desktop version detection
phodevi: Avoid deprecated wmic usage on Windows
phoromatic: Input sanitization updates in the result viewer
Phoronix Test Suite 10.8.3
23 April 2022

View File

@@ -1,4 +1,4 @@
# Phoronix Test Suite 10.8.3
# Phoronix Test Suite 10.8.5
![Phoronix Test Suite](pts-core/static/images/pts-308x160.png)
The **Phoronix Test Suite** is the most comprehensive testing and benchmarking

View File

@@ -75,7 +75,7 @@ $spec_file .= "%{_bindir}/phoronix-test-suite\n";
$spec_file .= "%{_datadir}/phoronix-test-suite/*\n";
$spec_file .= "%{_datadir}/applications/*\n";
$spec_file .= "%{_datadir}/icons/hicolor/*\n";
$spec_file .= "%{_datadir}/appdata/%{name}.appdata.xml\n";
$spec_file .= "%{_datadir}/metainfo/com.phoronix_test_suite.phoronix_test_suite.metainfo.xml\n";
$spec_file .= "%{_datadir}/doc/*\n";
$spec_file .= "%{_mandir}/man1/%{name}.1*\n";
$spec_file .= "%config(noreplace) %{_sysconfdir}/bash_completion.d\n";

View File

@@ -1,4 +1,4 @@
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "10.8.3"
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "10.8.5"
.SH NAME
phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation.
.SH SYNOPSIS
@@ -204,6 +204,9 @@ This sub-command provides a verbose look at all tests installed/uninstalled on t
.B list-test-usage
This option will list various details about installed tests and their usage.
.TP
.B print-tests [Test | Suite | OpenBenchmarking ID | Test Result] ...
This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).
.TP
.B search
This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..
.TP
@@ -255,7 +258,7 @@ This option can be used for validating a Phoronix Test Suite test suite as being
This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.
.TP
.B compare-results-to-baseline [Test Result] [Test Result]
This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
.TP
.B compare-results-two-way [Test Result]
This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.
@@ -264,7 +267,7 @@ This option will allows you to specify a result file and from there to compare t
This option is used if you wish to edit the title and description of an existing result file.
.TP
.B extract-from-result-file [Test Result]
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.
.TP
.B keep-results-in-result-file [Test Result]
This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.
@@ -272,6 +275,12 @@ This option is the inverse of the remove-results-from-result-file sub-command. I
.B merge-results [Test Result] ...
This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
.TP
.B prune-empty-results [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.
.TP
.B prune-zero-data [Test Result]
This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.
.TP
.B remove-incomplete-results-from-result-file [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.
.TP
@@ -307,10 +316,10 @@ This option will display a short list of possible Phoronix Test Suite commands.
This option is used for testing the distribution-specific dependency handler for external dependencies.
.TP
.B debug-render-test
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.
.TP
.B debug-self-test
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.
.TP
.B help
This option will display a list of available Phoronix Test Suite commands and possible parameter types.
@@ -335,7 +344,7 @@ This option is used if you wish to analyze a result file by seeing various stati
This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
.TP
.B workload-topology [Test Result]
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.
.TP
.SH MODULES
.B auto-load-module
@@ -358,13 +367,13 @@ This option can be used for easily removing a module from the AutoLoadModules li
.TP
.SH DEBUGGING
.B check-tests [Test]
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.
.TP
.B diagnostics
This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.
.TP
.B dump-file-info
This option will dump the MD5 / SHA256 hashes and file size for a given file.
This option will dump the MD5 / SHA256 checksums and file size for a given file.
.TP
.B dump-openbenchmarking-indexes
This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).
@@ -389,7 +398,7 @@ This option will list all available test profiles that are available from the en
.TP
.SH USER CONFIGURATION
.B enterprise-setup
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.
.TP
.B network-info
This option will print information detected by the Phoronix Test Suite around the system's network configuration.
@@ -411,7 +420,7 @@ This option will print all of the official environment variables supported by th
This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.
.TP
.B result-file-to-csv [Test Result]
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
.TP
.B result-file-to-html [Test Result]
This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
@@ -448,5 +457,5 @@ https://www.openbenchmarking.org/
https://www.phoronix.com/
.br
.SH AUTHORS
Copyright 2008 - 2022 by Phoronix Media, Michael Larabel.
Copyright 2008 - 2024 by Phoronix Media, Michael Larabel.
.TP

View File

@@ -377,6 +377,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p>
<h3>list-test-usage</h3>
<p>This option will list various details about installed tests and their usage.</p>
<h3>print-tests<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).</p>
<h3>search</h3>
<p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p>
<h3>test-to-suite-map</h3>
@@ -423,7 +426,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<p>This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.</p>
<h3>compare-results-to-baseline<em> [Test Result] [Test Result]</em>
</h3>
<p>This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
<p>This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
<h3>compare-results-two-way<em> [Test Result]</em>
</h3>
<p>This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.</p>
@@ -432,13 +435,19 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<p>This option is used if you wish to edit the title and description of an existing result file.</p>
<h3>extract-from-result-file<em> [Test Result]</em>
</h3>
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.</p>
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.</p>
<h3>keep-results-in-result-file<em> [Test Result]</em>
</h3>
<p>This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.</p>
<h3>merge-results<em> [Test Result] ...</em>
</h3>
<p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
<h3>prune-empty-results<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.</p>
<h3>prune-zero-data<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.</p>
<h3>remove-incomplete-results-from-result-file<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p>
@@ -472,9 +481,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<h3>debug-dependency-handler</h3>
<p>This option is used for testing the distribution-specific dependency handler for external dependencies.</p>
<h3>debug-render-test</h3>
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
<h3>debug-self-test</h3>
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.</p>
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.</p>
<h3>help</h3>
<p>This option will display a list of available Phoronix Test Suite commands and possible parameter types.</p>
<h3>version</h3>
@@ -497,7 +506,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
<h3>workload-topology<em> [Test Result]</em>
</h3>
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.</p>
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.</p>
<h1>Modules</h1>
<h3>auto-load-module</h3>
<p>This option can be used for easily adding a module to the AutoLoadModules list in the Phoronix Test Suite user configuration file. That list controls what PTS modules are automatically loaded on start-up of the Phoronix Test Suite.</p>
@@ -517,11 +526,11 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<h1>Debugging</h1>
<h3>check-tests<em> [Test]</em>
</h3>
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.</p>
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.</p>
<h3>diagnostics</h3>
<p>This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.</p>
<h3>dump-file-info</h3>
<p>This option will dump the MD5 / SHA256 hashes and file size for a given file.</p>
<p>This option will dump the MD5 / SHA256 checksums and file size for a given file.</p>
<h3>dump-openbenchmarking-indexes</h3>
<p>This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).</p>
<h3>dump-phodevi-smart-cache</h3>
@@ -538,7 +547,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<p>This option will list all available test profiles that are available from the enabled OpenBenchmarking.org repositories but are NOT SUPPORTED on the given hardware/software platform. This is mainly a debugging option for those looking for test profiles to potentially port to new platforms, etc.</p>
<h1>User Configuration</h1>
<h3>enterprise-setup</h3>
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.</p>
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.</p>
<h3>network-info</h3>
<p>This option will print information detected by the Phoronix Test Suite around the system's network configuration.</p>
<h3>network-setup</h3>
@@ -555,7 +564,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<p>This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.</p>
<h3>result-file-to-csv<em> [Test Result]</em>
</h3>
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
<h3>result-file-to-html<em> [Test Result]</em>
</h3>
<p>This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
@@ -580,7 +589,7 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<hr style="height: 50px; border: 0;"><a name="ModuleOptions"></a><h1>Module Options</h1>
<p>The following list is the modules included with the Phoronix Test Suite that are intended to extend the functionality of pts-core. Some of these options have commands that can be run directly in a similar manner to the other Phoronix Test Suite user commands. Some modules are just meant to be loaded directly by adding the module name to the AutoLoadModules tag in ~/.phoronix-test-suite/user-config.xml or via the PTS_MODULES environment variable. A list of available modules is also available by running <em>phoronix-test-suite list-modules.</em></p><hr>
<h2>Backup Creation + Restore</h2>
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the file-name will be auto-generated with a current time-stamp.</p>
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the filename will be auto-generated with a current timestamp.</p>
<p><strong>phoronix-test-suite backup.create</strong></p>
<p><strong>phoronix-test-suite backup.restore</strong></p>
<h2>System Maintenance / Cleanup</h2>
@@ -826,7 +835,7 @@ NOTE: Use the "system-sensors" command to see what sensors are available for mon
<p>Besides <strong>phoronix-test-suite shell</strong> and <strong>phoronix-test-suite help</strong>, there is also <strong>phoronix-test-suite interactive</strong> for helping new users understand Phoronix Test Suite benchmarking. Long story short, it should be as easy as running <strong>phoronix-test-suite benchmark stockfish</strong> or <strong>phoronix-test-suite benchmark crafty</strong> as some examples for carrying out automated, cross-platform benchmarks in a side-by-side and fully-reproducible manner.</p>
<hr style="height: 50px; border: 0;"><a name="ExternalDependencies"></a><h1>External Dependencies</h1>
<p>The Phoronix Test Suite has a feature known as "External Dependencies" where the Phoronix Test Suite can attempt to automatically install some of the test-specific dependencies on supported distributions. If running on a distribution where there is currently no External Dependencies profile, the needed package name(s) are listed for manual installation.</p>
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.</p><hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>OpenSuSE</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li>
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.</p><hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE Enterprise Linux</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li><li>openSUSE</li><li>openSUSE Leap</li><li>openSUSE Tumbleweed</li>
<hr style="height: 50px; border: 0;"><a name="Configuration"></a><h1>Configuration</h1>
<h1>User Files &amp; Folders</h1>
<p>These files/folders are the default locations when running as a non-root Phoronix Test Suite user. When running as root, the paths may appear in standard system paths like <em>/etc/phoronix-test-suite.xml</em>.</p>
@@ -889,7 +898,7 @@ NOTE: Use the "system-sensors" command to see what sensors are available for mon
<h1>Testing Options</h1>
<h3>SleepTimeBetweenTests</h3>
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>8</em>.</p>
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>6</em>.</p>
<h3>SaveSystemLogs</h3>
<p>If this option is set to <em>TRUE</em>, when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to <em>FALSE</em>, the system details / logs will not be saved by default. The default value is <em>FALSE</em>. When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.</p>
<h3>SaveInstallationLogs</h3>
@@ -1032,6 +1041,10 @@ The variable is relevant for: test execution / benchmarking.
The variable is relevant for: test execution / benchmarking.
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
</p>
<h2>LOG_CLI_OUTPUT</h2>
<p><em>[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.</em></p>
<p>The value can be of type: boolean (TRUE / FALSE).
</p>
<h2>MONITOR</h2>
<p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p>
<p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp)
@@ -1402,6 +1415,9 @@ In the event that a test profile fails to install or run, the following general
<h3>Solaris Operating System Tests<em> pts/solaris</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
<h3>Steam Tests<em> pts/steam</em>
</h3>
<p>This is a collection of test profiles having an external dependency on Steam</p>
<h3>System Subsystem Tests<em> pts/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
@@ -1414,9 +1430,6 @@ In the event that a test profile fails to install or run, the following general
<h3>Smp Tests<em> pts/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cuda Tests<em> pts/cuda</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
@@ -1426,12 +1439,18 @@ In the event that a test profile fails to install or run, the following general
<h3>Openmp Tests<em> pts/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Docker Tests<em> pts/docker</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
<h3>Ai Tests<em> pts/ai</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Go Tests<em> pts/go</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
@@ -1528,12 +1547,21 @@ In the event that a test profile fails to install or run, the following general
<h3>Smp Tests<em> system/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Openmp Tests<em> system/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Mpi Tests<em> system/mpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
<h3>64-bit Arm / AArch64 Tests In git<em> git/aarch64</em>
</h3>
<p>This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.</p>
<h3>All Tests in git<em> git/all</em>
</h3>
<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
<h3>Application Tests<em> git/application</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
<h3>BSD Operating System Tests<em> git/bsd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
@@ -1552,6 +1580,9 @@ In the event that a test profile fails to install or run, the following general
<h3>Rust Tests<em> git/rust</em>
</h3>
<p>This is a collection of test profiles having an external dependency on Rust</p>
<h3>System Subsystem Tests<em> git/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
<h3>Utility Tests<em> git/utility</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
@@ -1671,7 +1702,7 @@ SUPPORTED OPENBENCHMARKING.ORG REPOSITORIES:<br>
<p>If distributing a customized/local copy of the Phoronix Test Suite, the default behavior of the configuration file (in addition to deleting the pts_openbenchmarking_upload file) can be done via the user configuration defaults defined within <em>pts-core/static/user-config-defaults.xml</em>.</p>
<hr style="height: 50px; border: 0;"><a name="DevelopmentCredits"></a><h1>Development Credits</h1>
<p>The Phoronix Test Suite is based upon the extensive testing and internal tools developed by <a href="http://www.phoronix.com/">Phoronix.com</a> since 2004 along with support from leading tier-one computer hardware and software vendors. The principal architects of the Phoronix Test Suite are <a href="http://www.michaellarabel.com/">Michael Larabel</a> and Matthew Tippett. The phoronix-test-suite, pts_Graph, Phoromatic, Phodevi, and nye_Xml are some of the related open-source projects provided by <a href="http://www.phoronix-media.com/">Phoronix Media</a>.</p>
<p style="padding-top: 30px; text-align: center;">Copyright &copy; 2008 - 2022 by Phoronix Media.</p></div>
<p style="padding-top: 30px; text-align: center;">Copyright &copy; 2008 - 2024 by Phoronix Media.</p></div>
<div id="pts_footer">
<div id="pts_footer_logo"><a href="http://www.phoronix-test-suite.com/"><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" viewbox="0 0 76 41" width="76" height="41" preserveaspectratio="xMinYMin meet">
<path d="m74 22v9m-5-16v16m-5-28v28m-23-2h12.5c2.485281 0 4.5-2.014719 4.5-4.5s-2.014719-4.5-4.5-4.5h-8c-2.485281 0-4.5-2.014719-4.5-4.5s2.014719-4.5 4.5-4.5h12.5m-21 5h-11m11 13h-2c-4.970563 0-9-4.029437-9-9v-20m-24 40v-20c0-4.970563 4.0294373-9 9-9 4.970563 0 9 4.029437 9 9s-4.029437 9-9 9h-9" stroke="#222" stroke-width="4" fill="none"></path>

View File

@@ -231,6 +231,9 @@ This sub-command provides a verbose look at all tests installed/uninstalled on t
#### list-test-usage
This option will list various details about installed tests and their usage.
#### print-tests [Test | Suite | OpenBenchmarking ID | Test Result] ...
This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).
#### search
This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..
@@ -284,7 +287,7 @@ This option can be used for validating a Phoronix Test Suite test suite as being
This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.
#### compare-results-to-baseline [Test Result] [Test Result]
This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.
#### compare-results-two-way [Test Result]
This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.
@@ -293,7 +296,7 @@ This option will allows you to specify a result file and from there to compare t
This option is used if you wish to edit the title and description of an existing result file.
#### extract-from-result-file [Test Result]
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.
This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.
#### keep-results-in-result-file [Test Result]
This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.
@@ -301,6 +304,12 @@ This option is the inverse of the remove-results-from-result-file sub-command. I
#### merge-results [Test Result] ...
This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
#### prune-empty-results [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.
#### prune-zero-data [Test Result]
This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.
#### remove-incomplete-results-from-result-file [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.
@@ -337,10 +346,10 @@ This option will display a short list of possible Phoronix Test Suite commands.
This option is used for testing the distribution-specific dependency handler for external dependencies.
#### debug-render-test
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.
This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.
#### debug-self-test
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.
This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.
#### help
This option will display a list of available Phoronix Test Suite commands and possible parameter types.
@@ -366,7 +375,7 @@ This option is used if you wish to analyze a result file by seeing various stati
This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
#### workload-topology [Test Result]
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.
This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.
## Modules
@@ -391,13 +400,13 @@ This option can be used for easily removing a module from the AutoLoadModules li
## Debugging
#### check-tests [Test]
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.
This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.
#### diagnostics
This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.
#### dump-file-info
This option will dump the MD5 / SHA256 hashes and file size for a given file.
This option will dump the MD5 / SHA256 checksums and file size for a given file.
#### dump-openbenchmarking-indexes
This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).
@@ -423,7 +432,7 @@ This option will list all available test profiles that are available from the en
## User Configuration
#### enterprise-setup
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.
This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.
#### network-info
This option will print information detected by the Phoronix Test Suite around the system's network configuration.
@@ -446,7 +455,7 @@ This option will print all of the official environment variables supported by th
This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.
#### result-file-to-csv [Test Result]
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
#### result-file-to-html [Test Result]
This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.
@@ -481,7 +490,7 @@ The following list is the modules included with the Phoronix Test Suite that are
---
### Backup Creation + Restore
This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the file-name will be auto-generated with a current time-stamp.
This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the filename will be auto-generated with a current timestamp.
**phoronix-test-suite backup.create**
@@ -881,7 +890,7 @@ Below are a list of the operating systems that currently have external dependenc
---
Alpine LinuxAmazonAngstromArch LinuxClear LinuxClearOSClearOS Core ServerDebianDragonFlyBSDFedoraGentooLinux Embedded Development EnvironmentLinux MintMac OS XMacPortsMageiaMandrivaMicrosoft WindowsMidnightBSDNetBSDOpenBSDOpenIndianaOpenMandrivaOpenMandrivaLinuxOpenSolarisOpenSuSEOptwareOracle ServerPCLinuxOSPardus LinuxRed Hat EnterpriseRed Hat Enterprise ServerSUSESUSE LinuxScientificScientificSLSolusSolus LinuxTermuxUbuntuVoid LinuxZenwalkmacOS Brew
Alpine LinuxAmazonAngstromArch LinuxClear LinuxClearOSClearOS Core ServerDebianDragonFlyBSDFedoraGentooLinux Embedded Development EnvironmentLinux MintMac OS XMacPortsMageiaMandrivaMicrosoft WindowsMidnightBSDNetBSDOpenBSDOpenIndianaOpenMandrivaOpenMandrivaLinuxOpenSolarisOptwareOracle ServerPCLinuxOSPardus LinuxRed Hat EnterpriseRed Hat Enterprise ServerSUSE Enterprise LinuxSUSE LinuxScientificScientificSLSolusSolus LinuxTermuxUbuntuVoid LinuxZenwalkmacOS BrewopenSUSEopenSUSE LeapopenSUSE Tumbleweed
# Configuration
## User Files & Folders
@@ -979,7 +988,7 @@ This option sets the directory for the main download cache. The download cache i
## Testing Options
#### SleepTimeBetweenTests
This option sets the time (in seconds) to sleep between running tests. The default value is *8* .
This option sets the time (in seconds) to sleep between running tests. The default value is *6* .
#### SaveSystemLogs
If this option is set to *TRUE* , when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to *FALSE* , the system details / logs will not be saved by default. The default value is *FALSE* . When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.
@@ -1183,6 +1192,12 @@ The variable is relevant for: test execution / benchmarking.
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
### LOG_CLI_OUTPUT
*[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.*
The value can be of type: boolean (TRUE / FALSE).
### MONITOR
*This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).*
@@ -1683,6 +1698,9 @@ This is a collection of test profiles that have been detected to be single-threa
#### Solaris Operating System Tests pts/solaris
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.
#### Steam Tests pts/steam
This is a collection of test profiles having an external dependency on Steam
#### System Subsystem Tests pts/system
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
@@ -1695,9 +1713,6 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Smp Tests pts/smp
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
#### Opencl Tests pts/opencl
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
#### Cuda Tests pts/cuda
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.
@@ -1707,12 +1722,18 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Openmp Tests pts/openmp
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.
#### Cloud Tests pts/cloud
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.
#### Docker Tests pts/docker
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.
#### Ai Tests pts/ai
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.
#### Opencl Tests pts/opencl
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
#### Cloud Tests pts/cloud
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.
#### Go Tests pts/go
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.
@@ -1809,12 +1830,21 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Smp Tests system/smp
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
#### Openmp Tests system/openmp
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.
#### Mpi Tests system/mpi
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.
#### 64-bit Arm / AArch64 Tests In git git/aarch64
This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.
#### All Tests in git git/all
This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
#### Application Tests git/application
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.
#### BSD Operating System Tests git/bsd
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
@@ -1833,6 +1863,9 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Rust Tests git/rust
This is a collection of test profiles having an external dependency on Rust
#### System Subsystem Tests git/system
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
#### Utility Tests git/utility
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

File diff suppressed because it is too large Load Diff

View File

@@ -164,6 +164,9 @@
<p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p>
<h3>list-test-usage</h3>
<p>This option will list various details about installed tests and their usage.</p>
<h3>print-tests<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).</p>
<h3>search</h3>
<p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p>
<h3>test-to-suite-map</h3>
@@ -210,7 +213,7 @@
<p>This option is used if you wish to automatically attempt to sort the results by their result identifier string. Alternatively, if using the environment variable "SORT_BY" other sort modes can be used, such as SORT_BY=date / SORT_BY=date-desc for sorting by the test run-time/date.</p>
<h3>compare-results-to-baseline<em> [Test Result] [Test Result]</em>
</h3>
<p>This option will allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
<p>This option allows you to specify a result as a baseline (first parameter) and a second result file (second parameter) that will offer some analysis for showing how the second result compares to the first in matching tests.</p>
<h3>compare-results-two-way<em> [Test Result]</em>
</h3>
<p>This option will allows you to specify a result file and from there to compare two individual runs within that result file for looking at wins/losses and other metrics in a head-to-head type comparison.</p>
@@ -219,13 +222,19 @@
<p>This option is used if you wish to edit the title and description of an existing result file.</p>
<h3>extract-from-result-file<em> [Test Result]</em>
</h3>
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.</p>
<p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is then prompted to specify a new result file name and select which result identifier to extract.</p>
<h3>keep-results-in-result-file<em> [Test Result]</em>
</h3>
<p>This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.</p>
<h3>merge-results<em> [Test Result] ...</em>
</h3>
<p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
<h3>prune-empty-results<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.</p>
<h3>prune-zero-data<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be where there is line graph data that currently has zero values (e.g. inaccurate/invalid sensor readings) and you wish to just drop those zero reading values from the result file.</p>
<h3>remove-incomplete-results-from-result-file<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p>
@@ -259,9 +268,9 @@
<h3>debug-dependency-handler</h3>
<p>This option is used for testing the distribution-specific dependency handler for external dependencies.</p>
<h3>debug-render-test</h3>
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code-paths This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
<p>This option is used during the development of the Phoronix Test Suite software for testing of the result and graph rendering code paths. This option will download a large number of reference test results from LinuxBenchmarking.com.</p>
<h3>debug-self-test</h3>
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code-paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code-paths and looking for hot areas to optimize, etc.</p>
<p>This option is used during the development of the Phoronix Test Suite software for testing of internal interfaces, commands, and other common code paths. The produced numbers should only be comparable for the same version of the Phoronix Test Suite, on the same hardware/software system, conducted on the same day of testing. This isn't intended as any scientific benchmark but simply to stress common PHP code paths and looking for hot areas to optimize, etc.</p>
<h3>help</h3>
<p>This option will display a list of available Phoronix Test Suite commands and possible parameter types.</p>
<h3>version</h3>
@@ -284,7 +293,7 @@
<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
<h3>workload-topology<em> [Test Result]</em>
</h3>
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology/make-up / logical groupings of the benchmarks being run.</p>
<p>This option will read a saved test results file and print the test profiles contained within and their arrangement within different test suites for getting an idea as to the workload topology / make-up / logical groupings of the benchmarks being run.</p>
<h1>Modules</h1>
<h3>auto-load-module</h3>
<p>This option can be used for easily adding a module to the AutoLoadModules list in the Phoronix Test Suite user configuration file. That list controls what PTS modules are automatically loaded on start-up of the Phoronix Test Suite.</p>
@@ -304,11 +313,11 @@
<h1>Debugging</h1>
<h3>check-tests<em> [Test]</em>
</h3>
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.</p>
<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, URL location, MD5 and SHA256 checksums.</p>
<h3>diagnostics</h3>
<p>This option will print information that is useful to developers when debugging problems with the Phoronix Test Suite and/or test profiles and test suites.</p>
<h3>dump-file-info</h3>
<p>This option will dump the MD5 / SHA256 hashes and file size for a given file.</p>
<p>This option will dump the MD5 / SHA256 checksums and file size for a given file.</p>
<h3>dump-openbenchmarking-indexes</h3>
<p>This option is used for dumping the parsed output of OpenBenchmarking.org index files (metadata).</p>
<h3>dump-phodevi-smart-cache</h3>
@@ -325,7 +334,7 @@
<p>This option will list all available test profiles that are available from the enabled OpenBenchmarking.org repositories but are NOT SUPPORTED on the given hardware/software platform. This is mainly a debugging option for those looking for test profiles to potentially port to new platforms, etc.</p>
<h1>User Configuration</h1>
<h3>enterprise-setup</h3>
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes and defaults the anonymous usage reporting to being disabled and other conservative defaults.</p>
<p>This option can be run by enterprise users immediately after package installation or as part of an in-house setup script. Running this command will ensure the phoronix-test-suite program is never interrupted on new runs to accept user agreement changes. It also defaults the anonymous usage reporting to being disabled, along with other conservative settings.</p>
<h3>network-info</h3>
<p>This option will print information detected by the Phoronix Test Suite around the system's network configuration.</p>
<h3>network-setup</h3>
@@ -342,7 +351,7 @@
<p>This option will read a saved test results file and output the raw result file run data to a CSV file. This raw (individual) result file output is intended for data analytic purposes where the result-file-to-csv is more end-user-ready.</p>
<h3>result-file-to-csv<em> [Test Result]</em>
</h3>
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output. The CSV (Comma Separated Values) output can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
<p>This option will read a saved test results file and output the system hardware and software information along with the results to a CSV output (Comma Separated Values) file. This file can then be loaded into a spreadsheet for easy viewing. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>
<h3>result-file-to-html<em> [Test Result]</em>
</h3>
<p>This option will read a saved test results file and output the system hardware and software information along with the results to pure HTML file. No external files are required for CSS/JavaScript or other assets. The graphs are rendered as inline SVG. This is a pure HTML-only representation of the results for emailing or other easy analysis outside of the Phoronix Test Suite. The outputted file appears in the user home directory or can otherwise be controlled via the OUTPUT_DIR and OUTPUT_FILE environment variables.</p>

View File

@@ -6,7 +6,7 @@
<body>
<p>The following list is the modules included with the Phoronix Test Suite that are intended to extend the functionality of pts-core. Some of these options have commands that can be run directly in a similar manner to the other Phoronix Test Suite user commands. Some modules are just meant to be loaded directly by adding the module name to the AutoLoadModules tag in ~/.phoronix-test-suite/user-config.xml or via the PTS_MODULES environment variable. A list of available modules is also available by running <em>phoronix-test-suite list-modules.</em><hr></p>
<h2>Backup Creation + Restore</h2>
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the file-name will be auto-generated with a current time-stamp.</p>
<p>This is a module for creating backups of the Phoronix Test Suite / Phoromatic and allows for restoring of created backups. The backup will be in ZIP or TAR format. If only a path is specified, the filename will be auto-generated with a current timestamp.</p>
<p><strong>phoronix-test-suite backup.create</strong></p>
<p><strong>phoronix-test-suite backup.restore</strong></p>
<h2>System Maintenance / Cleanup</h2>

View File

@@ -5,6 +5,6 @@
</head>
<body>
<p>The Phoronix Test Suite has a feature known as "External Dependencies" where the Phoronix Test Suite can attempt to automatically install some of the test-specific dependencies on supported distributions. If running on a distribution where there is currently no External Dependencies profile, the needed package name(s) are listed for manual installation.</p>
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.<hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>OpenSuSE</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li></p>
<p>Below are a list of the operating systems that currently have external dependencies support within the Phoronix Test Suite for the automatic installation of needed test files.<hr><ul></ul><li>Alpine Linux</li><li>Amazon</li><li>Angstrom</li><li>Arch Linux</li><li>Clear Linux</li><li>ClearOS</li><li>ClearOS Core Server</li><li>Debian</li><li>DragonFlyBSD</li><li>Fedora</li><li>Gentoo</li><li>Linux Embedded Development Environment</li><li>Linux Mint</li><li>Mac OS X</li><li>MacPorts</li><li>Mageia</li><li>Mandriva</li><li>Microsoft Windows</li><li>MidnightBSD</li><li>NetBSD</li><li>OpenBSD</li><li>OpenIndiana</li><li>OpenMandriva</li><li>OpenMandrivaLinux</li><li>OpenSolaris</li><li>Optware</li><li>Oracle Server</li><li>PCLinuxOS</li><li>Pardus Linux</li><li>Red Hat Enterprise</li><li>Red Hat Enterprise Server</li><li>SUSE Enterprise Linux</li><li>SUSE Linux</li><li>Scientific</li><li>ScientificSL</li><li>Solus</li><li>Solus Linux</li><li>Termux</li><li>Ubuntu</li><li>Void Linux</li><li>Zenwalk</li><li>macOS Brew</li><li>openSUSE</li><li>openSUSE Leap</li><li>openSUSE Tumbleweed</li></p>
</body>
</html>

View File

@@ -45,7 +45,7 @@
<h1>Testing Options</h1>
<h3>SleepTimeBetweenTests</h3>
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>8</em>.</p>
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>6</em>.</p>
<h3>SaveSystemLogs</h3>
<p>If this option is set to <em>TRUE</em>, when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to <em>FALSE</em>, the system details / logs will not be saved by default. The default value is <em>FALSE</em>. When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.</p>
<h3>SaveInstallationLogs</h3>

View File

@@ -66,6 +66,10 @@ The variable is relevant for: test execution / benchmarking.
The variable is relevant for: test execution / benchmarking.
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
</p>
<h2>LOG_CLI_OUTPUT</h2>
<p><em>[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.</em></p>
<p>The value can be of type: boolean (TRUE / FALSE).
</p>
<h2>MONITOR</h2>
<p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p>
<p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp)

View File

@@ -111,6 +111,9 @@
<h3>Solaris Operating System Tests<em> pts/solaris</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
<h3>Steam Tests<em> pts/steam</em>
</h3>
<p>This is a collection of test profiles having an external dependency on Steam</p>
<h3>System Subsystem Tests<em> pts/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
@@ -123,9 +126,6 @@
<h3>Smp Tests<em> pts/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cuda Tests<em> pts/cuda</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
@@ -135,12 +135,18 @@
<h3>Openmp Tests<em> pts/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Docker Tests<em> pts/docker</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
<h3>Ai Tests<em> pts/ai</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Go Tests<em> pts/go</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
@@ -237,12 +243,21 @@
<h3>Smp Tests<em> system/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Openmp Tests<em> system/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Mpi Tests<em> system/mpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
<h3>64-bit Arm / AArch64 Tests In git<em> git/aarch64</em>
</h3>
<p>This is a collection of test profiles where there have been successful benchmark results submitted to OpenBenchmarking.org from 64-bit Arm / AArch64 CPU architecture hardware, i.e. these tests are proven to be 64-bit Arm / AArch64 compatible though not necessarily all compatible test profiles for the given architecture - just those with submitted public results previously on OpenBenchmarking.org.</p>
<h3>All Tests in git<em> git/all</em>
</h3>
<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
<h3>Application Tests<em> git/application</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
<h3>BSD Operating System Tests<em> git/bsd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
@@ -261,6 +276,9 @@
<h3>Rust Tests<em> git/rust</em>
</h3>
<p>This is a collection of test profiles having an external dependency on Rust</p>
<h3>System Subsystem Tests<em> git/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
<h3>Utility Tests<em> git/utility</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>

View File

@@ -50,7 +50,7 @@ rm -rf $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/
rm -rf $DESTDIR$INSTALL_PREFIX/share/doc/phoronix-test-suite/
mkdir -p $DESTDIR$INSTALL_PREFIX/bin/
mkdir -p $DESTDIR$INSTALL_PREFIX/share/appdata/
mkdir -p $DESTDIR$INSTALL_PREFIX/share/metainfo/
mkdir -p $DESTDIR$INSTALL_PREFIX/share/applications/
mkdir -p $DESTDIR$INSTALL_PREFIX/share/icons/hicolor/48x48/apps/
mkdir -p $DESTDIR$INSTALL_PREFIX/share/man/man1/
@@ -74,7 +74,7 @@ cp pts-core/static/bash_completion $DESTDIR$INSTALL_PREFIX/../etc/bash_completio
cp pts-core/static/images/phoronix-test-suite.png $DESTDIR$INSTALL_PREFIX/share/icons/hicolor/48x48/apps/phoronix-test-suite.png
cp pts-core/static/phoronix-test-suite.desktop $DESTDIR$INSTALL_PREFIX/share/applications/
cp pts-core/static/phoronix-test-suite-launcher.desktop $DESTDIR$INSTALL_PREFIX/share/applications/
cp pts-core/static/phoronix-test-suite.appdata.xml $DESTDIR$INSTALL_PREFIX/share/appdata/
cp pts-core/static/com.phoronix_test_suite.phoronix_test_suite.metainfo.xml $DESTDIR$INSTALL_PREFIX/share/metainfo/
mkdir -p $DESTDIR$INSTALL_PREFIX/../usr/lib/systemd/system/
cp deploy/*-systemd/*.service $DESTDIR$INSTALL_PREFIX/../usr/lib/systemd/system/

View File

@@ -51,7 +51,6 @@ rm -rf "$DESTDIR$INSTALL_PREFIX"/share/phoronix-test-suite/
rm -rf "$DESTDIR$INSTALL_PREFIX"/share/doc/phoronix-test-suite/
mkdir -p "$DESTDIR$INSTALL_PREFIX"/bin/
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/appdata/
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/applications/
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/icons/hicolor/48x48/apps/
mkdir -p "$DESTDIR$INSTALL_PREFIX"/share/man/man1/
@@ -75,7 +74,6 @@ cp pts-core/static/bash_completion "$DESTDIR$INSTALL_PREFIX"/../etc/bash_complet
cp pts-core/static/images/phoronix-test-suite.png "$DESTDIR$INSTALL_PREFIX"/share/icons/hicolor/48x48/apps/phoronix-test-suite.png
cp pts-core/static/phoronix-test-suite.desktop "$DESTDIR$INSTALL_PREFIX"/share/applications/
cp pts-core/static/phoronix-test-suite-launcher.desktop "$DESTDIR$INSTALL_PREFIX"/share/applications/
cp pts-core/static/phoronix-test-suite.appdata.xml "$DESTDIR$INSTALL_PREFIX"/share/appdata/
mkdir -p "$DESTDIR$INSTALL_PREFIX"/../usr/lib/systemd/system/
cp deploy/*-systemd/*.service "$DESTDIR$INSTALL_PREFIX"/../usr/lib/systemd/system/
@@ -95,7 +93,7 @@ rm -f "$DESTDIR$INSTALL_PREFIX"/share/phoronix-test-suite/pts-core/static/images
rm -f "$DESTDIR$INSTALL_PREFIX"/share/phoronix-test-suite/pts-core/static/images/%phoronix-test-suite.png
sed -e 's:export PTS_DIR=$(actualpath "$(dirname "$0")"):export PTS_DIR='"$INSTALL_PREFIX"'\/share\/phoronix-test-suite:g'
sed -e 's:export PTS_DIR=$(actualpath "$(dirname "$0")"):export PTS_DIR='"$INSTALL_PREFIX"'\/share\/phoronix-test-suite:g' phoronix-test-suite > $DESTDIR$INSTALL_PREFIX/bin/phoronix-test-suite
chmod +x "$DESTDIR$INSTALL_PREFIX"/bin/phoronix-test-suite
# sed 's:\$url = PTS_PATH . \"documentation\/index.html\";:\$url = \"'"$INSTALL_PREFIX"'\/share\/doc\/packages\/phoronix-test-suite\/index.html\";:g' pts-core/commands/gui_gtk.php > $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core/commands/gui_gtk.php

File diff suppressed because one or more lines are too long

File diff suppressed because one or more lines are too long

File diff suppressed because one or more lines are too long

View File

@@ -1 +1 @@
{"overview":{"244a0e9a456f6a8561ce62689c1c96b783484955":{"description":"AV1 Video Encoding","test_version":"1.1.x","app_version":"Git","unit":"Frames Per Second","samples":40,"timing_samples":39,"hib":1,"first_appeared":1552068371,"last_appeared":1636695960,"run_time_avg":1618,"stddev_avg":0.02,"percentiles":[0.01,0.01,0.01,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.03,0.03,0.03,0.03,0.03,0.05,0.05,0.05,0.05,0.05,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.08,0.08,0.08,0.13,0.13,0.13,0.13,0.13,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.15,0.15,0.15,0.15,0.15,0.23,0.23,0.23,0.3,0.3,3.56,3.56,3.56,5.87,5.87],"run_time_percentiles":[10,10,10,17,17,17,200,200,263,263,263,390,390,396,396,396,438,438,438,438,438,439,439,439,439,439,440,440,440,442,442,442,442,442,779,779,822,822,822,847,847,847,851,851,852,852,852,893,893,1162,1162,1162,1173,1173,1761,1761,1761,1791,1791,1802,1802,1802,2300,2300,2300,2643,2643,3111,3111,3111,3113,3113,3116,3116,3116,3121,3121,3123,3123,3123,3123,3123,3123,3133,3133,3140,3140,3140,3173,3173,3207,3207,3207,3225,3225,3236,3236,3236,3262,3262],"tested_archs":["x86_64","aarch64"]}}}
{"overview":{"244a0e9a456f6a8561ce62689c1c96b783484955":{"description":"AV1 Video Encoding","test_version":"1.1.x","app_version":"Git","unit":"Frames Per Second","samples":48,"timing_samples":47,"hib":1,"first_appeared":1552068371,"last_appeared":1681404639,"run_time_avg":1344,"stddev_avg":0.45,"percentiles":[0.01,0.01,0.01,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.02,0.03,0.03,0.03,0.03,0.05,0.05,0.05,0.05,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.07,0.08,0.08,0.08,0.13,0.13,0.13,0.13,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.14,0.15,0.15,0.15,0.15,0.23,0.23,0.23,0.3,0.3,3.56,3.56,4.55,4.55,5.87,5.87,16.14,16.14,69.08,69.08,70.89,70.89,71.24,71.24,71.41,71.41,73.11,73.11,136.37,136.37],"run_time_percentiles":[2.5100000000000002,2.5100000000000002,2.5100000000000002,4.449999999999999,4.449999999999999,4.56,4.56,4.58,4.58,4.640000000000001,4.640000000000001,4.719999999999999,4.719999999999999,10,10,13,13,13,15,15,17,17,200,200,263,263,390,390,396,396,438,438,438,438,438,439,439,439,439,440,440,442,442,442,442,779,779,822,822,847,847,847,851,851,852,852,893,893,1162,1162,1173,1173,1761,1761,1791,1791,1802,1802,1802,2300,2300,2643,2643,3111,3111,3113,3113,3116,3116,3121,3121,3123,3123,3123,3123,3123,3133,3133,3140,3140,3173,3173,3207,3207,3225,3225,3236,3236,3262,3262],"tested_archs":["x86_64","aarch64"]}}}

View File

@@ -0,0 +1 @@
{"1.0.0":{"last_updated":"1673526602","commit_description":"Git-based ClickHouse test profile for QPL testing."}}

View File

@@ -0,0 +1,20 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>https://datasets.clickhouse.com/hits_compatible/hits.tsv.gz</URL>
<MD5>de2f86030d1c86fd39d03468bd90a911</MD5>
<SHA256>bd500f777ef0eb55dc9d4f0eb245870351cc44a44d72a56395048d5c15f09fe2</SHA256>
<FileName>hits.tsv.gz</FileName>
<FileSize>16298506510</FileSize>
</Package>
<Package>
<URL>https://github.com/ClickHouse/ClickBench/archive/d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0.zip</URL>
<MD5>c9e554e017403f399f3175258e12befa</MD5>
<SHA256>6ab8955c8fc0af8946f2b6d5dfdef708eafd89826e3ffa7204f664f256240238</SHA256>
<FileName>ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0.zip</FileName>
<FileSize>627752</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"overview":[]}

View File

@@ -0,0 +1,91 @@
#!/bin/bash
git clone --recursive https://github.com/ClickHouse/ClickHouse.git clickhouse-git
mkdir build
cd build
EXTRA_FLAGS="-DCMAKE_BUILD_TYPE=Release "
if grep avx /proc/cpuinfo > /dev/null
then
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_AVX=ON "
fi
if grep bmi /proc/cpuinfo > /dev/null
then
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_BMI=ON "
fi
if grep avx2 /proc/cpuinfo > /dev/null
then
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_AVX2=ON "
if grep avx512 /proc/cpuinfo > /dev/null
then
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_AVX512=ON -DENABLE_AVX512_FOR_SPEC_OP=ON "
if type accel-config > /dev/null
then
EXTRA_FLAGS="$EXTRA_FLAGS -DENABLE_QPL=ON "
fi
fi
fi
echo "Clickhouse CMake build configuration: $EXTRA_FLAGS"
cmake ../clickhouse-git $EXTRA_FLAGS
ninja
echo $? > ~/install-exit-status
cd ~
./build/programs/clickhouse server --version > ~/install-footnote 2>&1
unzip -o ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0.zip
gzip -d -k hits.tsv.gz
cp ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0/clickhouse/queries.sql queries.sql
mkdir config.d
echo "<clickhouse>
<profiles>
<default>
<allow_experimental_codecs>1</allow_experimental_codecs>
</default>
</profiles>
<compression>
<case>
<method>deflate_qpl</method>
</case>
</compression>
</clickhouse>" > config.d/qpl.xml
CLICKHOUSE_CLIENT=build/programs/clickhouse
echo "#!/bin/bash
rm -rf d*
rm -rf f*
rm -rf m*
rm -rf n*
rm -rf preprocessed_configs
rm -rf s*
rm -rf tmp
rm -rf u*
TRIES=3
./$CLICKHOUSE_CLIENT server 2>/dev/null &
SERVER_PID=\$!
sleep 5
./$CLICKHOUSE_CLIENT client < ClickBench-d9a1281ca7d2dd6c5144bd801a5ce493c0fe6fa0/clickhouse/create-tuned.sql
./$CLICKHOUSE_CLIENT client --time --query \"INSERT INTO hits FORMAT TSV\" < hits.tsv
echo \$? > ~/test-exit-status
cat queries.sql | while read query; do
sync
echo \"QUERY: \$query\" >> \$LOG_FILE
for i in \$(seq 1 \$TRIES); do
echo -n \"Clickhouse Query Time \$i: \" >> \$LOG_FILE
./$CLICKHOUSE_CLIENT client --time --format=Null --max_memory_usage=100G --max_threads=\$NUM_CPU_CORES --query=\"\$query\" --progress 0 >> \$LOG_FILE 2>&1
retval=\$?
if [ \$retval -ne 0 ]; then
echo \$retval > ~/test-exit-status
kill -9 \$SERVER_PID
sleep 3
exit
fi
done
done
kill -9 \$SERVER_PID
sleep 2
rm -rf d*
rm -rf f*
rm -rf m*
rm -rf n*
rm -rf preprocessed_configs
rm -rf s*
rm -rf tmp
rm -rf u*" > clickhouse
chmod +x clickhouse

View File

@@ -0,0 +1,25 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Clickhouse Query Time 1: #_RESULT_#</OutputTemplate>
<LineHint>Clickhouse Query Time 1:</LineHint>
<MultiMatch>GEOMETRIC_MEAN</MultiMatch>
<DivideResultDivisor>60</DivideResultDivisor>
<ArgumentsDescription>100M Rows Hits Dataset, First Run / Cold Cache</ArgumentsDescription>
</ResultsParser>
<ResultsParser>
<OutputTemplate>Clickhouse Query Time 2: #_RESULT_#</OutputTemplate>
<LineHint>Clickhouse Query Time 2:</LineHint>
<MultiMatch>GEOMETRIC_MEAN</MultiMatch>
<DivideResultDivisor>60</DivideResultDivisor>
<ArgumentsDescription>100M Rows Hits Dataset, Second Run</ArgumentsDescription>
</ResultsParser>
<ResultsParser>
<OutputTemplate>Clickhouse Query Time 3: #_RESULT_#</OutputTemplate>
<LineHint>Clickhouse Query Time 3:</LineHint>
<MultiMatch>GEOMETRIC_MEAN</MultiMatch>
<DivideResultDivisor>60</DivideResultDivisor>
<ArgumentsDescription>100M Rows Hits Dataset, Third Run</ArgumentsDescription>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,25 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>ClickHouse</Title>
<Description>ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. This test profile is currently an experimental build of ClickHouse from Git and setup for Intel QPL accelerator use.</Description>
<ResultScale>Queries Per Minute, Geo Mean</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.0</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Application</SoftwareType>
<TestType>System</TestType>
<License>Free</License>
<Status>Experimental</Status>
<ExternalDependencies>build-utilities, cmake, nasm, git, clang</ExternalDependencies>
<EnvironmentSize>91900</EnvironmentSize>
<ProjectURL>https://clickhouse.com/</ProjectURL>
<RepositoryURL>https://github.com/ClickHouse/ClickHouse</RepositoryURL>
<Maintainer>Michael Larabel</Maintainer>
<SystemDependencies>ninja, lld</SystemDependencies>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"1.1.0":{"last_updated":"1647888021","commit_description":"Update download links, adjust for v1.0+ that have changed CLI options, add threads\/framedelay options."},"1.0.1":{"last_updated":"1579721829","commit_description":"Ensure dav1d-git build folder is cleaned on reinstall."},"1.0.0":{"last_updated":"1579697045","commit_description":"Add a Git version of dav1d benchmark."}}

View File

@@ -0,0 +1,42 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.2-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ffmpeg.org/releases/ffmpeg-4.4.tar.xz</URL>
<MD5>7b9d5b652d20e8c5405304ad72636d4a</MD5>
<SHA256>06b10a183ce5371f915c6bb15b7b1fffbe046e8275099c96affc29e17645d909</SHA256>
<FileName>ffmpeg-4.4.tar.xz</FileName>
<FileSize>9557868</FileSize>
<PlatformSpecific>Linux, BSD</PlatformSpecific>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/Stream2_AV1_HD_6.8mbps.webm</URL>
<MD5>5e4c83cf494cbe6dc1668cbbd7ff774c</MD5>
<SHA256>2f23d29750a0663a6df656e8137cf934bddfc96b31e5088db2c3624f19ed14d4</SHA256>
<FileName>Stream2_AV1_HD_6.8mbps.webm</FileName>
<FileSize>122378926</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/Stream2_AV1_4K_22.7mbps.webm</URL>
<MD5>8acc9c60c10a37bf4e568b465b03e35a</MD5>
<SHA256>52f3aa1d4b4487af62d37b0f295aabbc4b57f03fdc4c76402c6358193e4aa490</SHA256>
<FileName>Stream2_AV1_4K_22.7mbps.webm</FileName>
<FileSize>409458359</FileSize>
</Package>
<Package>
<URL>http://download.opencontent.netflix.com.s3.amazonaws.com/AV1/Chimera/Old/Chimera-AV1-8bit-1920x1080-6736kbps.mp4</URL>
<MD5>d444e11f8b049de2a9739899a9c0b4f6</MD5>
<SHA256>d566d294e2c18bb274a54aad03352c92312a62c393656d38e1f7dda10c0bf10c</SHA256>
<FileName>Chimera-AV1-8bit-1920x1080-6736kbps.mp4</FileName>
<FileSize>313490236</FileSize>
</Package>
<Package>
<URL>http://download.opencontent.netflix.com.s3.amazonaws.com/AV1/Chimera/Old/Chimera-AV1-10bit-1920x1080-6191kbps.mp4</URL>
<MD5>4c0f24bac42ddcda3d46087a36492ce4</MD5>
<SHA256>df2080fd77e0dbd9138bd4f172bf008d2ade17da7ab4532fba54ceccf40a9439</SHA256>
<FileName>Chimera-AV1-10bit-1920x1080-6191kbps.mp4</FileName>
<FileSize>288122748</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,36 @@
#!/bin/sh
# FFmpeg install to demux AV1 WebM to IVF that can then be consumed by dav1d...
tar -xf ffmpeg-4.4.tar.xz
mkdir ffmpeg_/
cd ffmpeg-4.4
./configure --disable-zlib --disable-doc --prefix=$HOME/ffmpeg_/
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
make install
cd ~/
./ffmpeg_/bin/ffmpeg -i Stream2_AV1_HD_6.8mbps.webm -vcodec copy -an -f ivf summer_nature_1080p.ivf
./ffmpeg_/bin/ffmpeg -i Stream2_AV1_4K_22.7mbps.webm -vcodec copy -an -f ivf summer_nature_4k.ivf
./ffmpeg_/bin/ffmpeg -i Chimera-AV1-8bit-1920x1080-6736kbps.mp4 -vcodec copy -an -f ivf chimera_8b_1080p.ivf
./ffmpeg_/bin/ffmpeg -i Chimera-AV1-10bit-1920x1080-6191kbps.mp4 -vcodec copy -an -f ivf chimera_10b_1080p.ivf
rm -rf ffmpeg-4.2.1
rm -rf ffmpeg_
# Build Dav1d
rm -rf dav1d-git
git clone https://code.videolan.org/videolan/dav1d.git dav1d-git
cd dav1d-git
git rev-parse --short HEAD > ~/install-footnote
mkdir build
meson build --buildtype release
ninja -C build
echo $? > ~/install-exit-status
cd ~
echo "#!/bin/sh
./dav1d-git/build/tools/dav1d \$@ > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > dav1d
chmod +x dav1d

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.2-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Decoded 8929 8929 frames (100.0%) - #_RESULT_# 25 fps (9.20x)</OutputTemplate>
<LineHint>fps</LineHint>
<TurnCharsToSpace>/</TurnCharsToSpace>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,140 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.2-->
<PhoronixTestSuite>
<TestInformation>
<Title>dav1d</Title>
<AppVersion>Git</AppVersion>
<Description>Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content. The git/dav1d test profile builds against current dav1d Git, for the static version use the pts/dav1d test profile.</Description>
<ResultScale>FPS</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.0</Version>
<SupportedPlatforms>Linux, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, yasm, meson, git</ExternalDependencies>
<EnvironmentSize>1200</EnvironmentSize>
<ProjectURL>https://www.videolan.org/projects/dav1d.html</ProjectURL>
<RepositoryURL>http://code.videolan.org/videolan/dav1d</RepositoryURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>--muxer null </Arguments>
</Default>
<Option>
<DisplayName>Video Input</DisplayName>
<Identifier>video</Identifier>
<ArgumentPrefix>-i </ArgumentPrefix>
<Menu>
<Entry>
<Name>Summer Nature 1080p</Name>
<Value>summer_nature_1080p.ivf</Value>
</Entry>
<Entry>
<Name>Summer Nature 4K</Name>
<Value>summer_nature_4k.ivf</Value>
</Entry>
<Entry>
<Name>Chimera 1080p</Name>
<Value>chimera_8b_1080p.ivf</Value>
</Entry>
<Entry>
<Name>Chimera 1080p 10-bit</Name>
<Value>chimera_10b_1080p.ivf</Value>
</Entry>
</Menu>
</Option>
<Option>
<DisplayName>Threads</DisplayName>
<Identifier>threads</Identifier>
<ArgumentPrefix>--threads </ArgumentPrefix>
<Menu>
<Entry>
<Name>1</Name>
<Value>1</Value>
</Entry>
<Entry>
<Name>4</Name>
<Value>4</Value>
</Entry>
<Entry>
<Name>8</Name>
<Value>8</Value>
</Entry>
<Entry>
<Name>16</Name>
<Value>16</Value>
</Entry>
<Entry>
<Name>32</Name>
<Value>32</Value>
</Entry>
<Entry>
<Name>64</Name>
<Value>64</Value>
</Entry>
<Entry>
<Name>128</Name>
<Value>128</Value>
</Entry>
<Entry>
<Name>160</Name>
<Value>160</Value>
</Entry>
<Entry>
<Name>256</Name>
<Value>256</Value>
</Entry>
<Entry>
<Name>384</Name>
<Value>384</Value>
</Entry>
</Menu>
</Option>
<Option>
<DisplayName>Frame Delay</DisplayName>
<Identifier>frame-delay</Identifier>
<ArgumentPrefix>--framedelay </ArgumentPrefix>
<Menu>
<Entry>
<Name>1</Name>
<Value>1</Value>
</Entry>
<Entry>
<Name>4</Name>
<Value>4</Value>
</Entry>
<Entry>
<Name>8</Name>
<Value>8</Value>
</Entry>
<Entry>
<Name>12</Name>
<Value>12</Value>
</Entry>
<Entry>
<Name>16</Name>
<Value>16</Value>
</Entry>
<Entry>
<Name>24</Name>
<Value>24</Value>
</Entry>
<Entry>
<Name>32</Name>
<Value>32</Value>
</Entry>
<Entry>
<Name>64</Name>
<Value>64</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

File diff suppressed because one or more lines are too long

File diff suppressed because one or more lines are too long

View File

@@ -1 +1 @@
{"overview":{"622f5f75d068059e83e0f1d74060a7bd53ef41a5":{"description":"1080p 8-bit YUV To HEVC Video Encode","test_version":"1.0.x","app_version":"Git","unit":"Frames Per Second","samples":74,"timing_samples":73,"hib":1,"first_appeared":1552068371,"last_appeared":1641941673,"run_time_avg":182,"stddev_avg":2.28,"percentiles":[0.25,0.25,0.38,1.14,1.14,1.54,4.24,5.3,5.3,5.6,7.38,7.39,7.39,40.35,54.7,76.93,76.93,77.43,77.81,81.94,81.94,87.12,87.4,95.85,95.85,96.04,97.06,97.06,97.57,97.6,97.69,97.69,98.56,98.75,98.79,98.79,98.94,99.35,99.44,99.44,99.71,99.92,100.38,100.38,100.8,100.85,101.11,101.11,101.36,101.53,102.89,102.89,104.36,106.75,106.75,107.56,108.22,108.71,108.71,115.3,120.2,125.26,125.26,125.66,126.55,137.89,137.89,142.12,146.55,147.65,147.65,149.46,150.38,150.6,150.6,151,151.06,151.06,152.13,174.42,196.71,196.71,203.28,210.13,228.72,228.72,253,257.61,257.9,257.9,261,261.08,265.85,265.85,277.69,298.36,343.67,343.67,363,363.18],"run_time_percentiles":[7.28,7.28,8.43,8.89,8.89,9.36,9.85,10,10,12,13,13,13,13,14,14,14,14,15,15,16,17,18,18,18,18,18,18,18,18,18,18,18,19,19,19,19,19,19,19,19,19,20,20,20,20,21,22,22,22,24,24,24,24,25,25,25,25,26,31,31,34,39,39,41,43,43,43,43,45,45,45,46,51,51,51,60,65,65,80,94,95,95,96,96,97,97,98,126,126,247,247,325,325,342,430,1577,1577,3211,4760],"tested_archs":["x86_64"]}}}
{"overview":{"622f5f75d068059e83e0f1d74060a7bd53ef41a5":{"description":"1080p 8-bit YUV To HEVC Video Encode","test_version":"1.0.x","app_version":"Git","unit":"Frames Per Second","samples":85,"timing_samples":84,"hib":1,"first_appeared":1552068371,"last_appeared":1689666386,"run_time_avg":167,"stddev_avg":2.37,"percentiles":[0.25,0.25,0.38,1.14,1.54,4.24,4.65,4.65,5.3,5.6,7.38,7.39,40.35,40.5,40.5,51.32,51.33,54.7,76.93,77.43,77.81,77.81,81.94,83.56,84.12,87.12,87.4,87.4,95.85,96.04,97.06,97.57,97.6,97.69,97.69,98.56,98.75,98.79,98.94,99.35,99.44,99.44,99.71,99.92,100.38,100.8,100.85,100.85,101.11,101.36,101.53,102.89,104.36,106.75,106.75,107.56,108.22,108.71,115.3,120.2,125.26,125.26,125.66,126.55,137.89,142.12,146.55,146.55,147.65,147.88,149.46,150.38,150.6,151,151,151.06,152.13,174.42,184.3,185.29,196.71,196.71,203.28,210.13,228.72,249.59,253,253,257.61,257.9,261,261.08,265.85,277.69,277.69,292.81,298.36,343.67,363,363.18],"run_time_percentiles":[7.28,7.28,8.18,8.43,8.89,9.36,9.85,9.85,10,10,11,12,13,13,13,13,13,14,14,14,14,15,16,17,18,18,18,18,18,18,18,18,18,18,19,19,19,19,19,19,19,20,20,20,20,21,22,22,24,24,24,24,25,25,25,26,28,28,31,34,37,37,39,39,41,43,43,43,45,45,45,45,46,46,51,51,51,60,65,80,92,94,94,95,96,96,97,98,98,126,247,247,325,342,342,391,430,1577,3211,4760],"tested_archs":["x86_64"]}}}

View File

@@ -0,0 +1 @@
{"1.0.0":{"last_updated":"1683925273","commit_description":"Allow automating 3DMark benchmark if you have the necessary licensed files already on your system."}}

View File

@@ -0,0 +1,10 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<Downloads>
<Package>
<FileName>3dmark-attan-extreme-1.1.2.1-workload-bin.zip</FileName>
<FileSize>277469377</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,23 @@
#!/bin/sh
unzip -o 3dmark-attan-extreme-1.1.2.1-workload-bin.zip
chmod +x bin/linux/x64/workload
echo "#!/bin/sh
echo \"{
\\\"workload_name\\\": \\\"WildLifeGt1XC\\\",
\\\"rendering_resolution\\\": [\$1, \$2],
\\\"asset_root\\\": \\\"assets_desktop\\\",
\\\"timeline\\\": \\\"timelines_heavy/attan_gt1_heavy_timeline.txt\\\",
\\\"fullscreen\\\": true,
\\\"debug_api\\\": false,
\\\"enable_debug_log\\\": false,
\\\"base_log_path\\\": \\\"\\\",
\\\"threads\\\": 0,
\\\"vsync\\\": false,
\\\"loop\\\": false,
\\\"loop_count\\\": 0
}\" > settings/pts.json
rm -f result.json
./bin/linux/x64/workload --in=settings/pts.json --out=result.json
echo \$? > ~/test-exit-status
cat result.json > \$LOG_FILE" > 3dmark
chmod +x 3dmark

View File

@@ -0,0 +1,23 @@
#!/bin/sh
unzip -o 3dmark-attan-extreme-1.1.2.1-workload-bin.zip
chmod +x bin/windows/x64/workload.exe
echo "#!/bin/sh
echo \"{
\\\"workload_name\\\": \\\"WildLifeGt1XC\\\",
\\\"rendering_resolution\\\": [\$1, \$2],
\\\"asset_root\\\": \\\"assets_desktop\\\",
\\\"timeline\\\": \\\"timelines_heavy/attan_gt1_heavy_timeline.txt\\\",
\\\"fullscreen\\\": true,
\\\"debug_api\\\": false,
\\\"enable_debug_log\\\": false,
\\\"base_log_path\\\": \\\"\\\",
\\\"threads\\\": 0,
\\\"vsync\\\": false,
\\\"loop\\\": false,
\\\"loop_count\\\": 0
}\" > settings/pts.json
rm -f result.json
./bin/windows/x64/workload.exe --in=settings/pts.json --out=result.json
echo \$? > ~/test-exit-status
cat result.json > \$LOG_FILE" > 3dmark
chmod +x 3dmark

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate> "value": #_RESULT_#</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,38 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>3DMark Wild Life Extreme</Title>
<AppVersion>1.1.2.1</AppVersion>
<Description>This test profile only automates the vendor build of 3DMark with its command-line / JSON support. If you do not have a licensed copy of the necessary 3DMark binaries in your Phoronix Test Suite download cache on your system, this test profile will not do anything and simply fail. You must have already obtained the proper licensed binaries from UL for this test profile to work -- this test profile simply automates the firing of the 3DMark benchmark at your desired resolution and capturing the results within the Phoronix Test Suite while you must already have the necessary 3DMark files on your system.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
<PreInstallMessage>This test profile only automates the vendor build of 3DMark with its command-line / JSON support. If you do not have a licensed copy of the necessary 3DMark binaries in your Phoronix Test Suite download cache on your system, this test profile will not do anything and simply fail. You must have already obtained the proper licensed binaries from UL for this test profile to work -- this test profile simply automates the firing of the 3DMark benchmark at your desired resolution and capturing the results within the Phoronix Test Suite while you must already have the necessary 3DMark files on your system.</PreInstallMessage>
</TestInformation>
<TestProfile>
<Version>1.0.0</Version>
<SupportedPlatforms>Linux, Windows</SupportedPlatforms>
<SoftwareType>Game</SoftwareType>
<TestType>Graphics</TestType>
<License>Restricted</License>
<Status>Experimental</Status>
<SupportedArchitectures>x86_64</SupportedArchitectures>
<RequiresDisplay>TRUE</RequiresDisplay>
<EnvironmentSize>598</EnvironmentSize>
<ProjectURL>https://www.3dmark.com/</ProjectURL>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Option>
<DisplayName>Resolution</DisplayName>
<Identifier>auto-resolution</Identifier>
<Menu>
<Entry>
<Name>$VIDEO_WIDTH x $VIDEO_HEIGHT</Name>
<Value>$VIDEO_WIDTH $VIDEO_HEIGHT</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"1.0.2":{"last_updated":"1658252311","commit_description":"Update tensorflow pip dependency so it works on newer distributuions."},"1.0.1":{"last_updated":"1605138215","commit_description":"Fix for macOS support."},"1.0.0":{"last_updated":"1594232753","commit_description":"Initial commit of AI Benchmark Alpha."}}

View File

@@ -0,0 +1 @@
{"overview":{"6ca1d493839e7acaaacdd66d2ed4166cbcc71052":{"description":"Device Inference Score","test_version":"1.0.x","app_version":"0.1.2","unit":"Score","samples":1164,"timing_samples":1149,"hib":1,"first_appeared":1594236431,"last_appeared":1705438847,"run_time_avg":1206,"stddev_avg":0,"percentiles":[46,236,370,417,465,511,536,569,581,627,640,660,665,673,681,703,728,735,745,756,769,815,863,889,936,955,986,1020,1029,1041,1060,1077,1090,1102,1120,1128,1162,1173,1183,1245,1268,1284,1294,1306,1321,1352,1373,1392,1412,1428,1454,1464,1481,1502,1533,1569,1580,1605,1619,1638,1654,1660,1711,1735,1768,1788,1811,1825,1837,1843,1854,1861,1879,1894,1906,1912,1921,1928,1936,1952,1968,1983,2007,2026,2042,2054,2079,2100,2125,2159,2232,2288,2324,2343,2508,2857,3341,3995,4700,18696],"run_time_percentiles":[379,560,646,705,734,798,859,865,952,979,983,1007,1020,1033,1035,1042,1048,1056,1060,1063,1071,1074,1075,1079,1083,1085,1087,1091,1093,1098,1103,1105,1108,1114,1119,1121,1125,1129,1131,1133,1136,1141,1146,1147,1150,1154,1157,1159,1163,1167,1170,1174,1177,1182,1187,1188,1197,1201,1206,1211,1217,1223,1226,1230,1235,1241,1253,1259,1269,1279,1287,1295,1299,1307,1315,1322,1329,1338,1350,1360,1370,1382,1390,1403,1418,1428,1434,1447,1468,1478,1496,1512,1520,1528,1537,1582,1616,1658,1762,2199],"tested_archs":["x86_64","aarch64","arm64"]},"18d0ce5cc395e59249172d7c8c5cd0ae47d30c7e":{"description":"Device AI Score","test_version":"1.0.x","app_version":"0.1.2","unit":"Score","samples":1163,"timing_samples":1149,"hib":1,"first_appeared":1594236431,"last_appeared":1705438847,"run_time_avg":1206,"stddev_avg":0,"percentiles":[74,487,785,930,1034,1118,1152,1200,1256,1272,1288,1318,1349,1372,1391,1424,1512,1546,1598,1636,1689,1722,1737,1765,1825,1910,1943,1965,1982,1996,2053,2111,2150,2206,2215,2221,2236,2277,2303,2340,2374,2401,2445,2464,2486,2527,2562,2586,2612,2621,2654,2673,2686,2714,2734,2771,2792,2855,2898,2908,2925,2932,2998,3018,3045,3072,3113,3124,3153,3176,3205,3251,3279,3333,3352,3390,3411,3439,3472,3495,3518,3545,3572,3611,3672,3730,3781,3886,3992,4176,4189,4521,4778,5532,5574,6548,7522,9310,10315,38200],"run_time_percentiles":[379,560,646,705,734,798,859,865,952,979,983,1007,1020,1033,1035,1042,1048,1056,1060,1063,1071,1074,1075,1079,1083,1085,1087,1091,1093,1098,1103,1105,1108,1114,1119,1121,1125,1129,1131,1133,1136,1141,1146,1147,1150,1154,1157,1159,1163,1167,1170,1174,1177,1182,1187,1188,1197,1201,1206,1211,1217,1223,1226,1230,1235,1241,1253,1259,1269,1279,1287,1295,1299,1307,1315,1322,1329,1338,1350,1360,1370,1382,1390,1403,1418,1428,1434,1447,1468,1478,1496,1512,1520,1528,1537,1582,1616,1658,1762,2199],"tested_archs":["x86_64","aarch64","arm64"]},"5a3d50e3e91837d6f813a215ecd471122e41fbda":{"description":"Device Training Score","test_version":"1.0.x","app_version":"0.1.2","unit":"Score","samples":1162,"timing_samples":1148,"hib":1,"first_appeared":1594236431,"last_appeared":1705438847,"run_time_avg":1206,"stddev_avg":0,"percentiles":[28,260,421,491,548,574,596,603,611,625,638,677,687,691,706,731,751,776,785,790,818,839,853,861,870,883,897,910,924,949,964,974,986,992,1002,1025,1038,1044,1051,1059,1062,1066,1074,1079,1086,1094,1104,1109,1125,1130,1133,1135,1145,1160,1173,1179,1185,1197,1216,1226,1249,1263,1277,1282,1288,1307,1319,1338,1348,1362,1391,1407,1428,1446,1456,1466,1478,1490,1503,1518,1534,1553,1606,1634,1720,1790,1841,1878,2020,2306,2496,2612,2811,3222,3508,3691,4163,5090,5648,19122],"run_time_percentiles":[379,560,646,705,734,798,859,865,952,979,983,1007,1020,1033,1035,1042,1048,1056,1060,1063,1071,1074,1075,1079,1083,1085,1087,1091,1093,1097,1103,1105,1108,1113,1119,1121,1125,1129,1131,1133,1136,1141,1146,1147,1150,1154,1157,1159,1163,1167,1170,1174,1177,1182,1187,1188,1197,1201,1205,1211,1216,1223,1226,1230,1234,1241,1251,1259,1269,1279,1286,1295,1298,1307,1315,1322,1329,1337,1350,1360,1369,1381,1390,1401,1418,1428,1434,1447,1468,1478,1496,1512,1520,1528,1537,1582,1616,1658,1762,2199],"tested_archs":["x86_64","aarch64","arm64"]}}}

View File

@@ -0,0 +1,25 @@
#!/bin/bash
if which pip3 >/dev/null 2>&1 ;
then
echo 0 > ~/install-exit-status
else
echo "ERROR: Python pip3 is not found on the system! This test profile needs Python pip3 to proceed."
echo 2 > ~/install-exit-status
fi
pip3 install --user tensorflow==2.9.1
pip3 install --user ai-benchmark==0.1.2
if [[ ! -f "$HOME/.local/bin/ai-benchmark" ]]
then
echo "ERROR: AI-Benchmark failed to install on the system!"
echo 2 > ~/install-exit-status
fi
echo "#!/bin/bash
cd \$HOME/.local/bin/
python3 ./ai-benchmark > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > ai-benchmark
chmod +x ai-benchmark

View File

@@ -0,0 +1,25 @@
#!/bin/bash
if which pip3 >/dev/null 2>&1 ;
then
echo 0 > ~/install-exit-status
else
echo "ERROR: Python pip3 is not found on the system! This test profile needs Python pip3 to proceed."
echo 2 > ~/install-exit-status
fi
pip3 install --user tensorflow==2.9.1
pip3 install --user ai-benchmark==0.1.2
if [[ ! -f "$HOME/.local/bin/ai-benchmark" ]]
then
echo "ERROR: AI-Benchmark failed to install on the system!"
echo 2 > ~/install-exit-status
fi
echo "#!/bin/bash
cd \$HOME/Library/Python/3.*/bin/
python3 ./ai-benchmark > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > ai-benchmark
chmod +x ai-benchmark

View File

@@ -0,0 +1,16 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Device Inference Score: #_RESULT_#</OutputTemplate>
<ArgumentsDescription>Device Inference Score</ArgumentsDescription>
</ResultsParser>
<ResultsParser>
<OutputTemplate>Device Training Score: #_RESULT_#</OutputTemplate>
<ArgumentsDescription>Device Training Score</ArgumentsDescription>
</ResultsParser>
<ResultsParser>
<OutputTemplate>Device AI Score: #_RESULT_#</OutputTemplate>
<ArgumentsDescription>Device AI Score</ArgumentsDescription>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,25 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>AI Benchmark Alpha</Title>
<AppVersion>0.1.2</AppVersion>
<Description>AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library.</Description>
<ResultScale>Score</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>1</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.2</Version>
<SupportedPlatforms>Linux, BSD, MacOSX</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>System</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>python</ExternalDependencies>
<RequiresInternet>TRUE</RequiresInternet>
<EnvironmentSize>10</EnvironmentSize>
<ProjectURL>http://ai-benchmark.com/alpha</ProjectURL>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"1.1.3":{"last_updated":"1659825851","commit_description":"This test is still deprecated and not useful when there are tests like FIO, but update download link so at least mirror is serving for those wanting it..."},"1.1.2":{"last_updated":"1601214674","commit_description":"Deprecate aio-stress."},"1.1.1":{"last_updated":"1376422733","commit_description":"Fix aio-stress compilation."},"1.1.0":{"last_updated":"1291658419","commit_description":"Initial import into OpenBenchmarking.org"}}

View File

@@ -0,0 +1,12 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aio-stress.c</URL>
<MD5>727e5fc3566837b3ea72f887d048769b</MD5>
<FileName>aio-stress.c</FileName>
<FileSize>39513</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"overview":{"2829059a4752865dce3ac12c01497347a3b14174":{"description":"Test: Random Write","test_version":"1.1.x","app_version":"0.21","unit":"MB\/s","samples":6263,"timing_samples":741,"hib":1,"first_appeared":1298700000,"last_appeared":1708096136,"run_time_avg":148,"stddev_avg":9.39,"percentiles":[0.11,2.49,5.07,7.07,8.8,10.36,11.54,12.61,13.42,14.63,16.12,17.68,18.77,20.7,22.1,24.26,25.84,28.12,29.79,30.97,32.99,35.83,39.02,42.52,47.72,51.34,55.4,58.65,62.07,68.01,74.49,82.1,91.68,99.98,111.33,122.4,135.18,139.05,144.71,157.22,174.46,188.49,203.64,222.5,242.34,261.19,284.98,313.32,341.25,372.3,396.39,429.8,461.2,497.2,538.38,581.94,630.45,680.19,721.47,771.65,837.14,895.04,938.05,991.19,1029.66,1072.45,1122.99,1180.32,1252.77,1319.31,1374.3,1416.16,1479.2,1531.54,1596.17,1637.39,1678.38,1745.03,1790.89,1848.82,1917.18,1997.51,2070.08,2151.41,2166.72,2197.63,2284.9,2376.22,2439.56,2571.14,2679.23,2820.7,2958.07,3057.58,3209.87,3446.23,3552,3638.31,3828.9,4269.57],"run_time_percentiles":[1.7200000000000002,2.8499999999999996,3.34,3.7199999999999998,3.84,4,4.27,4.48,4.73,5.09,5.41,5.72,5.99,6.379999999999999,6.52,7.18,8.52,9.55,10,10,11,11,11,12,12,13,14,15,16,17,17,17,20,22,23,24,24,26,28,30,31,31,32,33,34,34,35,37,38,42,45,48,50,52,55,56,58,61,62,63,65,70,72,73,77,79,81,83,86,88,96,101,106,112,116,124,130,136,148,163,186,203,215,233,242,254,268,293,352,372,426,446,480,531,586,724,894,1060,1218,1525],"tested_archs":["x86_64","i686","ppc64le","armv7l","mips64","ppc64","aarch64","armv6l","mips64el"]},"f4f9a92cea869281661787dedbabbf000d252bea":{"description":"Random Write","test_version":"1.1.x","app_version":"0.21","unit":"MB\/s","samples":2960,"timing_samples":262,"hib":1,"first_appeared":1298700000,"last_appeared":1707157794,"run_time_avg":95,"stddev_avg":6.43,"percentiles":[0.53,3.63,6.15,8.48,10.05,12.33,13.36,15.39,17.85,20.53,23.46,25.41,29.18,33.9,37.82,42.48,46.21,49.52,56.28,62.72,70.8,80.35,88.55,101.07,113.84,129.52,149.09,173.31,191.48,210.56,233.5,267.63,300.94,340.51,391.16,446.19,497.76,550.9,606.8,649.4,682.41,727,779,810.99,835.06,861.85,898.34,934.16,976.06,1025.64,1054.05,1093.77,1131.8,1168,1212.77,1275,1331.53,1373.41,1398.13,1429.7,1464.03,1488,1523.91,1558.14,1592.18,1629.13,1684.41,1728.83,1776.49,1820.27,1862.01,1899.03,1923.76,1944.38,1979.05,2011.05,2042.17,2068.85,2105.32,2149.79,2183.86,2215.6,2253.16,2292.94,2340.76,2373.33,2421.18,2467.18,2503.61,2540.16,2591.14,2645.37,2732.25,2798.48,2885.71,3042.85,3144.34,3344.46,3599.46,3910.81],"run_time_percentiles":[2.07,3.54,4.2,4.359999999999999,4.52,4.5600000000000005,5.2299999999999995,5.81,6.09,6.19,6.369999999999999,6.57,7.039999999999999,7.4399999999999995,7.449999999999999,8.07,8.15,8.26,8.59,8.66,8.93,9.02,9.16,9.51,9.61,9.69,9.74,9.959999999999999,10,10,11,11,11,12,12,13,13,14,17,18,18,19,20,20,21,21,23,25,26,26,27,28,29,30,31,31,31,32,35,37,39,42,44,46,47,48,49,53,56,57,61,63,63,69,71,73,79,79,82,88,94,108,117,129,139,143,164,168,193,212,243,249,299,325,411,448,489,596,808,1240],"tested_archs":["x86_64","i686","ppc","armv7l","armv5tel","armv6l","sparc64","aarch64","ppc64","ppc64le"]},"f741d1daf21b100843b4f58c3dfcd4ef82391acd":{"description":"","test_version":"1.1.x","app_version":"0.21","unit":"MB\/s","samples":20,"timing_samples":13,"hib":1,"first_appeared":1519443538,"last_appeared":1558024404,"run_time_avg":112,"stddev_avg":1.68,"percentiles":[874.72,874.72,874.72,874.72,874.72,1145.51,1145.51,1145.51,1145.51,1145.51,1726.03,1726.03,1726.03,1726.03,1726.03,1779.25,1779.25,1779.25,1779.25,1779.25,2137.06,2137.06,2137.06,2137.06,2137.06,2168.91,2168.91,2168.91,2168.91,2168.91,2417.96,2417.96,2417.96,2417.96,2417.96,3259.43,3259.43,3259.43,3259.43,3259.43,3529.37,3529.37,3529.37,3529.37,3529.37,4029.93,4029.93,4029.93,4029.93,4029.93,4053,4053,4053,4053,4053,4254,4254,4254,4254,4254,4315.17,4315.17,4315.17,4315.17,4315.17,4342,4342,4342,4342,4342,4454.4,4454.4,4454.4,4454.4,4454.4,4502.18,4502.18,4502.18,4502.18,4502.18,4511.63,4511.63,4511.63,4511.63,4511.63,4516.85,4516.85,4516.85,4516.85,4516.85,4675.08,4675.08,4675.08,4675.08,4675.08,5109.61,5109.61,5109.61,5109.61,5109.61],"run_time_percentiles":[74,74,74,74,74,74,74,74,76,76,76,76,76,76,76,76,81,81,81,81,81,81,81,81,104,104,104,104,104,104,104,105,105,105,105,105,105,105,105,105,105,105,105,105,105,105,105,115,115,115,115,115,115,115,127,127,127,127,127,127,127,127,129,129,129,129,129,129,129,129,130,130,130,130,130,130,130,134,134,134,134,134,134,134,134,136,136,136,136,136,136,136,136,137,137,137,137,137,137,137],"tested_archs":["x86_64"]}}}

View File

@@ -0,0 +1,11 @@
#!/bin/sh
cc -Wall -O3 -pthread -o aio-stress-bin aio-stress.c -laio
echo $? > ~/install-exit-status
# add support for allowing aio-test-file to be on removable media devices
echo "#!/bin/sh
./aio-stress-bin \$@ aio-test-file > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status
rm -f aio-test-file" > aio-stress
chmod +x aio-stress

View File

@@ -0,0 +1,16 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>adding stage random write
dropping thread count to the number of contexts 1
starting with random write
file size 1024MB, record size 64KB, depth 64, ios per iteration 8
max io_submit 8, buffer alignment set to 4KB
threads 1 files 1 contexts 1 context offset 2MB verification off
random write on aio-test-file (#_RESULT_# MB/s) 1024.00 MB in 3.84s
thread 0 random write totals (63.36 MB/s) 1024.00 MB in 16.16s
Running single thread version</OutputTemplate>
<LineHint>random write on aio-test-file</LineHint>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,40 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>AIO-Stress</Title>
<AppVersion>0.21</AppVersion>
<Description>AIO-Stress is an a-synchronous I/O benchmark created by SuSE. Current this profile uses a 2048MB test file and a 64KB record size.</Description>
<ResultScale>MB/s</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.3</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Benchmark</SoftwareType>
<TestType>Disk</TestType>
<License>Free</License>
<Status>Deprecated</Status>
<ExternalDependencies>build-utilities, libaio-development</ExternalDependencies>
<EnvironmentSize>0.5</EnvironmentSize>
<EnvironmentTestingSize>1024</EnvironmentTestingSize>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-s 2g -r 64k -t 3</Arguments>
</Default>
<Option>
<DisplayName>Test</DisplayName>
<Identifier>test</Identifier>
<ArgumentPrefix>-o </ArgumentPrefix>
<Menu>
<Entry>
<Name>Random Write</Name>
<Value>2</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -1 +1 @@
{"1.2.1":{"last_updated":"1587821615","commit_description":"Build fix for GCC 10 over -fcommon."},"1.2.0":{"last_updated":"1578702218","commit_description":"Update against aircrack-ng 1.5.2 upstream."},"1.1.2":{"last_updated":"1544204113","commit_description":"Add FreeBSD support - https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/49"},"1.1.1":{"last_updated":"1534766496","commit_description":"Libtool is a needed external dependency."},"1.1.0":{"last_updated":"1534764076","commit_description":"Just default to the program selection of optimal SIMD mode for given CPU than punting it out as a test option."},"1.0.0":{"last_updated":"1534721886","commit_description":"Initial commit of aircrack-ng."}}
{"1.3.0":{"last_updated":"1658341022","commit_description":"Update against aircrack-ng 1.7 upstream."},"1.2.1":{"last_updated":"1587821615","commit_description":"Build fix for GCC 10 over -fcommon."},"1.2.0":{"last_updated":"1578702218","commit_description":"Update against aircrack-ng 1.5.2 upstream."},"1.1.2":{"last_updated":"1544204113","commit_description":"Add FreeBSD support - https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/49"},"1.1.1":{"last_updated":"1534766496","commit_description":"Libtool is a needed external dependency."},"1.1.0":{"last_updated":"1534764076","commit_description":"Just default to the program selection of optimal SIMD mode for given CPU than punting it out as a test option."},"1.0.0":{"last_updated":"1534721886","commit_description":"Initial commit of aircrack-ng."}}

View File

@@ -1 +1 @@
{"overview":{"d2d7056061e60fa2028ce3c43a2c5b9ef1054d15":{"description":"","test_version":"1.2.x","app_version":"1.5.2","unit":"k\/s","samples":1239,"timing_samples":1084,"hib":1,"first_appeared":1298700000,"last_appeared":1644671738,"run_time_avg":91,"stddev_avg":0.35,"percentiles":[21.301,564.86,732.609,859.239,1135.158,1312.751,2374.469,2988.239,4528.306,5530.121,6080.323,7097.289,9816.583,10871.199,11782.264,12645.586,14110.899,15308.778,16315.864,21261.418,22510.359,23406.397,23578.213,24041.231,25302.454,26000.194,28094.217,29153.007,30745.605,31941.767,32820.82,34428.901,35831.751,36549.701,39171.317,41967.424,42837.239,43380.448,44509.906,45816.605,46017.203,46918.01,48195.792,49602.012,49828.659,51441.775,56060.484,56987.685,58522.66,61096.182,61777.853,63293.533,67285.917,70179.706,71372.792,73241.349,74570.422,74867.396,75232.563,76600.156,78155.112,81288.125,85859.643,87239.099,89544.31,91122.013,93309.013,95752.747,102066.641,105477.352,112289.3,114487.602,117948.081,119683.651,121307.56,122135.474,123965.623,136235.312,140660.365,143169.12,147145.813,150246.589,153409.854,154391.141,158501.557,171180.016,176411.323,183954.51,187755.724,191463.005,208055.63,210157.651,212825.677,235281.64,269072.198,279013.979,305708.052,342733.521,369565.886,411439.698],"run_time_percentiles":[90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,91,91,91,91,91,91,91,91,91,91,91,91,91,91],"tested_archs":["alpha","s390x","aarch64","x86_64","i686","ppc64le","armv7l","armv6l"]}},"capabilities":{"shared_libraries":["libsqlite3.so.0","libcrypto.so.3","libhwloc.so.15","libc.so.6","libm.so.6","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}
{"overview":{"d2d7056061e60fa2028ce3c43a2c5b9ef1054d15":{"description":"","test_version":"1.2.x","app_version":"1.5.2","unit":"k\/s","samples":1096,"timing_samples":918,"hib":1,"first_appeared":1298700000,"last_appeared":1685944538,"run_time_avg":91,"stddev_avg":0.43,"percentiles":[21.301,332.595,647.897,777.105,938.198,1156.666,1312.751,1641.83,2457.92,2919.638,4043.208,4950.609,5682.671,6215.89,7331.648,9816.583,10871.199,11773.423,12412.329,13567.158,14380.628,15542.016,17014.166,21410.086,22528.883,23406.397,23857.538,25302.454,26000.194,28138.343,29153.007,30569.77,31725.17,32502.932,33230.017,35086.951,36381.721,37038.971,41283.053,42027.096,42773.974,43380.448,44185.456,44989.962,45911.889,46844.139,48284.826,50066.117,54172.197,57070.345,58522.66,60814.93,61777.853,63293.533,67381.812,71372.792,72583.789,74312.841,74674.698,74876.414,75278.799,75955.109,78991.187,82555.857,86054.253,87391.794,89843.268,92662.643,93833.212,96854.951,102274.19,105842.414,113476.435,115023.461,118324.172,120042.941,121945.805,123965.623,134900.094,136964.25,143877.719,147145.813,149434.375,153749.041,155994.026,173042.464,178112.75,183954.51,188211.141,191730.766,206728.807,209353.656,211019.99,234676.412,269132.531,278601.802,309044.362,360016.052,399462.01,412355.927],"run_time_percentiles":[90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,91,91,91,91,91,91,91,91,91,91,91,91,91,91,92],"tested_archs":["alpha","s390x","aarch64","loongarch64","i686","x86_64","riscv64","ppc64le","armv7l","armv6l"]}},"capabilities":{"shared_libraries":["libsqlite3.so.0","libcrypto.so.3","libhwloc.so.15","libc.so.6","libm.so.6","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}

View File

@@ -0,0 +1 @@
{"1.3.0":{"last_updated":"1658341022","commit_description":"Update against aircrack-ng 1.7 upstream."},"1.2.1":{"last_updated":"1587821615","commit_description":"Build fix for GCC 10 over -fcommon."},"1.2.0":{"last_updated":"1578702218","commit_description":"Update against aircrack-ng 1.5.2 upstream."},"1.1.2":{"last_updated":"1544204113","commit_description":"Add FreeBSD support - https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/49"},"1.1.1":{"last_updated":"1534766496","commit_description":"Libtool is a needed external dependency."},"1.1.0":{"last_updated":"1534764076","commit_description":"Just default to the program selection of optimal SIMD mode for given CPU than punting it out as a test option."},"1.0.0":{"last_updated":"1534721886","commit_description":"Initial commit of aircrack-ng."}}

View File

@@ -0,0 +1,22 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>https://download.aircrack-ng.org/aircrack-ng-1.7.tar.gz</URL>
<MD5>a918ea7146f91d8c799fb770c38f4bec</MD5>
<SHA256>05a704e3c8f7792a17315080a21214a4448fd2452c1b0dd5226a3a55f90b58c3</SHA256>
<FileName>aircrack-ng-1.7.tar.gz</FileName>
<FileSize>7740634</FileSize>
<PlatformSpecific>Linux, BSD</PlatformSpecific>
</Package>
<Package>
<URL>https://download.aircrack-ng.org/aircrack-ng-1.7-win.zip</URL>
<MD5>37af71e78813e897297cca59cc0f70b7</MD5>
<SHA256>767a456bf0675032d37d3c8caf05e2e5dcb105c218614b2e4e42b51370d05205</SHA256>
<FileName>aircrack-ng-1.7-win.zip</FileName>
<FileSize>12187975</FileSize>
<PlatformSpecific>Windows</PlatformSpecific>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"overview":{"3410d84ae27222a43194d8f23ebe47214f5f0a4c":{"description":"","test_version":"1.3.x","app_version":"1.7","unit":"k\/s","samples":660,"timing_samples":472,"hib":1,"first_appeared":1658341083,"last_appeared":1708030825,"run_time_avg":121,"stddev_avg":0.57,"percentiles":[185.712,717.452,1056.863,1533.028,1554.702,2828.087,4511.38,5679.547,6330.689,8308.58,10845.705,10853.684,12327.782,13177.493,13901.608,14278.955,15240.032,15861.852,17059.544,19692.105,20926.953,22985.176,22997.307,23015.182,23361.854,23834.895,24326.692,25600.648,26385.408,26808.277,27168.783,28607.353,28988.186,29282.41,29537.933,30167.784,30980.769,31809.872,32138.42,32420.542,33339.81,33647.548,34813.75,35752.578,36348.24,37546.297,37882.18,38549.703,39568.315,40095.85,40912.359,40936.625,41097.704,41961.466,42058.29,43648.758,44347.105,45575.689,46300.818,46726.076,47149.558,49448.236,50609.276,51494.668,52401.87,53055.453,58566.391,61211.798,61373.603,61653.867,62268.641,66599.039,69849.534,69948.187,70092.234,72763.094,74001.531,76103.367,85231.198,85791.701,87842.211,88343.224,88764.997,88889.464,90173.539,99753.68,115236.185,118827.708,119800.427,127694.852,130573.645,140142.057,149298.135,149778.797,154271.743,159452.823,165289.688,174395.482,177255.708,277535.281],"run_time_percentiles":[90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,90,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,91,92,92,93,93,120,121,121,151,181,302,363,427,453,453,453,453,453],"tested_archs":["aarch64","x86_64","i686","ppc64","loongarch64"]}},"capabilities":{"shared_libraries":["libsqlite3.so.0","libcrypto.so.3","libhwloc.so.15","libc.so.6","libm.so.6","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}

View File

@@ -0,0 +1,26 @@
#!/bin/sh
tar -xf aircrack-ng-1.7.tar.gz
cd aircrack-ng-1.7
export CFLAGS="-O3 -fcommon $CFLAGS"
export CXXFLAGS="-O3 -fcommon $CXFLAGS"
if [ "$OS_TYPE" = "BSD" ]
then
if [ -e /usr/local/lib/libcrypto.so ]
then
env MAKE=gmake CFLAGS=-I/usr/local/include LDFLAGS=-L/usr/local/lib ./autogen.sh
else
env MAKE=gmake ./autogen.sh
fi
gmake -j $NUM_CPU_CORES
else
./autogen.sh
make -j $NUM_CPU_CORES
fi
echo $? > ~/install-exit-status
cd ~
echo "#!/bin/sh
cd aircrack-ng-1.7
./aircrack-ng -p \$NUM_CPU_CORES \$@ 2>&1 | tr '\\r' '\\n' | awk -v max=0 '{if(\$1>max){max=\$1}}END{print max \" k/s\"}' > \$LOG_FILE
echo \$? > ~/test-exit-status" > aircrack-ng
chmod +x aircrack-ng

View File

@@ -0,0 +1,8 @@
#!/bin/sh
unzip -o aircrack-ng-1.7-win.zip
echo "#!/bin/sh
cd aircrack-ng-1.7-win/bin
./aircrack-ng.exe \$@ 2>&1 | tr '\\r' '\\n' | awk -v max=0 '{if(\$1>max){max=\$1}}END{print max \" k/s\"}' > \$LOG_FILE
echo \$? > ~/test-exit-status" > aircrack-ng
chmod +x aircrack-ng

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>#_RESULT_# k/s</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,31 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>Aircrack-ng</Title>
<AppVersion>1.7</AppVersion>
<Description>Aircrack-ng is a tool for assessing WiFi/WLAN network security.</Description>
<ResultScale>k/s</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.3.0</Version>
<SupportedPlatforms>Linux, BSD, Windows</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, openssl-development, libtool</ExternalDependencies>
<EnvironmentSize>25</EnvironmentSize>
<ProjectURL>https://www.aircrack-ng.org/</ProjectURL>
<RepositoryURL>https://github.com/aircrack-ng/aircrack-ng</RepositoryURL>
<Maintainer>Michael Larabel</Maintainer>
<SystemDependencies>libnl-genl-3.so</SystemDependencies>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-S -Z 30</Arguments>
</Default>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -1 +1 @@
{"overview":{"69526d521378438e5f655dcb6fb765bcc0a1f739":{"description":"","test_version":"1.1.x","app_version":"1.2","unit":"Figure Of Merit","samples":803,"timing_samples":674,"hib":1,"first_appeared":1610314372,"last_appeared":1644614345,"run_time_avg":76,"stddev_avg":0.38,"percentiles":[11598791,48455720,79329519,100256967,104900300,111657933,118125933,122317033,126339000,135503067,142650533,151352533,158158533,162813667,171060000,178649867,180582833,182989900,187064700,190828733,197095100,197783100,203466800,206211667,207396300,209751500,211532933,212380367,213491533,215459633,218828933,220939167,223191833,225469833,226736933,233286800,234747267,236594433,237665667,237882700,239904300,246834133,248944067,252787967,258316567,259622700,263139500,269008333,274539633,279353800,284822367,302617633,306343067,333464900,362705800,388631100,405894633,423545833,449916460,455725033,455987533,461967333,555149067,569584800,643180925,698523743,715046633,766191002,774304800,776102500,778528698,788266875,828037633,856893400,862041616,880998567,892248833,909532667,994860367,1008908000,1015392664,1028804667,1082117000,1084411667,1174487333,1251105333,1437771333,1448026333,1469068333,1477345667,1513203000,1641018330,1682638000,1886144333,1908343333,1915276000,1925810000,1942166475,2056553667,2169275000],"run_time_percentiles":[19,25,30,30,32,33,34,35,35,35,36,37,38,39,40,40,41,42,42,42,43,44,44,45,46,47,48,49,49,50,50,50,51,52,53,53,54,54,55,55,56,56,57,58,58,59,59,59,59,60,60,60,61,62,62,63,64,65,66,67,67,68,68,69,71,71,72,74,77,78,82,83,85,88,93,96,97,102,106,106,110,113,120,121,122,123,124,125,125,126,128,130,131,137,145,148,169,176,228,294],"tested_archs":["x86_64","aarch64","ppc64le","loongarch64"]}},"capabilities":{"shared_libraries":["libm.so.6","libmpi.so.40","libgomp.so.1","libc.so.6","libopen-rte.so.40","libopen-pal.so.40","libhwloc.so.15","libz.so.1","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}
{"overview":{"69526d521378438e5f655dcb6fb765bcc0a1f739":{"description":"","test_version":"1.1.x","app_version":"1.2","unit":"Figure Of Merit","samples":1937,"timing_samples":1572,"hib":1,"first_appeared":1610314372,"last_appeared":1708306443,"run_time_avg":96,"stddev_avg":0.34,"percentiles":[5399313,47416048,79989370,97335947,105854833,117077667,126186033,141639567,153946400,162645667,171020687,180576900,186550500,190611300,196063733,203466800,207396300,209997300,212790133,216410733,221044600,224467600,226736933,232651900,236364233,236840200,238166033,243764700,249308100,254272900,259411100,265467500,269210500,275577975,283664715,293931600,305828500,318448533,356193300,360396650,368590800,373158700,377134100,385110420,387234000,396403133,413901867,421885375,431857267,439998067,453791600,455987533,526662133,569326033,628017667,695048500,763136167,776102500,790178362,856893400,883735200,910060867,926684567,1007308000,1012765000,1016181000,1028805333,1044983000,1057050667,1065483667,1082117000,1110140000,1242423333,1386811000,1466522667,1495535333,1611826000,1641018330,1675197000,1718826333,1818800333,1889431000,1911925333,1917570000,1926452000,1935317000,1988543333,1998897333,2038989000,2065741000,2119944667,2209036667,2332743667,2355505667,2872242308,3174538667,3830123000,4255809000,4358309667,4545229333],"run_time_percentiles":[15,24,28,30,32,34,35,36,37,38,40,41,42,43,44,45,46,47,48,49,49,50,50,51,51,52,52,53,53,54,54,55,55,56,56,57,58,58,59,59,60,60,60,61,62,63,63,63,64,65,66,66,67,67,68,68,70,70,71,71,72,74,76,78,79,82,84,85,87,89,93,96,97,101,102,104,106,108,108,111,112,115,116,121,122,124,125,126,128,135,144,148,155,173,210,216,231,272,364,559],"tested_archs":["loongarch64","aarch64","i686","x86_64","ppc64le"]}},"capabilities":{"shared_libraries":["libm.so.6","libmpi.so.40","libgomp.so.1","libc.so.6","libopen-rte.so.40","libopen-pal.so.40","libhwloc.so.15","libz.so.1","libudev.so.1"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2"],"honors_cflags":"0","scales_cpu_cores":"1"}}

View File

@@ -1 +1 @@
{"overview":{"bd9b448de8b7bbc2ad9a76a226264c6d6c2c7f7d":{"description":"Size: 2048 x 2048 - Total Time","test_version":"1.0.x","app_version":"","unit":"Seconds","samples":3272,"timing_samples":2587,"hib":0,"first_appeared":1517180843,"last_appeared":2147512538,"run_time_avg":275,"stddev_avg":1.04,"percentiles":[19.107,21.537,24.412,26.059,27.119,27.788,28.411,28.886,29.391,29.991,30.674,31.11,31.48,31.95,32.43,33.16,33.463,34.02,34.6,35.13,35.53,36.05,36.61,36.889,37.649,38.12,38.61,38.79,39.08,39.278,39.402,39.74,40.01,40.21,40.4,40.565,40.75,41,41.256,41.58,42.03,42.44,42.83,43.46,44.14,44.53,45.1,46.14,46.76,47.36,48.08,48.99,49.86,50.774,51.49,52.63,53.88,54.79,55.52,56.56,57.78,58.8,60.02,61.97,62.834,64.11,65.71,67.19,68.13,70.44,73.08,75.08,76.34,77.828,79.716,81.98,85.16,88.81,92.16,94.62,100.03,106.8,111.185,120.36,124.578,137.3,146,153,162.67,172.46,180.46,192,235.31,261.3,285.13,296.34,334,385.64,490.316,649.38],"run_time_percentiles":[57,65,73,77,81,82,85,86,87,89,91,93,94,95,96,97,100,100,102,104,105,106,108,109,111,111,114,115,116,116,117,118,118,119,120,120,121,121,122,122,123,124,124,126,127,129,132,134,137,139,142,143,146,149,152,154,159,162,166,170,176,178,183,189,194,199,205,218,226,232,237,243,250,263,269,278,286,304,323,349,372,401,431,446,466,487,517,519,549,578,685,760,819,856,898,976,1083,1170,1371,1577],"tested_archs":["x86_64","ppc64le","s390x","aarch64","sparc64","alpha","riscv64","i686","armv7l","arm64","ppc","mips64","e2k","armv8l","armv6l","arm","loongarch64"]}},"capabilities":{"shared_libraries":["libm.so.6","libc.so.6"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2","AVX","FMA","AVX512"],"honors_cflags":"1","scales_cpu_cores":"0"}}
{"overview":{"bd9b448de8b7bbc2ad9a76a226264c6d6c2c7f7d":{"description":"Size: 2048 x 2048 - Total Time","test_version":"1.0.x","app_version":"","unit":"Seconds","samples":3791,"timing_samples":3144,"hib":0,"first_appeared":1298700000,"last_appeared":2147512538,"run_time_avg":317,"stddev_avg":1.05,"percentiles":[15.624,21.284,22.731,24.676,26.147,27.02,27.674,28.31,28.8,29.32,29.745,30.435,30.872,31.232,31.547,31.982,32.321,32.94,33.402,33.868,34.421,35.078,35.48,35.978,36.212,36.68,37.011,37.678,38.132,38.6,38.79,39.11,39.312,39.48,39.88,40.168,40.36,40.54,40.721,41.091,41.37,41.75,42.337,42.72,43.34,43.88,44.197,44.39,44.86,45.54,46.16,47.022,47.515,48.46,49.361,50.46,51.47,52.703,54.001,54.81,55.53,56.18,57.57,58.83,60.553,61.985,62.7,64.01,65.71,67.28,68.48,71.05,73.758,75.5,76.839,78.887,80.915,83.69,87.62,90.61,94.202,99.714,104.94,110.943,119.78,124.511,140,147.1,156,169.64,173.13,187.36,211.91,251.64,273,287.64,329.472,368.838,473.927,601.7],"run_time_percentiles":[47,65,69,74,79,81,83,85,86,87,90,91,93,94,95,96,97,99,100,101,103,105,106,107,108,109,111,111,113,115,116,116,117,118,118,119,120,121,121,122,123,124,125,127,129,131,133,133,135,137,139,142,144,147,151,154,159,163,166,168,175,178,184,187,192,198,204,215,225,231,237,244,253,266,276,283,300,316,338,362,393,431,449,468,494,517,523,569,640,738,779,841,867,936,1035,1143,1300,1577,1897,2143],"tested_archs":["x86_64","ppc64le","s390x","loongarch64","aarch64","sparc64","alpha","riscv64","i686","armv7l","arm64","ppc","mips64","e2k","armv8l","armv6l","arm"]}},"capabilities":{"shared_libraries":["libm.so.6","libc.so.6"],"default_instructions":["MMX","SSE","SSE2"],"max_instructions":["MMX","SSE","SSE2","AVX","FMA","AVX512"],"honors_cflags":"1","scales_cpu_cores":"0"}}

View File

@@ -0,0 +1 @@
{"3.4.0":{"last_updated":"1655544139","commit_description":"Update against AOM v3.4 upstream."},"3.3.0":{"last_updated":"1645125446","commit_description":"Update against AOM-AV1 3.3 upstream."},"3.2.0":{"last_updated":"1634254352","commit_description":"Update against upstream libaom v3.2.0 release, drop Windows support for now since the Appveyor builds stopped, also unify versioning."},"2.4.0":{"last_updated":"1620318386","commit_description":"Update against libaom 3.1 upstream."},"2.3.0":{"last_updated":"1616591956","commit_description":"Update against v3.0 upstream, add 4K video option too now that libaom is faster than before..."},"2.2.0":{"last_updated":"1615556384","commit_description":"Update against libaom 2.1-rc1 Git state, increase tile settings."},"2.1.2":{"last_updated":"1599928929","commit_description":"Speedup installation per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/158"},"2.1.1":{"last_updated":"1589911361","commit_description":"Update argument options."},"2.1.0":{"last_updated":"1589893519","commit_description":"Update against libaom 2.0.0."},"2.0.2":{"last_updated":"1578683006","commit_description":"Cap number of threads for AOM encoding to 64 threads, otherwise the program errors out due to its MAX_NUM_THREADS."},"2.0.1":{"last_updated":"1578682331","commit_description":"Add Windows support."},"2.0.0":{"last_updated":"1578680871","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/112 plus also rebase to latest AOM Git."},"1.2.0":{"last_updated":"1568659804","commit_description":"Update per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/101 re-base to AOM Git as of 2019-09-16."},"1.1.0":{"last_updated":"1549915618","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/58 plus fixing FPS reporting, switch to using AOM AV1 Git as of today, multi-threading is used by default by upstream aomenc already, and other changes."},"1.0.0":{"last_updated":"1522420880","commit_description":"Initial work on the AOM AV1 video encode test profile, but not too practical yet given the current extremely slow speed of the encoder, etc. So mostly a placeholder until that code is in better shape."}}

View File

@@ -0,0 +1,35 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.3-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>676792531</FileSize>
</Package>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>2804470345</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-340.tar.xz</URL>
<MD5>1fb6341b4cf686d066d52ada5bdf581f</MD5>
<SHA256>a7552aae8d6e659326d2b1be7f41bac996c95723d3e77f1804143aac3c584d96</SHA256>
<FileName>aom-340.tar.xz</FileName>
<FileSize>3678784</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-310-win64.zip</URL>
<MD5>7b7aa1f8d64f8a9e0f83cbef82370f82</MD5>
<SHA256>eb2765db33fcbca79466d8f29f28be6b95f1a7d2ade0ee67f0ebaf190f73dfd8</SHA256>
<FileName>aom-310-win64.zip</FileName>
<FileSize>4113883</FileSize>
<PlatformSpecific>Windows</PlatformSpecific>
</Package>
</Downloads>
</PhoronixTestSuite>

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,25 @@
#!/bin/sh
tar -xf aom-340.tar.xz
cd aom/build
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
echo "#!/bin/sh
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
NUM_CPU_CORES=64
fi
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
rm -f test.av1" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,19 @@
#!/bin/sh
unzip -o aom-310-win64.zip
chmod +x aomenc.exe
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
echo "#!/bin/sh
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
NUM_CPU_CORES=64
fi
./aomenc.exe --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
rm -f test.av1" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.3-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
<LineHint>fps</LineHint>
<TurnCharsToSpace>(</TurnCharsToSpace>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,80 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.3-->
<PhoronixTestSuite>
<TestInformation>
<Title>AOM AV1</Title>
<AppVersion>3.4</AppVersion>
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>3.4.0</Version>
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
<EnvironmentSize>1950</EnvironmentSize>
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>--tile-columns=2 --tile-rows=2 --row-mt=1</Arguments>
</Default>
<Option>
<DisplayName>Encoder Mode</DisplayName>
<Identifier>enc-mode</Identifier>
<Menu>
<Entry>
<Name>Speed 10 Realtime</Name>
<Value>--cpu-used=10 --rt</Value>
</Entry>
<Entry>
<Name>Speed 9 Realtime</Name>
<Value>--cpu-used=9 --rt</Value>
</Entry>
<Entry>
<Name>Speed 8 Realtime</Name>
<Value>--cpu-used=8 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Realtime</Name>
<Value>--cpu-used=6 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Two-Pass</Name>
<Value>--cpu-used=6</Value>
</Entry>
<Entry>
<Name>Speed 4 Two-Pass</Name>
<Value>--cpu-used=4</Value>
</Entry>
<Entry>
<Name>Speed 0 Two-Pass</Name>
<Value>--cpu-used=0 --limit=20</Value>
<Message>Slowest</Message>
</Entry>
</Menu>
</Option>
<Option>
<DisplayName>Input</DisplayName>
<Identifier>input</Identifier>
<Menu>
<Entry>
<Name>Bosphorus 1080p</Name>
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
</Entry>
<Entry>
<Name>Bosphorus 4K</Name>
<Value>Bosphorus_3840x2160.y4m</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,35 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>676792531</FileSize>
</Package>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>2804470345</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-350.tar.xz</URL>
<MD5>4bad477efe71208b0a190efd1fc5da8b</MD5>
<SHA256>7d4d88d2b0cea58243aa422f5ee4656a676b8a74170fbc29a2f36eb310446740</SHA256>
<FileName>aom-350.tar.xz</FileName>
<FileSize>3690192</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-310-win64.zip</URL>
<MD5>7b7aa1f8d64f8a9e0f83cbef82370f82</MD5>
<SHA256>eb2765db33fcbca79466d8f29f28be6b95f1a7d2ade0ee67f0ebaf190f73dfd8</SHA256>
<FileName>aom-310-win64.zip</FileName>
<FileSize>4113883</FileSize>
<PlatformSpecific>Windows</PlatformSpecific>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,20 @@
#!/bin/sh
tar -xf aom-350.tar.xz
cd aom/build
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
echo "#!/bin/sh
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
NUM_CPU_CORES=64
fi
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
rm -f test.av1" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,14 @@
#!/bin/sh
unzip -o aom-310-win64.zip
chmod +x aomenc.exe
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
echo "#!/bin/sh
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
NUM_CPU_CORES=64
fi
./aomenc.exe --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
rm -f test.av1" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
<LineHint>fps</LineHint>
<TurnCharsToSpace>(</TurnCharsToSpace>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,81 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>AOM AV1</Title>
<AppVersion>3.5</AppVersion>
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>3.5.0</Version>
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
<EnvironmentSize>1950</EnvironmentSize>
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>--tile-columns=4 --tile-rows=2 --row-mt=1 --fp-mt=1</Arguments>
</Default>
<Option>
<DisplayName>Encoder Mode</DisplayName>
<Identifier>enc-mode</Identifier>
<Menu>
<Entry>
<Name>Speed 10 Realtime</Name>
<Value>--cpu-used=10 --rt</Value>
<Message>Fastest</Message>
</Entry>
<Entry>
<Name>Speed 9 Realtime</Name>
<Value>--cpu-used=9 --rt</Value>
</Entry>
<Entry>
<Name>Speed 8 Realtime</Name>
<Value>--cpu-used=8 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Realtime</Name>
<Value>--cpu-used=6 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Two-Pass</Name>
<Value>--cpu-used=6</Value>
</Entry>
<Entry>
<Name>Speed 4 Two-Pass</Name>
<Value>--cpu-used=4</Value>
</Entry>
<Entry>
<Name>Speed 0 Two-Pass</Name>
<Value>--cpu-used=0 --limit=20</Value>
<Message>Slowest</Message>
</Entry>
</Menu>
</Option>
<Option>
<DisplayName>Input</DisplayName>
<Identifier>input</Identifier>
<Menu>
<Entry>
<Name>Bosphorus 1080p</Name>
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
</Entry>
<Entry>
<Name>Bosphorus 4K</Name>
<Value>Bosphorus_3840x2160.y4m</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"3.6.0":{"last_updated":"1675812855","commit_description":"Update against upstream AOM v3.6 release."},"3.5.0":{"last_updated":"1663855054","commit_description":"Update against AOM-AV1 3.5, tune parameters too."},"3.4.0":{"last_updated":"1655544139","commit_description":"Update against AOM v3.4 upstream."},"3.3.0":{"last_updated":"1645125446","commit_description":"Update against AOM-AV1 3.3 upstream."},"3.2.0":{"last_updated":"1634254352","commit_description":"Update against upstream libaom v3.2.0 release, drop Windows support for now since the Appveyor builds stopped, also unify versioning."},"2.4.0":{"last_updated":"1620318386","commit_description":"Update against libaom 3.1 upstream."},"2.3.0":{"last_updated":"1616591956","commit_description":"Update against v3.0 upstream, add 4K video option too now that libaom is faster than before..."},"2.2.0":{"last_updated":"1615556384","commit_description":"Update against libaom 2.1-rc1 Git state, increase tile settings."},"2.1.2":{"last_updated":"1599928929","commit_description":"Speedup installation per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/158"},"2.1.1":{"last_updated":"1589911361","commit_description":"Update argument options."},"2.1.0":{"last_updated":"1589893519","commit_description":"Update against libaom 2.0.0."},"2.0.2":{"last_updated":"1578683006","commit_description":"Cap number of threads for AOM encoding to 64 threads, otherwise the program errors out due to its MAX_NUM_THREADS."},"2.0.1":{"last_updated":"1578682331","commit_description":"Add Windows support."},"2.0.0":{"last_updated":"1578680871","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/112 plus also rebase to latest AOM Git."},"1.2.0":{"last_updated":"1568659804","commit_description":"Update per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/101 re-base to AOM Git as of 2019-09-16."},"1.1.0":{"last_updated":"1549915618","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/58 plus fixing FPS reporting, switch to using AOM AV1 Git as of today, multi-threading is used by default by upstream aomenc already, and other changes."},"1.0.0":{"last_updated":"1522420880","commit_description":"Initial work on the AOM AV1 video encode test profile, but not too practical yet given the current extremely slow speed of the encoder, etc. So mostly a placeholder until that code is in better shape."}}

View File

@@ -0,0 +1,27 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>676792531</FileSize>
</Package>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>2804470345</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-360.tar.xz</URL>
<MD5>aeea2fe982060b2e99320febae96e430</MD5>
<SHA256>bc774bbc17364974262c39b3130567dc0fec23c7540cd42bfbacf7685985aa4d</SHA256>
<FileName>aom-360.tar.xz</FileName>
<FileSize>3721800</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,19 @@
#!/bin/sh
tar -xf aom-360.tar.xz
cd aom/build
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
echo "#!/bin/sh
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
NUM_CPU_CORES=64
fi
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
rm -f test.av1" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
<LineHint>fps</LineHint>
<TurnCharsToSpace>(</TurnCharsToSpace>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,81 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>AOM AV1</Title>
<AppVersion>3.6</AppVersion>
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>3.6.0</Version>
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
<EnvironmentSize>1950</EnvironmentSize>
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>--tile-columns=4 --tile-rows=2 --row-mt=1 --fp-mt=1</Arguments>
</Default>
<Option>
<DisplayName>Encoder Mode</DisplayName>
<Identifier>enc-mode</Identifier>
<Menu>
<Entry>
<Name>Speed 10 Realtime</Name>
<Value>--cpu-used=10 --rt</Value>
<Message>Fastest</Message>
</Entry>
<Entry>
<Name>Speed 9 Realtime</Name>
<Value>--cpu-used=9 --rt</Value>
</Entry>
<Entry>
<Name>Speed 8 Realtime</Name>
<Value>--cpu-used=8 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Realtime</Name>
<Value>--cpu-used=6 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Two-Pass</Name>
<Value>--cpu-used=6</Value>
</Entry>
<Entry>
<Name>Speed 4 Two-Pass</Name>
<Value>--cpu-used=4</Value>
</Entry>
<Entry>
<Name>Speed 0 Two-Pass</Name>
<Value>--cpu-used=0 --limit=20</Value>
<Message>Slowest</Message>
</Entry>
</Menu>
</Option>
<Option>
<DisplayName>Input</DisplayName>
<Identifier>input</Identifier>
<Menu>
<Entry>
<Name>Bosphorus 1080p</Name>
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
</Entry>
<Entry>
<Name>Bosphorus 4K</Name>
<Value>Bosphorus_3840x2160.y4m</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"3.7.0":{"last_updated":"1693774819","commit_description":"Update against libaom 3.7 upstream."},"3.6.0":{"last_updated":"1675812855","commit_description":"Update against upstream AOM v3.6 release."},"3.5.0":{"last_updated":"1663855054","commit_description":"Update against AOM-AV1 3.5, tune parameters too."},"3.4.0":{"last_updated":"1655544139","commit_description":"Update against AOM v3.4 upstream."},"3.3.0":{"last_updated":"1645125446","commit_description":"Update against AOM-AV1 3.3 upstream."},"3.2.0":{"last_updated":"1634254352","commit_description":"Update against upstream libaom v3.2.0 release, drop Windows support for now since the Appveyor builds stopped, also unify versioning."},"2.4.0":{"last_updated":"1620318386","commit_description":"Update against libaom 3.1 upstream."},"2.3.0":{"last_updated":"1616591956","commit_description":"Update against v3.0 upstream, add 4K video option too now that libaom is faster than before..."},"2.2.0":{"last_updated":"1615556384","commit_description":"Update against libaom 2.1-rc1 Git state, increase tile settings."},"2.1.2":{"last_updated":"1599928929","commit_description":"Speedup installation per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/158"},"2.1.1":{"last_updated":"1589911361","commit_description":"Update argument options."},"2.1.0":{"last_updated":"1589893519","commit_description":"Update against libaom 2.0.0."},"2.0.2":{"last_updated":"1578683006","commit_description":"Cap number of threads for AOM encoding to 64 threads, otherwise the program errors out due to its MAX_NUM_THREADS."},"2.0.1":{"last_updated":"1578682331","commit_description":"Add Windows support."},"2.0.0":{"last_updated":"1578680871","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/112 plus also rebase to latest AOM Git."},"1.2.0":{"last_updated":"1568659804","commit_description":"Update per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/101 re-base to AOM Git as of 2019-09-16."},"1.1.0":{"last_updated":"1549915618","commit_description":"Updates per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/pull\/58 plus fixing FPS reporting, switch to using AOM AV1 Git as of today, multi-threading is used by default by upstream aomenc already, and other changes."},"1.0.0":{"last_updated":"1522420880","commit_description":"Initial work on the AOM AV1 video encode test profile, but not too practical yet given the current extremely slow speed of the encoder, etc. So mostly a placeholder until that code is in better shape."}}

View File

@@ -0,0 +1,27 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>676792531</FileSize>
</Package>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>815ca5830c8ea2f95545429817b96b1f</MD5>
<SHA256>d0fcb7d8cfc6e51c47ce8b427dab41ce38300c4b1a51a1903ddd5d86067c4c79</SHA256>
<FileName>Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>2804470345</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-370.tar.xz</URL>
<MD5>ff2800504e33fcb07469d5a3ce21e02b</MD5>
<SHA256>09426a65168a77317e52923ef4e4d73f1e644cc7ac5e1d4660d9fbd06b04852d</SHA256>
<FileName>aom-370.tar.xz</FileName>
<FileSize>3781644</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,19 @@
#!/bin/sh
tar -xf aom-370.tar.xz
cd aom/build
cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 -DCMAKE_BUILD_TYPE=Release ..
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z -aoa
7z x Bosphorus_3840x2160_120fps_420_8bit_YUV_Y4M.7z -aoa
echo "#!/bin/sh
# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
NUM_CPU_CORES=64
fi
./aom/build/aomenc --threads=\$NUM_CPU_CORES -o test.av1 \$@ > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
rm -f test.av1" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
<LineHint>fps</LineHint>
<TurnCharsToSpace>(</TurnCharsToSpace>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,85 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.4-->
<PhoronixTestSuite>
<TestInformation>
<Title>AOM AV1</Title>
<AppVersion>3.7</AppVersion>
<Description>This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>3.7.0</Version>
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
<EnvironmentSize>1950</EnvironmentSize>
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
<RepositoryURL>https://aomedia.googlesource.com/aom</RepositoryURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>--tile-columns=4 --tile-rows=2 --row-mt=1 --fp-mt=1</Arguments>
</Default>
<Option>
<DisplayName>Encoder Mode</DisplayName>
<Identifier>enc-mode</Identifier>
<Menu>
<Entry>
<Name>Speed 11 Realtime</Name>
<Value>--cpu-used=11 --rt</Value>
<Message>Fastest</Message>
</Entry>
<Entry>
<Name>Speed 10 Realtime</Name>
<Value>--cpu-used=10 --rt</Value>
</Entry>
<Entry>
<Name>Speed 9 Realtime</Name>
<Value>--cpu-used=9 --rt</Value>
</Entry>
<Entry>
<Name>Speed 8 Realtime</Name>
<Value>--cpu-used=8 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Realtime</Name>
<Value>--cpu-used=6 --rt</Value>
</Entry>
<Entry>
<Name>Speed 6 Two-Pass</Name>
<Value>--cpu-used=6</Value>
</Entry>
<Entry>
<Name>Speed 4 Two-Pass</Name>
<Value>--cpu-used=4</Value>
</Entry>
<Entry>
<Name>Speed 0 Two-Pass</Name>
<Value>--cpu-used=0 --limit=20</Value>
<Message>Slowest</Message>
</Entry>
</Menu>
</Option>
<Option>
<DisplayName>Input</DisplayName>
<Identifier>input</Identifier>
<Menu>
<Entry>
<Name>Bosphorus 1080p</Name>
<Value>Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m</Value>
</Entry>
<Entry>
<Name>Bosphorus 4K</Name>
<Value>Bosphorus_3840x2160.y4m</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1 @@
{"3.0.0":{"last_updated":"1679778582","commit_description":"Update Apache for GCC 13 compiler fix, switch to using wrk for better scaling."},"2.0.1":{"last_updated":"1650407028","commit_description":"Support for using go install for Go 1.17+ support."},"2.0.0":{"last_updated":"1628809739","commit_description":"Update against Apache HTTPD 2.4.48, switch to Bombardier for load testingm, add concurrent request option."},"1.7.2":{"last_updated":"1559340501","commit_description":"Add expat as external dependency per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/82 and also update one broken download link..."},"1.7.1":{"last_updated":"1519950827","commit_description":"Add Windows support for Apache test."},"1.7.0":{"last_updated":"1518023217","commit_description":"Update against HTTPD 2.4.29 and latest APR \/ APR-Util packages."},"1.6.1":{"last_updated":"1396227113","commit_description":"Update download links, add pcre external dependency rather than just relying upon perl external dependency."},"1.6.0":{"last_updated":"1386105148","commit_description":"Update upstream packages, up the run count to one million requests."},"1.5.2":{"last_updated":"1359422378","commit_description":"Apache test profile works on PC-BSD 9.1."},"1.5.1":{"last_updated":"1358635876","commit_description":"Add perl as external dependency to Apache so pcre-devel is obtained on distributions where needed. Also fix a broken download link in downloads.xml."},"1.5.0":{"last_updated":"1349325922","commit_description":"Update against upstream Apache HTTPD 2.4.3 release."},"1.4.0":{"last_updated":"1327870087","commit_description":"Update against upstream Apache HTTPD 2.2.21."},"1.3.1":{"last_updated":"1327851329","commit_description":"Update download links for upstream Apache HTTPD. No other changes."},"1.3.0":{"last_updated":"1291663084","commit_description":"Initial import into OpenBenchmarking.org"}}

View File

@@ -0,0 +1 @@
{"overview":{"eaf16ef4d48329890775e5e99d2c1980f17c16b9":{"description":"Static Web Page Serving","test_version":"1.6.x","app_version":"2.4.7","unit":"Requests Per Second","samples":14790,"timing_samples":170,"hib":1,"first_appeared":1298700000,"last_appeared":1707157794,"run_time_avg":232,"stddev_avg":1.54,"percentiles":[93.05,758,1168.06,1607.89,1928.62,2215.32,2456.49,2743.37,3070.03,3352.82,3588.85,3826.96,4046.66,4297.17,4551.29,4826.21,5143.48,5433.67,5681.07,5862.23,6039.43,6230.45,6455.85,6614.93,6808.54,7019.52,7234.81,7448.04,7734.11,8028.4,8331.72,8576.87,8824.12,9125.39,9407.38,9753.28,10086.21,10388.26,10658.71,10920.89,11147.2,11399.13,11687.26,12006.24,12230.43,12525.46,12872.21,13186.22,13436.96,13649.21,14016.23,14360.42,14674.38,14988.96,15222.27,15517.35,15822.96,16139.06,16467.44,16733.86,17047.96,17352.14,17604.3,17873.48,18268.96,18629.25,18939.79,19242.35,19500.41,19803.74,20162.37,20558.78,20943.48,21386.65,21897.03,22324.69,22734.69,23280.61,23772.71,24293.32,24989.82,25617.7,26396.76,27108.43,27960.06,28747.95,29821.48,30625.24,31686.5,33054.07,34251.27,35399.82,37462.49,39421.48,40998.65,42677.59,44153.7,46624.19,49330.27,52331.33],"run_time_percentiles":[55,62,62,63,63,73,74,75,75,77,77,77,80,84,84,86,88,89,91,99,100,100,101,102,103,103,105,107,108,112,114,115,117,117,118,118,119,119,119,125,125,125,128,130,131,135,138,139,141,142,146,147,147,148,151,152,154,154,164,166,172,178,197,214,218,227,263,265,266,267,268,269,270,272,273,273,274,281,314,324,366,372,449,493,508,510,516,517,518,518,522,523,524,528,530,559,573,762,861,916],"tested_archs":["arm","aarch64","sparc64","mips64","ppc64","ppc64le","x86_64","i686","armv7l","armv6l","i386","ppc","mips"]}},"capabilities":{"shared_libraries":["libm.so.6","libc.so.6"],"default_instructions":["MMX","SSE","SSE2","SSSE3","SSE4_1","AVX","AVX2","AES","AVX512","VAES"],"max_instructions":["MMX","SSE","SSE2","SSSE3","SSE4_1","AVX","AVX2","AES","AVX512","VAES"],"honors_cflags":"0","scales_cpu_cores":"0"}}

View File

@@ -0,0 +1 @@
{"2.0.1":{"last_updated":"1650407028","commit_description":"Support for using go install for Go 1.17+ support."},"2.0.0":{"last_updated":"1628809739","commit_description":"Update against Apache HTTPD 2.4.48, switch to Bombardier for load testingm, add concurrent request option."},"1.7.2":{"last_updated":"1559340501","commit_description":"Add expat as external dependency per https:\/\/github.com\/phoronix-test-suite\/test-profiles\/issues\/82 and also update one broken download link..."},"1.7.1":{"last_updated":"1519950827","commit_description":"Add Windows support for Apache test."},"1.7.0":{"last_updated":"1518023217","commit_description":"Update against HTTPD 2.4.29 and latest APR \/ APR-Util packages."},"1.6.1":{"last_updated":"1396227113","commit_description":"Update download links, add pcre external dependency rather than just relying upon perl external dependency."},"1.6.0":{"last_updated":"1386105148","commit_description":"Update upstream packages, up the run count to one million requests."},"1.5.2":{"last_updated":"1359422378","commit_description":"Apache test profile works on PC-BSD 9.1."},"1.5.1":{"last_updated":"1358635876","commit_description":"Add perl as external dependency to Apache so pcre-devel is obtained on distributions where needed. Also fix a broken download link in downloads.xml."},"1.5.0":{"last_updated":"1349325922","commit_description":"Update against upstream Apache HTTPD 2.4.3 release."},"1.4.0":{"last_updated":"1327870087","commit_description":"Update against upstream Apache HTTPD 2.2.21."},"1.3.1":{"last_updated":"1327851329","commit_description":"Update download links for upstream Apache HTTPD. No other changes."},"1.3.0":{"last_updated":"1291663084","commit_description":"Initial import into OpenBenchmarking.org"}}

View File

@@ -0,0 +1,34 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.2-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://archive.apache.org/dist/httpd/httpd-2.4.48.tar.bz2, http://ftp.bit.nl/apache/httpd-2.4.48.tar.bz2</URL>
<MD5>a7088cec171b0d00bf43394ce64d3909</MD5>
<SHA256>1bc826e7b2e88108c7e4bf43c026636f77a41d849cfb667aa7b5c0b86dbf966c</SHA256>
<FileName>httpd-2.4.48.tar.bz2</FileName>
<FileSize>7194385</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/http-test-files-1.tar.xz</URL>
<MD5>b86f3e8f5bc9d0014818c5122a6f784d</MD5>
<SHA256>9d6eace9544c59b910ea403a4693338efc12a6b0915fe227aed86c971b82d3dd</SHA256>
<FileName>http-test-files-1.tar.xz</FileName>
<FileSize>2346324</FileSize>
</Package>
<Package>
<URL>https://ftp.osuosl.org/pub/blfs/conglomeration/apr/apr-1.7.0.tar.bz2, http://archive.apache.org/dist/apr/apr-1.7.0.tar.bz2</URL>
<MD5>7a14a83d664e87599ea25ff4432e48a7</MD5>
<SHA256>e2e148f0b2e99b8e5c6caa09f6d4fb4dd3e83f744aa72a952f94f5a14436f7ea</SHA256>
<FileName>apr-1.7.0.tar.bz2</FileName>
<FileSize>872238</FileSize>
</Package>
<Package>
<URL>http://www.apache.org/dist/apr/apr-util-1.6.1.tar.bz2, http://apache.cs.utah.edu//apr/apr-util-1.6.1.tar.bz2, http://archive.apache.org/dist/apr/apr-util-1.6.1.tar.bz2</URL>
<MD5>8ff5dc36fa39a2a3db1df196d3ed6086</MD5>
<SHA256>d3e12f7b6ad12687572a3a39475545a072608f4ba03a6ce8a3778f607dd0035b</SHA256>
<FileName>apr-util-1.6.1.tar.bz2</FileName>
<FileSize>428595</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,59 @@
#!/bin/bash
mkdir $HOME/httpd_
tar -xf http-test-files-1.tar.xz
tar -xf httpd-2.4.48.tar.bz2
tar -xf apr-util-1.6.1.tar.bz2
tar -xf apr-1.7.0.tar.bz2
mv apr-1.7.0 httpd-2.4.48/srclib/apr
mv apr-util-1.6.1 httpd-2.4.48/srclib/apr-util
cd httpd-2.4.48/
./configure --prefix=$HOME/httpd_ --with-included-apr
if [ "$OS_TYPE" = "BSD" ]
then
gmake -j $NUM_CPU_CORES
gmake install
echo $? > ~/install-exit-status
else
make -j $NUM_CPU_CORES
make install
echo $? > ~/install-exit-status
fi
cd ~
rm -rf httpd-2.4.48/
rm -rf httpd_/manual/
mv -f http-test-files/* httpd_/htdocs/
echo "
--- httpd_/conf/httpd.conf.orig 2009-05-05 11:45:32.000000000 -0400
+++ httpd_/conf/httpd.conf 2009-05-05 11:46:09.000000000 -0400
@@ -37,7 +37,7 @@
# prevent Apache from glomming onto all bound IP addresses.
#
#Listen 12.34.56.78:80
-Listen 80
+Listen 8088
#
# Dynamic Shared Object (DSO) Support
" > CHANGE-PORT.patch
patch -p0 < CHANGE-PORT.patch
go get -u github.com/codesenberg/bombardier
if [ $? -ne 0 ]
then
# Go 1.17+ path
go install github.com/codesenberg/bombardier@latest
fi
echo "#!/bin/sh
~/go/bin/bombardier \$@ > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > apache
chmod +x apache

View File

@@ -0,0 +1,4 @@
#!/bin/sh
./httpd_/bin/apachectl -k stop
rm -f httpd_/logs/*
sleep 3

View File

@@ -0,0 +1,3 @@
#!/bin/sh
./httpd_/bin/apachectl -k start -f $HOME/httpd_/conf/httpd.conf
sleep 5

View File

@@ -0,0 +1,4 @@
#!/bin/sh
cd Apache24/bin
./httpd.exe &
sleep 10

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.2-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate> Reqs/sec #_RESULT_# 25659.25 589863.96</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,64 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v10.8.2-->
<PhoronixTestSuite>
<TestInformation>
<Title>Apache HTTP Server</Title>
<AppVersion>2.4.48</AppVersion>
<Description>This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the Golang "Bombardier" program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients.</Description>
<ResultScale>Requests Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>2.0.1</Version>
<SupportedPlatforms>Linux, Solaris, BSD, MacOSX</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>System</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, perl, pcre, expat, golang</ExternalDependencies>
<InstallRequiresInternet>TRUE</InstallRequiresInternet>
<EnvironmentSize>208</EnvironmentSize>
<ProjectURL>https://httpd.apache.org/</ProjectURL>
<RepositoryURL>https://github.com/apache/httpd</RepositoryURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-d 90s </Arguments>
<PostArguments> http://127.0.0.1:8088/test.html</PostArguments>
</Default>
<Option>
<DisplayName>Concurrent Requests</DisplayName>
<Identifier>concurrent</Identifier>
<ArgumentPrefix>-c </ArgumentPrefix>
<Menu>
<Entry>
<Name>1</Name>
<Value>1</Value>
</Entry>
<Entry>
<Name>20</Name>
<Value>20</Value>
</Entry>
<Entry>
<Name>100</Name>
<Value>100</Value>
</Entry>
<Entry>
<Name>200</Name>
<Value>200</Value>
</Entry>
<Entry>
<Name>500</Name>
<Value>500</Value>
</Entry>
<Entry>
<Name>1000</Name>
<Value>1000</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

Some files were not shown because too many files have changed in this diff Show More