josh/phoronix-test-suite
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Bump to 10.8.5

Browse Source
This commit is contained in:
Michael Larabel
2024-03-24 05:34:17 -05:00
parent 5dbaac229a
commit c2605245ac
11 changed files with 2362 additions and 2181 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
AUTHORS
View File

@@ -1,4 +1,4 @@
Copyright 2008 - 2021 by Phoronix Media. Copyright 2008 - 2024 by Phoronix Media.
Lead Architects: Lead Architects:

7
ChangeLog
View File

@@ -1,5 +1,12 @@
PHORONIX TEST SUITE CHANGE-LOG PHORONIX TEST SUITE CHANGE-LOG
Phoronix Test Suite 10.8.5
[GIT]
pts-core: PHP 8.2 warning fixes
pts-core: Various bug fixes
phodevi: Hardware/software detection updates
Phoronix Test Suite 10.8.4 Phoronix Test Suite 10.8.4
3 July 2022 3 July 2022

2
README.md
View File

@@ -1,4 +1,4 @@
# Phoronix Test Suite 10.8.4 # Phoronix Test Suite 10.8.5
![Phoronix Test Suite](pts-core/static/images/pts-308x160.png) ![Phoronix Test Suite](pts-core/static/images/pts-308x160.png)
The **Phoronix Test Suite** is the most comprehensive testing and benchmarking The **Phoronix Test Suite** is the most comprehensive testing and benchmarking

10
documentation/man-pages/phoronix-test-suite.1
View File

@@ -1,4 +1,4 @@
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "10.8.4" .TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "10.8.5"
.SH NAME .SH NAME
phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation. phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation.
.SH SYNOPSIS .SH SYNOPSIS
@@ -204,6 +204,9 @@ This sub-command provides a verbose look at all tests installed/uninstalled on t
.B list-test-usage .B list-test-usage
This option will list various details about installed tests and their usage. This option will list various details about installed tests and their usage.
.TP .TP
.B print-tests [Test | Suite | OpenBenchmarking ID | Test Result] ...
This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).
.TP
.B search .B search
This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query.. This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..
.TP .TP
@@ -272,6 +275,9 @@ This option is the inverse of the remove-results-from-result-file sub-command. I
.B merge-results [Test Result] ... .B merge-results [Test Result] ...
This option will manually merge multiple sets of test results generated by the Phoronix Test Suite. This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
.TP .TP
.B prune-empty-results [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.
.TP
.B remove-incomplete-results-from-result-file [Test Result] .B remove-incomplete-results-from-result-file [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them. This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.
.TP .TP
@@ -448,5 +454,5 @@ https://www.openbenchmarking.org/
https://www.phoronix.com/ https://www.phoronix.com/
.br .br
.SH AUTHORS .SH AUTHORS
Copyright 2008 - 2022 by Phoronix Media, Michael Larabel. Copyright 2008 - 2024 by Phoronix Media, Michael Larabel.
.TP .TP

38
documentation/phoronix-test-suite.html
View File

@@ -377,6 +377,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p> <p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p>
<h3>list-test-usage</h3> <h3>list-test-usage</h3>
<p>This option will list various details about installed tests and their usage.</p> <p>This option will list various details about installed tests and their usage.</p>
<h3>print-tests<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).</p>
<h3>search</h3> <h3>search</h3>
<p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p> <p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p>
<h3>test-to-suite-map</h3> <h3>test-to-suite-map</h3>
@@ -439,6 +442,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
<h3>merge-results<em> [Test Result] ...</em> <h3>merge-results<em> [Test Result] ...</em>
</h3> </h3>
<p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p> <p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
<h3>prune-empty-results<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.</p>
<h3>remove-incomplete-results-from-result-file<em> [Test Result]</em> <h3>remove-incomplete-results-from-result-file<em> [Test Result]</em>
</h3> </h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p> <p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p>
@@ -889,7 +895,7 @@ NOTE: Use the "system-sensors" command to see what sensors are available for mon
<h1>Testing Options</h1> <h1>Testing Options</h1>
<h3>SleepTimeBetweenTests</h3> <h3>SleepTimeBetweenTests</h3>
<p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>8</em>.</p> <p>This option sets the time (in seconds) to sleep between running tests. The default value is <em>6</em>.</p>
<h3>SaveSystemLogs</h3> <h3>SaveSystemLogs</h3>
<p>If this option is set to <em>TRUE</em>, when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to <em>FALSE</em>, the system details / logs will not be saved by default. The default value is <em>FALSE</em>. When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.</p> <p>If this option is set to <em>TRUE</em>, when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to <em>FALSE</em>, the system details / logs will not be saved by default. The default value is <em>FALSE</em>. When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.</p>
<h3>SaveInstallationLogs</h3> <h3>SaveInstallationLogs</h3>
@@ -1032,6 +1038,10 @@ The variable is relevant for: test execution / benchmarking.
The variable is relevant for: test execution / benchmarking. The variable is relevant for: test execution / benchmarking.
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf. The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
</p> </p>
<h2>LOG_CLI_OUTPUT</h2>
<p><em>[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.</em></p>
<p>The value can be of type: boolean (TRUE / FALSE).
</p>
<h2>MONITOR</h2> <h2>MONITOR</h2>
<p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p> <p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p>
<p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp) <p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp)
@@ -1402,6 +1412,9 @@ In the event that a test profile fails to install or run, the following general
<h3>Solaris Operating System Tests<em> pts/solaris</em> <h3>Solaris Operating System Tests<em> pts/solaris</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
<h3>Steam Tests<em> pts/steam</em>
</h3>
<p>This is a collection of test profiles having an external dependency on Steam</p>
<h3>System Subsystem Tests<em> pts/system</em> <h3>System Subsystem Tests<em> pts/system</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
@@ -1414,9 +1427,6 @@ In the event that a test profile fails to install or run, the following general
<h3>Smp Tests<em> pts/smp</em> <h3>Smp Tests<em> pts/smp</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cuda Tests<em> pts/cuda</em> <h3>Cuda Tests<em> pts/cuda</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
@@ -1426,12 +1436,18 @@ In the event that a test profile fails to install or run, the following general
<h3>Openmp Tests<em> pts/openmp</em> <h3>Openmp Tests<em> pts/openmp</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Docker Tests<em> pts/docker</em> <h3>Docker Tests<em> pts/docker</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
<h3>Ai Tests<em> pts/ai</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Go Tests<em> pts/go</em> <h3>Go Tests<em> pts/go</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
@@ -1534,6 +1550,9 @@ In the event that a test profile fails to install or run, the following general
<h3>All Tests in git<em> git/all</em> <h3>All Tests in git<em> git/all</em>
</h3> </h3>
<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p> <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
<h3>Application Tests<em> git/application</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
<h3>BSD Operating System Tests<em> git/bsd</em> <h3>BSD Operating System Tests<em> git/bsd</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
@@ -1552,6 +1571,9 @@ In the event that a test profile fails to install or run, the following general
<h3>Rust Tests<em> git/rust</em> <h3>Rust Tests<em> git/rust</em>
</h3> </h3>
<p>This is a collection of test profiles having an external dependency on Rust</p> <p>This is a collection of test profiles having an external dependency on Rust</p>
<h3>System Subsystem Tests<em> git/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
<h3>Utility Tests<em> git/utility</em> <h3>Utility Tests<em> git/utility</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
@@ -1671,7 +1693,7 @@ SUPPORTED OPENBENCHMARKING.ORG REPOSITORIES:<br>
<p>If distributing a customized/local copy of the Phoronix Test Suite, the default behavior of the configuration file (in addition to deleting the pts_openbenchmarking_upload file) can be done via the user configuration defaults defined within <em>pts-core/static/user-config-defaults.xml</em>.</p> <p>If distributing a customized/local copy of the Phoronix Test Suite, the default behavior of the configuration file (in addition to deleting the pts_openbenchmarking_upload file) can be done via the user configuration defaults defined within <em>pts-core/static/user-config-defaults.xml</em>.</p>
<hr style="height: 50px; border: 0;"><a name="DevelopmentCredits"></a><h1>Development Credits</h1> <hr style="height: 50px; border: 0;"><a name="DevelopmentCredits"></a><h1>Development Credits</h1>
<p>The Phoronix Test Suite is based upon the extensive testing and internal tools developed by <a href="http://www.phoronix.com/">Phoronix.com</a> since 2004 along with support from leading tier-one computer hardware and software vendors. The principal architects of the Phoronix Test Suite are <a href="http://www.michaellarabel.com/">Michael Larabel</a> and Matthew Tippett. The phoronix-test-suite, pts_Graph, Phoromatic, Phodevi, and nye_Xml are some of the related open-source projects provided by <a href="http://www.phoronix-media.com/">Phoronix Media</a>.</p> <p>The Phoronix Test Suite is based upon the extensive testing and internal tools developed by <a href="http://www.phoronix.com/">Phoronix.com</a> since 2004 along with support from leading tier-one computer hardware and software vendors. The principal architects of the Phoronix Test Suite are <a href="http://www.michaellarabel.com/">Michael Larabel</a> and Matthew Tippett. The phoronix-test-suite, pts_Graph, Phoromatic, Phodevi, and nye_Xml are some of the related open-source projects provided by <a href="http://www.phoronix-media.com/">Phoronix Media</a>.</p>
<p style="padding-top: 30px; text-align: center;">Copyright &copy; 2008 - 2022 by Phoronix Media.</p></div> <p style="padding-top: 30px; text-align: center;">Copyright &copy; 2008 - 2024 by Phoronix Media.</p></div>
<div id="pts_footer"> <div id="pts_footer">
<div id="pts_footer_logo"><a href="http://www.phoronix-test-suite.com/"><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" viewbox="0 0 76 41" width="76" height="41" preserveaspectratio="xMinYMin meet"> <div id="pts_footer_logo"><a href="http://www.phoronix-test-suite.com/"><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" viewbox="0 0 76 41" width="76" height="41" preserveaspectratio="xMinYMin meet">
<path d="m74 22v9m-5-16v16m-5-28v28m-23-2h12.5c2.485281 0 4.5-2.014719 4.5-4.5s-2.014719-4.5-4.5-4.5h-8c-2.485281 0-4.5-2.014719-4.5-4.5s2.014719-4.5 4.5-4.5h12.5m-21 5h-11m11 13h-2c-4.970563 0-9-4.029437-9-9v-20m-24 40v-20c0-4.970563 4.0294373-9 9-9 4.970563 0 9 4.029437 9 9s-4.029437 9-9 9h-9" stroke="#222" stroke-width="4" fill="none"></path> <path d="m74 22v9m-5-16v16m-5-28v28m-23-2h12.5c2.485281 0 4.5-2.014719 4.5-4.5s-2.014719-4.5-4.5-4.5h-8c-2.485281 0-4.5-2.014719-4.5-4.5s2.014719-4.5 4.5-4.5h12.5m-21 5h-11m11 13h-2c-4.970563 0-9-4.029437-9-9v-20m-24 40v-20c0-4.970563 4.0294373-9 9-9 4.970563 0 9 4.029437 9 9s-4.029437 9-9 9h-9" stroke="#222" stroke-width="4" fill="none"></path>

38
documentation/phoronix-test-suite.md
View File

@@ -231,6 +231,9 @@ This sub-command provides a verbose look at all tests installed/uninstalled on t
#### list-test-usage #### list-test-usage
This option will list various details about installed tests and their usage. This option will list various details about installed tests and their usage.
#### print-tests [Test | Suite | OpenBenchmarking ID | Test Result] ...
This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).
#### search #### search
This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query.. This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..
@@ -301,6 +304,9 @@ This option is the inverse of the remove-results-from-result-file sub-command. I
#### merge-results [Test Result] ... #### merge-results [Test Result] ...
This option will manually merge multiple sets of test results generated by the Phoronix Test Suite. This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
#### prune-empty-results [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.
#### remove-incomplete-results-from-result-file [Test Result] #### remove-incomplete-results-from-result-file [Test Result]
This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them. This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.
@@ -979,7 +985,7 @@ This option sets the directory for the main download cache. The download cache i
## Testing Options ## Testing Options
#### SleepTimeBetweenTests #### SleepTimeBetweenTests
This option sets the time (in seconds) to sleep between running tests. The default value is *8* . This option sets the time (in seconds) to sleep between running tests. The default value is *6* .
#### SaveSystemLogs #### SaveSystemLogs
If this option is set to *TRUE* , when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to *FALSE* , the system details / logs will not be saved by default. The default value is *FALSE* . When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting. If this option is set to *TRUE* , when saving the results from a test it will also save various system details and logs to a sub-directory of the result file's location. Among the logs that will be archived include the X.Org log, dmesg, and lspci outputs. These system details may also be saved if a test suite explicitly requests this information be saved. If this option is set to *FALSE* , the system details / logs will not be saved by default. The default value is *FALSE* . When running in batch mode or using a Phoronix Certification and Qualification Suite, the logs will be saved regardless of this user setting.
@@ -1183,6 +1189,12 @@ The variable is relevant for: test execution / benchmarking.
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf. The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
### LOG_CLI_OUTPUT
*[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.*
The value can be of type: boolean (TRUE / FALSE).
### MONITOR ### MONITOR
*This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).* *This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).*
@@ -1683,6 +1695,9 @@ This is a collection of test profiles that have been detected to be single-threa
#### Solaris Operating System Tests pts/solaris #### Solaris Operating System Tests pts/solaris
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.
#### Steam Tests pts/steam
This is a collection of test profiles having an external dependency on Steam
#### System Subsystem Tests pts/system #### System Subsystem Tests pts/system
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
@@ -1695,9 +1710,6 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Smp Tests pts/smp #### Smp Tests pts/smp
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
#### Opencl Tests pts/opencl
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
#### Cuda Tests pts/cuda #### Cuda Tests pts/cuda
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.
@@ -1707,12 +1719,18 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Openmp Tests pts/openmp #### Openmp Tests pts/openmp
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.
#### Cloud Tests pts/cloud
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.
#### Docker Tests pts/docker #### Docker Tests pts/docker
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.
#### Ai Tests pts/ai
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.
#### Opencl Tests pts/opencl
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
#### Cloud Tests pts/cloud
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.
#### Go Tests pts/go #### Go Tests pts/go
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.
@@ -1815,6 +1833,9 @@ This is a collection of test profiles where there have been successful benchmark
#### All Tests in git git/all #### All Tests in git git/all
This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository. This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
#### Application Tests git/application
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.
#### BSD Operating System Tests git/bsd #### BSD Operating System Tests git/bsd
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
@@ -1833,6 +1854,9 @@ This is a collection of test profiles found within the specified OpenBenchmarkin
#### Rust Tests git/rust #### Rust Tests git/rust
This is a collection of test profiles having an external dependency on Rust This is a collection of test profiles having an external dependency on Rust
#### System Subsystem Tests git/system
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
#### Utility Tests git/utility #### Utility Tests git/utility
This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test. This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.

4396
documentation/phoronix-test-suite.pdf
View File

File diff suppressed because it is too large Load Diff

6
documentation/stubs/00_user_options.html
View File

@@ -164,6 +164,9 @@
<p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p> <p>This sub-command provides a verbose look at all tests installed/uninstalled on the system and whether any errors were encountered at install-time or run-time and other test installation/runtime metrics for complementing other Phoronix Test Suite sub-command outputs.</p>
<h3>list-test-usage</h3> <h3>list-test-usage</h3>
<p>This option will list various details about installed tests and their usage.</p> <p>This option will list various details about installed tests and their usage.</p>
<h3>print-tests<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will print the test identifiers of the specified result file(s), test suite(s), OpenBenchmarking.org ID(s), or other runnable object(s).</p>
<h3>search</h3> <h3>search</h3>
<p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p> <p>This option provides command-line searching abilities for test profiles / test suites / test results. The search query can be passed as a parameter otherwise the user is prompted to input their search query..</p>
<h3>test-to-suite-map</h3> <h3>test-to-suite-map</h3>
@@ -226,6 +229,9 @@
<h3>merge-results<em> [Test Result] ...</em> <h3>merge-results<em> [Test Result] ...</em>
</h3> </h3>
<p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p> <p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
<h3>prune-empty-results<em> [Test Result]</em>
</h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file that had no successful runs. I.e. if any run attempt(s) only errored out without producing any result for any of the test run(s) saved in that file. The user must specify a saved results file.</p>
<h3>remove-incomplete-results-from-result-file<em> [Test Result]</em> <h3>remove-incomplete-results-from-result-file<em> [Test Result]</em>
</h3> </h3>
<p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p> <p>This option is used if there are test results (benchmarks) to be dropped from a given result file for having incomplete data, either a test run did not attempt to run that benchmark or failed to properly run. The user must specify a saved results file and the command will then attempt to find any results with incomplete/missing data and prompt the user with confirmation to remove them.</p>

4
documentation/stubs/42_env_vars.html
View File

@@ -66,6 +66,10 @@ The variable is relevant for: test execution / benchmarking.
The variable is relevant for: test execution / benchmarking. The variable is relevant for: test execution / benchmarking.
The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf. The variable depends upon functionality provided by the Phoronix Test Suite module: linux_perf.
</p> </p>
<h2>LOG_CLI_OUTPUT</h2>
<p><em>[EXPERIMENTAL] When this option is enabled, the Phoronix Test Suite standard output from the terminal will be logged to any relevant Phoronix Test Suite / Phoromatic log file. This is mainly useful for debugging purposes and if wishing to always archive the standard output as part of Phoronix Test Suite logs.</em></p>
<p>The value can be of type: boolean (TRUE / FALSE).
</p>
<h2>MONITOR</h2> <h2>MONITOR</h2>
<p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p> <p><em>This option can be used for system sensor monitoring during test execution. The Phoronix Test Suite system_monitor module can monitor various exposed sensors and record them as part of the result file and present them as additional graphs / metrics in the result viewer. The exposed sensors varies by platform hardware/software. This functionality also requires PHP PCNTL support and thus is not available for some platforms (i.e. Windows).</em></p>
<p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp) <p>The value can be of type: enumeration (all, cpu.peak-freq, cpu.temp, cpu.power, cpu.usage, gpu.freq, gpu.power, gpu.temp, hdd.temp, memory.usage, swap.usage, sys.power, sys.temp)

24
documentation/stubs/55_virtual_suites.html
View File

@@ -111,6 +111,9 @@
<h3>Solaris Operating System Tests<em> pts/solaris</em> <h3>Solaris Operating System Tests<em> pts/solaris</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
<h3>Steam Tests<em> pts/steam</em>
</h3>
<p>This is a collection of test profiles having an external dependency on Steam</p>
<h3>System Subsystem Tests<em> pts/system</em> <h3>System Subsystem Tests<em> pts/system</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
@@ -123,9 +126,6 @@
<h3>Smp Tests<em> pts/smp</em> <h3>Smp Tests<em> pts/smp</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cuda Tests<em> pts/cuda</em> <h3>Cuda Tests<em> pts/cuda</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
@@ -135,12 +135,18 @@
<h3>Openmp Tests<em> pts/openmp</em> <h3>Openmp Tests<em> pts/openmp</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Docker Tests<em> pts/docker</em> <h3>Docker Tests<em> pts/docker</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
<h3>Ai Tests<em> pts/ai</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing ai.</p>
<h3>Opencl Tests<em> pts/opencl</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
<h3>Cloud Tests<em> pts/cloud</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
<h3>Go Tests<em> pts/go</em> <h3>Go Tests<em> pts/go</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
@@ -243,6 +249,9 @@
<h3>All Tests in git<em> git/all</em> <h3>All Tests in git<em> git/all</em>
</h3> </h3>
<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p> <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
<h3>Application Tests<em> git/application</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
<h3>BSD Operating System Tests<em> git/bsd</em> <h3>BSD Operating System Tests<em> git/bsd</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
@@ -261,6 +270,9 @@
<h3>Rust Tests<em> git/rust</em> <h3>Rust Tests<em> git/rust</em>
</h3> </h3>
<p>This is a collection of test profiles having an external dependency on Rust</p> <p>This is a collection of test profiles having an external dependency on Rust</p>
<h3>System Subsystem Tests<em> git/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
<h3>Utility Tests<em> git/utility</em> <h3>Utility Tests<em> git/utility</em>
</h3> </h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p> <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>

16
pts-core/pts-core.php
View File

@@ -3,8 +3,8 @@
/* /*
Phoronix Test Suite Phoronix Test Suite
URLs: http://www.phoronix.com, http://www.phoronix-test-suite.com/ URLs: http://www.phoronix.com, http://www.phoronix-test-suite.com/
Copyright (C) 2008 - 2022, Phoronix Media Copyright (C) 2008 - 2024, Phoronix Media
Copyright (C) 2008 - 2022, Michael Larabel Copyright (C) 2008 - 2024, Michael Larabel
pts-core.php: To boot-strap the Phoronix Test Suite start-up pts-core.php: To boot-strap the Phoronix Test Suite start-up
This program is free software; you can redistribute it and/or modify This program is free software; you can redistribute it and/or modify
@@ -211,16 +211,16 @@ function pts_needed_extensions()
// Required? - The Check If In Place - Name - Description // Required? - The Check If In Place - Name - Description
// Required extesnions denoted by 1 at [0] // Required extesnions denoted by 1 at [0]
array(1, extension_loaded('dom'), 'DOM', 'The Document Object Model is required for XML operations.'), array(1, extension_loaded('dom'), 'DOM', 'The Document Object Model is required for XML operations.'),
array(1, extension_loaded('zip') || extension_loaded('zlib'), 'ZIP', 'ZIP support is required for file compression.'), array(1, extension_loaded('zip') || extension_loaded('zlib'), 'ZIP', 'ZIP support is required for file (de)compression.'),
array(1, function_exists('json_decode'), 'JSON', 'JSON support is required for OpenBenchmarking.org.'), array(1, function_exists('json_decode'), 'JSON', 'JSON support is required for OpenBenchmarking.org.'),
array(1, function_exists('simplexml_load_string'), 'SimpleXML', 'SimpleXML is required for XML operations.'), array(1, function_exists('simplexml_load_string'), 'SimpleXML', 'SimpleXML is required for XML operations.'),
// Optional but recommended extensions // Optional but recommended extensions
array(0, extension_loaded('openssl'), 'OpenSSL', 'OpenSSL support is recommended to support HTTPS traffic.'), array(0, extension_loaded('openssl'), 'OpenSSL', 'OpenSSL support is highly recommended to support HTTPS traffic.'),
array(0, extension_loaded('gd'), 'GD', 'The GD library is recommended for improved graph rendering.'), array(0, extension_loaded('gd'), 'GD', 'The GD library is recommended for improved graph rendering.'),
array(0, extension_loaded('zlib'), 'Zlib', 'The Zlib extension can be used for greater file compression.'), array(0, extension_loaded('zlib'), 'Zlib', 'The Zlib extension can be used for greater file compression.'),
array(0, function_exists('bzcompress'), 'Bzip2', 'The bzcompress/bzip2 support can be used for greater file compression.'), array(0, function_exists('bzcompress'), 'Bzip2', 'The bzcompress/bzip2 support can be used for greater file compression.'),
array(0, extension_loaded('sqlite3'), 'SQLite3', 'SQLite3 is required when running a Phoromatic server.'), array(0, extension_loaded('sqlite3'), 'SQLite3', 'SQLite3 is required when running a Phoromatic server.'),
array(0, function_exists('pcntl_fork'), 'PCNTL', 'PCNTL is highly recommended as it is required by some tests.'), array(0, function_exists('pcntl_fork'), 'PCNTL', 'PCNTL is highly recommended as it is required by some tests and for threading features.'),
array(0, function_exists('posix_getpwuid'), 'POSIX', 'POSIX support is highly recommended.'), array(0, function_exists('posix_getpwuid'), 'POSIX', 'POSIX support is highly recommended.'),
array(0, function_exists('curl_init'), 'CURL', 'CURL is recommended for an enhanced download experience.'), array(0, function_exists('curl_init'), 'CURL', 'CURL is recommended for an enhanced download experience.'),
array(0, function_exists('socket_create_listen'), 'Sockets', 'Sockets is needed when running the Phoromatic Server.'), array(0, function_exists('socket_create_listen'), 'Sockets', 'Sockets is needed when running the Phoromatic Server.'),
@@ -228,9 +228,9 @@ function pts_needed_extensions()
); );
} }
pts_define('PTS_VERSION', '10.8.4'); pts_define('PTS_VERSION', '10.8.5');
pts_define('PTS_CORE_VERSION', 10840); pts_define('PTS_CORE_VERSION', 10850);
pts_define('PTS_RELEASE_DATE', '20220703'); pts_define('PTS_RELEASE_DATE', '20240324');
pts_define('PTS_CODENAME', 'Nesseby'); pts_define('PTS_CODENAME', 'Nesseby');
pts_define('PTS_IS_CLIENT', (defined('PTS_MODE') && strstr(PTS_MODE, 'CLIENT') !== false)); pts_define('PTS_IS_CLIENT', (defined('PTS_MODE') && strstr(PTS_MODE, 'CLIENT') !== false));