Prep for 10.2.2

Add new command to download and check each test-profile

AUTHORS

@@ -1,4 +1,4 @@
-Copyright 2008 - 2020 by Phoronix Media.
+Copyright 2008 - 2021 by Phoronix Media.
 
 Lead Architects:
 

ChangeLog

@@ -1,6 +1,141 @@
 PHORONIX TEST SUITE CHANGE-LOG
 
-Phoronix Test Suite (Git)
+Phoronix Test Suite 10.2.2
+17 February 2021
+
+pts-core: Add helper text when hitting a download with no working mirrors
+pts-core: Various external dependency updates
+pts-core: Add enable-repo sub-command for more easily enabling new OpenBenchmarking.org repos
+pts-core: Result viewer fix for the limit drop down menu potentially not being activated in some cases
+pts-core: Allow renaming runs within the result viewer
+phoromatic: Ensure pcntl_signal is present before starting Phoromatic Server
+phoromatic: PHP 8 compatibility fixes
+phodevi: Fix display driver name potentially being reported inaccurate for some obscure graphics cards / driver configurations
+phodevi: Export current GPU graphics card PCI device ID (GPU_DEVICE_ID) for some games/tests relying on it for configuration
+
+Phoronix Test Suite 10.2.1
+1 February 2021
+
+pts-core: Add "InstallRequiresInternet" option for test profiles that is more narrow (install time only) than the existing "RequiresInternet"
+pts-core: Add check-tests sub-command
+pts-core: Fix possible crash on PDF output
+pts-core: Various small fixes and tweaks
+pts-core: Fix PHP8 + cURL download error
+pts_Graph: A number of minor SVG standards compliance updates
+phodevi: Log Transparent Huge Pages setting as part of system details
+phodevi: Don't bother parsing the X.org log if it grows too big
+
+Phoronix Test Suite 10.2.0
+5 January 2021
+
+pts-core: PHP8 detection improvements
+pts-core: For estimated run time, avoid over-calculating time if test has no options but multiple outputs
+pts-core: Updated (Open)Mandriva external dependencies
+pts_Graph: Minor enhancements
+phodevi: Add support for reporting ACPI Platform Profile and INT340x Workload Hint
+
+Phoronix Test Suite 10.2.0 Milestone 3
+21 December 2020
+
+pts-core: Add debug-unhandled-dependencies option
+pts-core: Default to 2.5% std dev threshold default on new installs
+pts-core: BSD external dependency updates
+pts-core: Various refinements to the text user interface
+pts-core: When a test profile hits a failed download / broken mirror, report that URL to OpenBenchmarking.org
+phodevi: Don't restore the Phodevi cache if the /etc/machine-id changed (or /etc/hostname as fallback)
+
+Phoronix Test Suite 10.2.0 Milestone 2
+6 December 2020
+
+pts-core: Transition to new JSON-based data format for managing test install metadata while maintaining backwards compatibility with prior XML format
+pts-core: Begin tracking test run-times per-hash (all configured test options) for more detailed time tracking and in turn time estimates on subsequent runs
+pts-core: Increase compression factor when uploading benchmark results
+pts-core: Last minute fixes for PHP 8.0 compatibility
+phodevi: Report if CPUFreq Boost enabled/disabled
+turbostat: Add TurboStat module to easily generate turbostat dumps on a per-test basis to log files
+phoromatic: Much faster web viewer performance especially with large databases
+
+Phoronix Test Suite 10.2.0 Milestone 1
+21 November 2020
+
+pts-core: Log lock_stat, config.gz, dmidecode to system logs
+pts-core: Only show Apple options when running on macOS
+pts-core: Add extra safeguard around FORCE_TIMES_TO_RUN for disabling dynamic run count
+ob_auto_compare: Intelligently choose more relevant reference results
+phodevi: macOS CPU temperature monitoring support
+phodevi: Support for reading WattsUp Pro power meter data directly without utility using WATTS_UP_METER=<USB TTY>
+phodevi: Report Google Compute Engine machine type as part of motherboard string
+phodevi: Add dumpe2fs to system logs when running on EXT4 and root
+phodevi: Add block size reporting
+phodevi: CPU power reporting for Ampere Altra
+phodevi: Various Ampere Altra hardware detection/reporting improvements
+phodevi: Support reading CPU package power consumption on macOS using powermetrics
+
+Phoronix Test Suite 10.0.1
+21 October 2020
+
+pts-core: Fix for older versions of PHP such as in RHEL7
+pts-core: Add Thermald version reporting to system table when active
+phodevi: Detection improvements for new CPUs
+phodevi: Avoid "11th Gen Intel" CPU string
+phodevi: Update for NVMe drive reporting with KIOXIA, Toshiba sometimes not reporting their brand first
+
+Phoronix Test Suite 10.0.0
+13 October 2020
+
+pts-core: Ensure any post-run script is triggered still under halt-testing/skip-test conditions
+pts-core: Allow batch processing of performance per dollar metrics
+phodevi: Add Intel AMX presence detection
+phodevi: Add detection for Intel Alder Lake, Jasper Lake, Sapphire Rapids, and others
+phoromatic: Ensure Windows tests get displayed even if running the Phoromatic Server on Linux
+flush_caches: Add module to flush system caches between runs
+test_timeout: Add module to quit a test run if it exceeds a predefined time limit or 'auto' determination
+
+Phoronix Test Suite 10.0.0 Milestone 3
+1 October 2020
+
+pts-core: Don't show Vulkan options if Vulkan support is known to be unavailable/broken
+pts-core: Add OptionSelect tag support within test suite definitions
+pts-core: Allow * wildcard match in FileCheck handling within external dependency XML
+pts-core: Add "OS" TestType
+pts-core: Various external dependency updates
+pts-core: Continued tweaking to the analytics engine
+phodevi: Add Neoverse N2, Cortex-X1 detection and other Arm CPU updates
+pts_Graph: Various improvements
+
+Phoronix Test Suite 10.0.0 Milestone 2
+12 September 2020
+
+pts-core: Honor NO_COLOR environment variable for disabling terminal coloring
+pts-core: Allow launching just the result viewer from systemd (phoronix-result-server.service)
+pts-core: Result viewer UI tweaks
+pts-core: Minor fixes
+pts-core: Add RequiresRootInstall test profile option
+pts-core: Result file text output tweaks
+pts-core: More robust test result parsing in certain time formats
+
+Phoronix Test Suite 10.0.0 Milestone 1
+19 August 2020
+
+pts-core: Add keep-results-in-result-file sub-command
+pts-core: Split the dynamic result viewer into its own embed class for result file handling to allow for easy re-use by OpenBenchmarking, Phoromatic, etc
+pts-core: Various changes for supporting the new OpenBenchmarking.org infrastructure
+pts_Graph: Add histogram type
+phodevi: CPU core name / family detection to friendly strings (OpenBenchmarking.org driven)
+phodevi: Report core name via system-info command
+phodevi: Various storage HDD/SSD detection reporting improvements
+phodevi: Ampere Altra detection
+phodevi: macOS/Apple hardware detection improvements
+
+Phoronix Test Suite 9.8.0
+9 July 2020
+
+pts-core: Handling of cases where all options are unsupported (such as CUDA and OpenCL tests with no valid backends found) to avoid prompts
+pts-core: Be more liberal in allowing CUDA/OpenCL GPU compute tests to run fine without display server active
+pts-core: Fix for not filling test suites of contained tests in some select cases (sub-suites listing in results viewer)
+pts-core: Allow creating new virtual test suites that are not prefixed by a OB repository
+phodevi: NVIDIA GPU detection within WSL2
+docker: Rewritten phoronix/pts Docker implementation based on Ubuntu 20.04 LTS
 
 Phoronix Test Suite 9.8.0 Milestone 2
 24 June 2020

README.md

@@ -1,4 +1,4 @@
-# Phoronix Test Suite 9.8.0m2
+# Phoronix Test Suite 10.2.2
 https://www.phoronix-test-suite.com/
 
 The **Phoronix Test Suite** is the most comprehensive testing and benchmarking

deploy/docker/ubuntu-pts-docker-build.sh

@@ -0,0 +1,56 @@
+#!/bin/bash
+
+export TESTS_TO_PRECACHE=""
+
+# Ensure Docker on system
+DIR_NAME=phoronix-pts-docker
+mkdir -p ./$DIR_NAME/base/
+OS_OUTER=`pwd`
+cd $DIR_NAME/base
+OS_ROOT_PATH=`pwd`
+
+rm -rf phoronix-test-suite/
+git clone https://github.com/phoronix-test-suite/phoronix-test-suite.git
+cd phoronix-test-suite
+rm -rf .git
+
+# cache OpenBenchmarking.org metadata
+export PTS_USER_PATH_OVERRIDE=$OS_ROOT_PATH/var/lib/phoronix-test-suite/
+rm -f $PTS_USER_PATH_OVERRIDE
+mkdir -p $PTS_USER_PATH_OVERRIDE
+./phoronix-test-suite make-openbenchmarking-cache lean
+
+# cache select tests
+export PTS_DOWNLOAD_CACHE_OVERRIDE=$OS_ROOT_PATH/var/cache/phoronix-test-suite/download-cache/
+mkdir -p $PTS_DOWNLOAD_CACHE_OVERRIDE
+export PTS_DOWNLOAD_CACHING_PLATFORM_LIMIT=1
+# ./phoronix-test-suite make-download-cache $TESTS_TO_PRECACHE
+# ./phoronix-test-suite info 1809091-PTS-CLEARLIN01
+
+rm -f $PTS_USER_PATH_OVERRIDE/core.pt2so
+
+# cleanup
+cd $OS_OUTER/$DIR_NAME
+
+tar -C base -cf base.tar .
+rm -f base.tar.xz
+xz -v -T0 base.tar
+
+cat > Dockerfile << EOF
+FROM ubuntu:20.04
+MAINTAINER Phoronix Media <commercial@phoronix-test-suite.com>
+ADD base.tar.xz /
+ARG DEBIAN_FRONTEND=noninteractive
+RUN apt update
+RUN apt install -y unzip php-cli apt-utils mesa-utils php-xml git-core apt-file
+RUN apt-file update
+CMD ["/phoronix-test-suite/phoronix-test-suite", "shell"]
+EOF
+
+docker build -t $DIR_NAME .
+
+# docker run -it phoronix-pts-docker
+
+# docker tag phoronix-pts-docker phoronix/pts
+# docker push phoronix/pts
+

deploy/farm-system-customizations/intel-xorg-headless.conf

@@ -1,27 +0,0 @@
-Section "Monitor"
-    Identifier             "Monitor0"
-    Modeline "1920x1080" 174.83 1920 2056 2248 2536 1080 1081 1084 1149             # 174.83 MHz,  68.94 kHz,  60.00 Hz
-    Option      "PreferredMode"  "1920x1080"
-        Option "Enable" "true"
-EndSection
-
-Section "Device"
-    Identifier             "Device0"
-    Driver                 "intel" #Choose the driver used for this monitor
-        Option "DDC" "0"
-        Option "Virtualheads" "1"
-        Option "Vsync" "0"
-        Option "SwapbuffersWait" "0"
-	Option "DRI" "3"
-EndSection
-
-Section "Screen"
-    Identifier             "Screen0"  #Collapse Monitor and Device section to Screen section
-    Device                 "Device0"
-    Monitor                "Monitor0"
-    DefaultDepth           24 #Choose the depth (16||24)
-    SubSection             "Display"
-        Depth              24
-        Modes              "1920x1080" #Choose the resolution
-    EndSubSection
-EndSection

deploy/farm-system-customizations/radeon-xorg-headless.conf

@@ -1,23 +0,0 @@
-Section "Device"
-    Identifier             "Device0"
-    Driver                 "radeon"
-	Option "SwapBuffersWait" "0"
-		Option "DRI "3"
-EndSection
-
-Section "Monitor"
-    Identifier             "Monitor0"
-        Option "enable" "true"
-     Modeline "1920x1080" 148.50 1920 2448 2492 2640 1080 1084 1089 1125 +hsync +vsync
-EndSection
-
-Section "Screen"
-        Identifier "Fake"
-        Device "Device0"
-        Monitor "Monitor0"
-        Option "ConnectedMonitor" "Monitor0"
-        SubSection "Display"
-                Depth 24
-                Modes "1920x1080"
-        EndSubSection
-EndSection

deploy/farm-system-customizations/ubuntu-initial-setup.sh

@@ -1,10 +0,0 @@
-#!/bin/sh
-
-sudo apt-get install openssh-server git-core php5-cli
-
-echo "GRUB_RECORDFAIL_TIMEOUT=0" >> /etc/default/grub
-update-grub
-
-sudo passwd
-
-# check if needing "tty -s &&" for auto log-in user in ~/.profile

deploy/phoromatic-systemd/phoronix-result-server.service

@@ -0,0 +1,14 @@
+[Unit]
+Description=Phoronix Test Suite Result viewer
+After=syslog.target network.target
+Documentation=man:phoronix-test-suite(1)
+
+[Service]
+TimeoutStartSec=300
+ExecStart=/usr/bin/phoronix-test-suite start-result-viewer daemon
+Restart=on-failure
+
+[Install]
+WantedBy=multi-user.target
+
+

documentation/man-pages/phoronix-test-suite.1

@@ -1,4 +1,4 @@
-.TH phoronix-test-suite 1  "www.phoronix-test-suite.com" "9.8.0m2"
+.TH phoronix-test-suite 1  "www.phoronix-test-suite.com" "10.2.2"
 .SH NAME
 phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation.
 .SH SYNOPSIS
@@ -110,6 +110,9 @@ This option and its arguments pre-set the Phoronix Test Suite batch run mode wit
 .B clone-result [OpenBenchmarking ID]  ...
 This option will download a local copy of a file that was saved to OpenBenchmarking.org, as long as a valid public ID is supplied.
 .TP
+.B enable-repo
+This option is used if wanting to add a new OpenBenchmarking.org account/repository to your system for enabling third-party/unofficial test profiles and test suites.
+.TP
 .B list-recommended-tests
 This option will list recommended test profiles for benchmarking sorted by hardware sub-system. The recommended tests are determined via querying OpenBenchmarking.org and determining the most popular tests for a given environment based upon the number of times a test profile has been downloaded, the number of test results available on OpenBenchmarking.org for a given test profile, the age of the test profile, and other weighted factors.
 .TP
@@ -144,6 +147,9 @@ This option can be used for uploading a test profile to your account on OpenBenc
 This option can be used for uploading a test suite to your account on OpenBenchmarking.org. By uploading your test suite to OpenBenchmarking.org, others are then able to browse and access this test suite for easy distribution.
 .TP
 .SH INFORMATION
+.B check-tests [Test]
+This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.
+.TP
 .B info [Test | Suite | OpenBenchmarking ID | Test Result]
 This option will show details about the supplied test, suite, virtual suite, or result file.
 .TP
@@ -257,12 +263,12 @@ This option is used if you wish to edit the title and description of an existing
 .B extract-from-result-file [Test Result]
 This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.
 .TP
+.B keep-results-in-result-file [Test Result]
+This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.
+.TP
 .B merge-results [Test Result]  ...
 This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
 .TP
-.B refresh-graphs [Test Result]
-This option will re-render and save all result graphs within a saved file. This option can be used when making modifications to the graphing code or its color/option configuration file and testing the changes.
-.TP
 .B remove-result [Test Result]
 This option will permanently remove the saved file set that is set as the first argument.
 .TP
@@ -324,22 +330,6 @@ This option will display a list of available Phoronix Test Suite commands and po
 .B version
 This option will display the Phoronix Test Suite client version.
 .TP
-.SH RESULT ANALYSIS
-.B analyze-all-runs [Test Result]
-This option will generate a candlestick graph showing the distribution of results from all trial runs. The candlestick graph is similar to the Japanese candlestick charts used by the financial industry, except instead of representing stock data it is numerical result data from all trial runs.\n\nThe tip of the upper-wick represents the highest value of the test runs with the tip of the lower-wick representing the lowest value of all test runs. The upper-edge of the candle body represents the first or last run value and the lower-edge represents the first or last run value. Lastly, if the last run value is less than the first run value, the candle body is the same color as the graph background, otherwise the last run value is greater.
-.TP
-.B executive-summary [Test Result]
-This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.
-.TP
-.B result-file-confidence [Test Result]
-This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.
-.TP
-.B result-file-stats [Test Result]
-This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.
-.TP
-.B wins-and-losses [Test Result]
-This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
-.TP
 .SH MODULES
 .B auto-load-module
 This option can be used for easily adding a module to the AutoLoadModules list in the Phoronix Test Suite user configuration file. That list controls what PTS modules are automatically loaded on start-up of the Phoronix Test Suite.
@@ -375,6 +365,19 @@ This option can be used for resetting the Phoronix Test Suite user configuration
 .B user-config-set
 This option can be used for setting an XML value in the Phoronix Test Suite user configuration file.
 .TP
+.SH RESULT ANALYSIS
+.B executive-summary [Test Result]
+This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.
+.TP
+.B result-file-confidence [Test Result]
+This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.
+.TP
+.B result-file-stats [Test Result]
+This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.
+.TP
+.B wins-and-losses [Test Result]
+This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
+.TP
 .SH PHOROMATIC
 .B start-phoromatic-server
 Start the Phoromatic web server for controlling local Phoronix Test Suite client systems to facilitate automated and repeated test orchestration and other automated features targeted at the enterprise.
@@ -396,5 +399,5 @@ https://www.phoronix.com/
 .br
 https://www.phoronix.com/forums/
 .SH AUTHORS
-Copyright 2008 - 2020 by Phoronix Media, Michael Larabel.
+Copyright 2008 - 2021 by Phoronix Media, Michael Larabel.
 .TP

documentation/phoronix-test-suite.html

@@ -324,6 +324,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
 <h3>clone-result<em>  [OpenBenchmarking ID]  ...</em>
 </h3>
 <p>This option will download a local copy of a file that was saved to OpenBenchmarking.org, as long as a valid public ID is supplied.</p>
+<h3>enable-repo<em>  </em>
+</h3>
+<p>This option is used if wanting to add a new OpenBenchmarking.org account/repository to your system for enabling third-party/unofficial test profiles and test suites.</p>
 <h3>list-recommended-tests<em>  </em>
 </h3>
 <p>This option will list recommended test profiles for benchmarking sorted by hardware sub-system. The recommended tests are determined via querying OpenBenchmarking.org and determining the most popular tests for a given environment based upon the number of times a test profile has been downloaded, the number of test results available on OpenBenchmarking.org for a given test profile, the age of the test profile, and other weighted factors.</p>
@@ -358,6 +361,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
 </h3>
 <p>This option can be used for uploading a test suite to your account on OpenBenchmarking.org. By uploading your test suite to OpenBenchmarking.org, others are then able to browse and access this test suite for easy distribution.</p>
 <h1>Information</h1>
+<h3>check-tests<em>  [Test]</em>
+</h3>
+<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.</p>
 <h3>info<em>  [Test | Suite | OpenBenchmarking ID | Test Result]</em>
 </h3>
 <p>This option will show details about the supplied test, suite, virtual suite, or result file.</p>
@@ -471,12 +477,12 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
 <h3>extract-from-result-file<em>  [Test Result]</em>
 </h3>
 <p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.</p>
+<h3>keep-results-in-result-file<em>  [Test Result]</em>
+</h3>
+<p>This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.</p>
 <h3>merge-results<em>  [Test Result]  ...</em>
 </h3>
 <p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
-<h3>refresh-graphs<em>  [Test Result]</em>
-</h3>
-<p>This option will re-render and save all result graphs within a saved file. This option can be used when making modifications to the graphing code or its color/option configuration file and testing the changes.</p>
 <h3>remove-result<em>  [Test Result]</em>
 </h3>
 <p>This option will permanently remove the saved file set that is set as the first argument.</p>
@@ -538,22 +544,6 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
 <h3>version<em>  </em>
 </h3>
 <p>This option will display the Phoronix Test Suite client version.</p>
-<h1>Result Analysis</h1>
-<h3>analyze-all-runs<em>  [Test Result]</em>
-</h3>
-<p>This option will generate a candlestick graph showing the distribution of results from all trial runs. The candlestick graph is similar to the Japanese candlestick charts used by the financial industry, except instead of representing stock data it is numerical result data from all trial runs.\n\nThe tip of the upper-wick represents the highest value of the test runs with the tip of the lower-wick representing the lowest value of all test runs. The upper-edge of the candle body represents the first or last run value and the lower-edge represents the first or last run value. Lastly, if the last run value is less than the first run value, the candle body is the same color as the graph background, otherwise the last run value is greater.</p>
-<h3>executive-summary<em>  [Test Result]</em>
-</h3>
-<p>This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.</p>
-<h3>result-file-confidence<em>  [Test Result]</em>
-</h3>
-<p>This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.</p>
-<h3>result-file-stats<em>  [Test Result]</em>
-</h3>
-<p>This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.</p>
-<h3>wins-and-losses<em>  [Test Result]</em>
-</h3>
-<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
 <h1>Modules</h1>
 <h3>auto-load-module<em>  </em>
 </h3>
@@ -589,6 +579,19 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
 <h3>user-config-set<em>  </em>
 </h3>
 <p>This option can be used for setting an XML value in the Phoronix Test Suite user configuration file.</p>
+<h1>Result Analysis</h1>
+<h3>executive-summary<em>  [Test Result]</em>
+</h3>
+<p>This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.</p>
+<h3>result-file-confidence<em>  [Test Result]</em>
+</h3>
+<p>This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.</p>
+<h3>result-file-stats<em>  [Test Result]</em>
+</h3>
+<p>This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.</p>
+<h3>wins-and-losses<em>  [Test Result]</em>
+</h3>
+<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
 <h1>Phoromatic</h1>
 <h3>start-phoromatic-server<em>  </em>
 </h3>
@@ -610,6 +613,9 @@ along with this program. If not, see <http://www.gnu.org/licenses/>.
 <h2>Generate Perf FlameGraphs For Tests</h2>
 <p>Setting FLAME_GRAPH_PATH=&lt;path to flamegraph path&gt; will auto-load and enable this Phoronix Test Suite module. The module will generate a Linux perf FlameGraph for each test run during the benchmarking process. Details on FlameGraph @ https://github.com/brendangregg/FlameGraph</p>
 <p>This module utilizes the following environmental variables: FLAME_GRAPH_PATH.</p>
+<h2>Flush Caches</h2>
+<p>Loading this module will ensure caches (page cache, swap, etc) automatically get flushed prior to running any test.</p>
+<p>This module utilizes the following environmental variables: PTS_FLUSH_CACHES.</p>
 <h2>Graphics Override</h2>
 <p>This module allows you to override some graphics rendering settings for the ATI and NVIDIA drivers while running the Phoronix Test Suite.</p>
 <p>This module utilizes the following environmental variables: FORCE_AA, FORCE_AF.</p>
@@ -735,8 +741,6 @@ Supported Options:
   - all.memory
   - memory.temp
   - memory.usage
-  - all.network
-  - network.usage
   - all.swap
   - swap.usage
   - all.sys
@@ -748,12 +752,18 @@ Supported Options:
   - all.sys.voltage
 
 NOTE: Use the "system-sensors" command to see what sensors are available for monitoring on the system.</p>
+<h2>Test Timeout</h2>
+<p>This module allows killing a test if it exceeds a defined threshold, such as if the test is hung, etc. TEST_TIMEOUT_AFTER= environment variable can be used for controlling the behavior. When this variable is set, the value will can be set to "auto" or a positive integer. The value indicates the number of minutes until a test run should be aborted, such as for a safeguard against hung/deadlocked processes or other issues. Setting this to a high number as a backup would be recommended for fending off possible hangs / stalls in the testing process if the test does not quit on its own for whatever reason. If the value is "auto", it will quit if the time of a test run exceeds 3x the average time it normally takes the particular test to complete its run.</p>
+<p>This module utilizes the following environmental variables: TEST_TIMEOUT_AFTER.</p>
 <h2>Timed Screenshot</h2>
 <p>This is a module that will take a screenshot of the system at a pre-defined interval. ImageMagick must be installed onto the system prior to using this module.</p>
 <p>This module utilizes the following environmental variables: SCREENSHOT_INTERVAL.</p>
 <h2>Toggle Screensaver</h2>
 <p>This module toggles the system's screensaver while the Phoronix Test Suite is running. At this time, the GNOME and KDE screensavers are supported.</p>
 <p>This module utilizes the following environmental variables: HALT_SCREENSAVER.</p>
+<h2>Linux Turbostat Dumper</h2>
+<p>Setting TURBOSTAT_LOG_DIR=_DIR_ will auto-load and enable this Phoronix Test Suite module. The module will -- if turbostat is installed on the system and the user is root -- allow dumping of the TurboStat data to the specified directly on a per-test basis. This allows easily collecting of turbostat logs for each test being run.</p>
+<p>This module utilizes the following environmental variables: TURBOSTAT_LOG_DIR.</p>
 <h2>Update Checker</h2>
 <p>This module checks to see if the Phoronix Test Suite -- and its tests and suites -- are up to date plus also handles message of the day information.</p>
 <h2>Utilize Wine On Linux Benchmarking</h2>
@@ -825,6 +835,8 @@ NOTE: Use the "system-sensors" command to see what sensors are available for mon
 <p><strong>~/.phoronix-test-suite/test-suites/</strong></p>
 <p>This is the directory where test suites are stored.</p>
 <h1>Environment Variables</h1>
+<p><strong>TEST_TIMEOUT_AFTER</strong></p>
+<p>When this variable is set, the value will can be set to <em>auto</em> or a positive integer. The value indicates the number of minutes until a test run should be aborted, such as for a safeguard against hung/deadlocked processes or other issues. Setting this to a high number as a backup would be recommended for fending off possible hangs / stalls in the testing process if the test does not quit. If the value is <em>auto</em>, it will quit if the time of a test run exceeds 3x the average time it normally takes the particular test to complete its run. In the future, auto might be enabled by default in a future PTS release.</p>
 <p><strong>TEST_RESULTS_NAME</strong></p>
 <p>When this variable is set, the value will be used as the name for automatically saving the test results.</p>
 <p><strong>TEST_RESULTS_IDENTIFIER</strong></p>
@@ -940,58 +952,61 @@ In the event that a test profile fails to install or run, the following general
 <hr style="height: 50px; border: 0;"><a name="VirtualTestSuites"></a><h1>Virtual Test Suites</h1>
 <p>Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed. </p>
 <p>Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running <em>phoronix-test-suite list-available-virtual-suites.</em></p><hr>
-<h3>All Tests in pts<em>  pts/all</em>
+<h3>All Tests In Pts<em>  pts/all</em>
 </h3>
 <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>benchmark Tests<em>  pts/benchmark</em>
+<h3>Application Tests<em>  pts/application</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
+<h3>Benchmark Tests<em>  pts/benchmark</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.</p>
-<h3>BLAS (Basic Linear Algebra Sub-Routine) Library Tests<em>  pts/blas</em>
+<h3>BLAS (Basic Linear Algebra Sub-Routine) Tests<em>  pts/blas</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library</p>
-<h3>Boost Development Libraries Tests<em>  pts/boost</em>
+<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine)</p>
+<h3>C++ Boost Tests<em>  pts/boost</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on Boost Development Libraries</p>
-<h3>bsd Operating System Tests<em>  pts/bsd</em>
+<p>This is a collection of test profiles having an external dependency on C++ Boost</p>
+<h3>Bsd Operating System Tests<em>  pts/bsd</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>disk Subsystem Tests<em>  pts/disk</em>
+<h3>Disk Subsystem Tests<em>  pts/disk</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.</p>
-<h3>Everything in pts<em>  pts/everything</em>
+<h3>Everything In Pts<em>  pts/everything</em>
 </h3>
 <p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
 <h3>Fortran Tests<em>  pts/fortran</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Fortran</p>
-<h3>game Tests<em>  pts/game</em>
+<h3>Game Tests<em>  pts/game</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.</p>
 <h3>Go Language Tests<em>  pts/golang</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Go Language</p>
-<h3>graphics Subsystem Tests<em>  pts/graphics</em>
+<h3>Graphics Subsystem Tests<em>  pts/graphics</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.</p>
 <h3>Installed Tests<em>  pts/installed</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.</p>
-<h3>java Tests<em>  pts/java</em>
+<h3>Java Tests<em>  pts/java</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing java.</p>
 <h3>LAPACK (Linear Algebra Pack) Tests<em>  pts/lapack</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)</p>
-<h3>linux Operating System Tests<em>  pts/linux</em>
+<h3>Linux Operating System Tests<em>  pts/linux</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  pts/macosx</em>
+<h3>Macosx Operating System Tests<em>  pts/macosx</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>memory Subsystem Tests<em>  pts/memory</em>
+<h3>Memory Subsystem Tests<em>  pts/memory</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system.</p>
-<h3>network Subsystem Tests<em>  pts/network</em>
+<h3>Network Subsystem Tests<em>  pts/network</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.</p>
 <h3>Node.js + NPM Tests<em>  pts/node-npm</em>
@@ -1000,13 +1015,16 @@ In the event that a test profile fails to install or run, the following general
 <h3>OpenCV Tests<em>  pts/opencv</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on OpenCV</p>
-<h3>openmpi Tests<em>  pts/openmpi</em>
+<h3>Openmpi Tests<em>  pts/openmpi</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.</p>
-<h3>processor Subsystem Tests<em>  pts/processor</em>
+<h3>Os Subsystem Tests<em>  pts/os</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the os sub-system.</p>
+<h3>Processor Subsystem Tests<em>  pts/processor</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
-<h3>python Tests<em>  pts/python</em>
+<h3>Python Tests<em>  pts/python</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.</p>
 <h3>Ruby Tests<em>  pts/ruby</em>
@@ -1015,180 +1033,162 @@ In the event that a test profile fails to install or run, the following general
 <h3>Rust Tests<em>  pts/rust</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Rust</p>
-<h3>scientific Tests<em>  pts/scientific</em>
+<h3>Scientific Tests<em>  pts/scientific</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.</p>
-<h3>simulator Tests<em>  pts/simulator</em>
+<h3>Simulator Tests<em>  pts/simulator</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test.</p>
-<h3>solaris Operating System Tests<em>  pts/solaris</em>
+<h3>Solaris Operating System Tests<em>  pts/solaris</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
-<h3>system Subsystem Tests<em>  pts/system</em>
+<h3>System Subsystem Tests<em>  pts/system</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
-<h3>utility Tests<em>  pts/utility</em>
+<h3>Utility Tests<em>  pts/utility</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>windows Operating System Tests<em>  pts/windows</em>
+<h3>Windows Operating System Tests<em>  pts/windows</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.</p>
-<h3>smp Tests<em>  pts/smp</em>
+<h3>Smp Tests<em>  pts/smp</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
-<h3>opencl Tests<em>  pts/opencl</em>
+<h3>Opencl Tests<em>  pts/opencl</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
-<h3>cuda Tests<em>  pts/cuda</em>
+<h3>Cuda Tests<em>  pts/cuda</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
-<h3>mpi Tests<em>  pts/mpi</em>
+<h3>Mpi Tests<em>  pts/mpi</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
-<h3>openmp Tests<em>  pts/openmp</em>
+<h3>Openmp Tests<em>  pts/openmp</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
-<h3>cloud Tests<em>  pts/cloud</em>
+<h3>Cloud Tests<em>  pts/cloud</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
-<h3>docker Tests<em>  pts/docker</em>
+<h3>Docker Tests<em>  pts/docker</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
-<h3>go Tests<em>  pts/go</em>
+<h3>Go Tests<em>  pts/go</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
-<h3>vdpau Tests<em>  pts/vdpau</em>
+<h3>Vdpau Tests<em>  pts/vdpau</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.</p>
-<h3>video Tests<em>  pts/video</em>
+<h3>Video Tests<em>  pts/video</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.</p>
-<h3>responsiveness Tests<em>  pts/responsiveness</em>
+<h3>Responsiveness Tests<em>  pts/responsiveness</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.</p>
-<h3>All Tests in system<em>  system/all</em>
+<h3>All Tests In System<em>  system/all</em>
 </h3>
 <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>benchmark Tests<em>  system/benchmark</em>
+<h3>Application Tests<em>  system/application</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
+<h3>Benchmark Tests<em>  system/benchmark</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.</p>
-<h3>BLAS (Basic Linear Algebra Sub-Routine) Library Tests<em>  system/blas</em>
+<h3>BLAS (Basic Linear Algebra Sub-Routine) Tests<em>  system/blas</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library</p>
-<h3>Boost Development Libraries Tests<em>  system/boost</em>
+<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine)</p>
+<h3>C++ Boost Tests<em>  system/boost</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on Boost Development Libraries</p>
-<h3>bsd Operating System Tests<em>  system/bsd</em>
+<p>This is a collection of test profiles having an external dependency on C++ Boost</p>
+<h3>Bsd Operating System Tests<em>  system/bsd</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>disk Subsystem Tests<em>  system/disk</em>
+<h3>Disk Subsystem Tests<em>  system/disk</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.</p>
-<h3>Everything in system<em>  system/everything</em>
+<h3>Everything In System<em>  system/everything</em>
 </h3>
 <p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
-<h3>game Tests<em>  system/game</em>
+<h3>Game Tests<em>  system/game</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.</p>
-<h3>graphics Subsystem Tests<em>  system/graphics</em>
+<h3>Graphics Subsystem Tests<em>  system/graphics</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.</p>
 <h3>Installed Tests<em>  system/installed</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.</p>
-<h3>linux Operating System Tests<em>  system/linux</em>
+<h3>Linux Operating System Tests<em>  system/linux</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  system/macosx</em>
+<h3>Macosx Operating System Tests<em>  system/macosx</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>network Subsystem Tests<em>  system/network</em>
+<h3>Network Subsystem Tests<em>  system/network</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.</p>
-<h3>processor Subsystem Tests<em>  system/processor</em>
+<h3>OpenCV Tests<em>  system/opencv</em>
+</h3>
+<p>This is a collection of test profiles having an external dependency on OpenCV</p>
+<h3>OpenMPI Tests<em>  system/openmpi</em>
+</h3>
+<p>This is a collection of test profiles having an external dependency on OpenMPI</p>
+<h3>Processor Subsystem Tests<em>  system/processor</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
 <h3>Python Tests<em>  system/python</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Python</p>
-<h3>solaris Operating System Tests<em>  system/solaris</em>
+<h3>Scientific Tests<em>  system/scientific</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.</p>
+<h3>Solaris Operating System Tests<em>  system/solaris</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
-<h3>system Subsystem Tests<em>  system/system</em>
+<h3>System Subsystem Tests<em>  system/system</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
-<h3>utility Tests<em>  system/utility</em>
+<h3>Utility Tests<em>  system/utility</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>windows Operating System Tests<em>  system/windows</em>
+<h3>Windows Operating System Tests<em>  system/windows</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.</p>
-<h3>opencl Tests<em>  system/opencl</em>
+<h3>Opencl Tests<em>  system/opencl</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
-<h3>cuda Tests<em>  system/cuda</em>
+<h3>Cuda Tests<em>  system/cuda</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
-<h3>All Tests in git<em>  git/all</em>
+<h3>Smp Tests<em>  system/smp</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
+<h3>All Tests In Git<em>  git/all</em>
 </h3>
 <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>bsd Operating System Tests<em>  git/bsd</em>
+<h3>Bsd Operating System Tests<em>  git/bsd</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>Everything in git<em>  git/everything</em>
+<h3>Everything In Git<em>  git/everything</em>
 </h3>
 <p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
-<h3>linux Operating System Tests<em>  git/linux</em>
+<h3>Linux Operating System Tests<em>  git/linux</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  git/macosx</em>
+<h3>Macosx Operating System Tests<em>  git/macosx</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>processor Subsystem Tests<em>  git/processor</em>
+<h3>Processor Subsystem Tests<em>  git/processor</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
 <h3>Rust Tests<em>  git/rust</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Rust</p>
-<h3>utility Tests<em>  git/utility</em>
+<h3>Utility Tests<em>  git/utility</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>smp Tests<em>  git/smp</em>
+<h3>Smp Tests<em>  git/smp</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
-<h3>All Tests in windows<em>  windows/all</em>
-</h3>
-<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>benchmark Tests<em>  windows/benchmark</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.</p>
-<h3>bsd Operating System Tests<em>  windows/bsd</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>Everything in windows<em>  windows/everything</em>
-</h3>
-<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
-<h3>linux Operating System Tests<em>  windows/linux</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  windows/macosx</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>processor Subsystem Tests<em>  windows/processor</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
-<h3>solaris Operating System Tests<em>  windows/solaris</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
-<h3>system Subsystem Tests<em>  windows/system</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
-<h3>utility Tests<em>  windows/utility</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>windows Operating System Tests<em>  windows/windows</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.</p>
 <hr style="height: 50px; border: 0;"><a name="ComponentTesting"></a><h1>Component Testing</h1>
 <h1>Compiler Testing &amp; Masking</h1>
 <p>A majority of the test profiles provided by OpenBenchmarking.org to the Phoronix Test Suite are source-based tests. Relying upon the upstream source-code for each program under test allows for the tests to be easily brought to new platforms and architectures, avoids any out-of-tree / non-default packaging differences by different distributions and operating systems, and to allow the Phoronix Test Suite user to easily test new compilers and/or compiler options. For the source-based tests, the Phoronix Test Suite relies upon a compiler (e.g. GCC, LLVM/Clang, Sun Studio, Open64, et al) being present on the system under test. The Phoronix Test Suite does respect <em>CC/CXX</em> environment variables and test profiles are expected to honor <em>CFLAGS/CXXFLAGS</em> and other compiler settings.</p>
@@ -1216,7 +1216,7 @@ In the event that a test profile fails to install or run, the following general
 <p>If distributing a customized/local copy of the Phoronix Test Suite, the default behavior of the configuration file (in addition to deleting the pts_openbenchmarking_upload file) can be done via the user configuration defaults defined within <em>pts-core/static/user-config-defaults.xml</em>.</p>
 <hr style="height: 50px; border: 0;"><a name="DevelopmentCredits"></a><h1>Development Credits</h1>
 <p>The Phoronix Test Suite is based upon the extensive testing and internal tools developed by <a href="http://www.phoronix.com/">Phoronix.com</a> since 2004 along with support from leading tier-one computer hardware and software vendors. The principal architects of the Phoronix Test Suite are <a href="http://www.michaellarabel.com/">Michael Larabel</a> and Matthew Tippett. The phoronix-test-suite, pts_Graph, Phoromatic, Phodevi, tandem_Xml, and nye_Xml are some of the related open-source projects provided by <a href="http://www.phoronix-media.com/">Phoronix Media</a>.</p>
-<p style="padding-top: 30px; text-align: center;">Copyright &copy; 2008 - 2020 by Phoronix Media.</p></div>
+<p style="padding-top: 30px; text-align: center;">Copyright &copy; 2008 - 2021 by Phoronix Media.</p></div>
 		<div id="pts_footer">
 			<div id="pts_footer_logo"><a href="http://www.phoronix-test-suite.com/"><svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" version="1.1" viewbox="0 0 76 41" width="76" height="41" preserveaspectratio="xMinYMin meet">
   <path d="m74 22v9m-5-16v16m-5-28v28m-23-2h12.5c2.485281 0 4.5-2.014719 4.5-4.5s-2.014719-4.5-4.5-4.5h-8c-2.485281 0-4.5-2.014719-4.5-4.5s2.014719-4.5 4.5-4.5h12.5m-21 5h-11m11 13h-2c-4.970563 0-9-4.029437-9-9v-20m-24 40v-20c0-4.970563 4.0294373-9 9-9 4.970563 0 9 4.029437 9 9s-4.029437 9-9 9h-9" stroke="#c8d905" stroke-width="4" fill="none"></path>

documentation/phoronix-test-suite.md

@@ -134,6 +134,9 @@ This option and its arguments pre-set the Phoronix Test Suite batch run mode wit
 #### clone-result  [OpenBenchmarking ID]  ...
 This option will download a local copy of a file that was saved to OpenBenchmarking.org, as long as a valid public ID is supplied.
 
+#### enable-repo
+This option is used if wanting to add a new OpenBenchmarking.org account/repository to your system for enabling third-party/unofficial test profiles and test suites.
+
 #### list-recommended-tests
 This option will list recommended test profiles for benchmarking sorted by hardware sub-system. The recommended tests are determined via querying OpenBenchmarking.org and determining the most popular tests for a given environment based upon the number of times a test profile has been downloaded, the number of test results available on OpenBenchmarking.org for a given test profile, the age of the test profile, and other weighted factors.
 
@@ -169,6 +172,9 @@ This option can be used for uploading a test suite to your account on OpenBenchm
 
 
 ## Information
+#### check-tests  [Test]
+This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.
+
 #### info  [Test | Suite | OpenBenchmarking ID | Test Result]
 This option will show details about the supplied test, suite, virtual suite, or result file.
 
@@ -284,12 +290,12 @@ This option is used if you wish to edit the title and description of an existing
 #### extract-from-result-file  [Test Result]
 This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.
 
+#### keep-results-in-result-file  [Test Result]
+This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.
+
 #### merge-results  [Test Result]  ...
 This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.
 
-#### refresh-graphs  [Test Result]
-This option will re-render and save all result graphs within a saved file. This option can be used when making modifications to the graphing code or its color/option configuration file and testing the changes.
-
 #### remove-result  [Test Result]
 This option will permanently remove the saved file set that is set as the first argument.
 
@@ -353,23 +359,6 @@ This option will display a list of available Phoronix Test Suite commands and po
 This option will display the Phoronix Test Suite client version.
 
 
-## Result Analysis
-#### analyze-all-runs  [Test Result]
-This option will generate a candlestick graph showing the distribution of results from all trial runs. The candlestick graph is similar to the Japanese candlestick charts used by the financial industry, except instead of representing stock data it is numerical result data from all trial runs.\n\nThe tip of the upper-wick represents the highest value of the test runs with the tip of the lower-wick representing the lowest value of all test runs. The upper-edge of the candle body represents the first or last run value and the lower-edge represents the first or last run value. Lastly, if the last run value is less than the first run value, the candle body is the same color as the graph background, otherwise the last run value is greater.
-
-#### executive-summary  [Test Result]
-This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.
-
-#### result-file-confidence  [Test Result]
-This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.
-
-#### result-file-stats  [Test Result]
-This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.
-
-#### wins-and-losses  [Test Result]
-This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
-
-
 ## Modules
 #### auto-load-module
 This option can be used for easily adding a module to the AutoLoadModules list in the Phoronix Test Suite user configuration file. That list controls what PTS modules are automatically loaded on start-up of the Phoronix Test Suite.
@@ -407,6 +396,20 @@ This option can be used for resetting the Phoronix Test Suite user configuration
 This option can be used for setting an XML value in the Phoronix Test Suite user configuration file.
 
 
+## Result Analysis
+#### executive-summary  [Test Result]
+This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.
+
+#### result-file-confidence  [Test Result]
+This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.
+
+#### result-file-stats  [Test Result]
+This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.
+
+#### wins-and-losses  [Test Result]
+This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.
+
+
 ## Phoromatic
 #### start-phoromatic-server
 Start the Phoromatic web server for controlling local Phoronix Test Suite client systems to facilitate automated and repeated test orchestration and other automated features targeted at the enterprise.
@@ -445,6 +448,12 @@ Setting FLAME_GRAPH_PATH=<path to flamegraph path> will auto-load and enable thi
 This module utilizes the following environmental variables: FLAME_GRAPH_PATH.
 
 
+### Flush Caches
+Loading this module will ensure caches (page cache, swap, etc) automatically get flushed prior to running any test.
+
+This module utilizes the following environmental variables: PTS_FLUSH_CACHES.
+
+
 ### Graphics Override
 This module allows you to override some graphics rendering settings for the ATI and NVIDIA drivers while running the Phoronix Test Suite.
 
@@ -627,8 +636,6 @@ Supported Options:
   - all.memory
   - memory.temp
   - memory.usage
-  - all.network
-  - network.usage
   - all.swap
   - swap.usage
   - all.sys
@@ -642,6 +649,12 @@ Supported Options:
 NOTE: Use the "system-sensors" command to see what sensors are available for monitoring on the system.
 
 
+### Test Timeout
+This module allows killing a test if it exceeds a defined threshold, such as if the test is hung, etc. TEST_TIMEOUT_AFTER= environment variable can be used for controlling the behavior. When this variable is set, the value will can be set to "auto" or a positive integer. The value indicates the number of minutes until a test run should be aborted, such as for a safeguard against hung/deadlocked processes or other issues. Setting this to a high number as a backup would be recommended for fending off possible hangs / stalls in the testing process if the test does not quit on its own for whatever reason. If the value is "auto", it will quit if the time of a test run exceeds 3x the average time it normally takes the particular test to complete its run.
+
+This module utilizes the following environmental variables: TEST_TIMEOUT_AFTER.
+
+
 ### Timed Screenshot
 This is a module that will take a screenshot of the system at a pre-defined interval. ImageMagick must be installed onto the system prior to using this module.
 
@@ -654,6 +667,12 @@ This module toggles the system's screensaver while the Phoronix Test Suite is ru
 This module utilizes the following environmental variables: HALT_SCREENSAVER.
 
 
+### Linux Turbostat Dumper
+Setting TURBOSTAT_LOG_DIR=_DIR_ will auto-load and enable this Phoronix Test Suite module. The module will -- if turbostat is installed on the system and the user is root -- allow dumping of the TurboStat data to the specified directly on a per-test basis. This allows easily collecting of turbostat logs for each test being run.
+
+This module utilizes the following environmental variables: TURBOSTAT_LOG_DIR.
+
+
 ### Update Checker
 This module checks to see if the Phoronix Test Suite -- and its tests and suites -- are up to date plus also handles message of the day information.
 
@@ -796,6 +815,10 @@ This is the directory where test suites are stored.
 
 
 ## Environment Variables
+**TEST_TIMEOUT_AFTER**
+
+When this variable is set, the value will can be set to *auto* or a positive integer. The value indicates the number of minutes until a test run should be aborted, such as for a safeguard against hung/deadlocked processes or other issues. Setting this to a high number as a backup would be recommended for fending off possible hangs / stalls in the testing process if the test does not quit. If the value is *auto* , it will quit if the time of a test run exceeds 3x the average time it normally takes the particular test to complete its run. In the future, auto might be enabled by default in a future PTS release.
+
 **TEST_RESULTS_NAME**
 
 When this variable is set, the value will be used as the name for automatically saving the test results.
@@ -1022,58 +1045,61 @@ Virtual test suites can be installed and run just like a normal XML test suite a
 
 
 ---
-#### All Tests in pts  pts/all
+#### All Tests In Pts  pts/all
 This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
 
-#### benchmark Tests  pts/benchmark
+#### Application Tests  pts/application
+This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.
+
+#### Benchmark Tests  pts/benchmark
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.
 
-#### BLAS (Basic Linear Algebra Sub-Routine) Library Tests  pts/blas
-This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library
+#### BLAS (Basic Linear Algebra Sub-Routine) Tests  pts/blas
+This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine)
 
-#### Boost Development Libraries Tests  pts/boost
-This is a collection of test profiles having an external dependency on Boost Development Libraries
+#### C++ Boost Tests  pts/boost
+This is a collection of test profiles having an external dependency on C++ Boost
 
-#### bsd Operating System Tests  pts/bsd
+#### Bsd Operating System Tests  pts/bsd
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
 
-#### disk Subsystem Tests  pts/disk
+#### Disk Subsystem Tests  pts/disk
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.
 
-#### Everything in pts  pts/everything
+#### Everything In Pts  pts/everything
 This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
 
 #### Fortran Tests  pts/fortran
 This is a collection of test profiles having an external dependency on Fortran
 
-#### game Tests  pts/game
+#### Game Tests  pts/game
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.
 
 #### Go Language Tests  pts/golang
 This is a collection of test profiles having an external dependency on Go Language
 
-#### graphics Subsystem Tests  pts/graphics
+#### Graphics Subsystem Tests  pts/graphics
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.
 
 #### Installed Tests  pts/installed
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.
 
-#### java Tests  pts/java
+#### Java Tests  pts/java
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing java.
 
 #### LAPACK (Linear Algebra Pack) Tests  pts/lapack
 This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)
 
-#### linux Operating System Tests  pts/linux
+#### Linux Operating System Tests  pts/linux
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.
 
-#### macosx Operating System Tests  pts/macosx
+#### Macosx Operating System Tests  pts/macosx
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.
 
-#### memory Subsystem Tests  pts/memory
+#### Memory Subsystem Tests  pts/memory
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system.
 
-#### network Subsystem Tests  pts/network
+#### Network Subsystem Tests  pts/network
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.
 
 #### Node.js + NPM Tests  pts/node-npm
@@ -1082,13 +1108,16 @@ This is a collection of test profiles having an external dependency on Node.js +
 #### OpenCV Tests  pts/opencv
 This is a collection of test profiles having an external dependency on OpenCV
 
-#### openmpi Tests  pts/openmpi
+#### Openmpi Tests  pts/openmpi
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.
 
-#### processor Subsystem Tests  pts/processor
+#### Os Subsystem Tests  pts/os
+This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the os sub-system.
+
+#### Processor Subsystem Tests  pts/processor
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.
 
-#### python Tests  pts/python
+#### Python Tests  pts/python
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.
 
 #### Ruby Tests  pts/ruby
@@ -1097,180 +1126,162 @@ This is a collection of test profiles having an external dependency on Ruby
 #### Rust Tests  pts/rust
 This is a collection of test profiles having an external dependency on Rust
 
-#### scientific Tests  pts/scientific
+#### Scientific Tests  pts/scientific
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.
 
-#### simulator Tests  pts/simulator
+#### Simulator Tests  pts/simulator
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test.
 
-#### solaris Operating System Tests  pts/solaris
+#### Solaris Operating System Tests  pts/solaris
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.
 
-#### system Subsystem Tests  pts/system
+#### System Subsystem Tests  pts/system
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
 
-#### utility Tests  pts/utility
+#### Utility Tests  pts/utility
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.
 
-#### windows Operating System Tests  pts/windows
+#### Windows Operating System Tests  pts/windows
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.
 
-#### smp Tests  pts/smp
+#### Smp Tests  pts/smp
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
 
-#### opencl Tests  pts/opencl
+#### Opencl Tests  pts/opencl
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
 
-#### cuda Tests  pts/cuda
+#### Cuda Tests  pts/cuda
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.
 
-#### mpi Tests  pts/mpi
+#### Mpi Tests  pts/mpi
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.
 
-#### openmp Tests  pts/openmp
+#### Openmp Tests  pts/openmp
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.
 
-#### cloud Tests  pts/cloud
+#### Cloud Tests  pts/cloud
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.
 
-#### docker Tests  pts/docker
+#### Docker Tests  pts/docker
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.
 
-#### go Tests  pts/go
+#### Go Tests  pts/go
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.
 
-#### vdpau Tests  pts/vdpau
+#### Vdpau Tests  pts/vdpau
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.
 
-#### video Tests  pts/video
+#### Video Tests  pts/video
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.
 
-#### responsiveness Tests  pts/responsiveness
+#### Responsiveness Tests  pts/responsiveness
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.
 
-#### All Tests in system  system/all
+#### All Tests In System  system/all
 This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
 
-#### benchmark Tests  system/benchmark
+#### Application Tests  system/application
+This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.
+
+#### Benchmark Tests  system/benchmark
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.
 
-#### BLAS (Basic Linear Algebra Sub-Routine) Library Tests  system/blas
-This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library
+#### BLAS (Basic Linear Algebra Sub-Routine) Tests  system/blas
+This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine)
 
-#### Boost Development Libraries Tests  system/boost
-This is a collection of test profiles having an external dependency on Boost Development Libraries
+#### C++ Boost Tests  system/boost
+This is a collection of test profiles having an external dependency on C++ Boost
 
-#### bsd Operating System Tests  system/bsd
+#### Bsd Operating System Tests  system/bsd
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
 
-#### disk Subsystem Tests  system/disk
+#### Disk Subsystem Tests  system/disk
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.
 
-#### Everything in system  system/everything
+#### Everything In System  system/everything
 This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
 
-#### game Tests  system/game
+#### Game Tests  system/game
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.
 
-#### graphics Subsystem Tests  system/graphics
+#### Graphics Subsystem Tests  system/graphics
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.
 
 #### Installed Tests  system/installed
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.
 
-#### linux Operating System Tests  system/linux
+#### Linux Operating System Tests  system/linux
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.
 
-#### macosx Operating System Tests  system/macosx
+#### Macosx Operating System Tests  system/macosx
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.
 
-#### network Subsystem Tests  system/network
+#### Network Subsystem Tests  system/network
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.
 
-#### processor Subsystem Tests  system/processor
+#### OpenCV Tests  system/opencv
+This is a collection of test profiles having an external dependency on OpenCV
+
+#### OpenMPI Tests  system/openmpi
+This is a collection of test profiles having an external dependency on OpenMPI
+
+#### Processor Subsystem Tests  system/processor
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.
 
 #### Python Tests  system/python
 This is a collection of test profiles having an external dependency on Python
 
-#### solaris Operating System Tests  system/solaris
+#### Scientific Tests  system/scientific
+This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.
+
+#### Solaris Operating System Tests  system/solaris
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.
 
-#### system Subsystem Tests  system/system
+#### System Subsystem Tests  system/system
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
 
-#### utility Tests  system/utility
+#### Utility Tests  system/utility
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.
 
-#### windows Operating System Tests  system/windows
+#### Windows Operating System Tests  system/windows
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.
 
-#### opencl Tests  system/opencl
+#### Opencl Tests  system/opencl
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.
 
-#### cuda Tests  system/cuda
+#### Cuda Tests  system/cuda
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.
 
-#### All Tests in git  git/all
+#### Smp Tests  system/smp
+This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
+
+#### All Tests In Git  git/all
 This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
 
-#### bsd Operating System Tests  git/bsd
+#### Bsd Operating System Tests  git/bsd
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
 
-#### Everything in git  git/everything
+#### Everything In Git  git/everything
 This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
 
-#### linux Operating System Tests  git/linux
+#### Linux Operating System Tests  git/linux
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.
 
-#### macosx Operating System Tests  git/macosx
+#### Macosx Operating System Tests  git/macosx
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.
 
-#### processor Subsystem Tests  git/processor
+#### Processor Subsystem Tests  git/processor
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.
 
 #### Rust Tests  git/rust
 This is a collection of test profiles having an external dependency on Rust
 
-#### utility Tests  git/utility
+#### Utility Tests  git/utility
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.
 
-#### smp Tests  git/smp
+#### Smp Tests  git/smp
 This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.
 
-#### All Tests in windows  windows/all
-This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.
-
-#### benchmark Tests  windows/benchmark
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.
-
-#### bsd Operating System Tests  windows/bsd
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.
-
-#### Everything in windows  windows/everything
-This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.
-
-#### linux Operating System Tests  windows/linux
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.
-
-#### macosx Operating System Tests  windows/macosx
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.
-
-#### processor Subsystem Tests  windows/processor
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.
-
-#### solaris Operating System Tests  windows/solaris
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.
-
-#### system Subsystem Tests  windows/system
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.
-
-#### utility Tests  windows/utility
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.
-
-#### windows Operating System Tests  windows/windows
-This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.
-
 
 # Component Testing
 

documentation/stubs/00_user_options.html

@@ -106,6 +106,9 @@
 <h3>clone-result<em>  [OpenBenchmarking ID]  ...</em>
 </h3>
 <p>This option will download a local copy of a file that was saved to OpenBenchmarking.org, as long as a valid public ID is supplied.</p>
+<h3>enable-repo<em>  </em>
+</h3>
+<p>This option is used if wanting to add a new OpenBenchmarking.org account/repository to your system for enabling third-party/unofficial test profiles and test suites.</p>
 <h3>list-recommended-tests<em>  </em>
 </h3>
 <p>This option will list recommended test profiles for benchmarking sorted by hardware sub-system. The recommended tests are determined via querying OpenBenchmarking.org and determining the most popular tests for a given environment based upon the number of times a test profile has been downloaded, the number of test results available on OpenBenchmarking.org for a given test profile, the age of the test profile, and other weighted factors.</p>
@@ -140,6 +143,9 @@
 </h3>
 <p>This option can be used for uploading a test suite to your account on OpenBenchmarking.org. By uploading your test suite to OpenBenchmarking.org, others are then able to browse and access this test suite for easy distribution.</p>
 <h1>Information</h1>
+<h3>check-tests<em>  [Test]</em>
+</h3>
+<p>This option will perform a check on one or more test profiles to determine if there have been any vendor changes to the filename, filesize, url location, md5 and sha256 checksums.</p>
 <h3>info<em>  [Test | Suite | OpenBenchmarking ID | Test Result]</em>
 </h3>
 <p>This option will show details about the supplied test, suite, virtual suite, or result file.</p>
@@ -253,12 +259,12 @@
 <h3>extract-from-result-file<em>  [Test Result]</em>
 </h3>
 <p>This option will extract a single set of test results from a saved results file that contains multiple test results that have been merged. The user is the prompted to specify a new result file name and select which result identifier to extract.</p>
+<h3>keep-results-in-result-file<em>  [Test Result]</em>
+</h3>
+<p>This option is the inverse of the remove-results-from-result-file sub-command. If you wish to remove all results but those listed from a given result file, this option can be used. The user must specify a saved results file and then they will be prompted to provide a string to search for in keeping those results in that given result file but removing all other data.</p>
 <h3>merge-results<em>  [Test Result]  ...</em>
 </h3>
 <p>This option will manually merge multiple sets of test results generated by the Phoronix Test Suite.</p>
-<h3>refresh-graphs<em>  [Test Result]</em>
-</h3>
-<p>This option will re-render and save all result graphs within a saved file. This option can be used when making modifications to the graphing code or its color/option configuration file and testing the changes.</p>
 <h3>remove-result<em>  [Test Result]</em>
 </h3>
 <p>This option will permanently remove the saved file set that is set as the first argument.</p>
@@ -320,22 +326,6 @@
 <h3>version<em>  </em>
 </h3>
 <p>This option will display the Phoronix Test Suite client version.</p>
-<h1>Result Analysis</h1>
-<h3>analyze-all-runs<em>  [Test Result]</em>
-</h3>
-<p>This option will generate a candlestick graph showing the distribution of results from all trial runs. The candlestick graph is similar to the Japanese candlestick charts used by the financial industry, except instead of representing stock data it is numerical result data from all trial runs.\n\nThe tip of the upper-wick represents the highest value of the test runs with the tip of the lower-wick representing the lowest value of all test runs. The upper-edge of the candle body represents the first or last run value and the lower-edge represents the first or last run value. Lastly, if the last run value is less than the first run value, the candle body is the same color as the graph background, otherwise the last run value is greater.</p>
-<h3>executive-summary<em>  [Test Result]</em>
-</h3>
-<p>This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.</p>
-<h3>result-file-confidence<em>  [Test Result]</em>
-</h3>
-<p>This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.</p>
-<h3>result-file-stats<em>  [Test Result]</em>
-</h3>
-<p>This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.</p>
-<h3>wins-and-losses<em>  [Test Result]</em>
-</h3>
-<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
 <h1>Modules</h1>
 <h3>auto-load-module<em>  </em>
 </h3>
@@ -371,6 +361,19 @@
 <h3>user-config-set<em>  </em>
 </h3>
 <p>This option can be used for setting an XML value in the Phoronix Test Suite user configuration file.</p>
+<h1>Result Analysis</h1>
+<h3>executive-summary<em>  [Test Result]</em>
+</h3>
+<p>This option will attempt to auto-generate a textual executive summary for a result file to highlight prominent results / averages.</p>
+<h3>result-file-confidence<em>  [Test Result]</em>
+</h3>
+<p>This option will read a saved test results file and display various statistics on the confidence of the results with the standard deviation, three-sigma values, and other metrics while color-coding "passing" results in green.</p>
+<h3>result-file-stats<em>  [Test Result]</em>
+</h3>
+<p>This option is used if you wish to analyze a result file by seeing various statistics on the result data for result files containing at least two sets of data.</p>
+<h3>wins-and-losses<em>  [Test Result]</em>
+</h3>
+<p>This option is used if you wish to analyze a result file to see which runs produced the most wins/losses of those result identifiers in the saved file.</p>
 <h1>Phoromatic</h1>
 <h3>start-phoromatic-server<em>  </em>
 </h3>

documentation/stubs/00_zmodule_options.html

@@ -16,6 +16,9 @@
 <h2>Generate Perf FlameGraphs For Tests</h2>
 <p>Setting FLAME_GRAPH_PATH=&lt;path to flamegraph path&gt; will auto-load and enable this Phoronix Test Suite module. The module will generate a Linux perf FlameGraph for each test run during the benchmarking process. Details on FlameGraph @ https://github.com/brendangregg/FlameGraph</p>
 <p>This module utilizes the following environmental variables: FLAME_GRAPH_PATH.</p>
+<h2>Flush Caches</h2>
+<p>Loading this module will ensure caches (page cache, swap, etc) automatically get flushed prior to running any test.</p>
+<p>This module utilizes the following environmental variables: PTS_FLUSH_CACHES.</p>
 <h2>Graphics Override</h2>
 <p>This module allows you to override some graphics rendering settings for the ATI and NVIDIA drivers while running the Phoronix Test Suite.</p>
 <p>This module utilizes the following environmental variables: FORCE_AA, FORCE_AF.</p>
@@ -141,8 +144,6 @@ Supported Options:
   - all.memory
   - memory.temp
   - memory.usage
-  - all.network
-  - network.usage
   - all.swap
   - swap.usage
   - all.sys
@@ -154,12 +155,18 @@ Supported Options:
   - all.sys.voltage
 
 NOTE: Use the "system-sensors" command to see what sensors are available for monitoring on the system.</p>
+<h2>Test Timeout</h2>
+<p>This module allows killing a test if it exceeds a defined threshold, such as if the test is hung, etc. TEST_TIMEOUT_AFTER= environment variable can be used for controlling the behavior. When this variable is set, the value will can be set to "auto" or a positive integer. The value indicates the number of minutes until a test run should be aborted, such as for a safeguard against hung/deadlocked processes or other issues. Setting this to a high number as a backup would be recommended for fending off possible hangs / stalls in the testing process if the test does not quit on its own for whatever reason. If the value is "auto", it will quit if the time of a test run exceeds 3x the average time it normally takes the particular test to complete its run.</p>
+<p>This module utilizes the following environmental variables: TEST_TIMEOUT_AFTER.</p>
 <h2>Timed Screenshot</h2>
 <p>This is a module that will take a screenshot of the system at a pre-defined interval. ImageMagick must be installed onto the system prior to using this module.</p>
 <p>This module utilizes the following environmental variables: SCREENSHOT_INTERVAL.</p>
 <h2>Toggle Screensaver</h2>
 <p>This module toggles the system's screensaver while the Phoronix Test Suite is running. At this time, the GNOME and KDE screensavers are supported.</p>
 <p>This module utilizes the following environmental variables: HALT_SCREENSAVER.</p>
+<h2>Linux Turbostat Dumper</h2>
+<p>Setting TURBOSTAT_LOG_DIR=_DIR_ will auto-load and enable this Phoronix Test Suite module. The module will -- if turbostat is installed on the system and the user is root -- allow dumping of the TurboStat data to the specified directly on a per-test basis. This allows easily collecting of turbostat logs for each test being run.</p>
+<p>This module utilizes the following environmental variables: TURBOSTAT_LOG_DIR.</p>
 <h2>Update Checker</h2>
 <p>This module checks to see if the Phoronix Test Suite -- and its tests and suites -- are up to date plus also handles message of the day information.</p>
 <h2>Utilize Wine On Linux Benchmarking</h2>

documentation/stubs/40_configuration.html

@@ -21,6 +21,8 @@
 <p><strong>~/.phoronix-test-suite/test-suites/</strong></p>
 <p>This is the directory where test suites are stored.</p>
 <h1>Environment Variables</h1>
+<p><strong>TEST_TIMEOUT_AFTER</strong></p>
+<p>When this variable is set, the value will can be set to <em>auto</em> or a positive integer. The value indicates the number of minutes until a test run should be aborted, such as for a safeguard against hung/deadlocked processes or other issues. Setting this to a high number as a backup would be recommended for fending off possible hangs / stalls in the testing process if the test does not quit. If the value is <em>auto</em>, it will quit if the time of a test run exceeds 3x the average time it normally takes the particular test to complete its run. In the future, auto might be enabled by default in a future PTS release.</p>
 <p><strong>TEST_RESULTS_NAME</strong></p>
 <p>When this variable is set, the value will be used as the name for automatically saving the test results.</p>
 <p><strong>TEST_RESULTS_IDENTIFIER</strong></p>

documentation/stubs/55_virtual_suites.html

@@ -6,58 +6,61 @@
 <body>
 <p>Virtual test suites are not like a traditional test suite defined by the XML suite specification. Virtual test suites are dynamically generated in real-time by the Phoronix Test Suite client based upon the specified test critera. Virtual test suites can automatically consist of all test profiles that are compatible with a particular operating system or test profiles that meet other critera. When running a virtual suite, the OpenBenchmarking.org repository of the test profiles to use for generating the dynamic suite must be prefixed. </p>
 <p>Virtual test suites can be installed and run just like a normal XML test suite and shares nearly all of the same capabilities. However, when running a virtual suite, the user will be prompted to input any user-configuration options for needed test profiles just as they would need to do if running the test individually. When running a virtual suite, the user also has the ability to select individual tests within the suite to run or to run all of the contained test profiles. Virtual test suites are also only supported for an OpenBenchmarking.org repository if there is no test profile or test suite of the same name in the repository. Below is a list of common virtual test suites for the main Phoronix Test Suite repository, but the dynamic list of available virtual test suites based upon the enabled repositories is available by running <em>phoronix-test-suite list-available-virtual-suites.</em><hr></p>
-<h3>All Tests in pts<em>  pts/all</em>
+<h3>All Tests In Pts<em>  pts/all</em>
 </h3>
 <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>benchmark Tests<em>  pts/benchmark</em>
+<h3>Application Tests<em>  pts/application</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
+<h3>Benchmark Tests<em>  pts/benchmark</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.</p>
-<h3>BLAS (Basic Linear Algebra Sub-Routine) Library Tests<em>  pts/blas</em>
+<h3>BLAS (Basic Linear Algebra Sub-Routine) Tests<em>  pts/blas</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library</p>
-<h3>Boost Development Libraries Tests<em>  pts/boost</em>
+<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine)</p>
+<h3>C++ Boost Tests<em>  pts/boost</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on Boost Development Libraries</p>
-<h3>bsd Operating System Tests<em>  pts/bsd</em>
+<p>This is a collection of test profiles having an external dependency on C++ Boost</p>
+<h3>Bsd Operating System Tests<em>  pts/bsd</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>disk Subsystem Tests<em>  pts/disk</em>
+<h3>Disk Subsystem Tests<em>  pts/disk</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.</p>
-<h3>Everything in pts<em>  pts/everything</em>
+<h3>Everything In Pts<em>  pts/everything</em>
 </h3>
 <p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
 <h3>Fortran Tests<em>  pts/fortran</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Fortran</p>
-<h3>game Tests<em>  pts/game</em>
+<h3>Game Tests<em>  pts/game</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.</p>
 <h3>Go Language Tests<em>  pts/golang</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Go Language</p>
-<h3>graphics Subsystem Tests<em>  pts/graphics</em>
+<h3>Graphics Subsystem Tests<em>  pts/graphics</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.</p>
 <h3>Installed Tests<em>  pts/installed</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.</p>
-<h3>java Tests<em>  pts/java</em>
+<h3>Java Tests<em>  pts/java</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing java.</p>
 <h3>LAPACK (Linear Algebra Pack) Tests<em>  pts/lapack</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on LAPACK (Linear Algebra Pack)</p>
-<h3>linux Operating System Tests<em>  pts/linux</em>
+<h3>Linux Operating System Tests<em>  pts/linux</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  pts/macosx</em>
+<h3>Macosx Operating System Tests<em>  pts/macosx</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>memory Subsystem Tests<em>  pts/memory</em>
+<h3>Memory Subsystem Tests<em>  pts/memory</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the memory sub-system.</p>
-<h3>network Subsystem Tests<em>  pts/network</em>
+<h3>Network Subsystem Tests<em>  pts/network</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.</p>
 <h3>Node.js + NPM Tests<em>  pts/node-npm</em>
@@ -66,13 +69,16 @@
 <h3>OpenCV Tests<em>  pts/opencv</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on OpenCV</p>
-<h3>openmpi Tests<em>  pts/openmpi</em>
+<h3>Openmpi Tests<em>  pts/openmpi</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.</p>
-<h3>processor Subsystem Tests<em>  pts/processor</em>
+<h3>Os Subsystem Tests<em>  pts/os</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the os sub-system.</p>
+<h3>Processor Subsystem Tests<em>  pts/processor</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
-<h3>python Tests<em>  pts/python</em>
+<h3>Python Tests<em>  pts/python</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.</p>
 <h3>Ruby Tests<em>  pts/ruby</em>
@@ -81,179 +87,161 @@
 <h3>Rust Tests<em>  pts/rust</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Rust</p>
-<h3>scientific Tests<em>  pts/scientific</em>
+<h3>Scientific Tests<em>  pts/scientific</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.</p>
-<h3>simulator Tests<em>  pts/simulator</em>
+<h3>Simulator Tests<em>  pts/simulator</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a simulator software test.</p>
-<h3>solaris Operating System Tests<em>  pts/solaris</em>
+<h3>Solaris Operating System Tests<em>  pts/solaris</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
-<h3>system Subsystem Tests<em>  pts/system</em>
+<h3>System Subsystem Tests<em>  pts/system</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
-<h3>utility Tests<em>  pts/utility</em>
+<h3>Utility Tests<em>  pts/utility</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>windows Operating System Tests<em>  pts/windows</em>
+<h3>Windows Operating System Tests<em>  pts/windows</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.</p>
-<h3>smp Tests<em>  pts/smp</em>
+<h3>Smp Tests<em>  pts/smp</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
-<h3>opencl Tests<em>  pts/opencl</em>
+<h3>Opencl Tests<em>  pts/opencl</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
-<h3>cuda Tests<em>  pts/cuda</em>
+<h3>Cuda Tests<em>  pts/cuda</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
-<h3>mpi Tests<em>  pts/mpi</em>
+<h3>Mpi Tests<em>  pts/mpi</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
-<h3>openmp Tests<em>  pts/openmp</em>
+<h3>Openmp Tests<em>  pts/openmp</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
-<h3>cloud Tests<em>  pts/cloud</em>
+<h3>Cloud Tests<em>  pts/cloud</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cloud.</p>
-<h3>docker Tests<em>  pts/docker</em>
+<h3>Docker Tests<em>  pts/docker</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing docker.</p>
-<h3>go Tests<em>  pts/go</em>
+<h3>Go Tests<em>  pts/go</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
-<h3>vdpau Tests<em>  pts/vdpau</em>
+<h3>Vdpau Tests<em>  pts/vdpau</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.</p>
-<h3>video Tests<em>  pts/video</em>
+<h3>Video Tests<em>  pts/video</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.</p>
-<h3>responsiveness Tests<em>  pts/responsiveness</em>
+<h3>Responsiveness Tests<em>  pts/responsiveness</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.</p>
-<h3>All Tests in system<em>  system/all</em>
+<h3>All Tests In System<em>  system/all</em>
 </h3>
 <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>benchmark Tests<em>  system/benchmark</em>
+<h3>Application Tests<em>  system/application</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a application software test.</p>
+<h3>Benchmark Tests<em>  system/benchmark</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.</p>
-<h3>BLAS (Basic Linear Algebra Sub-Routine) Library Tests<em>  system/blas</em>
+<h3>BLAS (Basic Linear Algebra Sub-Routine) Tests<em>  system/blas</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine) Library</p>
-<h3>Boost Development Libraries Tests<em>  system/boost</em>
+<p>This is a collection of test profiles having an external dependency on BLAS (Basic Linear Algebra Sub-Routine)</p>
+<h3>C++ Boost Tests<em>  system/boost</em>
 </h3>
-<p>This is a collection of test profiles having an external dependency on Boost Development Libraries</p>
-<h3>bsd Operating System Tests<em>  system/bsd</em>
+<p>This is a collection of test profiles having an external dependency on C++ Boost</p>
+<h3>Bsd Operating System Tests<em>  system/bsd</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>disk Subsystem Tests<em>  system/disk</em>
+<h3>Disk Subsystem Tests<em>  system/disk</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the disk sub-system.</p>
-<h3>Everything in system<em>  system/everything</em>
+<h3>Everything In System<em>  system/everything</em>
 </h3>
 <p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
-<h3>game Tests<em>  system/game</em>
+<h3>Game Tests<em>  system/game</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a game software test.</p>
-<h3>graphics Subsystem Tests<em>  system/graphics</em>
+<h3>Graphics Subsystem Tests<em>  system/graphics</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the graphics sub-system.</p>
 <h3>Installed Tests<em>  system/installed</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.</p>
-<h3>linux Operating System Tests<em>  system/linux</em>
+<h3>Linux Operating System Tests<em>  system/linux</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  system/macosx</em>
+<h3>Macosx Operating System Tests<em>  system/macosx</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>network Subsystem Tests<em>  system/network</em>
+<h3>Network Subsystem Tests<em>  system/network</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the network sub-system.</p>
-<h3>processor Subsystem Tests<em>  system/processor</em>
+<h3>OpenCV Tests<em>  system/opencv</em>
+</h3>
+<p>This is a collection of test profiles having an external dependency on OpenCV</p>
+<h3>OpenMPI Tests<em>  system/openmpi</em>
+</h3>
+<p>This is a collection of test profiles having an external dependency on OpenMPI</p>
+<h3>Processor Subsystem Tests<em>  system/processor</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
 <h3>Python Tests<em>  system/python</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Python</p>
-<h3>solaris Operating System Tests<em>  system/solaris</em>
+<h3>Scientific Tests<em>  system/scientific</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a scientific software test.</p>
+<h3>Solaris Operating System Tests<em>  system/solaris</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
-<h3>system Subsystem Tests<em>  system/system</em>
+<h3>System Subsystem Tests<em>  system/system</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
-<h3>utility Tests<em>  system/utility</em>
+<h3>Utility Tests<em>  system/utility</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>windows Operating System Tests<em>  system/windows</em>
+<h3>Windows Operating System Tests<em>  system/windows</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.</p>
-<h3>opencl Tests<em>  system/opencl</em>
+<h3>Opencl Tests<em>  system/opencl</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing opencl.</p>
-<h3>cuda Tests<em>  system/cuda</em>
+<h3>Cuda Tests<em>  system/cuda</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
-<h3>All Tests in git<em>  git/all</em>
+<h3>Smp Tests<em>  system/smp</em>
+</h3>
+<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
+<h3>All Tests In Git<em>  git/all</em>
 </h3>
 <p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>bsd Operating System Tests<em>  git/bsd</em>
+<h3>Bsd Operating System Tests<em>  git/bsd</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>Everything in git<em>  git/everything</em>
+<h3>Everything In Git<em>  git/everything</em>
 </h3>
 <p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
-<h3>linux Operating System Tests<em>  git/linux</em>
+<h3>Linux Operating System Tests<em>  git/linux</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  git/macosx</em>
+<h3>Macosx Operating System Tests<em>  git/macosx</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>processor Subsystem Tests<em>  git/processor</em>
+<h3>Processor Subsystem Tests<em>  git/processor</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
 <h3>Rust Tests<em>  git/rust</em>
 </h3>
 <p>This is a collection of test profiles having an external dependency on Rust</p>
-<h3>utility Tests<em>  git/utility</em>
+<h3>Utility Tests<em>  git/utility</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>smp Tests<em>  git/smp</em>
+<h3>Smp Tests<em>  git/smp</em>
 </h3>
 <p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
-<h3>All Tests in windows<em>  windows/all</em>
-</h3>
-<p>This is a collection of all supported test profiles found within the specified OpenBenchmarking.org repository.</p>
-<h3>benchmark Tests<em>  windows/benchmark</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a benchmark software test.</p>
-<h3>bsd Operating System Tests<em>  windows/bsd</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the bsd Operating System.</p>
-<h3>Everything in windows<em>  windows/everything</em>
-</h3>
-<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository, including unsupported tests, etc.</p>
-<h3>linux Operating System Tests<em>  windows/linux</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the linux Operating System.</p>
-<h3>macosx Operating System Tests<em>  windows/macosx</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the macosx Operating System.</p>
-<h3>processor Subsystem Tests<em>  windows/processor</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the processor sub-system.</p>
-<h3>solaris Operating System Tests<em>  windows/solaris</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the solaris Operating System.</p>
-<h3>system Subsystem Tests<em>  windows/system</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the system sub-system.</p>
-<h3>utility Tests<em>  windows/utility</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a utility software test.</p>
-<h3>windows Operating System Tests<em>  windows/windows</em>
-</h3>
-<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the windows Operating System.</p>
 </body>
 </html>

install.bat

@@ -2,7 +2,7 @@
 
 :: Phoronix Test Suite
 :: URLs: http://www.phoronix.com, http://www.phoronix-test-suite.com/
-:: Copyright (C) 2018, Phoronix Media
+:: Copyright (C) 2018 - 2020, Phoronix Media
 ::
 :: This program is free software; you can redistribute it and/or modify
 :: it under the terms of the GNU General Public License as published by
@@ -29,5 +29,5 @@ md %destination%
 :: cd /d %destination%
 :: for /F "delims=" %%i in ('dir /b') do (rmdir "%%i" /s/q || del "%%i" /s/q)
 
-xcopy %cd% %destination% /E
+xcopy "%cd%" %destination% /E
 echo Phoronix Test Suite installed to %destination%

ob-cache/openbenchmarking.org/git.index

@@ -1 +1 @@
-{"main":{"generated":1590359065},"tests":{"aom-av1":{"title":"AOM AV1","description":"This is a simple test of the AOMedia AV1 encoder run on the CPU with a sample video file.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"746","last_updated":"1552063091","first_added":"1552063091","popularity":"1174","downloads":"1693","versions":["1.1.0"]},"dav1d":{"title":"dav1d","description":"Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"695","last_updated":"1579721829","first_added":"1579697045","popularity":"867","downloads":1780,"versions":["1.0.1","1.0.0"]},"rav1e":{"title":"rav1e","description":"Xiph rav1e is a Rust-written AV1 video encoder.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"709","last_updated":"1578155433","first_added":"1578155433","popularity":"831","downloads":"1997","versions":["1.0.0"]},"svt-av1":{"title":"SVT-AV1","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-AV1 CPU-based multi-threaded video encoder for the AV1 video format with a sample 1080p YUV video file. This test profile fork builds the encoder from Git source rather than a snapshot.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"156","last_updated":"1552059151","first_added":"1552059151","popularity":"1169","downloads":"1689","versions":["1.2.0"]},"svt-hevc":{"title":"SVT-HEVC","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC \/ H.265 video format with a sample 1080p YUV video file. This test uses SVT-HEVC from Git master.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"56","last_updated":"1552060068","first_added":"1552060068","popularity":"1163","downloads":"1681","versions":["1.0.0"]},"svt-vp9":{"title":"SVT-VP9","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample 1080p YUV video file. This test profile uses the Git snapshot of SVT-VP9.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"44","last_updated":"1552059681","first_added":"1552059681","popularity":"1170","downloads":"1678","versions":["1.0.0"]},"vpxenc":{"title":"VP9 libvpx Encoding","description":"This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9\/WebM format using a sample 1080p video.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"767","last_updated":"1552061773","first_added":"1552061773","popularity":"1172","downloads":"1661","versions":["2.3.0"]},"x265":{"title":"x265","description":"This is a simple test of the x265 encoder run on the CPU with a sample 1080p video file.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"137","last_updated":"1552061034","first_added":"1552061034","popularity":"1153","downloads":"1731","versions":["1.1.0"]}},"suites":[]}
+{"main":{"generated":1613564936},"tests":{"aom-av1":{"title":"AOM AV1","description":"This is a simple test of the AOMedia AV1 encoder run on the CPU with a sample video file.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"785","average_install_time":"182","last_updated":"1552063091","first_added":"1552063091","popularity":"1449","downloads":"2035","versions":["1.1.0"]},"dav1d":{"title":"dav1d","description":"Dav1d is an open-source, speedy AV1 video decoder. This test profile times how long it takes to decode sample AV1 video content.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"1571","average_install_time":"248","last_updated":"1579721829","first_added":"1579697045","popularity":"1265","downloads":2821,"versions":["1.0.1","1.0.0"]},"rav1e":{"title":"rav1e","description":"Xiph rav1e is a Rust-written AV1 video encoder.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"688","average_install_time":"258","last_updated":"1578155433","first_added":"1578155433","popularity":"1212","downloads":"2567","versions":["1.0.0"]},"svt-av1":{"title":"SVT-AV1","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-AV1 CPU-based multi-threaded video encoder for the AV1 video format with a sample 1080p YUV video file. This test profile fork builds the encoder from Git source rather than a snapshot.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"167","average_install_time":"80","last_updated":"1552059151","first_added":"1552059151","popularity":"1443","downloads":"2026","versions":["1.2.0"]},"svt-hevc":{"title":"SVT-HEVC","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC \/ H.265 video format with a sample 1080p YUV video file. This test uses SVT-HEVC from Git master.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"73","average_install_time":"53","last_updated":"1552060068","first_added":"1552060068","popularity":"1437","downloads":"2023","versions":["1.0.0"]},"svt-vp9":{"title":"SVT-VP9","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample 1080p YUV video file. This test profile uses the Git snapshot of SVT-VP9.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"42","average_install_time":"50","last_updated":"1552059681","first_added":"1552059681","popularity":"1445","downloads":"2015","versions":["1.0.0"]},"vpxenc":{"title":"VP9 libvpx Encoding","description":"This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9\/WebM format using a sample 1080p video.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"754","average_install_time":"76","last_updated":"1552061773","first_added":"1552061773","popularity":"1446","downloads":"1995","versions":["2.3.0"]},"x265":{"title":"x265","description":"This is a simple test of the x265 encoder run on the CPU with a sample 1080p video file.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"381","average_install_time":"187","last_updated":"1552061034","first_added":"1552061034","popularity":"1427","downloads":"2073","versions":["1.1.0"]}},"suites":[]}

ob-cache/test-profiles/pts/ai-benchmark-1.0.0/install.sh

@@ -0,0 +1,25 @@
+#!/bin/bash
+
+if which pip3 >/dev/null 2>&1 ;
+then
+	echo 0 > ~/install-exit-status
+else
+	echo "ERROR: Python pip3 is not found on the system! This test profile needs Python pip3 to proceed."
+	echo 2 > ~/install-exit-status
+fi
+
+pip3 install --user tensorflow==2.2.0
+pip3 install --user ai-benchmark==0.1.2
+
+if [[ ! -f "$HOME/.local/bin/ai-benchmark" ]]
+then
+	echo "ERROR: AI-Benchmark failed to install on the system!"
+	echo 2 > ~/install-exit-status
+fi
+
+echo "#!/bin/bash
+
+cd \$HOME/.local/bin/
+python3 ./ai-benchmark > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > ai-benchmark
+chmod +x ai-benchmark

ob-cache/test-profiles/pts/ai-benchmark-1.0.0/results-definition.xml

@@ -0,0 +1,16 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v9.8.0m2-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Device Inference Score: #_RESULT_#</OutputTemplate>
+    <ArgumentsDescription>Device Inference Score</ArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>Device Training Score: #_RESULT_#</OutputTemplate>
+    <ArgumentsDescription>Device Training Score</ArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>Device AI Score: #_RESULT_#</OutputTemplate>
+    <ArgumentsDescription>Device AI Score</ArgumentsDescription>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/ai-benchmark-1.0.0/test-definition.xml

@@ -0,0 +1,25 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v9.8.0m2-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>AI Benchmark Alpha</Title>
+    <AppVersion>0.1.2</AppVersion>
+    <Description>AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library.</Description>
+    <ResultScale>Score</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>1</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.0</Version>
+    <SupportedPlatforms>Linux, BSD, MacOSX</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>python</ExternalDependencies>
+    <RequiresInternet>TRUE</RequiresInternet>
+    <EnvironmentSize>10</EnvironmentSize>
+    <ProjectURL>http://ai-benchmark.com/alpha</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/ai-benchmark-1.0.1/install.sh

@@ -0,0 +1,25 @@
+#!/bin/bash
+
+if which pip3 >/dev/null 2>&1 ;
+then
+	echo 0 > ~/install-exit-status
+else
+	echo "ERROR: Python pip3 is not found on the system! This test profile needs Python pip3 to proceed."
+	echo 2 > ~/install-exit-status
+fi
+
+pip3 install --user tensorflow==2.2.0
+pip3 install --user ai-benchmark==0.1.2
+
+if [[ ! -f "$HOME/.local/bin/ai-benchmark" ]]
+then
+	echo "ERROR: AI-Benchmark failed to install on the system!"
+	echo 2 > ~/install-exit-status
+fi
+
+echo "#!/bin/bash
+
+cd \$HOME/.local/bin/
+python3 ./ai-benchmark > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > ai-benchmark
+chmod +x ai-benchmark

ob-cache/test-profiles/pts/ai-benchmark-1.0.1/install_macosx.sh

@@ -0,0 +1,24 @@
+#!/bin/bash
+
+if which pip3 >/dev/null 2>&1 ;
+then
+	echo 0 > ~/install-exit-status
+else
+	echo "ERROR: Python pip3 is not found on the system! This test profile needs Python pip3 to proceed."
+	echo 2 > ~/install-exit-status
+fi
+
+pip3 install --user tensorflow==2.2.0
+pip3 install --user ai-benchmark==0.1.2
+
+if [[ ! -f "$HOME/.local/bin/ai-benchmark" ]]
+then
+	echo "ERROR: AI-Benchmark failed to install on the system!"
+fi
+
+echo "#!/bin/bash
+
+cd \$HOME/Library/Python/3.*/bin/
+python3 ./ai-benchmark > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > ai-benchmark
+chmod +x ai-benchmark

ob-cache/test-profiles/pts/ai-benchmark-1.0.1/results-definition.xml

@@ -0,0 +1,16 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Device Inference Score: #_RESULT_#</OutputTemplate>
+    <ArgumentsDescription>Device Inference Score</ArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>Device Training Score: #_RESULT_#</OutputTemplate>
+    <ArgumentsDescription>Device Training Score</ArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>Device AI Score: #_RESULT_#</OutputTemplate>
+    <ArgumentsDescription>Device AI Score</ArgumentsDescription>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/ai-benchmark-1.0.1/test-definition.xml

@@ -0,0 +1,25 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>AI Benchmark Alpha</Title>
+    <AppVersion>0.1.2</AppVersion>
+    <Description>AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library.</Description>
+    <ResultScale>Score</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>1</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.1</Version>
+    <SupportedPlatforms>Linux, BSD, MacOSX</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>python</ExternalDependencies>
+    <RequiresInternet>TRUE</RequiresInternet>
+    <EnvironmentSize>10</EnvironmentSize>
+    <ProjectURL>http://ai-benchmark.com/alpha</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/aio-stress-1.1.2/downloads.xml

@@ -0,0 +1,12 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://fsbench.filesystems.org/bench/aio-stress.c</URL>
+      <MD5>727e5fc3566837b3ea72f887d048769b</MD5>
+      <FileName>aio-stress.c</FileName>
+      <FileSize>39513</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/aio-stress-1.1.2/install.sh

@@ -0,0 +1,11 @@
+#!/bin/sh
+
+cc -Wall -O3 -pthread -o aio-stress-bin aio-stress.c -laio
+echo $? > ~/install-exit-status
+
+# add support for allowing aio-test-file to be on removable media devices
+echo "#!/bin/sh
+./aio-stress-bin \$@ aio-test-file > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status
+rm -f aio-test-file" > aio-stress
+chmod +x aio-stress

ob-cache/test-profiles/pts/aio-stress-1.1.2/results-definition.xml

@@ -0,0 +1,16 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>adding stage random write
+dropping thread count to the number of contexts 1
+starting with random write
+file size 1024MB, record size 64KB, depth 64, ios per iteration 8
+max io_submit 8, buffer alignment set to 4KB
+threads 1 files 1 contexts 1 context offset 2MB verification off
+random write on aio-test-file (#_RESULT_# MB/s) 1024.00 MB in 3.84s
+thread 0 random write totals (63.36 MB/s) 1024.00 MB in 16.16s
+Running single thread version</OutputTemplate>
+    <LineHint>random write on aio-test-file</LineHint>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/aio-stress-1.1.2/test-definition.xml

@@ -0,0 +1,40 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>AIO-Stress</Title>
+    <AppVersion>0.21</AppVersion>
+    <Description>AIO-Stress is an a-synchronous I/O benchmark created by SuSE. Current this profile uses a 2048MB test file and a 64KB record size.</Description>
+    <ResultScale>MB/s</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.1.2</Version>
+    <SupportedPlatforms>Linux</SupportedPlatforms>
+    <SoftwareType>Benchmark</SoftwareType>
+    <TestType>Disk</TestType>
+    <License>Free</License>
+    <Status>Deprecated</Status>
+    <ExternalDependencies>build-utilities, libaio-development</ExternalDependencies>
+    <EnvironmentSize>0.5</EnvironmentSize>
+    <EnvironmentTestingSize>1024</EnvironmentTestingSize>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Default>
+      <Arguments>-s 2g -r 64k -t 3</Arguments>
+    </Default>
+    <Option>
+      <DisplayName>Test</DisplayName>
+      <Identifier>test</Identifier>
+      <ArgumentPrefix>-o </ArgumentPrefix>
+      <Menu>
+        <Entry>
+          <Name>Random Write</Name>
+          <Value>2</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/amg-1.1.0/downloads.xml

@@ -0,0 +1,13 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://www.phoronix-test-suite.com/benchmark-files/AMG-20200304.tar.xz</URL>
+      <MD5>aa0b1856f5f2d5c7e9250de8a4ef5084</MD5>
+      <SHA256>918964262a30023b65a1e67efc15ec7e434d48c3e886497d1fb2b2fb131043f8</SHA256>
+      <FileName>AMG-20200304.tar.xz</FileName>
+      <FileSize>1311336</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/amg-1.1.0/install.sh

@@ -0,0 +1,24 @@
+#!/bin/sh
+
+tar -xf AMG-20200304.tar.xz
+rm -rf AMG-bin
+mv AMG AMG-bin
+cd AMG-bin
+make -j $NUM_CPU_CORES
+echo $? > ~/install-exit-status
+
+cd ~/
+cat>amg<<EOT
+#!/bin/sh
+cd AMG-bin
+
+if [ "\$NUM_CPU_CORES" -gt "\$NUM_CPU_PHYSICAL_CORES" ]; then
+	export OMP_NUM_THREADS=2
+else
+	export OMP_NUM_THREADS=1
+fi
+mpirun --allow-run-as-root -np \$NUM_CPU_PHYSICAL_CORES ./test/amg -n 96 96 96 > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status
+EOT
+chmod +x amg
+

ob-cache/test-profiles/pts/amg-1.1.0/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Figure of Merit (FOM_1): #_RESULT_#</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/amg-1.1.0/test-definition.xml

@@ -0,0 +1,24 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>Algebraic Multi-Grid Benchmark</Title>
+    <AppVersion>1.2</AppVersion>
+    <Description>AMG is a parallel algebraic multigrid solver for linear systems arising from problems on unstructured grids.  The driver provided with AMG builds linear systems for various 3-dimensional problems.</Description>
+    <ResultScale>Figure Of Merit</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.1.0</Version>
+    <SupportedPlatforms>Linux</SupportedPlatforms>
+    <SoftwareType>Scientific</SoftwareType>
+    <TestType>Processor</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>openmpi-development, build-utilities</ExternalDependencies>
+    <EnvironmentSize>10</EnvironmentSize>
+    <ProjectURL>https://github.com/LLNL/AMG</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/aom-av1-2.1.2/downloads.xml

@@ -0,0 +1,28 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
+      <MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
+      <SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
+      <FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
+      <FileSize>676792531</FileSize>
+    </Package>
+    <Package>
+      <URL>http://www.phoronix-test-suite.com/benchmark-files/aom-200.tar.xz</URL>
+      <MD5>93c614944b53ed69f36439e433411ddc</MD5>
+      <SHA256>8996bb24c5768a109e3d20cb4b7adb617d7a4095e11801cef1ffccba5e5e6e2c</SHA256>
+      <FileName>aom-200.tar.xz</FileName>
+      <FileSize>2390800</FileSize>
+    </Package>
+    <Package>
+      <URL>http://www.phoronix-test-suite.com/benchmark-files/aom-200-windows.zip</URL>
+      <MD5>693fe89d844c2735c347b78d3b2df32f</MD5>
+      <SHA256>b27e905f990dffb4071475b0129809ab30f49ed578e69857af61c63400a8572b</SHA256>
+      <FileName>aom-200-windows.zip</FileName>
+      <FileSize>3691863</FileSize>
+      <PlatformSpecific>Windows</PlatformSpecific>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/aom-av1-2.1.2/install.sh

@@ -0,0 +1,24 @@
+#!/bin/sh
+
+tar -xf aom-200.tar.xz
+cd aom/build
+cmake -DENABLE_DOCS=0 -DENABLE_TESTS=0 -DCONFIG_AV1_DECODER=0 ..
+make -j $NUM_CPU_CORES
+echo $? > ~/install-exit-status
+cd ~
+
+7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z
+
+# Current AOMedia Git has MAX_NUM_THREADS value of 64, don't go over 64 threads or error
+
+echo "#!/bin/sh
+
+if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
+	NUM_CPU_CORES=64
+fi
+
+./aom/build/aomenc --threads=\$NUM_CPU_CORES \$@ -o test.av1 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m > 1.log 2>&1
+echo \$? > ~/test-exit-status
+sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
+rm -f test.av1" > aom-av1
+chmod +x aom-av1

ob-cache/test-profiles/pts/aom-av1-2.1.2/install_windows.sh

@@ -0,0 +1,17 @@
+#!/bin/sh
+
+unzip -o aom-200-windows.zip
+7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z
+chmod +x aomenc.exe
+
+echo "#!/bin/sh
+
+if [ \"\$NUM_CPU_CORES\" -gt 64 ]; then
+	NUM_CPU_CORES=64
+fi
+
+./aomenc.exe --threads=\$NUM_CPU_CORES \$@ -o test.av1 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m > 1.log 2>&1
+echo \$? > ~/test-exit-status
+sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE
+rm -f test.av1" > aom-av1
+chmod +x aom-av1

ob-cache/test-profiles/pts/aom-av1-2.1.2/results-definition.xml

@@ -0,0 +1,9 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Pass 1/2 frame    3/4        768B    2048b/f   61440b/s  165907 us #_RESULT_# fps)</OutputTemplate>
+    <LineHint>fps</LineHint>
+    <TurnCharsToSpace>(</TurnCharsToSpace>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/aom-av1-2.1.2/test-definition.xml

@@ -0,0 +1,56 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>AOM AV1</Title>
+    <AppVersion>2.0</AppVersion>
+    <Description>This is a simple test of the AOMedia AV1 encoder run on the CPU with a sample video file.</Description>
+    <ResultScale>Frames Per Second</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>2.1.2</Version>
+    <SupportedPlatforms>Linux, MacOSX, BSD, Windows</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>Processor</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
+    <EnvironmentSize>950</EnvironmentSize>
+    <ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
+    <InternalTags>SMP</InternalTags>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Default>
+      <Arguments>--tile-columns=2 --tile-rows=1</Arguments>
+    </Default>
+    <Option>
+      <DisplayName>Encoder Mode</DisplayName>
+      <Identifier>enc-mode</Identifier>
+      <Menu>
+        <Entry>
+          <Name>Speed 8 Realtime</Name>
+          <Value>--cpu-used=8 --rt</Value>
+        </Entry>
+        <Entry>
+          <Name>Speed 6 Realtime</Name>
+          <Value>--cpu-used=6 --rt</Value>
+        </Entry>
+        <Entry>
+          <Name>Speed 6 Two-Pass</Name>
+          <Value>--cpu-used=6 --limit=80</Value>
+        </Entry>
+        <Entry>
+          <Name>Speed 4 Two-Pass</Name>
+          <Value>--cpu-used=4 --limit=40</Value>
+        </Entry>
+        <Entry>
+          <Name>Speed 0 Two-Pass</Name>
+          <Value>--cpu-used=0 --limit=10</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/apache-siege-1.0.5/downloads.xml

@@ -0,0 +1,53 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0m2-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://archive.apache.org/dist/httpd/httpd-2.4.29.tar.bz2, http://ftp.lfs-matrix.net/pub/blfs/conglomeration/httpd/httpd-2.4.29.tar.bz2</URL>
+      <MD5>0c599404ef6b69eee95bcd9fcd094407</MD5>
+      <SHA256>777753a5a25568a2a27428b2214980564bc1c38c1abf9ccc7630b639991f7f00</SHA256>
+      <FileName>httpd-2.4.29.tar.bz2</FileName>
+      <FileSize>6567926</FileSize>
+      <PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>http://www.phoronix-test-suite.com/benchmark-files/apache-ab-test-files-1.tar.gz, http://www.phoronix.net/downloads/phoronix-test-suite/benchmark-files/apache-ab-test-files-1.tar.gz</URL>
+      <MD5>ca0c5bf0dd482a2847c68a52c0759942</MD5>
+      <FileName>apache-ab-test-files-1.tar.gz</FileName>
+      <FileSize>6008</FileSize>
+    </Package>
+    <Package>
+      <URL>http://archive.apache.org/dist/apr/apr-1.6.3.tar.bz2</URL>
+      <MD5>12f2a349483ad6f12db49ba01fbfdbfa</MD5>
+      <SHA256>131f06d16d7aabd097fa992a33eec2b6af3962f93e6d570a9bd4d85e95993172</SHA256>
+      <FileName>apr-1.6.3.tar.bz2</FileName>
+      <FileSize>854100</FileSize>
+      <PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>http://www.apache.org/dist/apr/apr-util-1.6.1.tar.bz2, http://apache.cs.utah.edu//apr/apr-util-1.6.1.tar.bz2</URL>
+      <MD5>8ff5dc36fa39a2a3db1df196d3ed6086</MD5>
+      <SHA256>d3e12f7b6ad12687572a3a39475545a072608f4ba03a6ce8a3778f607dd0035b</SHA256>
+      <FileName>apr-util-1.6.1.tar.bz2</FileName>
+      <FileSize>428595</FileSize>
+      <PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>http://download.joedog.org/siege/siege-3.1.4.tar.gz</URL>
+      <MD5>a893b92a453e1c1d596314aa951981f4</MD5>
+      <SHA256>0436970ca81ade76eb419bc42d3f8460b475079eb5d8f199d2fa83328893099d</SHA256>
+      <FileName>siege-3.1.4.tar.gz</FileName>
+      <FileSize>530149</FileSize>
+      <PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://raw.githubusercontent.com/apurvanandan1997/pts-test-profiles-patches/master/apache-siege-1.0.4/INCLUDE-SIGNAL-HEADER.patch</URL>
+      <MD5>0d3415820c82fbebbfe571c339d0badd</MD5>
+      <SHA256>67dcc5efaf079e9725a4350c3f760b69ca7a37dd04766ab92b005976e064f70b</SHA256>
+      <FileName>INCLUDE-SIGNAL-HEADER.patch</FileName>
+      <FileSize>260</FileSize>
+      <PlatformSpecific>BSD</PlatformSpecific>
+      <Optional>TRUE</Optional>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/apache-siege-1.0.5/install.sh

@@ -0,0 +1,44 @@
+#!/bin/sh
+
+mkdir $HOME/httpd_
+
+tar -zxvf apache-ab-test-files-1.tar.gz
+tar -jxvf httpd-2.4.29.tar.bz2
+tar -jxvf apr-util-1.6.1.tar.bz2
+tar -jxvf apr-1.6.3.tar.bz2
+mv apr-1.6.3 httpd-2.4.29/srclib/apr
+mv apr-util-1.6.1 httpd-2.4.29/srclib/apr-util
+
+cd httpd-2.4.29/
+./configure --prefix=$HOME/httpd_ --with-included-apr
+make -j $NUM_CPU_CORES
+echo $? > ~/install-exit-status
+make install
+cd ~
+rm -rf httpd-2.4.29/
+rm -rf httpd_/manual/
+
+patch -p0 < CHANGE-APACHE-PORT.patch
+mv -f test.html httpd_/htdocs/
+mv -f pts.png httpd_/htdocs/
+
+
+cd ~
+tar -xf siege-3.1.4.tar.gz
+if [ $OS_TYPE = "BSD" ]
+then
+        patch -p0 < INCLUDE-SIGNAL-HEADER.patch
+fi
+cd siege-3.1.4
+./configure
+make -j $NUM_CPU_CORES
+cd utils
+bash siege.config
+cd ~
+
+echo "#!/bin/sh
+cd siege-3.1.4/src
+./siege \$@ 2>&1 | grep -v HTTP > \$LOG_FILE
+echo \$? > ~/test-exit-status" > apache-siege
+
+chmod +x apache-siege

ob-cache/test-profiles/pts/apache-siege-1.0.5/post.sh

@@ -0,0 +1,4 @@
+#!/bin/sh
+./httpd_/bin/apachectl -k stop
+rm -f httpd_/logs/*
+sleep 3

ob-cache/test-profiles/pts/apache-siege-1.0.5/pre.sh

@@ -0,0 +1,7 @@
+#!/bin/sh
+./httpd_/bin/apachectl -k start -f $HOME/httpd_/conf/httpd.conf
+sleep 5
+
+cd siege-3.1.4/utils
+bash siege.config
+cd ~

ob-cache/test-profiles/pts/apache-siege-1.0.5/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0m2-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Transaction rate:	    #_RESULT_# trans/sec</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/apache-siege-1.0.5/test-definition.xml

@@ -0,0 +1,66 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0m2-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>Apache Siege</Title>
+    <AppVersion>2.4.29</AppVersion>
+    <Description>This is a test of the Apache web server performance being facilitated by the Siege web server benchmark program.</Description>
+    <ResultScale>Transactions Per Second</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.5</Version>
+    <SupportedPlatforms>Linux, Solaris, BSD, MacOSX</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities, perl, pcre, openssl-development, expat</ExternalDependencies>
+    <EnvironmentSize>208</EnvironmentSize>
+    <ProjectURL>https://www.joedog.org/siege-home/</ProjectURL>
+    <InternalTags>SMP</InternalTags>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Default>
+      <Arguments>-r10000 -d1 -b </Arguments>
+      <PostArguments> http://localhost:8088/test.html</PostArguments>
+    </Default>
+    <Option>
+      <DisplayName>Concurrent Users</DisplayName>
+      <Identifier>concurrent</Identifier>
+      <ArgumentPrefix>-c</ArgumentPrefix>
+      <Menu>
+        <Entry>
+          <Name>1</Name>
+          <Value>1</Value>
+        </Entry>
+        <Entry>
+          <Name>10</Name>
+          <Value>10</Value>
+        </Entry>
+        <Entry>
+          <Name>50</Name>
+          <Value>50</Value>
+        </Entry>
+        <Entry>
+          <Name>100</Name>
+          <Value>100</Value>
+        </Entry>
+        <Entry>
+          <Name>200</Name>
+          <Value>200</Value>
+        </Entry>
+        <Entry>
+          <Name>250</Name>
+          <Value>250</Value>
+        </Entry>
+        <Entry>
+          <Name>500</Name>
+          <Value>500</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/apitest-1.1.1/downloads.xml

@@ -0,0 +1,13 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://phoronix-test-suite.com/benchmark-files/apitest-20140726.tar.bz2</URL>
+      <MD5>28ac817817d35ab335ad40dcec682b6d</MD5>
+      <SHA256>67a48803c10c147f99632e1aa54cf1afce1b785d2ecf850b5f960e72d2dd5258</SHA256>
+      <FileName>apitest-20140726.tar.bz2</FileName>
+      <FileSize>23855194</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/apitest-1.1.1/install.sh

@@ -0,0 +1,16 @@
+#!/bin/sh
+
+tar -xjf apitest-20140726.tar.bz2
+cd apitest-master
+mkdir out
+cd out
+cmake -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release -DHAVE_LIBUDEV_H=0  ..
+make -j $NUM_CPU_JOBS
+echo $? > ~/install-exit-status
+
+cd ~
+echo "#!/bin/sh
+cd apitest-master/bin/
+./apitest \$@ > \$LOG_FILE 2>&1
+echo $? > ~/test-exit-status" > apitest
+chmod +x apitest

ob-cache/test-profiles/pts/apitest-1.1.1/results-definition.xml

@@ -0,0 +1,8 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate> NullProblem             oglcore    NullSolution                     30316       15.000     #_RESULT_#        0.495</OutputTemplate>
+    <LineBeforeHint>fps</LineBeforeHint>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/apitest-1.1.1/test-definition.xml

@@ -0,0 +1,136 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>APITest</Title>
+    <AppVersion>2014-07-26</AppVersion>
+    <Description>APITest is a micro-benchmark developed by John McDonald of OpenGL 4 functionality.</Description>
+    <ResultScale>Frames Per Second</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.1.1</Version>
+    <SupportedPlatforms>Linux, MacOSX</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>Graphics</TestType>
+    <License>Free</License>
+    <Status>Deprecated</Status>
+    <ExternalDependencies>build-utilities, sdl2-development, cmake</ExternalDependencies>
+    <RequiresDisplay>TRUE</RequiresDisplay>
+    <EnvironmentSize>225</EnvironmentSize>
+    <ProjectURL>http://github.com/nvMcJohn/apitest</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Default>
+      <Arguments>-b -t 10 -a oglcore</Arguments>
+    </Default>
+    <Option>
+      <DisplayName>Resolution</DisplayName>
+      <Identifier>auto-resolution</Identifier>
+      <ArgumentPrefix>-r </ArgumentPrefix>
+      <Menu>
+        <Entry>
+          <Name>$VIDEO_WIDTH x $VIDEO_HEIGHT</Name>
+          <Value>$VIDEO_WIDTH $VIDEO_HEIGHT</Value>
+        </Entry>
+      </Menu>
+    </Option>
+    <Option>
+      <DisplayName>Test</DisplayName>
+      <Identifier>test</Identifier>
+      <ArgumentPrefix>-s </ArgumentPrefix>
+      <Menu>
+        <Entry>
+          <Name>DynamicStreaming GLBufferSubData</Name>
+          <Value>GLBufferSubData</Value>
+        </Entry>
+        <Entry>
+          <Name>DynamicStreaming GLMapUnsynchronized</Name>
+          <Value>GLMapUnsynchronized</Value>
+        </Entry>
+        <Entry>
+          <Name>DynamicStreaming GLMapPersistent</Name>
+          <Value>GLMapPersistent</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLUniform</Name>
+          <Value>GLUniform</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLDrawLoop</Name>
+          <Value>GLDrawLoop</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLMultiDrawBuffer-SDP</Name>
+          <Value>GLMultiDrawBuffer-SDP</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLMultiDrawBuffer-NoSDP</Name>
+          <Value>GLMultiDrawBuffer-NoSDP</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLBufferRange</Name>
+          <Value>GLBufferRange</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLBufferSubData</Name>
+          <Value>GLBufferSubData</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLBufferStorage-SDP</Name>
+          <Value>GLBufferStorage-SDP</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLBufferStorage-NoSDP</Name>
+          <Value>GLBufferStorage-NoSDP</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLDynamicBuffer</Name>
+          <Value>GLDynamicBuffer</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLMapUnsynchronized</Name>
+          <Value>GLMapUnsynchronized</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLMapPersistent</Name>
+          <Value>GLMapPersistent</Value>
+        </Entry>
+        <Entry>
+          <Name>UntexturedObjects GLTexCoord</Name>
+          <Value>GLTexCoord</Value>
+        </Entry>
+        <Entry>
+          <Name>TexturedQuadsProblem GLBindless</Name>
+          <Value>GLBindless</Value>
+        </Entry>
+        <Entry>
+          <Name>TexturedQuadsProblem GLNaive</Name>
+          <Value>GLNaive</Value>
+        </Entry>
+        <Entry>
+          <Name>TexturedQuadsProblem GLNaiveUniform</Name>
+          <Value>GLNaiveUniform</Value>
+        </Entry>
+        <Entry>
+          <Name>TexturedQuadsProblem GLNoTex</Name>
+          <Value>GLNoTex</Value>
+        </Entry>
+        <Entry>
+          <Name>TexturedQuadsProblem GLNoTexUniform</Name>
+          <Value>GLNoTexUniform</Value>
+        </Entry>
+        <Entry>
+          <Name>TexturedQuadsProblem GLSBTA</Name>
+          <Value>GLSBTA</Value>
+        </Entry>
+        <Entry>
+          <Name>TexturedQuadsProblem GLTextureArray</Name>
+          <Value>GLTextureArray</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/askap-2.1.0/downloads.xml

@@ -0,0 +1,13 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>https://github.com/ATNF/askap-benchmarks/archive/v1.0.tar.gz</URL>
+      <MD5>4155097c3b7f32002f97be4abf078bb9</MD5>
+      <SHA256>25ec60886de40d27c6100324224c724b3a0d3847d1f619f8aab45866d9cf857b</SHA256>
+      <FileName>askap-benchmarks-1.0.tar.gz</FileName>
+      <FileSize>129002812</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/askap-2.1.0/install.sh

@@ -0,0 +1,53 @@
+#!/bin/sh
+
+tar -xf askap-benchmarks-1.0.tar.gz
+
+cd ~/askap-benchmarks-1.0/attic/tConvolveOpenCL/
+make
+cd ~/askap-benchmarks-1.0/attic/tConvolveCuda
+make
+cd ~/askap-benchmarks-1.0/current/tConvolveMPI
+sed -i 's/CXX=CC/CXX=mpic++/g' Makefile
+make
+cd ~/askap-benchmarks-1.0/attic/tConvolveOMP
+make
+cd ~/askap-benchmarks-1.0/attic/tConvolveMT
+make
+cd ~/askap-benchmarks-1.0/current/tHogbomCleanOMP
+cp ../../data/dirty_4096.img dirty.img
+cp ../../data/psf_4096.img psf.img
+make
+echo $? > ~/install-exit-status
+
+cd ~/
+echo "#!/bin/sh
+cd askap-benchmarks-1.0/
+
+case \"\$1\" in
+\"tConvolveOpenCL\")
+	cd attic/tConvolveOpenCL
+	./tConvolveOpenCL > \$LOG_FILE
+	;;
+\"tConvolveCuda\")
+	cd attic/tConvolveCuda
+	./tConvolveCuda > \$LOG_FILE
+	;;
+\"tConvolveMPI\")
+	cd current/tConvolveMPI
+	mpirun --allow-run-as-root -np \$NUM_CPU_PHYSICAL_CORES ./tConvolveMPI > \$LOG_FILE
+	;;
+\"tConvolveOMP\")
+	cd attic/tConvolveOMP
+	OMP_NUM_THREADS=\$NUM_CPU_CORES ./tConvolveOMP > \$LOG_FILE
+	;;
+\"tConvolveMT\")
+	cd attic/tConvolveMT
+	./tConvolveMT \$NUM_CPU_CORES > \$LOG_FILE
+	;;
+\"tHogbomCleanOMP\")
+	cd current/tHogbomCleanOMP
+	./tHogbomCleanOMP > \$LOG_FILE
+	;;
+esac
+echo \$? > ~/test-exit-status" > askap
+chmod +x askap

ob-cache/test-profiles/pts/askap-2.1.0/results-definition.xml

@@ -0,0 +1,30 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Gridding rate   #_RESULT_#</OutputTemplate>
+    <ResultScale>Million Grid Points Per Second</ResultScale>
+    <AppendToArgumentsDescription>Gridding</AppendToArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>Degridding rate   #_RESULT_#</OutputTemplate>
+    <ResultScale>Million Grid Points Per Second</ResultScale>
+    <AppendToArgumentsDescription>Degridding</AppendToArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>    Degridding rate (total)    #_RESULT_# (Mpix/sec)</OutputTemplate>
+    <LineHint>Degridding rate (total)</LineHint>
+    <ResultScale>Mpix/sec</ResultScale>
+    <AppendToArgumentsDescription>Degridding</AppendToArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>    Gridding rate (total)      #_RESULT_# (Mpix/sec)</OutputTemplate>
+    <LineHint>Gridding rate (total</LineHint>
+    <ResultScale>Mpix/sec</ResultScale>
+    <AppendToArgumentsDescription>Gridding</AppendToArgumentsDescription>
+  </ResultsParser>
+  <ResultsParser>
+    <OutputTemplate>    Cleaning rate  #_RESULT_# (iterations per second)</OutputTemplate>
+    <ResultScale>Iterations Per Second</ResultScale>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/askap-2.1.0/test-definition.xml

@@ -0,0 +1,57 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>ASKAP</Title>
+    <AppVersion>1.0</AppVersion>
+    <Description>ASKAP is a set of benchmarks from the Australian SKA Pathfinder. The principal ASKAP benchmarks are the Hogbom Clean Benchmark (tHogbomClean) and Convolutional Resamping Benchmark (tConvolve) as well as some previous ASKAP benchmarks being included as well for OpenCL and CUDA execution of tConvolve.</Description>
+    <ResultScale>Million Grid Points Per Second</ResultScale>
+    <Proportion>HIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>2.1.0</Version>
+    <SupportedPlatforms>Linux</SupportedPlatforms>
+    <SoftwareType>Benchmark</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities, cuda, opencl, openmpi-development</ExternalDependencies>
+    <EnvironmentSize>417</EnvironmentSize>
+    <ProjectURL>https://github.com/ATNF/askap-benchmarks</ProjectURL>
+    <InternalTags>CUDA, SMP, MPI, OpenMP</InternalTags>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Option>
+      <DisplayName>Test</DisplayName>
+      <Identifier>test</Identifier>
+      <Menu>
+        <Entry>
+          <Name>tConvolve OpenCL</Name>
+          <Value>tConvolve OpenCL</Value>
+        </Entry>
+        <Entry>
+          <Name>tConvolve CUDA</Name>
+          <Value>tConvolveCuda</Value>
+        </Entry>
+        <Entry>
+          <Name>tConvolve MPI</Name>
+          <Value>tConvolveMPI</Value>
+        </Entry>
+        <Entry>
+          <Name>tConvolve OpenMP</Name>
+          <Value>tConvolveOMP</Value>
+        </Entry>
+        <Entry>
+          <Name>tConvolve MT</Name>
+          <Value>tConvolveMT</Value>
+        </Entry>
+        <Entry>
+          <Name>Hogbom Clean OpenMP</Name>
+          <Value>tHogbomCleanOMP</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/asmfish-1.1.2/downloads.xml

@@ -0,0 +1,13 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://www.phoronix-test-suite.com/benchmark-files/asmFish-20180723.zip</URL>
+      <MD5>15c79b8378787f5fee0a37ccc22fe97f</MD5>
+      <SHA256>f03f6c037ad37cde553ffd02efb4643a43a71cbb4942c809aeb22db12cb1e0c1</SHA256>
+      <FileName>asmFish-20180723.zip</FileName>
+      <FileSize>2207999</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/asmfish-1.1.2/install.sh

@@ -0,0 +1,16 @@
+#!/bin/sh
+
+unzip -o asmFish-20180723.zip
+cd asmFish-master
+chmod +x LinuxOS_binaries/*
+cd ~
+
+echo "#!/bin/sh
+cd asmFish-master
+if [ \$OS_ARCH = \"aarch64\" ]
+then
+	echo \"bench 1024 \$NUM_CPU_CORES 26\" | ./LinuxOS_binaries/armFishL_2018-07-23_v8 > \$LOG_FILE 2>&1
+else
+	echo \"bench 1024 \$NUM_CPU_CORES 26\" |  ./LinuxOS_binaries/asmFishL_2018-07-23_base > \$LOG_FILE 2>&1
+fi" > asmfish
+chmod +x asmfish

ob-cache/test-profiles/pts/asmfish-1.1.2/install_macosx.sh

@@ -0,0 +1,11 @@
+#!/bin/sh
+
+unzip -o asmFish-20180723.zip
+cd asmFish-master
+chmod +x MacOS_binaries/*
+cd ~
+
+echo "#!/bin/sh
+cd asmFish-master/MacOS_binaries
+echo \"bench 1024 \$NUM_CPU_CORES 26\" |  ./asmFishX_2018-07-23_base > \$LOG_FILE 2>&1" > asmfish
+chmod +x asmfish

ob-cache/test-profiles/pts/asmfish-1.1.2/install_windows.sh

@@ -0,0 +1,8 @@
+#!/bin/sh
+
+unzip -o asmFish-20180723.zip
+
+echo "#!/bin/sh
+cd asmFish-master/WindowsOS_binaries
+echo \"bench 1024 \$NUM_CPU_CORES 26\" |  ./asmFishW_2018-07-23_base.exe > \$LOG_FILE 2>&1" > asmfish
+chmod +x asmfish

ob-cache/test-profiles/pts/asmfish-1.1.2/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Nodes/second    : #_RESULT_#</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/asmfish-1.1.2/test-definition.xml

@@ -0,0 +1,25 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>asmFish</Title>
+    <AppVersion>2018-07-23</AppVersion>
+    <Description>This is a test of asmFish, an advanced chess benchmark written in Assembly.</Description>
+    <ResultScale>Nodes/second</ResultScale>
+    <Proportion>HIB</Proportion>
+    <SubTitle>1024 Hash Memory, 26 Depth</SubTitle>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.1.2</Version>
+    <SupportedPlatforms>Linux, Windows, MacOSX</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>Processor</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <EnvironmentSize>5</EnvironmentSize>
+    <ProjectURL>https://github.com/lantonov/asmFish/</ProjectURL>
+    <InternalTags>SMP</InternalTags>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.0/downloads.xml

@@ -0,0 +1,37 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v9.8.0-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://phoronix-test-suite.com/benchmark-files/png-samples-1.tar.xz</URL>
+      <MD5>3f928e4d08777e6e84c54202a00429de</MD5>
+      <SHA256>9810c8fd3afd35b4755c2a46f14fc66e2b9199c22e46a5946123c9250f2d1ccd</SHA256>
+      <FileName>png-samples-1.tar.xz</FileName>
+      <FileSize>58346628</FileSize>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/archive/2.0.tar.gz</URL>
+      <MD5>93562e3d6d709b2e62b404cbd4ddba3f</MD5>
+      <SHA256>f466c224ad6c0bb44401d77a05a3155cc9368df01a57b33ec242a1ea7240eefe</SHA256>
+      <FileName>astc-encoder-2.0.tar.gz</FileName>
+      <FileSize>29956405</FileSize>
+      <PlatformSpecific>Linux</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/releases/download/2.0/astcenc-2.0-macos-x64.zip</URL>
+      <MD5>7d44922e73ddd8bb51e9ef4e294bdca0</MD5>
+      <SHA256>79333ca74b9bf091c87ab290ad2c99ff002b8bab23dd8c0815687a5f65fc05f0</SHA256>
+      <FileName>astcenc-2.0-macos-x64.zip</FileName>
+      <FileSize>801491</FileSize>
+      <PlatformSpecific>MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/releases/download/2.0/astcenc-2.0-windows-x64.zip</URL>
+      <MD5>27ae2a95633a967ec2672d98cb389f29</MD5>
+      <SHA256>8db18954950b01f9a16c54a3c63afc6763692db7b96492330a9b726cdfebb7d0</SHA256>
+      <FileName>astcenc-2.0-windows-x64.zip</FileName>
+      <FileSize>1396420</FileSize>
+      <PlatformSpecific>Windows</PlatformSpecific>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.0/install.sh

@@ -0,0 +1,13 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+tar -xf astc-encoder-2.0.tar.gz
+cd astc-encoder-2.0/Source
+make -j $NUM_CPU_CORES
+echo \$? > ~/install-exit-status
+
+cd ~
+echo "#!/bin/sh
+./astc-encoder-2.0/Source/astcenc-avx2 -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > astcenc
+chmod +x astcenc

ob-cache/test-profiles/pts/astcenc-1.0.0/install_macosx.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+unzip -o astcenc-2.0-macos-x64.zip
+chmod +x astcenc-2.0-macos-x64/astcenc-avx2
+
+echo "#!/bin/sh
+./astcenc-2.0-macos-x64/astcenc-avx2 -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > basis
+chmod +x basis

ob-cache/test-profiles/pts/astcenc-1.0.0/install_windows.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+unzip -o astcenc-2.0-windows-x64.zip
+chmod +x astcenc-windows-x64/astcenc-avx2.exe
+
+echo "#!/bin/sh
+./astcenc-windows-x64/astcenc-avx2.exe -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > basis
+chmod +x basis

ob-cache/test-profiles/pts/astcenc-1.0.0/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v9.8.0-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>    Total time:                  #_RESULT_# s</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.0/test-definition.xml

@@ -0,0 +1,48 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v9.8.0-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>ASTC Encoder</Title>
+    <AppVersion>2.0</AppVersion>
+    <Description>ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression.</Description>
+    <ResultScale>Seconds</ResultScale>
+    <Proportion>LIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.0</Version>
+    <SupportedPlatforms>Linux, Windows, MacOSX</SupportedPlatforms>
+    <SoftwareType>Benchmark</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities</ExternalDependencies>
+    <EnvironmentSize>66</EnvironmentSize>
+    <ProjectURL>https://github.com/ARM-software/astc-encoder</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Option>
+      <DisplayName>Preset</DisplayName>
+      <Identifier>preset</Identifier>
+      <Menu>
+        <Entry>
+          <Name>Fast</Name>
+          <Value>-fast</Value>
+        </Entry>
+        <Entry>
+          <Name>Medium</Name>
+          <Value>-medium</Value>
+        </Entry>
+        <Entry>
+          <Name>Thorough</Name>
+          <Value>-thorough</Value>
+        </Entry>
+        <Entry>
+          <Name>Exhaustive</Name>
+          <Value>-exhaustive</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.1/downloads.xml

@@ -0,0 +1,37 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://phoronix-test-suite.com/benchmark-files/png-samples-1.tar.xz</URL>
+      <MD5>3f928e4d08777e6e84c54202a00429de</MD5>
+      <SHA256>9810c8fd3afd35b4755c2a46f14fc66e2b9199c22e46a5946123c9250f2d1ccd</SHA256>
+      <FileName>png-samples-1.tar.xz</FileName>
+      <FileSize>58346628</FileSize>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/archive/2.0.tar.gz</URL>
+      <MD5>93562e3d6d709b2e62b404cbd4ddba3f</MD5>
+      <SHA256>f466c224ad6c0bb44401d77a05a3155cc9368df01a57b33ec242a1ea7240eefe</SHA256>
+      <FileName>astc-encoder-2.0.tar.gz</FileName>
+      <FileSize>29956405</FileSize>
+      <PlatformSpecific>Linux</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/releases/download/2.0/astcenc-2.0-macos-x64.zip</URL>
+      <MD5>7d44922e73ddd8bb51e9ef4e294bdca0</MD5>
+      <SHA256>79333ca74b9bf091c87ab290ad2c99ff002b8bab23dd8c0815687a5f65fc05f0</SHA256>
+      <FileName>astcenc-2.0-macos-x64.zip</FileName>
+      <FileSize>801491</FileSize>
+      <PlatformSpecific>MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/releases/download/2.0/astcenc-2.0-windows-x64.zip</URL>
+      <MD5>27ae2a95633a967ec2672d98cb389f29</MD5>
+      <SHA256>8db18954950b01f9a16c54a3c63afc6763692db7b96492330a9b726cdfebb7d0</SHA256>
+      <FileName>astcenc-2.0-windows-x64.zip</FileName>
+      <FileSize>1396420</FileSize>
+      <PlatformSpecific>Windows</PlatformSpecific>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.1/install.sh

@@ -0,0 +1,13 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+tar -xf astc-encoder-2.0.tar.gz
+cd astc-encoder-2.0/Source
+make -j $NUM_CPU_CORES
+echo \$? > ~/install-exit-status
+
+cd ~
+echo "#!/bin/sh
+./astc-encoder-2.0/Source/astcenc-avx2 -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > astcenc
+chmod +x astcenc

ob-cache/test-profiles/pts/astcenc-1.0.1/install_macosx.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+unzip -o astcenc-2.0-macos-x64.zip
+chmod +x astcenc-2.0-macos-x64/astcenc-avx2
+
+echo "#!/bin/sh
+./astcenc-2.0-macos-x64/astcenc-avx2 -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > astcenc
+chmod +x astcenc

ob-cache/test-profiles/pts/astcenc-1.0.1/install_windows.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+unzip -o astcenc-2.0-windows-x64.zip
+chmod +x astcenc-windows-x64/astcenc-avx2.exe
+
+echo "#!/bin/sh
+./astcenc-windows-x64/astcenc-avx2.exe -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > basis
+chmod +x basis

ob-cache/test-profiles/pts/astcenc-1.0.1/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>    Total time:                  #_RESULT_# s</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.1/test-definition.xml

@@ -0,0 +1,48 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>ASTC Encoder</Title>
+    <AppVersion>2.0</AppVersion>
+    <Description>ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression.</Description>
+    <ResultScale>Seconds</ResultScale>
+    <Proportion>LIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.1</Version>
+    <SupportedPlatforms>Linux, Windows, MacOSX</SupportedPlatforms>
+    <SoftwareType>Benchmark</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities</ExternalDependencies>
+    <EnvironmentSize>66</EnvironmentSize>
+    <ProjectURL>https://github.com/ARM-software/astc-encoder</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Option>
+      <DisplayName>Preset</DisplayName>
+      <Identifier>preset</Identifier>
+      <Menu>
+        <Entry>
+          <Name>Fast</Name>
+          <Value>-fast</Value>
+        </Entry>
+        <Entry>
+          <Name>Medium</Name>
+          <Value>-medium</Value>
+        </Entry>
+        <Entry>
+          <Name>Thorough</Name>
+          <Value>-thorough</Value>
+        </Entry>
+        <Entry>
+          <Name>Exhaustive</Name>
+          <Value>-exhaustive</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.2/downloads.xml

@@ -0,0 +1,37 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://phoronix-test-suite.com/benchmark-files/png-samples-1.tar.xz</URL>
+      <MD5>3f928e4d08777e6e84c54202a00429de</MD5>
+      <SHA256>9810c8fd3afd35b4755c2a46f14fc66e2b9199c22e46a5946123c9250f2d1ccd</SHA256>
+      <FileName>png-samples-1.tar.xz</FileName>
+      <FileSize>58346628</FileSize>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/archive/2.0.tar.gz</URL>
+      <MD5>93562e3d6d709b2e62b404cbd4ddba3f</MD5>
+      <SHA256>f466c224ad6c0bb44401d77a05a3155cc9368df01a57b33ec242a1ea7240eefe</SHA256>
+      <FileName>astc-encoder-2.0.tar.gz</FileName>
+      <FileSize>29956405</FileSize>
+      <PlatformSpecific>Linux</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/releases/download/2.0/astcenc-2.0-macos-x64.zip</URL>
+      <MD5>7d44922e73ddd8bb51e9ef4e294bdca0</MD5>
+      <SHA256>79333ca74b9bf091c87ab290ad2c99ff002b8bab23dd8c0815687a5f65fc05f0</SHA256>
+      <FileName>astcenc-2.0-macos-x64.zip</FileName>
+      <FileSize>801491</FileSize>
+      <PlatformSpecific>MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://github.com/ARM-software/astc-encoder/releases/download/2.0/astcenc-2.0-windows-x64.zip</URL>
+      <MD5>27ae2a95633a967ec2672d98cb389f29</MD5>
+      <SHA256>8db18954950b01f9a16c54a3c63afc6763692db7b96492330a9b726cdfebb7d0</SHA256>
+      <FileName>astcenc-2.0-windows-x64.zip</FileName>
+      <FileSize>1396420</FileSize>
+      <PlatformSpecific>Windows</PlatformSpecific>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.2/install.sh

@@ -0,0 +1,21 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+tar -xf astc-encoder-2.0.tar.gz
+cd astc-encoder-2.0/Source
+
+ASTCBIN=avx2
+if [ $OS_ARCH = "aarch64" ]
+then
+	sed -i 's/VEC ?= avx2/VEC ?= neon/g' Makefile
+	ASTCBIN=neon
+fi
+
+make -j $NUM_CPU_CORES
+echo \$? > ~/install-exit-status
+
+cd ~
+echo "#!/bin/sh
+./astc-encoder-2.0/Source/astcenc-$ASTCBIN -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > astcenc
+chmod +x astcenc

ob-cache/test-profiles/pts/astcenc-1.0.2/install_macosx.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+unzip -o astcenc-2.0-macos-x64.zip
+chmod +x astcenc-2.0-macos-x64/astcenc-avx2
+
+echo "#!/bin/sh
+./astcenc-2.0-macos-x64/astcenc-avx2 -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > astcenc
+chmod +x astcenc

ob-cache/test-profiles/pts/astcenc-1.0.2/install_windows.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+unzip -o astcenc-2.0-windows-x64.zip
+chmod +x astcenc-windows-x64/astcenc-avx2.exe
+
+echo "#!/bin/sh
+./astcenc-windows-x64/astcenc-avx2.exe -tl sample-4.png 1.png 8x6 \$@ > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > basis
+chmod +x basis

ob-cache/test-profiles/pts/astcenc-1.0.2/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>    Total time:                  #_RESULT_# s</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/astcenc-1.0.2/test-definition.xml

@@ -0,0 +1,48 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>ASTC Encoder</Title>
+    <AppVersion>2.0</AppVersion>
+    <Description>ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression.</Description>
+    <ResultScale>Seconds</ResultScale>
+    <Proportion>LIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.2</Version>
+    <SupportedPlatforms>Linux, Windows, MacOSX</SupportedPlatforms>
+    <SoftwareType>Benchmark</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities</ExternalDependencies>
+    <EnvironmentSize>66</EnvironmentSize>
+    <ProjectURL>https://github.com/ARM-software/astc-encoder</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Option>
+      <DisplayName>Preset</DisplayName>
+      <Identifier>preset</Identifier>
+      <Menu>
+        <Entry>
+          <Name>Fast</Name>
+          <Value>-fast</Value>
+        </Entry>
+        <Entry>
+          <Name>Medium</Name>
+          <Value>-medium</Value>
+        </Entry>
+        <Entry>
+          <Name>Thorough</Name>
+          <Value>-thorough</Value>
+        </Entry>
+        <Entry>
+          <Name>Exhaustive</Name>
+          <Value>-exhaustive</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/basis-1.0.2/downloads.xml

@@ -0,0 +1,29 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://phoronix-test-suite.com/benchmark-files/png-samples-1.tar.xz</URL>
+      <MD5>3f928e4d08777e6e84c54202a00429de</MD5>
+      <SHA256>9810c8fd3afd35b4755c2a46f14fc66e2b9199c22e46a5946123c9250f2d1ccd</SHA256>
+      <FileName>png-samples-1.tar.xz</FileName>
+      <FileSize>58346628</FileSize>
+    </Package>
+    <Package>
+      <URL>https://github.com/BinomialLLC/basis_universal/archive/v1.12.tar.gz</URL>
+      <MD5>51de6b32f21847b49b74fa6e147c2c91</MD5>
+      <SHA256>e654e4c333b7bc886e049c13f75de8ae1d2ca23aae6fd2252521bfd484461322</SHA256>
+      <FileName>basis_universal-1.12.tar.gz</FileName>
+      <FileSize>29599729</FileSize>
+      <PlatformSpecific>Linux, MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://github.com/BinomialLLC/basis_universal/releases/download/v1.12/basisu_win_linux_v112.zip</URL>
+      <MD5>a44d5d941cb1f8f1d57ec145ef2b310a</MD5>
+      <SHA256>2a5e50b8626e6f49a51c624eafadd5be42a49651cf16ff252feacf5d8f133460</SHA256>
+      <FileName>basisu_win_linux_v112.zip</FileName>
+      <FileSize>1514207</FileSize>
+      <PlatformSpecific>Windows</PlatformSpecific>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/basis-1.0.2/install.sh

@@ -0,0 +1,15 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+tar -xf basis_universal-1.12.tar.gz
+cd basis_universal-1.12/
+cmake CMakeLists.txt
+make -j $NUM_CPU_CORES
+echo \$? > ~/install-exit-status
+
+cd ~
+echo "#!/bin/sh
+cd basis_universal-1.12/bin
+./basisu \$@ ~/sample-*.png > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > basis
+chmod +x basis

ob-cache/test-profiles/pts/basis-1.0.2/install_macosx.sh

@@ -0,0 +1,15 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+tar -xf basis_universal-1.12.tar.gz
+cd basis_universal-1.12/
+cmake CMakeLists.txt
+make -j $NUM_CPU_CORES
+echo \$? > ~/install-exit-status
+
+cd ~
+echo "#!/bin/sh
+cd basis_universal-1.12/bin_osx
+./basisu \$@ ~/sample-*.png > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > basis
+chmod +x basis

ob-cache/test-profiles/pts/basis-1.0.2/install_windows.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+unzip -o basisu_win_linux_v112.zip
+chmod +x basisu.exe
+
+echo "#!/bin/sh
+./basisu.exe \$@ sample-*.png > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > basis
+chmod +x basis

ob-cache/test-profiles/pts/basis-1.0.2/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Compression succeeded to file "sample-1.basis" in #_RESULT_# secs</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/basis-1.0.2/test-definition.xml

@@ -0,0 +1,52 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>Basis Universal</Title>
+    <AppVersion>1.12</AppVersion>
+    <Description>Basis Universal is a GPU texture codoec. This test times how long it takes to convert sRGB PNGs into Basis Univeral assets with various settings.</Description>
+    <ResultScale>Seconds</ResultScale>
+    <Proportion>LIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.2</Version>
+    <SupportedPlatforms>Linux, Windows, MacOSX</SupportedPlatforms>
+    <SoftwareType>Benchmark</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities, cmake</ExternalDependencies>
+    <EnvironmentSize>1</EnvironmentSize>
+    <ProjectURL>http://github.com/BinomialLLC/basis_universal</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Option>
+      <DisplayName>Settings</DisplayName>
+      <Identifier>settings</Identifier>
+      <Menu>
+        <Entry>
+          <Name>ETC1S</Name>
+          <Value> </Value>
+        </Entry>
+        <Entry>
+          <Name>UASTC Level 0</Name>
+          <Value>-uastc -uastc_level 0</Value>
+        </Entry>
+        <Entry>
+          <Name>UASTC Level 2</Name>
+          <Value>-uastc -uastc_level 2</Value>
+        </Entry>
+        <Entry>
+          <Name>UASTC Level 3</Name>
+          <Value>-uastc -uastc_level 3</Value>
+        </Entry>
+        <Entry>
+          <Name>UASTC Level 2 + RDO Post-Processing</Name>
+          <Value>-uastc -uastc_level 2 -uastc_rdo_q .75</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/battery-power-usage-1.0.1/install.sh

@@ -0,0 +1,10 @@
+#!/bin/sh
+
+echo "#!/bin/sh
+sleep 60
+xset dpms force off
+sleep 60
+xset dpms force on
+sleep 5
+\$TEST_MPLAYER_BASE/mplayer -vo xv -fs \$TEST_VIDEO_SAMPLE/Grey.ts" > battery-power-usage
+chmod +x battery-power-usage

ob-cache/test-profiles/pts/battery-power-usage-1.0.1/results-definition.xml

@@ -0,0 +1,9 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <SystemMonitor>
+    <Sensor>sys.power</Sensor>
+    <PollingFrequency>1</PollingFrequency>
+    <Report>ALL</Report>
+  </SystemMonitor>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/battery-power-usage-1.0.1/test-definition.xml

@@ -0,0 +1,26 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m2-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>Battery Power Usage</Title>
+    <AppVersion>1.3.0</AppVersion>
+    <Description>This test is designed for notebooks and netbooks and monitor's the system's battery consumption as it idles for 60 seconds, then turns off the monitor for 60 seconds via DPMS, then turns the display back on and plays back a sample H.264 1080p video file using mplayer with the X-Video output adapter. A line graph showing the power usage is then rendered.</Description>
+    <ResultScale>Milliwatts</ResultScale>
+    <DisplayFormat>LINE_GRAPH</DisplayFormat>
+    <SubTitle>Idle, DPMS Off, Video Playback</SubTitle>
+    <TimesToRun>1</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.1</Version>
+    <SupportedPlatforms>Linux</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Deprecated</Status>
+    <ExternalDependencies>build-utilities, xorg-development, xorg-video, zlib-development, yasm</ExternalDependencies>
+    <Extends>pts/mplayer-base</Extends>
+    <EnvironmentSize>36</EnvironmentSize>
+    <ProjectURL>http://www.mplayerhq.hu/</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/betsy-1.0.0/downloads.xml

@@ -0,0 +1,20 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0m1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>http://phoronix-test-suite.com/benchmark-files/png-samples-1.tar.xz</URL>
+      <MD5>3f928e4d08777e6e84c54202a00429de</MD5>
+      <SHA256>9810c8fd3afd35b4755c2a46f14fc66e2b9199c22e46a5946123c9250f2d1ccd</SHA256>
+      <FileName>png-samples-1.tar.xz</FileName>
+      <FileSize>58346628</FileSize>
+    </Package>
+    <Package>
+      <URL>https://github.com/darksylinc/betsy/archive/v1.1-beta.tar.gz</URL>
+      <MD5>da3c8e4fdeefc6fa391dbd56d4ae358e</MD5>
+      <SHA256>aa67f9a9749e3845766678fdb366b45cde139470ee2f96962275422ba769065e</SHA256>
+      <FileName>betsy-1.1-beta.tar.gz</FileName>
+      <FileSize>6784294</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/betsy-1.0.0/install.sh

@@ -0,0 +1,19 @@
+#!/bin/sh
+
+tar -xf png-samples-1.tar.xz
+tar -xf betsy-1.1-beta.tar.gz
+cd betsy-1.1-beta
+
+mkdir build
+cd build
+
+cmake -DCMAKE_BUILD_TYPE=Release -GNinja ..
+ninja
+echo $? > ~/install-exit-status
+
+cd ~
+echo "#!/bin/sh
+cd betsy-1.1-beta/bin/Release/
+./betsy ~/sample-4.png \$@ out.ktx > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > betsy
+chmod +x betsy

ob-cache/test-profiles/pts/betsy-1.0.0/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0m1-->
+<PhoronixTestSuite>
+  <SystemMonitor>
+    <Sensor>sys.time</Sensor>
+  </SystemMonitor>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/betsy-1.0.0/test-definition.xml

@@ -0,0 +1,53 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.2.0m1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>Betsy GPU Compressor</Title>
+    <AppVersion>1.1 Beta</AppVersion>
+    <Description>Betsy is an open-source GPU compressor of various GPU compression techniques. Betsy is written in GLSL for Vulkan/OpenGL (compute shader) support for GPU-based texture compression.</Description>
+    <ResultScale>Seconds</ResultScale>
+    <Proportion>LIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.0.0</Version>
+    <SupportedPlatforms>Linux</SupportedPlatforms>
+    <SoftwareType>Benchmark</SoftwareType>
+    <TestType>Graphics</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities, sdl2-development, cmake, meson</ExternalDependencies>
+    <RequiresDisplay>TRUE</RequiresDisplay>
+    <EnvironmentSize>75</EnvironmentSize>
+    <ProjectURL>https://github.com/darksylinc/betsy</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Option>
+      <DisplayName>Codec</DisplayName>
+      <Identifier>codec</Identifier>
+      <ArgumentPrefix>--codec=</ArgumentPrefix>
+      <Menu>
+        <Entry>
+          <Name>ETC1</Name>
+          <Value>etc1</Value>
+        </Entry>
+        <Entry>
+          <Name>ETC2 RGB</Name>
+          <Value>etc2_rgb</Value>
+        </Entry>
+      </Menu>
+    </Option>
+    <Option>
+      <DisplayName>Quality</DisplayName>
+      <Identifier>quality</Identifier>
+      <ArgumentPrefix>--quality=</ArgumentPrefix>
+      <Menu>
+        <Entry>
+          <Name>Highest</Name>
+          <Value>2</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/blender-1.8.0/downloads.xml

@@ -0,0 +1,51 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>https://download.blender.org/release/Blender2.90/blender-2.90.0-linux64.tar.xz, http://mirror.clarkson.edu/blender/release/Blender2.90/blender-2.90.0-linux64.tar.xz</URL>
+      <MD5>0933e02bf26b56675e9b88ee4e8df956</MD5>
+      <SHA256>d0c9218fa4fc981204d3d187c35b5168b4df4ea71e2e74fb61be1540b935a83c</SHA256>
+      <FileName>blender-2.90.0-linux64.tar.xz</FileName>
+      <FileSize>147176708</FileSize>
+      <PlatformSpecific>Linux</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://download.blender.org/release/Blender2.90/blender-2.90.0-windows64.zip, http://mirror.clarkson.edu/blender/release/Blender2.90/blender-2.90.0-windows64.zip</URL>
+      <MD5>746ac862b92b5f0005d8dc170b713084</MD5>
+      <SHA256>f51e1c33f6c61bdef86008280173e4c5cf9c52e4f5c490e9a7e4db3a355639bc</SHA256>
+      <FileName>blender-2.90.0-windows64.zip</FileName>
+      <FileSize>197631706</FileSize>
+      <PlatformSpecific>Windows</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>https://download.blender.org/release/Blender2.90/blender-2.90.0-macOS.dmg, http://mirror.clarkson.edu/blender/release/Blender2.90/blender-2.90.0-macOS.dmg</URL>
+      <MD5>44650f790a59a3e6028db422ca3e2532</MD5>
+      <SHA256>51a999d21bf50a6e1f8423b9190571403ee1adc1248911207af13ce21599320b</SHA256>
+      <FileName>blender-2.90.0-macOS.dmg</FileName>
+      <FileSize>188972623</FileSize>
+      <PlatformSpecific>MacOSX</PlatformSpecific>
+    </Package>
+    <Package>
+      <URL>http://download.blender.org/demo/test/cycles_benchmark_20160228.zip</URL>
+      <MD5>61dabc9cc92dec9549f73f7453d9a875</MD5>
+      <SHA256>026e7499a7bd9e0d41fe4d43e611a145a62d8d5df4fe347a6a08c6f0e98cf0c6</SHA256>
+      <FileName>cycles_benchmark_20160228.zip</FileName>
+      <FileSize>530883683</FileSize>
+    </Package>
+    <Package>
+      <URL>http://svn.blender.org/svnroot/bf-blender/trunk/lib/benchmarks/cycles/barbershop_interior/barbershop_interior_cpu.blend</URL>
+      <MD5>2b1cb4c2f4f1813ab7a8d95dceabf48d</MD5>
+      <SHA256>95972b56180462cac47ec82f3a755bd9111ec18ca37a6196a319c013db994130</SHA256>
+      <FileName>barbershop_interior_cpu.blend</FileName>
+      <FileSize>287574804</FileSize>
+    </Package>
+    <Package>
+      <URL>http://svn.blender.org/svnroot/bf-blender/trunk/lib/benchmarks/cycles/barbershop_interior/barbershop_interior_gpu.blend</URL>
+      <MD5>10e5a559064df9f1da9dd43bef3f4523</MD5>
+      <SHA256>4a79ec95e7d96602ab16d475370f6b765a713a546edfa420dd53a4c25e464417</SHA256>
+      <FileName>barbershop_interior_gpu.blend</FileName>
+      <FileSize>287594564</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/blender-1.8.0/install.sh

@@ -0,0 +1,44 @@
+#!/bin/sh
+
+tar -xf blender-2.90.0-linux64.tar.xz
+unzip -o cycles_benchmark_20160228.zip
+
+mv benchmark/bmw27/*.blend  ~
+mv benchmark/classroom/*.blend ~
+mv benchmark/fishy_cat/*.blend ~
+mv benchmark/pabellon_barcelona/*.blend ~
+rm -rf benchmark
+
+echo "#!/bin/bash
+cd blender-2.90.0-linux64
+BLEND_ARGS=\$@
+if [[ \$@ =~ .*CUDA.* ]]
+then
+	COMPUTE_TYPE=\"CUDA\"
+elif [[ \$@ =~ .*OPENCL.* ]]
+then
+	COMPUTE_TYPE=\"OPENCL\"
+elif [[ \$@ =~ .*OPTIX.* ]]
+then
+	COMPUTE_TYPE=\"OPTIX\"
+elif [[ \$@ =~ .*NONE.* ]]
+then
+	COMPUTE_TYPE=\"NONE\"
+	BLEND_ARGS=\${BLEND_ARGS/_gpu/_cpu}
+else
+	COMPUTE_TYPE=\"NONE\"
+	BLEND_ARGS=\${BLEND_ARGS/_gpu/_cpu}
+fi
+
+echo \"import bpy
+bpy.context.preferences.addons['cycles'].preferences.get_devices()
+bpy.context.preferences.addons['cycles'].preferences.compute_device_type = '\$COMPUTE_TYPE'
+bpy.context.preferences.addons['cycles'].preferences.devices[0].use = True
+
+bpy.ops.wm.save_userpref()\" > setgpu.py
+
+./blender -b --python setgpu.py 
+
+./blender \$BLEND_ARGS > \$LOG_FILE 2> /dev/null
+rm -f output.test" > blender
+chmod +x blender

ob-cache/test-profiles/pts/blender-1.8.0/install_macosx.sh

@@ -0,0 +1,45 @@
+#!/bin/sh
+
+unzip -o cycles_benchmark_20160228.zip
+
+mv benchmark/bmw27/*.blend ~
+mv benchmark/classroom/*.blend ~
+mv benchmark/fishy_cat/*.blend ~
+mv benchmark/pabellon_barcelona/*.blend ~
+
+echo "#!/bin/bash
+
+[ ! -d /Volumes/Blender/ ] && hdid blender-2.90.0-macOS.dmg
+
+BLEND_ARGS=\$@
+if [[ \$@ =~ .*CUDA.* ]]
+then
+	COMPUTE_TYPE=\"CUDA\"
+elif [[ \$@ =~ .*OPENCL.* ]]
+then
+	COMPUTE_TYPE=\"OPENCL\"
+elif [[ \$@ =~ .*OPTIX.* ]]
+then
+	COMPUTE_TYPE=\"OPTIX\"
+elif [[ \$@ =~ .*NONE.* ]]
+then
+	COMPUTE_TYPE=\"NONE\"
+	BLEND_ARGS=\${BLEND_ARGS/_gpu/_cpu}
+else
+	COMPUTE_TYPE=\"NONE\"
+	BLEND_ARGS=\${BLEND_ARGS/_gpu/_cpu}
+fi
+
+echo \"import bpy
+
+bpy.context.preferences.addons['cycles'].preferences.get_devices()
+bpy.context.preferences.addons['cycles'].preferences.compute_device_type = '\$COMPUTE_TYPE'
+bpy.context.preferences.addons['cycles'].preferences.devices[0].use = True
+
+bpy.ops.wm.save_userpref()\" > ~/blender-setgpu.py
+
+/Volumes/Blender/Blender.app/Contents/MacOS/Blender -b --python \$DEBUG_HOME/blender-setgpu.py
+cd benchmark
+/Volumes/Blender/Blender.app/Contents/MacOS/Blender \$BLEND_ARGS > \$LOG_FILE
+rm -f output.test" > blender
+chmod +x blender

ob-cache/test-profiles/pts/blender-1.8.0/install_windows.sh

@@ -0,0 +1,47 @@
+#!/bin/sh
+
+unzip -o blender-2.90.0-windows64.zip
+unzip -o cycles_benchmark_20160228.zip
+
+mv benchmark/bmw27/*.blend ~
+mv benchmark/classroom/*.blend ~
+mv benchmark/fishy_cat/*.blend ~
+mv benchmark/pabellon_barcelona/*.blend ~
+rm -rf benchmark
+
+echo "#!/bin/bash
+cd blender-2.90.0-windows64
+BLEND_ARGS=\$@
+if [[ \$@ =~ .*CUDA.* ]]
+then
+	COMPUTE_TYPE=\"CUDA\"
+elif [[ \$@ =~ .*OPENCL.* ]]
+then
+	COMPUTE_TYPE=\"OPENCL\"
+elif [[ \$@ =~ .*OPTIX.* ]]
+then
+	COMPUTE_TYPE=\"OPTIX\"
+elif [[ \$@ =~ .*NONE.* ]]
+then
+	COMPUTE_TYPE=\"NONE\"
+	BLEND_ARGS=\${BLEND_ARGS/_gpu/_cpu}
+else
+	COMPUTE_TYPE=\"NONE\"
+	BLEND_ARGS=\${BLEND_ARGS/_gpu/_cpu}
+fi
+
+echo \"import bpy
+
+bpy.context.preferences.addons['cycles'].preferences.get_devices()
+bpy.context.preferences.addons['cycles'].preferences.compute_device_type = '\$COMPUTE_TYPE'
+bpy.context.preferences.addons['cycles'].preferences.devices[0].use = True
+
+bpy.ops.wm.save_userpref()\" > ~/blender-setgpu.py
+export HOME=\"\$DEBUG_HOME\"
+export PATH=\$DEBUG_PATH
+export PWD=\$DEBUG_HOME\blender-2.81-windows64
+./blender.exe -b --python \$DEBUG_HOME\blender-setgpu.py
+
+./blender.exe \$BLEND_ARGS > \$LOG_FILE
+rm -f output.test" > blender
+chmod +x blender

ob-cache/test-profiles/pts/blender-1.8.0/results-definition.xml

@@ -0,0 +1,8 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Time: #_RESULT_# (Saving: 00:00.03)</OutputTemplate>
+    <LineHint>Saving:</LineHint>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/blender-1.8.0/test-definition.xml

@@ -0,0 +1,82 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.0m1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>Blender</Title>
+    <AppVersion>2.90</AppVersion>
+    <Description>Blender is an open-source 3D creation software project. This test is of Blender's Cycles benchmark with various sample files. GPU computing via OpenCL or CUDA is supported.</Description>
+    <ResultScale>Seconds</ResultScale>
+    <Proportion>LIB</Proportion>
+    <TimesToRun>3</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.8.0</Version>
+    <SupportedPlatforms>Linux, Windows, MacOSX</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <SupportedArchitectures>x86_64</SupportedArchitectures>
+    <ExternalDependencies>bzip2-development, glut, opencl</ExternalDependencies>
+    <EnvironmentSize>950</EnvironmentSize>
+    <ProjectURL>https://www.blender.org/</ProjectURL>
+    <InternalTags>OpenCL, CUDA</InternalTags>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+  <TestSettings>
+    <Default>
+      <Arguments>-noaudio --enable-autoexec</Arguments>
+    </Default>
+    <Option>
+      <DisplayName>Blend File</DisplayName>
+      <Identifier>blend</Identifier>
+      <ArgumentPrefix>-b </ArgumentPrefix>
+      <ArgumentPostfix> -o output.test -x 1 -F JPEG -f 1</ArgumentPostfix>
+      <Menu>
+        <Entry>
+          <Name>BMW27</Name>
+          <Value>../bmw27_gpu.blend</Value>
+        </Entry>
+        <Entry>
+          <Name>Classroom</Name>
+          <Value>../classroom_gpu.blend</Value>
+        </Entry>
+        <Entry>
+          <Name>Fishy Cat</Name>
+          <Value>../fishy_cat_gpu.blend</Value>
+        </Entry>
+        <Entry>
+          <Name>Pabellon Barcelona</Name>
+          <Value>../pavillon_barcelone_gpu.blend</Value>
+        </Entry>
+        <Entry>
+          <Name>Barbershop</Name>
+          <Value>../barbershop_interior_gpu.blend</Value>
+        </Entry>
+      </Menu>
+    </Option>
+    <Option>
+      <DisplayName>Compute</DisplayName>
+      <Identifier>compute</Identifier>
+      <ArgumentPrefix> </ArgumentPrefix>
+      <Menu>
+        <Entry>
+          <Name>CPU-Only</Name>
+          <Value>NONE</Value>
+        </Entry>
+        <Entry>
+          <Name>OpenCL</Name>
+          <Value>OPENCL</Value>
+        </Entry>
+        <Entry>
+          <Name>CUDA</Name>
+          <Value>CUDA</Value>
+        </Entry>
+        <Entry>
+          <Name>NVIDIA OptiX</Name>
+          <Value>OPTIX</Value>
+        </Entry>
+      </Menu>
+    </Option>
+  </TestSettings>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/brl-cad-1.1.1/downloads.xml

@@ -0,0 +1,13 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <Downloads>
+    <Package>
+      <URL>https://iweb.dl.sourceforge.net/project/brlcad/BRL-CAD%20Source/7.30.8/brlcad-7.30.8.tar.bz2, https://managedway.dl.sourceforge.net/project/brlcad/BRL-CAD%20Source/7.30.8/brlcad-7.30.8.tar.bz2</URL>
+      <MD5>4e2f34eaca6e6f224f63a29a0735b4fb</MD5>
+      <SHA256>bb5dbcffb2a58d17963e74ed9ac83b2659fd2451b366b50e4961a9ea799aef7f</SHA256>
+      <FileName>brlcad-7.30.8.tar.bz2</FileName>
+      <FileSize>125443351</FileSize>
+    </Package>
+  </Downloads>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/brl-cad-1.1.1/install.sh

@@ -0,0 +1,18 @@
+#!/bin/sh
+
+tar -xf brlcad-7.30.8.tar.bz2
+
+mkdir brlcad-7.30.8/build
+cd brlcad-7.30.8/build
+cmake .. -DBRLCAD_ENABLE_STRICT=NO -DBRLCAD_BUNDLED_LIBS=ON -DBRLCAD_OPTIMIZED_BUILD=ON -DCMAKE_BUILD_TYPE=Release
+make -j $NUM_CPU_CORES
+echo $? > ~/install-exit-status
+cd ~
+
+echo "#!/bin/sh
+cd brlcad-7.30.8/build
+./bench/benchmark run -P\$NUM_CPU_CORES > \$LOG_FILE 2>&1
+echo \$? > ~/test-exit-status" > brl-cad
+chmod +x brl-cad
+
+

ob-cache/test-profiles/pts/brl-cad-1.1.1/results-definition.xml

@@ -0,0 +1,7 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <ResultsParser>
+    <OutputTemplate>Benchmark results indicate an approximate VGR performance metric of #_RESULT_#</OutputTemplate>
+  </ResultsParser>
+</PhoronixTestSuite>

ob-cache/test-profiles/pts/brl-cad-1.1.1/test-definition.xml

@@ -0,0 +1,25 @@
+<?xml version="1.0"?>
+<!--Phoronix Test Suite v10.0.1-->
+<PhoronixTestSuite>
+  <TestInformation>
+    <Title>BRL-CAD</Title>
+    <AppVersion>7.30.8</AppVersion>
+    <Description>BRL-CAD 7.28.0 is a cross-platform, open-source solid modeling system with built-in benchmark mode.</Description>
+    <ResultScale>VGR Performance Metric</ResultScale>
+    <Proportion>HIB</Proportion>
+    <SubTitle>VGR Performance Metric</SubTitle>
+    <TimesToRun>1</TimesToRun>
+  </TestInformation>
+  <TestProfile>
+    <Version>1.1.1</Version>
+    <SupportedPlatforms>Linux, Solaris, BSD, MacOSX</SupportedPlatforms>
+    <SoftwareType>Utility</SoftwareType>
+    <TestType>System</TestType>
+    <License>Free</License>
+    <Status>Verified</Status>
+    <ExternalDependencies>build-utilities, cmake, flex, tcl, zlib-development, libpng-development</ExternalDependencies>
+    <EnvironmentSize>48</EnvironmentSize>
+    <ProjectURL>http://brlcad.org/</ProjectURL>
+    <Maintainer>Michael Larabel</Maintainer>
+  </TestProfile>
+</PhoronixTestSuite>