Compare commits

...

69 Commits

Author SHA1 Message Date
Michael Larabel
bec2ec8abf Phoronix Test Suite 9.0.1 2019-10-01 05:17:06 -05:00
Michael Larabel
0b23ae45ca ob_auto_compare: string cleanup 2019-09-30 13:36:56 -05:00
Michael Larabel
26d943ad3f phoronix-test-suite: Use older method of setting PTS_DIR in launcher script 2019-09-30 10:37:22 -05:00
Michael Larabel
a5af2546ed pts-core: Cleanup 2019-09-30 05:09:25 -05:00
Michael Larabel
b6bb8ebaf5 ob_auto_compare: cleanup comments 2019-09-29 19:08:18 -05:00
Michael Larabel
a7765bff31 ob_auto_compare: Shorten string 2019-09-29 19:04:44 -05:00
Michael Larabel
38eb9fca74 ob_auto_compare: Try more aggressive reporting 2019-09-29 18:51:49 -05:00
Michael Larabel
a46d59a0a1 pts-core: Fix possible divide by zero 2019-09-29 12:27:38 -05:00
Michael Larabel
d539cd6b3a pts_ae_data: Relax some of the restrictions 2019-09-29 08:20:59 -05:00
Michael Larabel
844cf205f2 ob_auto_compare: better fallback 2019-09-27 06:34:34 -05:00
Michael Larabel
77a01ad55d ob_auto_compare: cleanup text 2019-09-26 18:14:52 -05:00
Michael Larabel
8e3567a2a8 pts-core: Fedora updates 2019-09-26 14:27:23 -05:00
Michael Larabel
044f16205d pts-core: Set AllowResultUploadsToOpenBenchmarking = FALSE in enterprise-setup 2019-09-26 09:43:08 -05:00
Michael Larabel
706076b5ad ob_auto_compare: Shorten up AMD CPU strings 2019-09-26 09:41:36 -05:00
Michael Larabel
00edce2f4d ob_auto_compare: Show since [date] as part of the inline box plot 2019-09-26 09:33:53 -05:00
Michael Larabel
06fdbf5c9d pts-core: Fix OB auto upload bit 2019-09-26 03:59:24 -05:00
Michael Larabel
84e1649ded pts-core: Fix OB auto upload bit 2019-09-26 03:57:32 -05:00
Michael Larabel
8325b0c0c1 pts-core: Two minor updates 2019-09-19 08:36:18 -05:00
Michael Larabel
9071c75ff9 phodevi: New cpu.peak-freq sensor for reporting just the highest CPU core frequency at that moment 2019-09-18 08:12:43 -05:00
Michael Larabel
e8dc9ed042 pts-core: Adjust prominence in doc 2019-09-16 18:02:40 -05:00
Michael Larabel
071b9b0dbb Prepping for Phoronix Test Suite 9.0.0 2019-09-16 17:50:14 -05:00
Fatima Sheremetyeva
d29cf05f49 Update ob-cache with newest tests 2019-09-16 10:53:28 -04:00
Michael Larabel
ba09d29285 pts-core: Don;t do the current cache on Windows due to line break differences causing bugs 2019-09-15 19:31:06 -05:00
Michael Larabel
452405eae5 pts-core: Last minute Windows tweak 2019-09-15 18:04:49 -05:00
Michael Larabel
5299acdb7a pts_Graph: Sort run-vs-run graph by spread 2019-09-15 10:34:29 -05:00
Michael Larabel
b17ec8f64f pts-core: Fix environment variable reporting of compiler flag strings getting clobbered 2019-09-14 10:22:23 -05:00
Michael Larabel
856e49dedb pts-core: Print the result viewer access key on start up 2019-09-13 13:36:06 -05:00
Michael Larabel
d7a61f371a pts-core: Fix FreeBSD dynamic result viewer crash 2019-09-13 10:59:49 -05:00
Michael Larabel
398d779222 pts-core: Fall back to SHA1 for dynamic result viewer if hash() does not exist, just encountered on FreeBSD 2019-09-13 10:57:53 -05:00
Michael Larabel
977a59d6a6 pts-core: Print address when result viewer web accessible 2019-09-13 10:50:38 -05:00
Michael Larabel
4f5b988ba2 pts-core: Allow accessing the new result viewer via localhost too rather than just 127.0.0.1 2019-09-13 10:27:17 -05:00
Michael Larabel
4e7e5132b2 pts-core: Add support for showing new + updated tests via the invalid command helper 2019-09-12 18:05:16 -05:00
Michael Larabel
9dcc2c037f pts_graph: Fix pie charts on multi-way comparison results 2019-09-12 13:06:13 -05:00
Michael Larabel
3cb0df557b pts-core: Allow showing pie charts of wins / losses 2019-09-08 10:05:58 -05:00
Michael Larabel
9eae9fe2d1 pts_Graph: Restore pie chart support from old PTS 6.0 code 2019-09-08 10:04:36 -05:00
Michael Larabel
68502df5db Fix for previous commit: 2019-09-08 09:05:54 -05:00
Michael Larabel
5d079483e0 pts-core: Some options are fine on one result run: 2019-09-08 09:03:18 -05:00
Michael Larabel
28a7dcc433 pts-core: Allow plotting all individual run results as a line graph 2019-09-08 08:55:25 -05:00
Michael Larabel
4564672670 pts-core: Nasm looks to have been left out in some XML definitions previously 2019-09-08 05:29:15 -05:00
Michael Larabel
b5f070e999 pts-core: Allow outputting pass/fail results to text 2019-09-04 17:29:48 -05:00
Michael Larabel
121c820fd9 pts-core: Uninitialized variable warning fix for pass/fail tests 2019-09-04 16:00:22 -05:00
Michael Larabel
a59284e9e1 pts-core: Add ram-capacity test option auto population 2019-09-04 15:46:14 -05:00
Michael Larabel
3613e73d07 phoronix-test-suite: Drop debug message from previous commit 2019-09-04 15:03:29 -05:00
Michael Larabel
7fb59a8321 phoronix-test-suite: Prep for systemd-inhibit support but do not enable as seems to be buggy still with systemd side 2019-09-04 12:22:18 -05:00
Michael Larabel
69213fc12d pts-core: Only overwrite the OB indexes when no Internet available 2019-09-04 11:45:01 -05:00
Michael Larabel
499df99996 pts-core: Add stress-batch-run sub-command for behavior like stress-run but no prompts for test options Per https://github.com/phoronix-test-suite/phoronix-test-suite/issues/360 2019-09-03 18:59:59 -05:00
Michael Larabel
12511585b5 pts-core: Add workaround for https://github.com/phoronix-test-suite/phoronix-test-suite/issues/368 2019-09-03 18:42:49 -05:00
Michael Larabel
049437ad11 pts-core: Ex dep updates for Solus 2019-09-03 15:11:18 -05:00
Michael Larabel
c135d18c87 Prep for 9.0 M3 2019-09-03 06:46:33 -05:00
Michael Larabel
e8da7779df pts-core: Fix for hdf5 detection 2019-09-03 06:04:53 -05:00
Michael Larabel
293d70b718 documentation: Add bits about offline cache and better handling no accidental uploads 2019-09-02 19:10:45 -05:00
Michael Larabel
b01424e521 documentation: Add bits about offline cache and better handling no accidental uploads 2019-09-02 19:10:24 -05:00
Michael Larabel
d1a6248d49 documentation: Add bits about offline cache and better handling no accidental uploads 2019-09-02 19:08:24 -05:00
Michael Larabel
3db564ad72 documentation: Add bits about offline cache and better handling no accidental uploads 2019-09-02 19:07:45 -05:00
Michael Larabel
6244f40dae documentation: Add bits about offline cache and better handling no accidental uploads 2019-09-02 19:04:26 -05:00
Michael Larabel
40cf5758c9 pts-core: Populate the test-suites ob-cache 2019-09-01 16:27:08 -05:00
Michael Larabel
c09da5297b pts-core: Populate the test-suites ob-cache 2019-09-01 16:26:51 -05:00
Fatima Sheremetyeva
7d4e7aca02 ob-cache: Initial population 2019-09-01 17:23:20 -04:00
Michael Larabel
eda132a240 pts-core: Handle OB indexes to overwrite from cache if newer than what is in user dir 2019-09-01 16:19:02 -05:00
Michael Larabel
f32168d2c6 pts-core: Support openbenchmarking.org dir copy 2019-09-01 16:05:11 -05:00
Michael Larabel
5d788a31ae pts-core: Introduce ob-cache 2019-09-01 15:55:49 -05:00
Michael Larabel
c287deb660 pts-core: Add libxml2 to the external dependency list 2019-08-28 13:11:36 -05:00
Michael Larabel
00508547ac pts-core: Add libxml2 to the external dependency list 2019-08-28 12:59:04 -05:00
Michael Larabel
d3757b36fa pts-core: Add hdf5 to the external dependency list 2019-08-28 12:54:15 -05:00
Michael Larabel
e14db63c59 pts-core: Bail out in upload-result when no support is there 2019-08-26 18:49:40 -05:00
Michael Larabel
f376bff463 pts-core: Fix for previous commits 2019-08-26 18:48:36 -05:00
Michael Larabel
dd998876cd pts-core: No reason to warn the user when usage data doesn't upload 2019-08-26 18:24:06 -05:00
Michael Larabel
29c6f29316 pts-core: Add AllowResultUploadsToOpenBenchmarking user config option
pts-core: Split OpenBenchmarking.org upload code into pts_openbenchmarking_upload file and allow it to be removed if wanting to strip out upload support
2019-08-26 18:18:25 -05:00
Michael Larabel
3750258613 pts-core: R9 got dropped from color coding before 2019-08-26 09:41:03 -05:00
1712 changed files with 46982 additions and 438 deletions

View File

@@ -1,5 +1,33 @@
PHORONIX TEST SUITE CHANGE-LOG
Phoronix Test Suite 9.0.1-Asker
1 October 2019
pts-core: Fatal error fix for old PHP5 versions with pts_openbenchmarking_upload crash
pts-core: Set AllowResultUploadsToOpenBenchmarking = FALSE in enterprise-setup
ob_auto_compare: Show "since [date]" as part of the inline box plot
ob_auto_compare: Various tweaks/styling improvements to the inline box-plot display
phodevi: New cpu.peak-freq sensor for reporting just the highest CPU core frequency at that moment
Phoronix Test Suite 9.0.0-Asker
16 September 2019
pts-core: Add stress-batch-run sub-command for behavior like stress-run but no prompts for test options
pts-core: Allow plotting all individual run results as a line graph
pts-core: Allow showing pie charts of wins/losses of tests
pts-core: Add support for showing "new + updated tests" via the invalid command helper
pts-core: Allow accessing the new result viewer via localhost too rather than just 127.0.0.1
pts_Graph: Restore pie chart support from PTS 6.0 state when dropped
Phoronix Test Suite 9.0.0 Milestone 3
3 September 2019
pts-core: Add AllowResultUploadsToOpenBenchmarking user config option
pts-core: Split OpenBenchmarking.org upload code into pts_openbenchmarking_upload file and allow it to be removed if wanting to strip out upload support
pts-core: Add "ob-cache" local cache of tests/suites to help offline use-cases
pts-core: Add hdf5 to the external dependency list
pts-core: Add libxml2 to the external dependency list
Phoronix Test Suite 9.0.0 Milestone 2
22 August 2019

View File

@@ -1,4 +1,4 @@
# Phoronix Test Suite 9.0.0m2
# Phoronix Test Suite 9.0.1
https://www.phoronix-test-suite.com/
The **Phoronix Test Suite** is the most comprehensive testing and benchmarking

View File

@@ -1,4 +1,4 @@
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "9.0.0m2"
.TH phoronix-test-suite 1 "www.phoronix-test-suite.com" "9.0.1"
.SH NAME
phoronix-test-suite \- The Phoronix Test Suite is an extensible open-source platform for performing testing and performance evaluation.
.SH SYNOPSIS
@@ -66,6 +66,9 @@ This option will query OpenBenchmarking.org to run random benchmarks and result
.B run-tests-in-suite
This option can be used if you wish to run all of the tests found in a supplied suite, but you wish to re-configure each of the test options rather than using the defaults supplied by the suite.
.TP
.B stress-batch-run [Test | Suite | OpenBenchmarking ID | Test Result] ...
This option will run the passed tests/suites in the multi-process stress-testing mode while behaving by the Phoronix Test Suite batch testing characteristics. The stress-batch-run mode is similar to the stress-run command except that for any tests passed to it will run all combinations of the options rather than prompting the user for the values to be selected.
.TP
.B stress-run [Test | Suite | OpenBenchmarking ID | Test Result] ...
This option will run the passed tests/suites in the multi-process stress-testing mode. The stress-run mode will not produce a result file but is rather intended for running multiple test profiles concurrently to stress / burn-in the system. The number of tests to run concurrently can be toggled via the PTS_CONCURRENT_TEST_RUNS environment variable and by default is set to a value of 2.
.TP

View File

@@ -5,57 +5,90 @@
### Introduction
Phoromatic is a remote management system for the Phoronix Test Suite. Phoromatic allows the automatic (hence the name *Phoro-matic* ) scheduling of tests, remote installation of new tests, and the management of multiple test systems all through an intuitive, easy-to-use web interface. Tests can be scheduled to automatically run on a routine basis across multiple test systems. The test results are then available from this central, secure location.
Phoromatic was originally introduced with Phoronix Test Suite 2.0 via Phoromatic.com as a project going back to 2008~2009. Phoromatic.com debuted as a hosted instance with the option of behind-the-firewall licensing for use within organizations. With Phoronix Test Suite 5.2 the model shifted to offer a local, open-source version of Phoromatic built into the Phoronix Test Suite code-base. Thanks to continued enterprise development, with Phoronix Test Suite 5.4 is now a fully-functioning, built-in version of Phoromatic that's open-source and can be used for behind-the-firewall testing without needing to push results to OpenBenchmarking.org and the ability to keep all results private.
Phoromatic in Phoronix Test Suite 5.4 also has the ability to support zero-conf network discovery using Avahi and the automatic distribution of needed test profiles/suites and test files. Phoronix Test Suite 5.4's Phoromatic is a significant breakthrough for open-source testing particularly those running this GPL benchmarking software within test labs and other large organizations.
### Features
Built atop the Phoronix Test Suite, Phoromatic offers many features for both enterprise and community/personal users:
#### Automated Scheduling
Whether it is every evening at 6:00PM, once every Thursday at 10:00AM or somewhere in between, Phoromatic can schedule tests to be run at user-defined intervals. The testing schedules can be updated through Phoromatic web interface. After the test(s) have run, the results will be immediately uploaded to Phoromatic.
#### Extensible
Any test profile or test suite that is compliant with the Phoronix Test Suite specification will work with Phoromatic. Phoromatic is able to leverage the hundreds of test profiles and test suites currently in the Phoronix Test Suite via OpenBenchmarking.org, along with any custom or proprietary test profiles you or your company utilize. Additionally, the Phoromatic interface allows the user to construct their own test suite(s).
#### Remote Testing
Once the test system is setup, all testing and management of that system can be done remotely. There is no need to execute Phoronix Test Suite commands locally using the GUI or command line version, but instead nearly all of the same features are accessible from the Phoromatic interface.
#### Multi-System Support
A single Phoromatic account is able to manage multiple test systems running the Phoronix Test Suite. Phoromatic supports grouping together test systems, tagging, and other features to support effectively managing many test systems. From the Phoromatic interface, installed system hardware and software from a given system can also be viewed.
#### Turn-Key Deployment
No additional software needs to be installed to support Phoromatic; all that's needed is Phoronix Test Suite 5.4 or later for full compatibility. New test systems can easily be synced with a given Phoromatic account by running a single command from the Phoronix Test Suite client.
#### Result Management
Test results are automatically uploaded to the Phoromatic account and remain private unless you opt to upload them to OpenBenchmarking.org. From the Phoromatic interface, results from multiple test systems can easily be compared and multiple results from the same systems can be used to track performance over time. There are also options to look at the statistical significance of the results and other features to efficiently and effectively analyze the system's performance.
#### Decentralized
Once the Phoronix Test Suite running on the Phoromatic Server has been able to cache all of the OpenBenchmarking.org test files and the needed files for each test, Phoromatic with any Phoronix Test Suite clients on your LAN can run fully decentralized without the need for a constant stream of OpenBenchmarking.org communication or Internet connection for that matter. (The only exception would be if your local systems don't have all their needed external dependencies and your system's package manager would need to install components like a compiler or necessary system libraries.
#### Fully Open-Source
Phoromatic is now fully open-source within the Phoronix Test Suite code-base for fostering greater development and new capabilities. Patches are welcome and Phoronix Media is available to provide commercial support and custom engineering services around Phoromatic and the Phoronix Test Suite.
### Phoromatic Server Setup
Phoromatic is built into the Phoronix Test Suite code-base and should be found in all packaged versions of the **phoronix-test-suite** . Starting the Phoromatic Server entails running phoronix-test-suite start-phoromatic-server after configuring the server information within *~/.phoronix-test-suite/user-config.xml* . The Phoromatic Server can with or without root permissions depending upon your firewall and the port numbers you wish to use for the server.
On the "client side", any up-to-date version of the Phoronix Test Suite can automatically communicate with the Phoromatic Server. If Avahi support is available (commonly in Linux distribution repositories as _avahi-tools_ ), there should be zero-conf discovery if the Phoromatic Server and client systems are on the same LAN. If a Phoronix Test Suite client discovers a Phoromatic Server, it will attempt to use it automatically as a local download cache. In the event of no Internet connection, it will also attempt to obtain the needed OpenBenchmarking.org test/suite meta-data from the Phoromatic Server based upon its archived meta-data. This allows the Phoronix Test Suite / Phoromatic deployment on the LAN to be self-sustaining without an Internet connection as long as the systems have all installed test dependencies.
Further configuration of the setup parameters for the Phoromatic Server and Phoronix Test Suite clients can be tuned via the *~/.phoronix-test-suite/user-config.xml* file. All control and configuration of the Phoromatic Server is done via the web-based interface when the Phoromatic Server is active.
The Phoromatic Server utilizes PHP/HHVM's built-in web-server capabilities and there's also a Phoronix Test Suite built-in WebSocket server that's also initiated for back-end processing. At this time there are no ports set by default for these services but must be defined within the user configuration file. With the Avahi zero-conf network discovery and other automated detection in place, there's little restrictions over the port selection.
Systemd and Upstart service files are shipped with the Phoronix Test Suite for those that wish to have the services automatically run as daemons. The only new requirements over the basic Phoronix Test Suite system requirements is having PHP-SQLite support installed and the newer version of PHP or HHVM is recommended for offering the best support.
### Example Deployments
#### Use Case A: Unrestricted Internet Access, Local Result Storage
Systems on your network with unrestricted Internet access is the easiest and simplest deployment for the Phoronix Test Suite and Phoromatic. After installing the Phoronix Test Suite on the system you wish to designate the Phoromatic Server and have configured the *user-config.xml* file, simply run:
**$ phoronix-test-suite start-phoromatic-server**
Assuming you have no firewall or permission issues, the built-in web server and WebSocket server should proceed to initiate along with outputting the IP/port information for these services. Unless otherwise disabled from the user configuration file and if avahi-tools is present, the Phoromatic Server will be advertised with Avahi for zero-configuration networking.
From the Phoromatic web interface you are able to create an account and from there proceed with the creating of test schedules, updating settings, and connecting systems. From the "client systems" you wish to use as the benchmarking nodes, it's simply a matter of running **phoronix-test-suite phoromatic.connect** with zero-conf networking or otherwise follow the information from the Phoromatic web interface for manual setup with the IP/port information.
#### Use Case B: No Internet Available To Client Systems
It's possible to run the Phoronix Test Suite and Phoromatic Server without a persistent Internet connection as long as you are able to first download the necessary files to the Phoromatic Server. After installing the Phoronix Test Suite on the system you wish to designate the Phoromatic Server and have configured the *user-config.xml* file, a few commands from the system while having an Internet connection will be able to cache the needed data:
**$ phoronix-test-suite make-download-cache x264 xonotic ffmpeg**
This command will simply download all of the needed test files for the tests/suites passed to the sub-command. Alternatively you could also pass pts/all to cache all tests. It's important though to just cache the tests/suites you'll be using on your network. This will generate the test file download cache by default to *~/.phoronix-test-suite/download-cache/* or */usr/share/phoronix-test-suite/download-cache/* depending upon your write permissions. You can always run this command later with more test files. Alternatively, if you already have a number of tests installed on the system, simply running "phoronix-test-suite make-download-cache" will generate the cache based upon the currently installed tests.
**$ phoronix-test-suite make-openbenchmarking-cache**
This command will cache as much of the OpenBenchmarking.org meta-data as possible for test profiles and test suites. After the above commands, the Phoromatic Server should no longer need a persistent Internet connection.
**$ phoronix-test-suite start-phoromatic-server**
Proceed to start the Phoromatic Server and operate as normal.
For the test clients without an Internet connection, as long as they're able to reach the Phoromatic Server, the Phoromatic Server should be able to automatically serve all of the needed test files download cache and OpenBenchmarking.org meta-data to the systems locally.
#### Use Case C: Phoromatic Across The Internet
If wishing to use the same Phoromatic Server across multiple geographic locations, it's easily possible -- you just lose out on the zero-conf networking ability. To let the Phoronix Test Suite client systems know about the remote Phoromatic Server, simply add the Phoromatic Server information to the client's *PhoromaticServers* element within the *user-config.xml* . Of course, make sure the Phoromatic Server has a globally resolvable IP address and its Phoromatic HTTP/WebSocket ports are open. Once informing the client of the Phoromatic Server, the use cases as above apply in the same manner.
### Client Setup
From Phoronix Test Suite client systems running on the LAN, the following command will report all available detected Phoromatic Servers along with important server and debugging information:
**$ phoronix-test-suite phoromatic.explore**
With the following example output on finding one successful server:
*IP: 192.168.1.211
HTTP PORT: 5447
WEBSOCKET PORT: 5427
@@ -64,29 +97,43 @@ PHORONIX TEST SUITE: Phoronix Test Suite v5.4.0m1 [5313]
DOWNLOAD CACHE: 19 FILES / 2390 MB CACHE SIZE
SUPPORTED OPENBENCHMARKING.ORG REPOSITORIES:
pts - Last Generated: 05 Oct 2014 07:16*
Phoromatic Servers are detected by the Phoronix Test Suite through Avahi or if manually configuring the Phoronix Test Suite clients to point to Phoromatic Servers. For networks without Avahi/auto-discovery support or for test systems that may be connecting from another network, the IP address and HTTP port number can be added to the local system's *~/.phoronix-test-suite/user-config.xml* with the *PhoromaticServers* element. Adding the *IP:port* (the Phoromatic Server's HTTP port) to the PhoromaticServers *user-config.xml* element for will perform targeted probing by the Phoronix Test Suite without any dependence on Avahi. Multiple Phoromatic Servers can be added if each IP:port is delimited by a comma.
To connect a Phoronix Test Suite system for benchmarking to an account, log into your Phoromatic account from the web-interface and on the main/system pages will be instructions along with a specially formed string to run, e.g. *phoronix-test-suite phoromatic.connect 192.168.1.211:5447/I0SSJY* . When running that command once on the system(s) to be synced to that account, as the administrator you'll be able to validate/approve the systems from the Phoromatic web interface. After that, whenever the system(s) are to be running benchmarks, simply have the **phoronix-test-suite phoromatic.connect** command running on the system (after the initial account has been synced, simply running **phoronix-test-suite phoromatic.connect** is enough for the system to find the server and its account).
### Root Administrator
The root administrator account is able to manage the server-level settings, e.g. Phoromatic storage location and other global settings related to the Phoronix Test Suite / Phoromatic Server, from the web user-interface.
To enable the root administrator log-in, first from the server's command-line interface run **phoronix-test-suite phoromatic.set-root-admin-password** to set the password. Following that, you can log into the root administrator account via the web interface via the *rootadmin* user-name and the set password.
### Other Advice
#### Disable Internet Precaution
If you have an Internet connection but want to ensure your Phoronix Test Suite client doesn't attempt to use it for any matter, via the *~/.phoronix-test-suite/user-config.xml* you can set *NoInternetCommunication* to *TRUE* . There's also a NoNetworkCommunication tag, but setting that to TRUE will disable any form of network communication -- including communication with the Phoromatic Server.
#### Ports / Services
The Phoromatic Server process currently relies upon a PHP/HHVM built-in web server process and a PTS-hosted WebSocket server. The web server process handles the web UI and much of the responsibilities of the Phoromatic Server. Over time the PTS WebSocket server will be increasingly utilized for bi-directional, real-time communication between the server and clients -- including for features like viewing real-time hardware sensors of client systems from the server UI.
#### Systemd / Upstart
Packaged with the Phoronix Test Suite are basic *phoromatic-client* and *phoromatic-server* configurations for both Upstart and systemd init systems. The *phoromatic-server* configuration will launch the Phoronix Test Suite's Phoromatic Server and the *phoromatic-client* service will attempt to connect to a _pre-configured_ Phoromatic Server. The systemd service files will automatically be installed via the Phoronix Test Suite *install-sh* process while the Upstart jobs can be copied from *deploy/phoromatic-upstart/** to */etc/init* .
#### Cache Verification
To confirm the files accessible to Phoronix Test Suite client systems, from the Phoromatic Server web user-interface go to the *settings* page followed by the *cache settings* link to view information about the download and OpenBenchmarking.org caches. From the client systems, running **phoronix-test-suite phoromatic.explore** will also supply cache statistics.
#### Log Files
The Phoromatic Server will produce a log file of events / debugging information to *~/.phoronix-test-suite/phoromatic.log* or */var/log/phoromatic.log* depending upon the service's permissions. When running the Phoronix Test Suite Phoromatic client, the log will be written to one of the respective locations in *phoronix-test-suite.log* .
#### Multi-User Accounts
For each time a user account is made from the Phoromatic web UI's log-in page, all of the test schedules, systems, and other account information is separate to allow for a completely isolated multi-user system. If a main administrator (the one creating the account) wishes to have multiple users sharing the same account data, that user can create additional accounts from the *Users* tab of their account. The main administrator can make an additional administrator account or a "viewer" account that can consume the account's data but not create/modify the schedules, systems, or other account details.
#### File Locations
When running the Phoronix Test Suite Phoromatic Server as root, rather than using the *~/.phoronix-test-suite/* directory, the standard Linux file-system hierarchy standard is honored. The main storage path is */var/lib/phoronix-test-suite/* , the user configuration file is */etc/phoronix-test-suite.xml* , and */var/cache/phoronix-test-suite/* for cache files.
#### Uploading Other Test Results
Unscheduled test results and other results found on connected systems to a Phoromatic account can upload the data to the Phoromatic Server using the *phoronix-test-suite phoromatic.upload-result <result file identifier >* sub-command.
#### User Context File Logging
For those utilizing custom set context script files as part of the Phoromatic test schedule, any important notes / log information can be written to the file specified by the *PHOROMATIC_LOG_FILE* environment variable set while running the user context scripts. The contents of that file is then sent to the Phoromatic Server otherwise the standard output of the script's execution is submitted to the Phoromatic Server for logging. These logs can then be viewed by the Phoromatic Server along with the test results. Other environment variables accessible when running a user context script include *PHOROMATIC_TRIGGER* , *PHOROMATIC_SCHEDULE_ID* , and *PHOROMATIC_SCHEDULE_PROCESS* .

View File

@@ -3,25 +3,38 @@
### Introduction
Phoronix Test Suite 8.0 features rewritten Windows support that is at a near feature parity to the program's long-standing support for Linux, macOS, BSD and Solaris operating systems. To make it abundantly clear, if you are using a Phoronix Test Suite version pre-8.0, you are best upgrading or ideally using Phoronix Test Suite Git as the Windows support remains in very active development at the moment as of early 2018.
The Phoronix Test Suite Windows support currently targets **Windows 10 x64** and **Windows Server 2016 x64** . Earlier versions of Windows, namely Windows Server 2012 and Windows 8, may work to some extent but some hardware/software reporting features and other capabilities may be missing or report warning messages. The Phoronix Test Suite Windows support is also exclusively focused on x86 64-bit support: the Phoronix Test Suite itself will run on x86 32-bit but many of the program dependencies are configured for making use of 64-bit binaries.
### Windows Setup / Dependencies
As with Phoronix Test Suite on Linux and other operating systems, the principal dependency is on PHP (PHP v5.3 or newer, including PHP 7.x). Running the *phoronix-test-suite.bat* file launcher for the Phoronix Test Suite on Windows will attempt to download and setup PHP on the system under *C:\PHP* as the default location should PHP support not be found within your system's *Program Files* directories. The PHP Windows build does depend upon Microsoft Visual C++ redistributable libraries, which the Windows launcher will also attempt to download and install if needed.
The Phoronix Test Suite on Windows does depend upon [Cygwin](https://www.cygwin.com/) for its Bash interpreter and other basic utilities to ease the process of porting test profiles to Windows with being able to use many of the same test installation scripts on Windows/Linux/macOS/BSD/Solaris then largely unmodified. Most of the Windows tests depend upon their respective native Windows applications/binaries while this Cygwin support is a convenience for handling these Bash setup scripts and also some test profiles that depend upon a GNU toolchain. The Phoronix Test Suite will attempt to download and setup Cygwin on the system if Cygwin isn't found in its default location of *C:\cygwin64* .
Various test profiles may depend upon other "external dependencies" like Python, PERL, Steam, and Java, as examples. The Phoronix Test Suite as with its support for other operating systems and Linux distributions will attempt to install these needed dependencies on a per-test basis when needed if existing support is not detected on the system.
### Running The Phoronix Test Suite On Windows
The Phoronix Test Suite can run from its local directory and does not need to be "installed" to a system path or any other "setup" process prior to execution. On a clean install of Windows 10 x64 or Windows Server 2016, deploying the Phoronix Test Suite is designed to be as easy and straight-forward as possible:
1. Download the Phoronix Test Suite 8.0+ or [Phoronix-Test-Suite from GitHub](https://github.com/phoronix-test-suite/phoronix-test-suite) ( [zip file](https://github.com/phoronix-test-suite/phoronix-test-suite/archive/master.zip) ).
2. From the Command Prompt or PowerShell, enter the *phoronix-test-suite* directory whether it be from Git or a zipped download.
3. Run the *phoronix-test-suite.bat* file that should proceed to run the Phoronix Test Suite just as you would on any other operating system. If needed the Phoronix Test Suite will try to initially download and setup PHP if needed followed by the attempted automatic Cygwin setup, etc.
4. Any of the Phoronix Test Suite commands from other operating systems should work on Windows. If you are new to the Phoronix Test Suite, you may enjoy a bit more guided experience by running the **phoronix-test-suite shell** command.
### Test Profiles On Windows
As of March 2018, around 50 of the test profiles are currently compatible with the Phoronix Test Suite on Windows. This includes many of the popular benchmarks and other interesting test cases. Over time more test profiles will continue to be ported to Windows where applicable and there are also some Windows-only tests also supported for execution by the Phoronix Test Suite.
### Getting Started
Besides **phoronix-test-suite shell** and **phoronix-test-suite help** , there is also **phoronix-test-suite interactive** for helping new users understand Phoronix Test Suite benchmarking. Long story short, it should be as easy as running **phoronix-test-suite benchmark c-ray** or **phoronix-test-suite benchmark crafty** as some examples for carrying out automated, cross-platform benchmarks in a side-by-side and fully-reproducible manner.
### Support
Community technical support is available via [GitHub](https://github.com/phoronix-test-suite/phoronix-test-suite/issues) or general inquiries via [the Phoronix Forums](https://www.phoronix.com/forums/forum/phoronix/phoronix-test-suite) . For enterprise inquiries, commercial support, and custom engineering services, [contact us](http://phoronix-test-suite.com/?k=commercial) .

View File

@@ -233,6 +233,8 @@ Virtual Test Suites
Component Testing
</a></li><li><a href="#%0APhoromatic%0A">
Phoromatic
</a></li><li><a href="#%0AOfflineImprovements+ConfidentialTesting/AvoidingAccidentalResultUploads%0A">
Offline Improvements + Confidential Testing / Avoiding Accidental Result Uploads
</a></li><li><a href="#%0ACreatingTestProfiles%0A">
Creating Test Profiles
</a></li><li><a href="#%0ADevelopmentCredits%0A">
@@ -313,6 +315,9 @@ User Options
<h3>run-tests-in-suite<em> </em>
</h3>
<p>This option can be used if you wish to run all of the tests found in a supplied suite, but you wish to re-configure each of the test options rather than using the defaults supplied by the suite.</p>
<h3>stress-batch-run<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will run the passed tests/suites in the multi-process stress-testing mode while behaving by the Phoronix Test Suite batch testing characteristics. The stress-batch-run mode is similar to the stress-run command except that for any tests passed to it will run all combinations of the options rather than prompting the user for the values to be selected.</p>
<h3>stress-run<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will run the passed tests/suites in the multi-process stress-testing mode. The stress-run mode will not produce a result file but is rather intended for running multiple test profiles concurrently to stress / burn-in the system. The number of tests to run concurrently can be toggled via the PTS_CONCURRENT_TEST_RUNS environment variable and by default is set to a value of 2.</p>
@@ -1116,6 +1121,93 @@ Virtual Test Suites
<h3>Smp Tests<em> git/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>All PTS Tests<em> pts/all</em>
</h3>
<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.</p>
<h3>Installed Tests<em> pts/installed</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.</p>
<h3>Every PTS Test<em> pts/everything</em>
</h3>
<p>This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.</p>
<h3>Linux Operating System Tests<em> pts/linux</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.</p>
<h3>Solaris Operating System Tests<em> pts/solaris</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.</p>
<h3>BSD Operating System Tests<em> pts/bsd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.</p>
<h3>MacOSX Operating System Tests<em> pts/macosx</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.</p>
<h3>Windows Operating System Tests<em> pts/windows</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.</p>
<h3>Hurd Operating System Tests<em> pts/hurd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.</p>
<h3>System Subsystem Tests<em> pts/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.</p>
<h3>Processor Subsystem Tests<em> pts/processor</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.</p>
<h3>Graphics Subsystem Tests<em> pts/graphics</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.</p>
<h3>Other Subsystem Tests<em> pts/other</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.</p>
<h3>Utility Tests<em> pts/utility</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.</p>
<h3>Simulator Tests<em> pts/simulator</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.</p>
<h3>Scientific Tests<em> pts/scientific</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.</p>
<h3>Benchmark Tests<em> pts/benchmark</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.</p>
<h3>Application Tests<em> pts/application</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.</p>
<h3>Game Tests<em> pts/game</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.</p>
<h3>Smp Tests<em> pts/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Cuda Tests<em> pts/cuda</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
<h3>Openmp Tests<em> pts/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Python Tests<em> pts/python</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.</p>
<h3>Go Tests<em> pts/go</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
<h3>Mpi Tests<em> pts/mpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
<h3>Vdpau Tests<em> pts/vdpau</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.</p>
<h3>Video Tests<em> pts/video</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.</p>
<h3>Responsiveness Tests<em> pts/responsiveness</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.</p>
<h3>Openmpi Tests<em> pts/openmpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.</p>
<h3>All WINDOWS Tests<em> windows/all</em>
</h3>
<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.</p>
@@ -1199,6 +1291,20 @@ Phoromatic
</h1>
<h1>Overview</h1>
<p>The Phoronix Test Suite now features its own built-in Phoromatic server and client implementations. See the <em>phoromatic.pdf</em> / <em>phoromatic.html</em> documentation for more information on this advanced capability.</p>
<hr style="height: 50px; border: 0;"><a name="OfflineImprovements+ConfidentialTesting/AvoidingAccidentalResultUploads%0A"></a><h1>
Offline Improvements + Confidential Testing / Avoiding Accidental Result Uploads
</h1>
<h1>Offline Enhancement Via Local Cache</h1>
<p>Beginning with Phoronix Test Suite 9.0, there are improvements to improve the out-of-the-box experience if running the Phoronix Test Suite in a strictly offline environment / behind-the-firewall without access to OpenBenchmarking.org for being able to obtain test profiles / test suites. From Phoronix Test Suite 3.0 when OpenBenchmarking.org was introduced until Phoronix Test Suite 9.0, Internet connectivity was initially required for obtaining the test profiles/suites as the cloud/repository. OpenBenchmarking.org allows for tests to be updated independently of the Phoronix Test Suite releases as well as allowing new tests to be introduced on-demand. Aside from when new tests require explicit new PTS features, this allows tests/suites to be seamlessly used by older versions of the Phoronix Test Suite without any upgrade process required, assuming Internet connectivity is available.</p>
<p>Beginning with Phoronix Test Suite 9.0, a static snapshot of the official tests/suites is included as part of the Phoronix Test Suite package. The intention with this is to provide a static snapshot with all tests/suites as of release time, similar to the behavior with pre-3.0 releases. The benefit to including this static snapshot is helping those that are running strictly offline/isolated to be able to have at least recent tests/suites available without first needing to query OpenBenchmarking.org for this data. But Internet support is certainly desired in order to be able to obtain updated and new test profiles.</p>
<p>This static snapshot is provided in the <em>ob-cache/</em> Phoronix Test Suite folder. If this cache is not needed or wish to customize/extend it, it can be safely removed and or altered without causing issues. When the Phoronix Test Suite has Internet connectivity, it will continue to query OpenBenchmarking.org for new/updated tests and suites.</p>
<p>This local cache does provide current and previous versions of test profiles to allow users to continue running older versions of tests/results even when upgrading their Phoronix Test Suite offline copy.</p>
<p>Even with the local cache, there still is the need for obtaining any necessary files needed to run the selected test(s). For those wishing to optimize that workflow for offline usage, see the existing <em>phoronix-test-suite make-download-cache</em> sub-command documentation. The <em>phoronix-test-suite make-openbenchmarking-cache</em> sub-command may also be desirable depending upon setup.</p>
<h1>Disabling OpenBenchmarking.org Result Upload Functionality</h1>
<p>Phoronix Test Suite 9.0 also improved the workflow around disabling OpenBenchmarking.org result uploading functionality for those carrying out confidential tests or otherwise wish to provide safeguards for ensuring no results may be accidentally uploaded publicly.</p>
<p>Removal of OpenBenchmarking.org upload support can be done by deleting <em>phoronix-test-suite/pts-core/objects/pts_openbenchmarking_upload.php</em>. If that file is removed, the Phoronix Test Suite should respond gracefully and not prompt users about any upload and within that file is the only logic for actually uploading the results to Openbenchmarking. So simply by removing that file you should be covered from any accidental uploading of results. Removal/disabling of this file also prevents any anonymous usage reporting.</p>
<p>For those without the ability to remove that file from their Phoronix Test Suite installation or as a secondary safeguard, from the Phoronix Test Suite user configuration file (<em>/etc/phoronix-test-suite.xml<em> as root or <em>~/.phoronix-test-suite/user-config.xml<em> for most users) is a "<em>AllowResultUploadsToOpenBenchmarking</em>" option. If setting that value to <em>FALSE</em>, it should apply the same behavior as if deleting the pts_openbenchmarking_upload file.</em></em></em></em></p>
<p>If distributing a customized/local copy of the Phoronix Test Suite, the default behavior of the configuration file (in addition to deleting the pts_openbenchmarking_upload file) can be done via the user configuration defaults defined within <em>pts-core/static/user-config-defaults.xml</em>.</p>
<hr style="height: 50px; border: 0;"><a name="CreatingTestProfiles%0A"></a><h1>
Creating Test Profiles
</h1>

File diff suppressed because it is too large Load Diff

View File

@@ -62,6 +62,9 @@
<h3>run-tests-in-suite<em> </em>
</h3>
<p>This option can be used if you wish to run all of the tests found in a supplied suite, but you wish to re-configure each of the test options rather than using the defaults supplied by the suite.</p>
<h3>stress-batch-run<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will run the passed tests/suites in the multi-process stress-testing mode while behaving by the Phoronix Test Suite batch testing characteristics. The stress-batch-run mode is similar to the stress-run command except that for any tests passed to it will run all combinations of the options rather than prompting the user for the values to be selected.</p>
<h3>stress-run<em> [Test | Suite | OpenBenchmarking ID | Test Result] ...</em>
</h3>
<p>This option will run the passed tests/suites in the multi-process stress-testing mode. The stress-run mode will not produce a result file but is rather intended for running multiple test profiles concurrently to stress / burn-in the system. The number of tests to run concurrently can be toggled via the PTS_CONCURRENT_TEST_RUNS environment variable and by default is set to a value of 2.</p>

View File

@@ -234,6 +234,93 @@
<h3>Smp Tests<em> git/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>All PTS Tests<em> pts/all</em>
</h3>
<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.</p>
<h3>Installed Tests<em> pts/installed</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository that are already installed on the system under test.</p>
<h3>Every PTS Test<em> pts/everything</em>
</h3>
<p>This is a collection of every test profile found within the specified OpenBenchmarking.org repository, including unsupported tests.</p>
<h3>Linux Operating System Tests<em> pts/linux</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Linux Operating System.</p>
<h3>Solaris Operating System Tests<em> pts/solaris</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Solaris Operating System.</p>
<h3>BSD Operating System Tests<em> pts/bsd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the BSD Operating System.</p>
<h3>MacOSX Operating System Tests<em> pts/macosx</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the MacOSX Operating System.</p>
<h3>Windows Operating System Tests<em> pts/windows</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Windows Operating System.</p>
<h3>Hurd Operating System Tests<em> pts/hurd</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being compatible with the Hurd Operating System.</p>
<h3>System Subsystem Tests<em> pts/system</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the System sub-system.</p>
<h3>Processor Subsystem Tests<em> pts/processor</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Processor sub-system.</p>
<h3>Graphics Subsystem Tests<em> pts/graphics</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Graphics sub-system.</p>
<h3>Other Subsystem Tests<em> pts/other</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a test of the Other sub-system.</p>
<h3>Utility Tests<em> pts/utility</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Utility software test.</p>
<h3>Simulator Tests<em> pts/simulator</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Simulator software test.</p>
<h3>Scientific Tests<em> pts/scientific</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Scientific software test.</p>
<h3>Benchmark Tests<em> pts/benchmark</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Benchmark software test.</p>
<h3>Application Tests<em> pts/application</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Application software test.</p>
<h3>Game Tests<em> pts/game</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified as being a Game software test.</p>
<h3>Smp Tests<em> pts/smp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing smp.</p>
<h3>Cuda Tests<em> pts/cuda</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing cuda.</p>
<h3>Openmp Tests<em> pts/openmp</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmp.</p>
<h3>Python Tests<em> pts/python</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing python.</p>
<h3>Go Tests<em> pts/go</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing go.</p>
<h3>Mpi Tests<em> pts/mpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing mpi.</p>
<h3>Vdpau Tests<em> pts/vdpau</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing vdpau.</p>
<h3>Video Tests<em> pts/video</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing video.</p>
<h3>Responsiveness Tests<em> pts/responsiveness</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing responsiveness.</p>
<h3>Openmpi Tests<em> pts/openmpi</em>
</h3>
<p>This is a collection of test profiles found within the specified OpenBenchmarking.org repository where the test profile is specified via an internal tag as testing openmpi.</p>
<h3>All WINDOWS Tests<em> windows/all</em>
</h3>
<p>This is a collection of all test profiles found within the specified OpenBenchmarking.org repository.</p>

View File

@@ -0,0 +1,18 @@
<html>
<head>
<Title>Offline Improvements + Confidential Testing / Avoiding Accidental Result Uploads</Title>
</head>
<body>
<h1>Offline Enhancement Via Local Cache</h1>
<p>Beginning with Phoronix Test Suite 9.0, there are improvements to improve the out-of-the-box experience if running the Phoronix Test Suite in a strictly offline environment / behind-the-firewall without access to OpenBenchmarking.org for being able to obtain test profiles / test suites. From Phoronix Test Suite 3.0 when OpenBenchmarking.org was introduced until Phoronix Test Suite 9.0, Internet connectivity was initially required for obtaining the test profiles/suites as the cloud/repository. OpenBenchmarking.org allows for tests to be updated independently of the Phoronix Test Suite releases as well as allowing new tests to be introduced on-demand. Aside from when new tests require explicit new PTS features, this allows tests/suites to be seamlessly used by older versions of the Phoronix Test Suite without any upgrade process required, assuming Internet connectivity is available.</p>
<p>Beginning with Phoronix Test Suite 9.0, a static snapshot of the official tests/suites is included as part of the Phoronix Test Suite package. The intention with this is to provide a static snapshot with all tests/suites as of release time, similar to the behavior with pre-3.0 releases. The benefit to including this static snapshot is helping those that are running strictly offline/isolated to be able to have at least recent tests/suites available without first needing to query OpenBenchmarking.org for this data. But Internet support is certainly desired in order to be able to obtain updated and new test profiles.</p>
<p>This static snapshot is provided in the <em>ob-cache/</em> Phoronix Test Suite folder. If this cache is not needed or wish to customize/extend it, it can be safely removed and or altered without causing issues. When the Phoronix Test Suite has Internet connectivity, it will continue to query OpenBenchmarking.org for new/updated tests and suites.</p>
<p>This local cache does provide current and previous versions of test profiles to allow users to continue running older versions of tests/results even when upgrading their Phoronix Test Suite offline copy.</p>
<p>Even with the local cache, there still is the need for obtaining any necessary files needed to run the selected test(s). For those wishing to optimize that workflow for offline usage, see the existing <em>phoronix-test-suite make-download-cache</em> sub-command documentation. The <em>phoronix-test-suite make-openbenchmarking-cache</em> sub-command may also be desirable depending upon setup.</p>
<h1>Disabling OpenBenchmarking.org Result Upload Functionality</h1>
<p>Phoronix Test Suite 9.0 also improved the workflow around disabling OpenBenchmarking.org result uploading functionality for those carrying out confidential tests or otherwise wish to provide safeguards for ensuring no results may be accidentally uploaded publicly.</p>
<p>Removal of OpenBenchmarking.org upload support can be done by deleting <em>phoronix-test-suite/pts-core/objects/pts_openbenchmarking_upload.php</em>. If that file is removed, the Phoronix Test Suite should respond gracefully and not prompt users about any upload and within that file is the only logic for actually uploading the results to Openbenchmarking. So simply by removing that file you should be covered from any accidental uploading of results. Removal/disabling of this file also prevents any anonymous usage reporting.</p>
<p>For those without the ability to remove that file from their Phoronix Test Suite installation or as a secondary safeguard, from the Phoronix Test Suite user configuration file (<em>/etc/phoronix-test-suite.xml<em> as root or <em>~/.phoronix-test-suite/user-config.xml<em> for most users) is a "<em>AllowResultUploadsToOpenBenchmarking</em>" option. If setting that value to <em>FALSE</em>, it should apply the same behavior as if deleting the pts_openbenchmarking_upload file.</p>
<p>If distributing a customized/local copy of the Phoronix Test Suite, the default behavior of the configuration file (in addition to deleting the pts_openbenchmarking_upload file) can be done via the user configuration defaults defined within <em>pts-core/static/user-config-defaults.xml</em>.</p>
</body>
</html>

View File

@@ -84,6 +84,7 @@ cp deploy/*-systemd/*.service $DESTDIR$INSTALL_PREFIX/../usr/lib/systemd/system/
rm -rf $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core
cp -r pts-core $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/
cp -r ob-cache $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/
cp -r deploy $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/
rm -f $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core/static/phoronix-test-suite.desktop
rm -f $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core/static/phoronix-test-suite-launcher.desktop
@@ -93,7 +94,7 @@ rm -f $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core/static/images/o
rm -f $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core/static/images/%phoronix-test-suite.png
sed 's:PTS_DIR=`pwd`:PTS_DIR='"$INSTALL_PREFIX"'\/share\/phoronix-test-suite:g' phoronix-test-suite > $DESTDIR$INSTALL_PREFIX/bin/phoronix-test-suite
sed 's:export PTS_DIR=$(readlink -f `dirname $0`):PTS_DIR='"$INSTALL_PREFIX"'\/share\/phoronix-test-suite:g' phoronix-test-suite > $DESTDIR$INSTALL_PREFIX/bin/phoronix-test-suite
chmod +x $DESTDIR$INSTALL_PREFIX/bin/phoronix-test-suite
# sed 's:\$url = PTS_PATH . \"documentation\/index.html\";:\$url = \"'"$INSTALL_PREFIX"'\/share\/doc\/packages\/phoronix-test-suite\/index.html\";:g' pts-core/commands/gui_gtk.php > $DESTDIR$INSTALL_PREFIX/share/phoronix-test-suite/pts-core/commands/gui_gtk.php

5
ob-cache/NOTICE.txt Normal file
View File

@@ -0,0 +1,5 @@
The files in this directory are optional, providing a static cache of test profiles / test suites available via OpenBenchmarking.org.
Patches to this directory will not be accepted but test profile changes should be submitted via https://github.com/phoronix-test-suite/test-profiles/
This "ob-cache" is intended to help those running the Phoronix Test Suite behind firewalls / offline where they may not be able to query OpenBenchmarking.org for obtaining test data.

View File

@@ -0,0 +1 @@
{"main":{"generated":1568592250},"tests":{"aom-av1":{"title":"AOM AV1","description":"This is a simple test of the AOMedia AV1 encoder run on the CPU with a sample video file.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"510","last_updated":"1552063091","first_added":"1552063091","popularity":"865","downloads":"1385","versions":["1.1.0"]},"svt-av1":{"title":"SVT-AV1","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-AV1 CPU-based multi-threaded video encoder for the AV1 video format with a sample 1080p YUV video file. This test profile fork builds the encoder from Git source rather than a snapshot.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"117","last_updated":"1552059151","first_added":"1552059151","popularity":"861","downloads":"1382","versions":["1.2.0"]},"svt-hevc":{"title":"SVT-HEVC","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC \/ H.265 video format with a sample 1080p YUV video file. This test uses SVT-HEVC from Git master.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"63","last_updated":"1552060068","first_added":"1552060068","popularity":"864","downloads":"1377","versions":["1.0.0"]},"svt-vp9":{"title":"SVT-VP9","description":"This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample 1080p YUV video file. This test profile uses the Git snapshot of SVT-VP9.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"63","last_updated":"1552059681","first_added":"1552059681","popularity":"866","downloads":"1374","versions":["1.0.0"]},"vpxenc":{"title":"VP9 libvpx Encoding","description":"This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9\/WebM format using a sample 1080p video.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"746","last_updated":"1552061773","first_added":"1552061773","popularity":"870","downloads":"1356","versions":["2.3.0"]},"x265":{"title":"x265","description":"This is a simple test of the x265 encoder run on the CPU with a sample 1080p video file.","test_type":"Processor","software_type":"Utility","status":"Verified","supported_platforms":["Linux","MacOSX","BSD"],"internal_tags":["SMP"],"test_extends":"","package_hash":null,"average_run_time":"119","last_updated":"1552061034","first_added":"1552061034","popularity":"859","downloads":"1420","versions":["1.1.0"]}},"suites":[]}

File diff suppressed because one or more lines are too long

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>676792531</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,18 @@
#!/bin/sh
rm -rf aom-master
git clone https://aomedia.googlesource.com/aom aom-master
mkdir aom-master/build
cd aom-master/build
cmake ..
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z
echo "#!/bin/sh
./aom-master/build/aomenc -v --rt --threads=\$NUM_CPU_CORES --tile-columns=2 --limit=20 -o test.av1 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
<LineHint>fps</LineHint>
<TurnCharsToSpace>(</TurnCharsToSpace>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,26 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>AOM AV1</Title>
<AppVersion>Git</AppVersion>
<Description>This is a simple test of the AOMedia AV1 encoder run on the CPU with a sample video file.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>AV1 Video Encoding</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.0</Version>
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm, git</ExternalDependencies>
<EnvironmentSize>369</EnvironmentSize>
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</URL>
<MD5>db7c7ff09acd5d7820cc4d1eb0939cf9</MD5>
<SHA256>e73a54088e88e6465f578625d185933e85c3209ab7105deb755a8b8918b78cab</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</FileName>
<FileSize>680772328</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,16 @@
#!/bin/sh
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z
rm -rf SVT-AV1-master
git clone https://github.com/OpenVisualCloud/SVT-AV1.git SVT-AV1-master
cd SVT-AV1-master/Build/linux
./build.sh release
echo $? > ~/install-exit-status
cd ~
echo "#!/bin/sh
./SVT-AV1-master/Bin/Release/SvtAv1EncApp -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080 > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > svt-av1
chmod +x svt-av1

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Average Speed: #_RESULT_# fps</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,26 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>SVT-AV1</Title>
<AppVersion>Git</AppVersion>
<Description>This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-AV1 CPU-based multi-threaded video encoder for the AV1 video format with a sample 1080p YUV video file. This test profile fork builds the encoder from Git source rather than a snapshot.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>1080p 8-bit YUV To AV1 Video Encode</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.2.0</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, yasm, cmake, git</ExternalDependencies>
<EnvironmentSize>1900</EnvironmentSize>
<ProjectURL>http://github.com/OpenVisualCloud/SVT-AV1</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</URL>
<MD5>db7c7ff09acd5d7820cc4d1eb0939cf9</MD5>
<SHA256>e73a54088e88e6465f578625d185933e85c3209ab7105deb755a8b8918b78cab</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</FileName>
<FileSize>680772328</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,19 @@
#!/bin/sh
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z
rm -rf SVT-HEVC-master
git clone https://github.com/intel/SVT-HEVC.git SVT-HEVC-master
cd SVT-HEVC-master/
mkdir build
cd build
cmake ..
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
echo "#!/bin/sh
./SVT-HEVC-master/Bin/Release/SvtHevcEncApp -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080 > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > svt-hevc
chmod +x svt-hevc

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Average Speed: #_RESULT_# fps</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,26 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>SVT-HEVC</Title>
<AppVersion>Git</AppVersion>
<Description>This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-HEVC CPU-based multi-threaded video encoder for the HEVC / H.265 video format with a sample 1080p YUV video file. This test uses SVT-HEVC from Git master.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>1080p 8-bit YUV To HEVC Video Encode</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.0</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, yasm, cmake, git</ExternalDependencies>
<EnvironmentSize>1900</EnvironmentSize>
<ProjectURL>http://github.com/intel/SVT-HEVC</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</URL>
<MD5>db7c7ff09acd5d7820cc4d1eb0939cf9</MD5>
<SHA256>e73a54088e88e6465f578625d185933e85c3209ab7105deb755a8b8918b78cab</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</FileName>
<FileSize>680772328</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,17 @@
#!/bin/sh
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z
rm -rf SVT-VP9-master
git clone https://github.com/OpenVisualCloud/SVT-VP9.git SVT-VP9-master
cd SVT-VP9-master/Build/linux
chmod +x build.sh
./build.sh release
echo $? > ~/install-exit-status
cd ~
echo "#!/bin/sh
./SVT-VP9-master/Bin/Release/SvtVp9EncApp -i Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv -w 1920 -h 1080 > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > svt-vp9
chmod +x svt-vp9

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Average Speed: #_RESULT_# fps</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,26 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>SVT-VP9</Title>
<AppVersion>Git</AppVersion>
<Description>This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample 1080p YUV video file. This test profile uses the Git snapshot of SVT-VP9.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>1080p 8-bit YUV To VP9 Video Encode</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.0</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, yasm, cmake, git</ExternalDependencies>
<EnvironmentSize>1900</EnvironmentSize>
<ProjectURL>http://github.com/OpenVisualCloud/SVT-VP9</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</URL>
<MD5>db7c7ff09acd5d7820cc4d1eb0939cf9</MD5>
<SHA256>e73a54088e88e6465f578625d185933e85c3209ab7105deb755a8b8918b78cab</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z</FileName>
<FileSize>680772328</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,22 @@
#!/bin/sh
git clone https://chromium.googlesource.com/webm/libvpx libvpx-master
mkdir vpx
cd libvpx-master
./configure --disable-install-docs --enable-shared --prefix=$HOME/vpx
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
make install
cd ~
rm -rf libvpx-master
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_RAW.7z
echo "#!/bin/bash
cd vpx/bin
THREADCOUNT=\$((\$NUM_CPU_CORES>64?64:\$NUM_CPU_CORES))
LD_PRELOAD=../lib/libvpx.so ./vpxenc --codec=vp9 -v --threads=\$THREADCOUNT --tile-columns=6 -o /dev/null ~/Bosphorus_1920x1080_120fps_420_8bit_YUV.yuv --width=1920 --height=1080 2> \$LOG_FILE
echo \$? > ~/test-exit-status" > vpxenc
chmod +x vpxenc

View File

@@ -0,0 +1,12 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Pass 1/2 frame 600/601 125008B 1666b/f 50003b/s 35453 ms (#_RESULT_# fps)</OutputTemplate>
<LineHint> fps</LineHint>
<ResultBeforeString>fps</ResultBeforeString>
<StripFromResult>(</StripFromResult>
<DeleteOutputBefore>600/600</DeleteOutputBefore>
<DeleteOutputAfter>Pass 2</DeleteOutputAfter>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,26 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>VP9 libvpx Encoding</Title>
<AppVersion>Git</AppVersion>
<Description>This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9/WebM format using a sample 1080p video.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>vpxenc VP9 1080p Video Encode</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>2.3.0</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, yasm, p7zip, git</ExternalDependencies>
<EnvironmentSize>827</EnvironmentSize>
<ProjectURL>http://www.webmproject.org/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>676792531</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,15 @@
#!/bin/sh
git clone https://github.com/videolan/x265 x265-master
cd x265-master/build
cmake ../source
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z
echo "#!/bin/sh
./x265-master/build/x265 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m /dev/null > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > x265
chmod +x x265

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>encoded 600 frames in 55.40s #_RESULT_# fps), 1098.05 kb/s, Avg QP:34.03</OutputTemplate>
<LineHint>encoded 600 frames</LineHint>
<StripFromResult>(</StripFromResult>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,26 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>x265</Title>
<AppVersion>Git</AppVersion>
<Description>This is a simple test of the x265 encoder run on the CPU with a sample 1080p video file.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>H.265 1080p Video Encoding</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.0</Version>
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, cmake, yasm, Git</ExternalDependencies>
<EnvironmentSize>2600</EnvironmentSize>
<ProjectURL>http://x265.org/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,11 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v4.8.0 (Sokndal)-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://fsbench.filesystems.org/bench/aio-stress.c</URL>
<MD5>727e5fc3566837b3ea72f887d048769b</MD5>
<FileSize>39513</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,11 @@
#!/bin/sh
cc -Wall -pthread -o aio-stress-bin aio-stress.c -laio
echo $? > ~/install-exit-status
# add support for allowing aio-test-file to be on removable media devices
echo "#!/bin/sh
./aio-stress-bin \$@ aio-test-file > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status
rm -f aio-test-file" > aio-stress
chmod +x aio-stress

View File

@@ -0,0 +1,16 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v4.8.0 (Sokndal)-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>adding stage random write
dropping thread count to the number of contexts 1
starting with random write
file size 1024MB, record size 64KB, depth 64, ios per iteration 8
max io_submit 8, buffer alignment set to 4KB
threads 1 files 1 contexts 1 context offset 2MB verification off
random write on aio-test-file (#_RESULT_# MB/s) 1024.00 MB in 3.84s
thread 0 random write totals (63.36 MB/s) 1024.00 MB in 16.16s
Running single thread version</OutputTemplate>
<LineHint>random write on aio-test-file</LineHint>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,40 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v4.8.0 (Sokndal)-->
<PhoronixTestSuite>
<TestInformation>
<Title>AIO-Stress</Title>
<AppVersion>0.21</AppVersion>
<Description>AIO-Stress is an a-synchronous I/O benchmark created by SuSE. Current this profile uses a 2048MB test file and a 64KB record size.</Description>
<ResultScale>MB/s</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.1</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Benchmark</SoftwareType>
<TestType>Disk</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, libaio-development</ExternalDependencies>
<EnvironmentSize>0.5</EnvironmentSize>
<EnvironmentTestingSize>1024</EnvironmentTestingSize>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-s 2g -r 64k -t 3</Arguments>
</Default>
<Option>
<DisplayName>Test</DisplayName>
<Identifier>test</Identifier>
<ArgumentPrefix>-o </ArgumentPrefix>
<Menu>
<Entry>
<Name>Random Write</Name>
<Value>2</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,22 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.4.0-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>https://download.aircrack-ng.org/aircrack-ng-1.3.tar.gz</URL>
<MD5>c7c5b076dee0c25ee580b0f56f455623</MD5>
<SHA256>8ae08a7c28741f6ace2769267112053366550e7f746477081188ad38410383ca</SHA256>
<FileName>aircrack-ng-1.3.tar.gz</FileName>
<FileSize>4501507</FileSize>
<PlatformSpecific>Linux, BSD</PlatformSpecific>
</Package>
<Package>
<URL>https://download.aircrack-ng.org/aircrack-ng-1.3-win.zip</URL>
<MD5>319913c6e5e11aa91788ca07df40f250</MD5>
<SHA256>cd5f8dc621211b87e6e73b24e4d3f83ce8da7979f14bd439bd933b04be6fac2c</SHA256>
<FileName>aircrack-ng-1.3-win.zip</FileName>
<FileSize>14043368</FileSize>
<PlatformSpecific>Windows</PlatformSpecific>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,24 @@
#!/bin/sh
tar -xf aircrack-ng-1.3.tar.gz
cd aircrack-ng-1.3
if [ "$OS_TYPE" = "BSD" ]
then
if [ -e /usr/local/lib/libcrypto.so ]
then
env MAKE=gmake CFLAGS=-I/usr/local/include LDFLAGS=-L/usr/local/lib ./autogen.sh
else
env MAKE=gmake ./autogen.sh
fi
gmake -j $NUM_CPU_CORES
else
./autogen.sh
make -j $NUM_CPU_CORES
fi
echo $? > ~/install-exit-status
cd ~
echo "#!/bin/sh
cd aircrack-ng-1.3
./src/aircrack-ng -p \$NUM_CPU_CORES \$@ 2>&1 | tr '\\r' '\\n' | awk -v max=0 '{if(\$1>max){max=\$1}}END{print max \" k/s\"}' > \$LOG_FILE
echo \$? > ~/test-exit-status" > aircrack-ng
chmod +x aircrack-ng

View File

@@ -0,0 +1,8 @@
#!/bin/sh
unzip -o aircrack-ng-1.3-win.zip
echo "#!/bin/sh
cd aircrack-ng-1.3-win
./bin/64bit/aircrack-ng.exe \$@ 2>&1 | tr '\\r' '\\n' | awk -v max=0 '{if(\$1>max){max=\$1}}END{print max \" k/s\"}' > \$LOG_FILE
echo \$? > ~/test-exit-status" > aircrack-ng
chmod +x aircrack-ng

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.4.0-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>#_RESULT_# k/s</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,29 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.4.0-->
<PhoronixTestSuite>
<TestInformation>
<Title>Aircrack-ng</Title>
<AppVersion>1.3</AppVersion>
<Description>Aircrack-ng is a tool for assessing WiFi/WLAN network security.</Description>
<ResultScale>k/s</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.2</Version>
<SupportedPlatforms>Linux, BSD, Windows</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, openssl-development, libtool</ExternalDependencies>
<EnvironmentSize>25</EnvironmentSize>
<ProjectURL>http://www.aircrack-ng.org/</ProjectURL>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-S -Z 30</Arguments>
</Default>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,12 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.0.0m0-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://phoronix-test-suite.com/benchmark-files/aobench-20180207.zip</URL>
<MD5>6d2f7b7b82bd3363b8a5f382252588bc</MD5>
<SHA256>0d8fe95cb6a35042e38f87ca25f7c4f53e9d8f7d142a414be84c4439250c7a4e</SHA256>
<FileSize>2581</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,10 @@
#!/bin/sh
unzip -o aobench-20180207.zip
cc ao.c -o ao -lm -O3 $CFLAGS
echo $? > ~/install-exit-status
echo "#!/bin/sh
./ao > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > aobench
chmod +x aobench

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.0.0m0-->
<PhoronixTestSuite>
<SystemMonitor>
<Sensor>sys.time</Sensor>
</SystemMonitor>
</PhoronixTestSuite>

View File

@@ -0,0 +1,24 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.0.0m0-->
<PhoronixTestSuite>
<TestInformation>
<Title>AOBench</Title>
<Description>AOBench is a lightweight ambient occlusion renderer, written in C. The test profile is using a size of 2048 x 2048.</Description>
<ResultScale>Seconds</ResultScale>
<Proportion>LIB</Proportion>
<SubTitle>Size: 2048 x 2048 - Total Time</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.1</Version>
<SupportedPlatforms>Linux, Solaris, MacOSX, BSD, Windows</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities</ExternalDependencies>
<EnvironmentSize>1</EnvironmentSize>
<ProjectURL>https://code.google.com/archive/p/aobench/</ProjectURL>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,20 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.0-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://ultravideo.cs.tut.fi/video/Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</URL>
<MD5>84ae521c95aa2537e16b34bbf72f2def</MD5>
<SHA256>e2f60b904789a60f6d1edc194d8540d401dd882e3ee3605b9b1de8feacc72133</SHA256>
<FileName>Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z</FileName>
<FileSize>676792531</FileSize>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/aom-20190211.tar.xz</URL>
<MD5>c955b47dbb1292e49354f6321a09b166</MD5>
<SHA256>898d4e437bb3dac9cc3009bd053d7c30b5e1db41744ac95470fd831960f488f2</SHA256>
<FileName>aom-20190211.tar.xz</FileName>
<FileSize>2153100</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,16 @@
#!/bin/sh
tar -xf aom-20190211.tar.xz
cd aom-20190211/build
cmake ..
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
cd ~
7z x Bosphorus_1920x1080_120fps_420_8bit_YUV_Y4M.7z
echo "#!/bin/sh
./aom-20190211/build/aomenc -v --rt --threads=\$NUM_CPU_CORES --tile-columns=2 --limit=20 -o test.av1 Bosphorus_1920x1080_120fps_420_8bit_YUV.y4m > 1.log 2>&1
echo \$? > ~/test-exit-status
sed \$'s/[^[:print:]\t]/\\n/g' 1.log > \$LOG_FILE" > aom-av1
chmod +x aom-av1

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.0-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Pass 1/2 frame 3/4 768B 2048b/f 61440b/s 165907 us #_RESULT_# fps)</OutputTemplate>
<LineHint>fps</LineHint>
<TurnCharsToSpace>(</TurnCharsToSpace>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,26 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.0-->
<PhoronixTestSuite>
<TestInformation>
<Title>AOM AV1</Title>
<AppVersion>2019-02-11</AppVersion>
<Description>This is a simple test of the AOMedia AV1 encoder run on the CPU with a sample video file.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>AV1 Video Encoding</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.0</Version>
<SupportedPlatforms>Linux, MacOSX, BSD</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, p7zip, cmake, perl, yasm</ExternalDependencies>
<EnvironmentSize>369</EnvironmentSize>
<ProjectURL>https://aomedia.googlesource.com/aom/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,44 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://archive.apache.org/dist/httpd/httpd-2.4.29.tar.bz2, http://ftp.lfs-matrix.net/pub/blfs/conglomeration/httpd/httpd-2.4.29.tar.bz2</URL>
<MD5>0c599404ef6b69eee95bcd9fcd094407</MD5>
<SHA256>777753a5a25568a2a27428b2214980564bc1c38c1abf9ccc7630b639991f7f00</SHA256>
<FileName>httpd-2.4.29.tar.bz2</FileName>
<FileSize>6567926</FileSize>
<PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/apache-ab-test-files-1.tar.gz, http://www.phoronix.net/downloads/phoronix-test-suite/benchmark-files/apache-ab-test-files-1.tar.gz</URL>
<MD5>ca0c5bf0dd482a2847c68a52c0759942</MD5>
<FileName>apache-ab-test-files-1.tar.gz</FileName>
<FileSize>6008</FileSize>
</Package>
<Package>
<URL>http://apache.melbourneitmirror.net/apr/apr-1.6.3.tar.bz2, http://archive.apache.org/dist/apr/apr-1.6.3.tar.bz2</URL>
<MD5>12f2a349483ad6f12db49ba01fbfdbfa</MD5>
<SHA256>131f06d16d7aabd097fa992a33eec2b6af3962f93e6d570a9bd4d85e95993172</SHA256>
<FileName>apr-1.6.3.tar.bz2</FileName>
<FileSize>854100</FileSize>
<PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
</Package>
<Package>
<URL>http://www.apache.org/dist/apr/apr-util-1.6.1.tar.bz2, http://apache.cs.utah.edu//apr/apr-util-1.6.1.tar.bz2</URL>
<MD5>8ff5dc36fa39a2a3db1df196d3ed6086</MD5>
<SHA256>d3e12f7b6ad12687572a3a39475545a072608f4ba03a6ce8a3778f607dd0035b</SHA256>
<FileName>apr-util-1.6.1.tar.bz2</FileName>
<FileSize>428595</FileSize>
<PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
</Package>
<Package>
<URL>http://phoronix-test-suite.com/benchmark-files/Apache24-2.4.29-x64-vc14-r2-ah.zip</URL>
<MD5>8f7e773c8db85d55e4cc81ef153fef61</MD5>
<SHA256>1e6f26e8fbe3decd4c31cff3347a074c7db1f8af5ac71bf4386a1e80304e47ef</SHA256>
<FileName>Apache24-2.4.29-x64-vc14-r2-ah.zip</FileName>
<FileSize>10444082</FileSize>
<PlatformSpecific>Windows</PlatformSpecific>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,29 @@
#!/bin/sh
mkdir $HOME/httpd_
tar -zxvf apache-ab-test-files-1.tar.gz
tar -jxvf httpd-2.4.29.tar.bz2
tar -jxvf apr-util-1.6.1.tar.bz2
tar -jxvf apr-1.6.3.tar.bz2
mv apr-1.6.3 httpd-2.4.29/srclib/apr
mv apr-util-1.6.1 httpd-2.4.29/srclib/apr-util
cd httpd-2.4.29/
./configure --prefix=$HOME/httpd_ --with-included-apr
make -j $NUM_CPU_JOBS
echo $? > ~/install-exit-status
make install
cd ~
rm -rf httpd-2.4.29/
rm -rf httpd_/manual/
patch -p0 < CHANGE-APACHE-PORT.patch
mv -f test.html httpd_/htdocs/
mv -f pts.png httpd_/htdocs/
echo "#!/bin/sh
./httpd_/bin/ab \$@ > \$LOG_FILE 2>&1
echo \$? > ~/test-exit-status" > apache
chmod +x apache

View File

@@ -0,0 +1,19 @@
#!/bin/bash
unzip -o Apache24-2.4.29-x64-vc14-r2-ah.zip
tar -xf apache-ab-test-files-1.tar.gz
mv -f test.html Apache24/htdocs/
mv -f pts.png Apache24/htdocs/
cd Apache24/conf
tail -n +2 httpd.conf > httpd.conf.2
echo "Define SRVROOT \"$DEBUG_HOME\Apache24\"
" > httpd.conf
cat httpd.conf.2 >> httpd.conf
cd ~
echo "#!/bin/sh
cd Apache24/bin
./ab.exe \$@ > \$LOG_FILE" > apache
chmod +x apache

View File

@@ -0,0 +1,4 @@
#!/bin/sh
./httpd_/bin/apachectl -k stop
rm -f httpd_/logs/*
sleep 3

View File

@@ -0,0 +1,4 @@
#!/bin/sh
kill -TERM `cat $HOME/Apache24/logs/httpd.pid`
sleep 10
rm -f $HOME/Apache24/logs/*

View File

@@ -0,0 +1,3 @@
#!/bin/sh
./httpd_/bin/apachectl -k start -f $HOME/httpd_/conf/httpd.conf
sleep 5

View File

@@ -0,0 +1,4 @@
#!/bin/sh
cd Apache24/bin
./httpd.exe &
sleep 10

View File

@@ -0,0 +1,20 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Document Path: /test.html
Document Length: 3064 bytes
Concurrency Level: 100
Time taken for tests: 29.224 seconds
Complete requests: 500000
Failed requests: 0
Write errors: 0
Total transferred: 1659096222 bytes
HTML transferred: 1532088856 bytes
Requests per second: #_RESULT_# [#/sec] (mean)
Time per request: 5.845 [ms] (mean)
Time per request: 0.058 [ms] (mean, across all concurrent requests)
Transfer rate: 55440.49 [Kbytes/sec] received</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,31 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>Apache Benchmark</Title>
<AppVersion>2.4.29</AppVersion>
<Description>This is a test of ab, which is the Apache benchmark program. This test profile measures how many requests per second a given system can sustain when carrying out 1,000,000 requests with 100 requests being carried out concurrently.</Description>
<ResultScale>Requests Per Second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>Static Web Page Serving</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.7.2</Version>
<SupportedPlatforms>Linux, Solaris, BSD, MacOSX, Windows</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>System</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, perl, pcre, expat</ExternalDependencies>
<EnvironmentSize>208</EnvironmentSize>
<ProjectURL>http://www.apache.org/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-n 1000000 -c 100 http://localhost:8088/test.html</Arguments>
</Default>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,44 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://archive.apache.org/dist/httpd/httpd-2.4.29.tar.bz2, http://ftp.lfs-matrix.net/pub/blfs/conglomeration/httpd/httpd-2.4.29.tar.bz2</URL>
<MD5>0c599404ef6b69eee95bcd9fcd094407</MD5>
<SHA256>777753a5a25568a2a27428b2214980564bc1c38c1abf9ccc7630b639991f7f00</SHA256>
<FileName>httpd-2.4.29.tar.bz2</FileName>
<FileSize>6567926</FileSize>
<PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
</Package>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/apache-ab-test-files-1.tar.gz, http://www.phoronix.net/downloads/phoronix-test-suite/benchmark-files/apache-ab-test-files-1.tar.gz</URL>
<MD5>ca0c5bf0dd482a2847c68a52c0759942</MD5>
<FileName>apache-ab-test-files-1.tar.gz</FileName>
<FileSize>6008</FileSize>
</Package>
<Package>
<URL>http://apache.melbourneitmirror.net/apr/apr-1.6.3.tar.bz2, http://archive.apache.org/dist/apr/apr-1.6.3.tar.bz2</URL>
<MD5>12f2a349483ad6f12db49ba01fbfdbfa</MD5>
<SHA256>131f06d16d7aabd097fa992a33eec2b6af3962f93e6d570a9bd4d85e95993172</SHA256>
<FileName>apr-1.6.3.tar.bz2</FileName>
<FileSize>854100</FileSize>
<PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
</Package>
<Package>
<URL>http://www.apache.org/dist/apr/apr-util-1.6.1.tar.bz2, http://apache.cs.utah.edu//apr/apr-util-1.6.1.tar.bz2</URL>
<MD5>8ff5dc36fa39a2a3db1df196d3ed6086</MD5>
<SHA256>d3e12f7b6ad12687572a3a39475545a072608f4ba03a6ce8a3778f607dd0035b</SHA256>
<FileName>apr-util-1.6.1.tar.bz2</FileName>
<FileSize>428595</FileSize>
<PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
</Package>
<Package>
<URL>http://download.joedog.org/siege/siege-3.1.4.tar.gz</URL>
<MD5>a893b92a453e1c1d596314aa951981f4</MD5>
<SHA256>0436970ca81ade76eb419bc42d3f8460b475079eb5d8f199d2fa83328893099d</SHA256>
<FileName>siege-3.1.4.tar.gz</FileName>
<FileSize>530149</FileSize>
<PlatformSpecific>Linux, Solaris, BSD, MacOSX</PlatformSpecific>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,40 @@
#!/bin/sh
mkdir $HOME/httpd_
tar -zxvf apache-ab-test-files-1.tar.gz
tar -jxvf httpd-2.4.29.tar.bz2
tar -jxvf apr-util-1.6.1.tar.bz2
tar -jxvf apr-1.6.3.tar.bz2
mv apr-1.6.3 httpd-2.4.29/srclib/apr
mv apr-util-1.6.1 httpd-2.4.29/srclib/apr-util
cd httpd-2.4.29/
./configure --prefix=$HOME/httpd_ --with-included-apr
make -j $NUM_CPU_CORES
echo $? > ~/install-exit-status
make install
cd ~
rm -rf httpd-2.4.29/
rm -rf httpd_/manual/
patch -p0 < CHANGE-APACHE-PORT.patch
mv -f test.html httpd_/htdocs/
mv -f pts.png httpd_/htdocs/
cd ~
tar -xf siege-3.1.4.tar.gz
cd siege-3.1.4
./configure
make -j $NUM_CPU_CORES
cd utils
bash siege.config
cd ~
echo "#!/bin/sh
cd siege-3.1.4/src
./siege \$@ 2>&1 | grep -v HTTP > \$LOG_FILE
echo \$? > ~/test-exit-status" > apache-siege
chmod +x apache-siege

View File

@@ -0,0 +1,4 @@
#!/bin/sh
./httpd_/bin/apachectl -k stop
rm -f httpd_/logs/*
sleep 3

View File

@@ -0,0 +1,7 @@
#!/bin/sh
./httpd_/bin/apachectl -k start -f $HOME/httpd_/conf/httpd.conf
sleep 5
cd siege-3.1.4/utils
bash siege.config
cd ~

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Transaction rate: #_RESULT_# trans/sec</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,62 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>Apache Siege</Title>
<AppVersion>2.4.29</AppVersion>
<Description>This is a test of the Apache web server performance being facilitated by the Siege web serverb enchmark program.</Description>
<ResultScale>Transactions Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.4</Version>
<SupportedPlatforms>Linux, Solaris, BSD, MacOSX</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>System</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, perl, pcre, openssl-development, expat</ExternalDependencies>
<EnvironmentSize>208</EnvironmentSize>
<ProjectURL>https://www.joedog.org/siege-home/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-r10000 -d1 -b </Arguments>
<PostArguments> http://localhost:8088/test.html</PostArguments>
</Default>
<Option>
<DisplayName>Concurrent Users</DisplayName>
<Identifier>concurrent</Identifier>
<ArgumentPrefix>-c</ArgumentPrefix>
<Menu>
<Entry>
<Name>1</Name>
<Value>1</Value>
</Entry>
<Entry>
<Name>10</Name>
<Value>10</Value>
</Entry>
<Entry>
<Name>50</Name>
<Value>50</Value>
</Entry>
<Entry>
<Name>100</Name>
<Value>100</Value>
</Entry>
<Entry>
<Name>200</Name>
<Value>200</Value>
</Entry>
<Entry>
<Name>250</Name>
<Value>250</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,12 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v5.2.1 (Khanino)-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://phoronix-test-suite.com/benchmark-files/apitest-20140726.tar.bz2</URL>
<MD5>28ac817817d35ab335ad40dcec682b6d</MD5>
<SHA256>67a48803c10c147f99632e1aa54cf1afce1b785d2ecf850b5f960e72d2dd5258</SHA256>
<FileSize>23855194</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,16 @@
#!/bin/sh
tar -xjf apitest-20140726.tar.bz2
cd apitest-master
mkdir out
cd out
cmake -G "Unix Makefiles" -DCMAKE_BUILD_TYPE=Release -DHAVE_LIBUDEV_H=0 ..
make -j $NUM_CPU_JOBS
echo $? > ~/install-exit-status
cd ~
echo "#!/bin/sh
cd apitest-master/bin/
./apitest \$@ > \$LOG_FILE 2>&1
echo $? > ~/test-exit-status" > apitest
chmod +x apitest

View File

@@ -0,0 +1,8 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v5.2.1 (Khanino)-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate> NullProblem oglcore NullSolution 30316 15.000 #_RESULT_# 0.495</OutputTemplate>
<LineBeforeHint>fps</LineBeforeHint>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,137 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v5.2.1 (Khanino)-->
<PhoronixTestSuite>
<TestInformation>
<Title>APITest</Title>
<AppVersion>2014-07-26</AppVersion>
<Description>APITest is a micro-benchmark developed by John McDonald of OpenGL 4 functionality.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.0</Version>
<SupportedPlatforms>Linux, MacOSX</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Graphics</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, sdl2-development, cmake</ExternalDependencies>
<EnvironmentSize>225</EnvironmentSize>
<ProjectURL>http://github.com/nvMcJohn/apitest</ProjectURL>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<Arguments>-b -t 10 -a oglcore</Arguments>
</Default>
<Option>
<DisplayName>Resolution</DisplayName>
<Identifier>auto-resolution</Identifier>
<ArgumentPrefix>-r </ArgumentPrefix>
<DefaultEntry>0</DefaultEntry>
<Menu>
<Entry>
<Name>$VIDEO_WIDTH x $VIDEO_HEIGHT</Name>
<Value>$VIDEO_WIDTH $VIDEO_HEIGHT</Value>
</Entry>
</Menu>
</Option>
<Option>
<DisplayName>Test</DisplayName>
<Identifier>test</Identifier>
<ArgumentPrefix>-s </ArgumentPrefix>
<DefaultEntry>0</DefaultEntry>
<Menu>
<Entry>
<Name>DynamicStreaming GLBufferSubData</Name>
<Value>GLBufferSubData</Value>
</Entry>
<Entry>
<Name>DynamicStreaming GLMapUnsynchronized</Name>
<Value>GLMapUnsynchronized</Value>
</Entry>
<Entry>
<Name>DynamicStreaming GLMapPersistent</Name>
<Value>GLMapPersistent</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLUniform</Name>
<Value>GLUniform</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLDrawLoop</Name>
<Value>GLDrawLoop</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLMultiDrawBuffer-SDP</Name>
<Value>GLMultiDrawBuffer-SDP</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLMultiDrawBuffer-NoSDP</Name>
<Value>GLMultiDrawBuffer-NoSDP</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLBufferRange</Name>
<Value>GLBufferRange</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLBufferSubData</Name>
<Value>GLBufferSubData</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLBufferStorage-SDP</Name>
<Value>GLBufferStorage-SDP</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLBufferStorage-NoSDP</Name>
<Value>GLBufferStorage-NoSDP</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLDynamicBuffer</Name>
<Value>GLDynamicBuffer</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLMapUnsynchronized</Name>
<Value>GLMapUnsynchronized</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLMapPersistent</Name>
<Value>GLMapPersistent</Value>
</Entry>
<Entry>
<Name>UntexturedObjects GLTexCoord</Name>
<Value>GLTexCoord</Value>
</Entry>
<Entry>
<Name>TexturedQuadsProblem GLBindless</Name>
<Value>GLBindless</Value>
</Entry>
<Entry>
<Name>TexturedQuadsProblem GLNaive</Name>
<Value>GLNaive</Value>
</Entry>
<Entry>
<Name>TexturedQuadsProblem GLNaiveUniform</Name>
<Value>GLNaiveUniform</Value>
</Entry>
<Entry>
<Name>TexturedQuadsProblem GLNoTex</Name>
<Value>GLNoTex</Value>
</Entry>
<Entry>
<Name>TexturedQuadsProblem GLNoTexUniform</Name>
<Value>GLNoTexUniform</Value>
</Entry>
<Entry>
<Name>TexturedQuadsProblem GLSBTA</Name>
<Value>GLSBTA</Value>
</Entry>
<Entry>
<Name>TexturedQuadsProblem GLTextureArray</Name>
<Value>GLTextureArray</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,43 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>https://github.com/appleseedhq/appleseed/releases/download/2.0.0-beta/appleseed-2.0.0-beta-0-g5cff7b96b-linux64-gcc48.zip</URL>
<MD5>092da084b0c6f0b4871e478ae308aa8c</MD5>
<SHA256>4cc73c2c836c153dd9056ccf6499738923e826dbebd8652776ff3c7973f824f2</SHA256>
<FileName>appleseed-2.0.0-beta-0-g5cff7b96b-linux64-gcc48.zip</FileName>
<FileSize>108932072</FileSize>
<PlatformSpecific>Linux</PlatformSpecific>
</Package>
<Package>
<URL>https://github.com/appleseedhq/appleseed/releases/download/2.0.0-beta/appleseed-2.0.0-beta-0-g5cff7b96b-win64-vs140.zip</URL>
<MD5>4e6befb880dfeece518f4ccadd5f2f2c</MD5>
<SHA256>1cc690aac45100b3e228cf6888cec9faf777994ef32ed96a3110d0b0e102bb57</SHA256>
<FileName>appleseed-2.0.0-beta-0-g5cff7b96b-win64-vs140.zip</FileName>
<FileSize>62994385</FileSize>
<PlatformSpecific>Windows</PlatformSpecific>
</Package>
<Package>
<URL>https://github.com/appleseedhq/appleseed-scenes/releases/download/1.8.0-beta/emily_1.4.zip</URL>
<MD5>ac70fa83eb5f12966fd28a000c54c210</MD5>
<SHA256>3ad9332ad0777d70871454228587372fee9ad98db35483cd25c96b7663b81886</SHA256>
<FileName>emily_1.4.zip</FileName>
<FileSize>417182051</FileSize>
</Package>
<Package>
<URL>https://github.com/appleseedhq/appleseed-scenes/releases/download/1.8.0-beta/disney_material_1.2.zip</URL>
<MD5>4eebe5b47792b8ca031995cf9e613893</MD5>
<SHA256>6aa882aab4ce14129fbc899a9e00e65d281a239373f17705d536488511d719c4</SHA256>
<FileName>disney_material_1.2.zip</FileName>
<FileSize>3436200</FileSize>
</Package>
<Package>
<URL>https://github.com/appleseedhq/appleseed-scenes/releases/download/1.8.0-beta/material_tester_1.4.zip</URL>
<MD5>64cfa21fad171fa1ceb32539b448755a</MD5>
<SHA256>0e185ed1363f98c826c7b37763ccac0b203118df850c9583be29299b4f8da22e</SHA256>
<FileName>material_tester_1.4.zip</FileName>
<FileSize>21341121</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,15 @@
#!/bin/sh
unzip -o appleseed-2.0.0-beta-0-g5cff7b96b-linux64-gcc48.zip
unzip -o emily_1.4.zip
unzip -o disney_material_1.2.zip
unzip -o material_tester_1.4.zip
cp -va emily/* appleseed
cp -va disney_material/* appleseed
cp -va material_tester/* appleseed
echo "#!/bin/bash
cd appleseed
./bin/appleseed.cli --benchmark-mode \$@ > \$LOG_FILE 2>&1" > appleseed-benchmark
chmod +x appleseed-benchmark

View File

@@ -0,0 +1,15 @@
#!/bin/sh
unzip -o appleseed-2.0.0-beta-0-g5cff7b96b-win64-vs140.zip
unzip -o emily_1.4.zip
unzip -o disney_material_1.2.zip
unzip -o material_tester_1.4.zip
cp -va emily/* appleseed
cp -va disney_material/* appleseed
cp -va material_tester/* appleseed
echo "#!/bin/bash
cd appleseed
./bin/appleseed.cli.exe --benchmark-mode \$@ > \$LOG_FILE 2>&1" > appleseed-benchmark
chmod +x appleseed-benchmark

View File

@@ -0,0 +1,8 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>render_time=#_RESULT_#</OutputTemplate>
<LineHint>render_time</LineHint>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,46 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>Appleseed</Title>
<AppVersion>2.0 Beta</AppVersion>
<Description>Appleseed is an open-source production renderer focused on physically-based global illumination rendering engine primarily designed for animation and visual effects.</Description>
<ResultScale>Seconds</ResultScale>
<Proportion>LIB</Proportion>
<Executable>appleseed-benchmark</Executable>
<TimesToRun>1</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.0</Version>
<SupportedPlatforms>Linux, Windows</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>System</TestType>
<License>Free</License>
<Status>Verified</Status>
<SupportedArchitectures>x86_64</SupportedArchitectures>
<EnvironmentSize>800</EnvironmentSize>
<ProjectURL>https://appleseedhq.net/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Option>
<DisplayName>Scene</DisplayName>
<Identifier>scene</Identifier>
<Menu>
<Entry>
<Name>Emily</Name>
<Value>emily.appleseed</Value>
</Entry>
<Entry>
<Name>Disney Material</Name>
<Value>disney_material_1.appleseed</Value>
</Entry>
<Entry>
<Name>Material Tester</Name>
<Value>material_tester_ambient_occlusion.appleseed</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,12 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.0.0m2-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://phoronix-test-suite.com/benchmark-files/arrayfire-benchmark-git-20170116.tar.gz</URL>
<MD5>a221ca234f4188c7c43a7a776a5f1aa3</MD5>
<SHA256>26df747a47543946c72f0d5d309620a6998894e45fe81fe2aecac696764fab34</SHA256>
<FileSize>7431207</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,82 @@
#!/bin/sh
# Not all of these dependencies below may be covered automatically by PTS, in particular arrayfire.
# http://arrayfire.com/download-splash/?redirect_to=/download or compile from source from gitub:
# https://github.com/arrayfire/arrayfire
# sudo apt-get install --no-install-recommends libboost-all-dev
#procuring arrayfire is easy! We prefer the no-gl version so we can run headless
# VER=3.4.2; wget http://arrayfire.com/installer_archive/${VER}/ArrayFire-no-gl-v${VER}_Linux_x86_64.sh
#ArrayFire is expected to be installed to /opt
#to install via the shell package ArrayFire supplies - use the prefix option ./ArrayFire-v3.4.2_Linux_x86_64.sh --prefix=/opt
#when prompted with "Do you want to include the subdirectory arrayfire-3?", say yes
#launch with the environment variable OpenCL_INCLUDE_DIR set to the path to cl.h
#e.g. OpenCL_INCLUDE_DIR=/opt/rocm/opencl/include/CL/ phoronix-test-suite install arrayfire
#also make sure to use the correct path to your OpenCL shared library
#e.g. LD_LIBRARY_PATH=/opt/rocm/opencl/lib/x86_64 phoronix-test-suite run arrayfire
if [ -d /usr/local/cuda ]
then
PATH="/usr/local/cuda/bin:$PATH"
export LD_LIBRARY_PATH=/usr/local/cuda/lib64:/usr/local/cuda/nvvm/lib64:$LD_LIBRARY_PATH
export CUDA_TOOLKIT_ROOT_DIR=/usr/local/cuda
if [ -n OpenCL_INCLUDE_DIR ]
then
export OpenCL_INCLUDE_DIR=/usr/local/cuda/include
fi
else
if [ -d /opt/rocm/opencl/lib/x86_64 ]
then
export OpenCL_INCLUDE_DIR=/opt/rocm/opencl/lib/x86_64
elif [ -n OpenCL_INCLUDE_DIR ]
then
export OpenCL_INCLUDE_DIR=/usr/include
fi
fi
rm -rf arrayfire-benchmark.git
tar -xvzf arrayfire-benchmark-git-20170116.tar.gz
if [ ! -e arrayfire-benchmark.git/bin/benchmark_opencl ]
then
pushd arrayfire-benchmark.git
AF_ROOT=`pwd`
./updateLibraries.sh --build --prefix=${AF_ROOT} --cl-path=${OpenCL_INCLUDE_DIR}
pushd build
cmake -DCMAKE_BUILD_TYPE=RelWithDebInfo -DArrayFire_DIR=${AF_ROOT}/arrayfire-3/share/ArrayFire/cmake -DOpenCL_INCLUDE_DIR=${OpenCL_INCLUDE_DIR} ..
#make -j${NUM_CPU_CORES} benchmark_opencl
make -j${NUM_CPU_CORES}
echo $? > ~/install-exit-status
popd
popd
fi
#pushd arrayfire-benchmark.git
cd ~/
echo "#!/bin/sh
cd arrayfire-benchmark.git
if [ -d /usr/local/cuda ]
then
export LD_LIBRARY_PATH=/usr/local/cuda/lib64:/usr/local/cuda/nvvm/lib64:\$LD_LIBRARY_PATH
fi
if [ -d /opt/rocm/opencl/lib/x86_64 ]
then
export LD_LIBRARY_PATH=/opt/rocm/opencl/lib/x86_64:\$LD_LIBRARY_PATH
fi
if [ -n COMPUTE_DEVICE ]
then
export COMPUTE_DEVICE=0
fi
timeout -s SIGKILL --preserve-status 30 ./\$@ -d \${COMPUTE_DEVICE} > \$LOG_FILE
echo \$? > ~/test-exit-status
perl -pi -e 's/\e\[(\d+)(;\d+)*m//g' \$LOG_FILE #scrub ansi codes
awk 'NR > 4 { print \$0 } NR <= 4 { next }' \${LOG_FILE} > \${LOG_FILE}.tmp; mv \${LOG_FILE}.tmp \${LOG_FILE}
grep -v Baseline \${LOG_FILE} > \${LOG_FILE}.tmp; mv \${LOG_FILE}.tmp \${LOG_FILE}
perl -pi -e 's/\e\[(\d+)(;\d+)*m//g' \$LOG_FILE #scrub ansi codes
sed -n '/Celero/,\$p' \$LOG_FILE
awk '/Celero/,0' \$LOG_FILE
awk 'NR > 4 { print \$0 } NR <= 4 { next }' \$LOG_FILE
grep -v Baseline \${LOG_FILE} > \${LOG_FILE}.tmp; mv \${LOG_FILE}.tmp \${LOG_FILE}
" > arrayfire
chmod +x arrayfire

File diff suppressed because it is too large Load Diff

File diff suppressed because it is too large Load Diff

View File

@@ -0,0 +1,12 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v6.0.0m5-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/askap-benchmarks-20151110.tar.gz</URL>
<MD5>5bb53220fddd2b727e57bf530656f15e</MD5>
<SHA256>fba2491eafac9faab6934dab6305bc8de51fc742e7854abd35eaaddf0b3f415e</SHA256>
<FileSize>115132</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,14 @@
#!/bin/sh
tar -zxvf askap-benchmarks-20151110.tar.gz
cd askap-benchmarks/tConvolveCuda
make
echo $? > ~/install-exit-status
cd ~/
echo "#!/bin/sh
cd askap-benchmarks/tConvolveCuda
./tConvolveCuda > \$LOG_FILE
echo \$? > ~/test-exit-status" > askap
chmod +x askap

View File

@@ -0,0 +1,12 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v6.0.0m5-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Gridding rate #_RESULT_#</OutputTemplate>
<MatchToTestArguments>Gridding</MatchToTestArguments>
</ResultsParser>
<ResultsParser>
<OutputTemplate>Degridding rate #_RESULT_#</OutputTemplate>
<MatchToTestArguments>Degridding</MatchToTestArguments>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,49 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v6.0.0m5-->
<PhoronixTestSuite>
<TestInformation>
<Title>ASKAP tConvolveCuda</Title>
<AppVersion>2015-11-10</AppVersion>
<Description>This is a CUDA benchmark of ATNF's ASKAP Benchmark with currently using the tConvolveCuda sub-test.</Description>
<ResultScale>Million Grid Points Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.0.0</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Benchmark</SoftwareType>
<TestType>Graphics</TestType>
<License>Free</License>
<Status>Verified</Status>
<ExternalDependencies>build-utilities, cuda</ExternalDependencies>
<EnvironmentSize>1</EnvironmentSize>
<ProjectURL>https://github.com/ATNF/askap-benchmarks</ProjectURL>
<InternalTags>CUDA</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Default>
<AllowCacheShare>TRUE</AllowCacheShare>
</Default>
<Option>
<DisplayName>Processing</DisplayName>
<Identifier>processing</Identifier>
<ArgumentPrefix></ArgumentPrefix>
<ArgumentPostfix></ArgumentPostfix>
<DefaultEntry>0</DefaultEntry>
<Menu>
<Entry>
<Name>Gridding</Name>
<Value>Gridding</Value>
<Message></Message>
</Entry>
<Entry>
<Name>Degridding</Name>
<Value>Degridding</Value>
<Message></Message>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.0m1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/asmFish-20180723.zip</URL>
<MD5>15c79b8378787f5fee0a37ccc22fe97f</MD5>
<SHA256>f03f6c037ad37cde553ffd02efb4643a43a71cbb4942c809aeb22db12cb1e0c1</SHA256>
<FileName>asmFish-20180723.zip</FileName>
<FileSize>2207999</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,16 @@
#!/bin/sh
unzip -o asmFish-20180723.zip
cd asmFish-master
chmod +x LinuxOS_binaries/*
cd ~
echo "#!/bin/sh
cd asmFish-master
if [ \$OS_ARCH = \"aarch64\" ]
then
echo \"bench 1024 \$NUM_CPU_CORES 26\" | ./LinuxOS_binaries/armFishL_2018-07-23_v8 > \$LOG_FILE 2>&1
else
echo \"bench 1024 \$NUM_CPU_CORES 26\" | ./LinuxOS_binaries/asmFishL_2018-07-23_base > \$LOG_FILE 2>&1
fi" > asmfish
chmod +x asmfish

View File

@@ -0,0 +1,11 @@
#!/bin/sh
unzip -o asmFish-20180723.zip
cd asmFish-master
chmod +x MacOS_binaries/*
cd ~
echo "#!/bin/sh
cd asmFish-master
echo \"bench 1024 \$NUM_CPU_CORES 26\" | ./asmFishX_2018-07-23_base > \$LOG_FILE 2>&1" > asmfish
chmod +x asmfish

View File

@@ -0,0 +1,8 @@
#!/bin/sh
unzip -o asmFish-20180723.zip
echo "#!/bin/sh
cd asmFish-master/WindowsOS_binaries
echo \"bench 1024 \$NUM_CPU_CORES 26\" | ./asmFishW_2018-07-23_base.exe > \$LOG_FILE 2>&1" > asmfish
chmod +x asmfish

View File

@@ -0,0 +1,7 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.0m1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Nodes/second : #_RESULT_#</OutputTemplate>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,25 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.6.0m1-->
<PhoronixTestSuite>
<TestInformation>
<Title>asmFish</Title>
<AppVersion>2018-07-23</AppVersion>
<Description>This is a test of asmFish, an advanced chess benchmark written in Assembly.</Description>
<ResultScale>Nodes/second</ResultScale>
<Proportion>HIB</Proportion>
<SubTitle>1024 Hash Memory, 26 Depth</SubTitle>
<TimesToRun>3</TimesToRun>
</TestInformation>
<TestProfile>
<Version>1.1.1</Version>
<SupportedPlatforms>Linux, Windows, MacOSX</SupportedPlatforms>
<SoftwareType>Utility</SoftwareType>
<TestType>Processor</TestType>
<License>Free</License>
<Status>Verified</Status>
<EnvironmentSize>5</EnvironmentSize>
<ProjectURL>https://github.com/lantonov/asmFish/</ProjectURL>
<InternalTags>SMP</InternalTags>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
</PhoronixTestSuite>

View File

@@ -0,0 +1,13 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<Downloads>
<Package>
<URL>http://www.phoronix-test-suite.com/benchmark-files/batman-arkham-origins-config-1.zip</URL>
<MD5>baa176aaa93fe9927bb407fbcd80a443</MD5>
<SHA256>92e5d6b46491a36a4722eb97e7b0a84c2ab97d7292281fe3b2d94c5fe7d8dce5</SHA256>
<FileName>batman-arkham-origins-config-1.zip</FileName>
<FileSize>1077</FileSize>
</Package>
</Downloads>
</PhoronixTestSuite>

View File

@@ -0,0 +1,30 @@
#!/bin/sh
if which steam>/dev/null 2>&1 ;
then
echo 0 > ~/install-exit-status
else
echo "ERROR: Steam is not found on the system! This test profile needs a working Steam installation in the PATH"
echo 2 > ~/install-exit-status
fi
HOME=$DEBUG_REAL_HOME steam steam://install/209000
unzip -o batman-arkham-origins-config-1.zip
cp -f GFXSettings.BatmanArkhamOrigins.xml $DEBUG_REAL_HOME/.steam/steam/steamapps/compatdata/209000/pfx/drive_c/users/steamuser/My\ Documents/WB\ Games/Batman\ Arkham\ Origins/
echo "#!/bin/bash
rm -f \$DEBUG_REAL_HOME/.steam/steam/steamapps/common/Batman\ Arkham\ Origins/SinglePlayer/BMGame/Logs/benchmark.log
cp -f GFXSettings.BatmanArkhamOrigins.xml \$DEBUG_REAL_HOME/.steam/steam/steamapps/compatdata/209000/pfx/drive_c/users/steamuser/My\ Documents/WB\ Games/Batman\ Arkham\ Origins/
HOME=\$DEBUG_REAL_HOME steam -applaunch 209000 Benchmark ResX=\$1 ResY=\$2
sleep 30
while [ ! -f \$DEBUG_REAL_HOME/.steam/steam/steamapps/common/Batman\ Arkham\ Origins/SinglePlayer/BMGame/Logs/benchmark.log ]
do
sleep 2
done
killall -9 BatmanOrigins.e
killall -9 BatmanOrigins.exe
cat \$DEBUG_REAL_HOME/.steam/steam/steamapps/common/Batman\ Arkham\ Origins/SinglePlayer/BMGame/Logs/benchmark.log > \$LOG_FILE" > batman-origins
chmod +x batman-origins

View File

@@ -0,0 +1,8 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<ResultsParser>
<OutputTemplate>Min = #_MIN_RESULT_# Max = #_MAX_RESULT_# Avg = #_RESULT_#</OutputTemplate>
<LineHint>Avg =</LineHint>
</ResultsParser>
</PhoronixTestSuite>

View File

@@ -0,0 +1,38 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v8.8.1-->
<PhoronixTestSuite>
<TestInformation>
<Title>Batman: Arkham Origins</Title>
<Description>This is a benchmark of &gt;Batman: Arkham Origins running under Steam Play (Proton) on Linux. The test profile assumes you have a Steam account, have Steam installed for the system, and that Batman: Arkham Origins is already purchased/installed. This automates the process of executing the game and using a standardized time demo.</Description>
<ResultScale>Frames Per Second</ResultScale>
<Proportion>HIB</Proportion>
<TimesToRun>3</TimesToRun>
<PreInstallMessage>This test will attempt to install the necessary game using your Steam account. If the test appears hung you may need to manually exit the Steam client.</PreInstallMessage>
</TestInformation>
<TestProfile>
<Version>1.6.1</Version>
<SupportedPlatforms>Linux</SupportedPlatforms>
<SoftwareType>Game</SoftwareType>
<TestType>Graphics</TestType>
<License>Retail</License>
<Status>Verified</Status>
<SupportedArchitectures>x86, x86_64</SupportedArchitectures>
<ExternalDependencies>steam</ExternalDependencies>
<RequiresDisplay>TRUE</RequiresDisplay>
<EnvironmentSize>4</EnvironmentSize>
<ProjectURL>https://store.steampowered.com/agecheck/app/209000/</ProjectURL>
<Maintainer>Michael Larabel</Maintainer>
</TestProfile>
<TestSettings>
<Option>
<DisplayName>Resolution</DisplayName>
<Identifier>auto-resolution</Identifier>
<Menu>
<Entry>
<Name>$VIDEO_WIDTH x $VIDEO_HEIGHT</Name>
<Value>$VIDEO_WIDTH $VIDEO_HEIGHT</Value>
</Entry>
</Menu>
</Option>
</TestSettings>
</PhoronixTestSuite>

View File

@@ -0,0 +1,10 @@
#!/bin/sh
echo "#!/bin/sh
sleep 60
xset dpms force off
sleep 60
xset dpms force on
sleep 5
\$TEST_MPLAYER_BASE/mplayer -vo xv -fs \$TEST_VIDEO_SAMPLE/Grey.ts" > battery-power-usage
chmod +x battery-power-usage

View File

@@ -0,0 +1,9 @@
<?xml version="1.0"?>
<!--Phoronix Test Suite v3.0.0a3 (Iveland) [ http://www.phoronix-test-suite.com/ ]-->
<PhoronixTestSuite>
<SystemMonitor>
<Sensor>sys.power</Sensor>
<PollingFrequency>1</PollingFrequency>
<Report>ALL</Report>
</SystemMonitor>
</PhoronixTestSuite>

Some files were not shown because too many files have changed in this diff Show More