{"id":1978,"date":"2024-03-04T02:50:38","date_gmt":"2024-03-04T02:50:38","guid":{"rendered":"https:\/\/mvermeulen.org\/perf\/?p=1978"},"modified":"2024-03-04T02:51:12","modified_gmt":"2024-03-04T02:51:12","slug":"200-phoronix-tests","status":"publish","type":"post","link":"https:\/\/mvermeulen.org\/perf\/2024\/03\/04\/200-phoronix-tests\/","title":{"rendered":"200 phoronix tests"},"content":{"rendered":"\n

I passed over 200 Phoronix tests added. There were a little over 10 benchmark articles in February. I seem to have most all the benchmarks when an article comes out and only needed to add one or two for some of them. So I think I am coming closer to saturating the number of (non-graphics) test cases. There are still some looking at the list of available tests and so I have been gradually adding a few stragglers but expect it to top out around 250 applications.<\/p>\n\n\n\n

One thing that is nice about this population is that it lets me look at some aggregate statistics about the types of tests, e.g. below is an IPC profile followed by a retirement rate example.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

Here is a profile about the amount of “on_core” for these compared to the 16-cores available. This shows an interesting distribution with the largest number of single-threaded applications and then a small number running on all cores.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Unlike a test set like SPEC CPU specifically designed to run mostly all the time on the CPU, this is a broader set of applications with different blocking issues including not necessarily being on the CPU. A tradeoff the other direction is that it isn’t as easy to see the effects of compilers and optimizations for these tests.<\/p>\n\n\n\n

As I get closer to an asymptotic limit of ~250 there can also now be other directions. Perhaps diving deeper into the CPU type metrics, or perhaps going deeper on a CPU-specific benchmark with different options?<\/p>\n","protected":false},"excerpt":{"rendered":"

I passed over 200 Phoronix tests added. There were a little over 10 benchmark articles in February. I seem to have most all the benchmarks when an article comes out and only needed to add one or two for some …<\/span> Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[11],"tags":[23,22],"class_list":["post-1978","post","type-post","status-publish","format-standard","hentry","category-experiment","tag-benchmarks","tag-phoronix"],"_links":{"self":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/posts\/1978","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/comments?post=1978"}],"version-history":[{"count":1,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/posts\/1978\/revisions"}],"predecessor-version":[{"id":1982,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/posts\/1978\/revisions\/1982"}],"wp:attachment":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/media?parent=1978"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/categories?post=1978"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/tags?post=1978"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}