{"id":2120,"date":"2024-03-20T12:16:28","date_gmt":"2024-03-20T12:16:28","guid":{"rendered":"https:\/\/mvermeulen.org\/perf\/?page_id=2120"},"modified":"2024-03-22T00:20:16","modified_gmt":"2024-03-22T00:20:16","slug":"qmcpack","status":"publish","type":"page","link":"https:\/\/mvermeulen.org\/perf\/workloads\/phoronix\/qmcpack\/","title":{"rendered":"qmcpack"},"content":{"rendered":"\n<p>A open source Quantum Monte Carlo (QMC) simulation code with six workloads using MPI.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1280\" height=\"960\" src=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/systemtime-36.png\" alt=\"\" class=\"wp-image-2139\" srcset=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/systemtime-36.png 1280w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/systemtime-36-1024x768.png 1024w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/systemtime-36-768x576.png 768w\" sizes=\"auto, (max-width: 1280px) 100vw, 1280px\" \/><\/figure>\n\n\n\n<p>Topdown profile shows differences among workloads but overall a moderatly high retirement rate.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1280\" height=\"960\" src=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/amdtopdown-38.png\" alt=\"\" class=\"wp-image-2141\" srcset=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/amdtopdown-38.png 1280w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/amdtopdown-38-1024x768.png 1024w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/03\/amdtopdown-38-768x576.png 768w\" sizes=\"auto, (max-width: 1280px) 100vw, 1280px\" \/><\/figure>\n\n\n\n<p>AMD metrics confirm this is floating point code with a low L2 miss rate. Frontend stalls including opcache misses and icache misses are higher.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>elapsed              2499.876\non_cpu               0.471          # 7.53 \/ 16 cores\nutime                18540.133\nstime                279.802\nnvcsw                267253         # 87.33%\nnivcsw               38781          # 12.67%\ninblock              0              # 0.00\/sec\nonblock              612760         # 245.12\/sec\ncpu-clock            18820238026460 # 18820.238 seconds\ntask-clock           18820339009536 # 18820.339 seconds\npage faults          3109375        # 165.214\/sec\ncontext switches     318172         # 16.906\/sec\ncpu migrations       21668          # 1.151\/sec\nmajor page faults    3045           # 0.162\/sec\nminor page faults    3106330        # 165.052\/sec\nalignment faults     0              # 0.000\/sec\nemulation faults     0              # 0.000\/sec\nbranches             22461830733574 # 112.402 branches per 1000 inst\nbranch misses        95072047637    # 0.42% branch miss\nconditional          15351486721874 # 76.821 conditional branches per 1000 inst\nindirect             1594633030241  # 7.980 indirect branches per 1000 inst\ncpu-cycles           81503776961511 # 1.87 GHz\ninstructions         216873675248429 # 2.66 IPC\nslots                163024728552936 #\nretiring             74147801543055 # 45.5% (45.5%)\n-- ucode             223663585020   #     0.1%\n-- fastpath          73924137958035 #    45.3%\nfrontend             33251313416882 # 20.4% (20.4%)\n-- latency           15458432843526 #     9.5%\n-- bandwidth         17792880573356 #    10.9%\nbackend              52902396193136 # 32.5% (32.5%)\n-- cpu               28130036258952 #    17.3%\n-- memory            24772359934184 #    15.2%\nspeculation          2652527659474  #  1.6% ( 1.6%)\n-- branch mispredict 2312381697199  #     1.4%\n-- pipeline restart  340145962275   #     0.2%\nsmt-contention       70637863915    #  0.0% ( 0.0%)\ncpu-cycles           70056047900986 # 1.89 GHz\ninstructions         184301782099454 # 2.63 IPC\ninstructions         61443640810233 # 58.085 l2 access per 1000 inst\nl2 hit from l1       3203344833251  # 1.45% l2 miss\nl2 miss from l1      27545024648    #\nl2 hit from l2 pf    341279478407   #\nl3 hit from l2 pf    22923123161    #\nl3 miss from l2 pf   1419531841     #\ninstructions         61414388678104 # 189.442 float per 1000 inst\nfloat 512            124            # 0.000 AVX-512 per 1000 inst\nfloat 256            1028           # 0.000 AVX-256 per 1000 inst\nfloat 128            11634484218727 # 189.442 AVX-128 per 1000 inst\nfloat MMX            0              # 0.000 MMX per 1000 inst\nfloat scalar         7              # 0.000 scalar per 1000 inst\ninstructions         183320760693268 #\nopcache              25758437755830 # 140.510 opcache per 1000 inst\nopcache miss         8035610764180  # 31.2% opcache miss rate\nl1 dTLB miss         926871253871   # 5.056 L1 dTLB per 1000 inst\nl2 dTLB miss         4877453192     # 0.027 L2 dTLB per 1000 inst\ninstructions         216933399893634 #\nicache               12980381188061 # 59.836 icache per 1000 inst\nicache miss          5639705054563  # 43.4% icache miss rate\nl1 iTLB miss         672008848887   # 3.098 L1 iTLB per 1000 inst\nl2 iTLB miss         0              # 0.000 L2 iTLB per 1000 inst\ntlb flush            614276         # 0.000 TLB flush per 1000 inst\n<\/code><\/pre>\n\n\n\n<p>Intel metrics confirm a low dram rate and overall have a low level of backend stalls.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>elapsed              5737.400\non_cpu               0.734          # 11.74 \/ 16 cores\nutime                67038.996\nstime                300.316\nnvcsw                304024         # 75.55%\nnivcsw               98410          # 24.45%\ninblock              318032         # 55.43\/sec\nonblock              509584         # 88.82\/sec\ncpu-clock            67339817205818 # 67339.817 seconds\ntask-clock           67339907346354 # 67339.907 seconds\npage faults          2014512        # 29.916\/sec\ncontext switches     430696         # 6.396\/sec\ncpu migrations       48520          # 0.721\/sec\nmajor page faults    5995           # 0.089\/sec\nminor page faults    2008517        # 29.827\/sec\nalignment faults     0              # 0.000\/sec\nemulation faults     0              # 0.000\/sec\nbranches             59500946712395 # 127.456 branches per 1000 inst\nbranch misses        197934244602   # 0.33% branch miss\nconditional          59500946747051 # 127.456 conditional branches per 1000 inst\nindirect             13124976106133 # 28.115 indirect branches per 1000 inst\nslots                415180653423602 #\nretiring             273696487216963 # 65.9% (65.9%) high\n-- ucode             20184709555080 #     4.9%\n-- fastpath          253511777661883 #    61.1%\nfrontend             61819690085221 # 14.9% (14.9%)\n-- latency           17123034533870 #     4.1%\n-- bandwidth         44696655551351 #    10.8%\nbackend              60638837676964 # 14.6% (14.6%) low\n-- cpu               44744051942427 #    10.8%\n-- memory            15894785734537 #     3.8%\nspeculation          17966962240492 #  4.3% ( 4.3%)\n-- branch mispredict 12994602079182 #     3.1%\n-- pipeline restart  4972360161310  #     1.2%\nsmt-contention       0              #  0.0% ( 0.0%)\ncpu-cycles           208272485168282 # 2.00 GHz\ninstructions         843020141703026 # 4.05 IPC high\nl2 access            4483162925590  # 14.309 l2 access per 1000 inst\nl2 miss              43256958269    # 0.96% l2 miss\ncpu-cycles           68419223332582 #  6.8% memory latency\nload stalls          3123740243951  #  0.0% l1 bound\nl1 miss              3242717002137  #  4.6% l2 bound\nl2 miss              98796768732    #  0.1% l3 bound\nl3 miss              53243773665    #  0.1% dram bound\nstore_stalls         1510444863594  #  2.2% store bound\n<\/code><\/pre>\n\n\n\n<p>Process overview shows qmcpack as the primary process<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>1243 processes\n\t725 qmcpack              59023.27   889.06\n\t 68 clinfo                  17.18     6.52\n\t174 mpirun                   8.26    22.61\n\t 38 vulkaninfo               1.33     1.15\n\t  4 vulkani:disk$0           0.14     0.13\n\t  6 php                      0.08     0.44\n\t  2 llvmpipe-0               0.07     0.07\n\t  2 llvmpipe-1               0.07     0.07\n\t  2 llvmpipe-10              0.07     0.07\n\t  2 llvmpipe-11              0.07     0.07\n\t  2 llvmpipe-12              0.07     0.07\n\t  2 llvmpipe-13              0.07     0.07\n\t  2 llvmpipe-14              0.07     0.07\n\t  2 llvmpipe-15              0.07     0.07\n\t  2 llvmpipe-2               0.07     0.07\n\t  2 llvmpipe-3               0.07     0.07\n\t  2 llvmpipe-4               0.07     0.07\n\t  2 llvmpipe-5               0.07     0.07\n\t  2 llvmpipe-6               0.07     0.07\n\t  2 llvmpipe-7               0.07     0.07\n\t  2 llvmpipe-8               0.07     0.07\n\t  2 llvmpipe-9               0.07     0.07\n\t  6 clang                    0.04     0.08\n\t  3 rocminfo                 0.00     0.03\n\t  1 lspci                    0.00     0.03\n\t  1 ps                       0.00     0.01\n\t 95 sh                       0.00     0.00\n\t 13 gcc                      0.00     0.00\n\t 12 gsettings                0.00     0.00\n\t  8 stat                     0.00     0.00\n\t  8 systemd-detect-          0.00     0.00\n\t  6 llvm-link                0.00     0.00\n\t  5 phoronix-test-s          0.00     0.00\n\t  4 glxinfo                  0.00     0.00\n\t  3 gmain                    0.00     0.00\n\t  2 cc                       0.00     0.00\n\t  2 lscpu                    0.00     0.00\n\t  2 setterm                  0.00     0.00\n\t  2 uname                    0.00     0.00\n\t  2 which                    0.00     0.00\n\t  1 date                     0.00     0.00\n\t  1 dconf worker             0.00     0.00\n\t  1 dirname                  0.00     0.00\n\t  1 dmesg                    0.00     0.00\n\t  1 dmidecode                0.00     0.00\n\t  1 grep                     0.00     0.00\n\t  1 ifconfig                 0.00     0.00\n\t  1 ip                       0.00     0.00\n\t  1 lsmod                    0.00     0.00\n\t  1 mktemp                   0.00     0.00\n\t  1 python                   0.00     0.00\n\t  1 python3                  0.00     0.00\n\t  1 qdbus                    0.00     0.00\n\t  1 readlink                 0.00     0.00\n\t  1 realpath                 0.00     0.00\n\t  1 sed                      0.00     0.00\n\t  1 sort                     0.00     0.00\n\t  1 stty                     0.00     0.00\n\t  1 systemctl                0.00     0.00\n\t  1 template.sh              0.00     0.00\n\t  1 wc                       0.00     0.00\n0 processes running\n47 maximum processes\n<\/code><\/pre>\n\n\n\n<p>Computation blocks<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>      175875) qmcpack          cpu=3 start=6.32  finish=34.76\n        175876) mpirun           cpu=13 start=6.32  finish=34.73\n          175880) mpirun           cpu=2 start=6.52  finish=34.73\n          175881) mpirun           cpu=14 start=6.52  finish=6.52 \n          175882) mpirun           cpu=3 start=6.54  finish=34.73\n          175884) mpirun           cpu=6 start=6.64  finish=34.73\n          175885) mpirun           cpu=8 start=6.64  finish=34.73\n          175886) qmcpack          cpu=8 start=6.68  finish=34.72\n            175894) qmcpack          cpu=13 start=6.71  finish=34.72\n            175895) qmcpack          cpu=10 start=6.71  finish=34.72\n          175887) qmcpack          cpu=5 start=6.68  finish=34.72\n            175896) qmcpack          cpu=13 start=6.72  finish=34.72\n            175897) qmcpack          cpu=4 start=6.72  finish=34.72\n          175888) qmcpack          cpu=9 start=6.68  finish=34.72\n            175898) qmcpack          cpu=1 start=6.72  finish=34.72\n            175900) qmcpack          cpu=7 start=6.72  finish=34.72\n          175889) qmcpack          cpu=14 start=6.69  finish=34.72\n            175899) qmcpack          cpu=11 start=6.72  finish=34.72\n            175901) qmcpack          cpu=11 start=6.73  finish=34.72\n          175890) qmcpack          cpu=7 start=6.69  finish=34.72\n            175902) qmcpack          cpu=11 start=6.73  finish=34.72\n            175903) qmcpack          cpu=13 start=6.73  finish=34.72\n          175891) qmcpack          cpu=12 start=6.70  finish=34.72\n            175904) qmcpack          cpu=10 start=6.73  finish=34.72\n            175905) qmcpack          cpu=14 start=6.74  finish=34.72\n          175892) qmcpack          cpu=2 start=6.70  finish=34.72\n            175906) qmcpack          cpu=6 start=6.74  finish=34.72\n            175907) qmcpack          cpu=10 start=6.74  finish=34.72\n          175893) qmcpack          cpu=0 start=6.71  finish=34.72\n            175908) qmcpack          cpu=13 start=6.74  finish=34.72\n            175909) qmcpack          cpu=6 start=6.75  finish=34.72\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>A open source Quantum Monte Carlo (QMC) simulation code with six workloads using MPI. Topdown profile shows differences among workloads but overall a moderatly high retirement rate. AMD metrics confirm this is floating point code with a low L2 miss <span class=\"excerpt-dots\">&hellip;<\/span> <a class=\"more-link\" href=\"https:\/\/mvermeulen.org\/perf\/workloads\/phoronix\/qmcpack\/\"><span class=\"more-msg\">Continue reading &rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":58,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-2120","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/2120","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/comments?post=2120"}],"version-history":[{"count":2,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/2120\/revisions"}],"predecessor-version":[{"id":2142,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/2120\/revisions\/2142"}],"up":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/58"}],"wp:attachment":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/media?parent=2120"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}