{"id":1135,"date":"2024-01-31T01:11:25","date_gmt":"2024-01-31T01:11:25","guid":{"rendered":"https:\/\/mvermeulen.org\/perf\/?page_id=1135"},"modified":"2024-01-31T14:19:15","modified_gmt":"2024-01-31T14:19:15","slug":"darktable","status":"publish","type":"page","link":"https:\/\/mvermeulen.org\/perf\/workloads\/phoronix\/darktable\/","title":{"rendered":"darktable"},"content":{"rendered":"\n<p>A photography workflow program. Looks to be mostly single-threaded with small sections of multi-threaded routines. There are eight workloads overall.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1280\" height=\"960\" src=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/systemtime-92.png\" alt=\"\" class=\"wp-image-1185\" srcset=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/systemtime-92.png 1280w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/systemtime-92-1024x768.png 1024w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/systemtime-92-768x576.png 768w\" sizes=\"auto, (max-width: 1280px) 100vw, 1280px\" \/><\/figure>\n\n\n\n<p>Topdown profile shows backend stalls as highest amount but also variation through the workload.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1280\" height=\"960\" src=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/amdtopdown-129.png\" alt=\"\" class=\"wp-image-1187\" srcset=\"https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/amdtopdown-129.png 1280w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/amdtopdown-129-1024x768.png 1024w, https:\/\/mvermeulen.org\/perf\/wp-content\/uploads\/sites\/7\/2024\/01\/amdtopdown-129-768x576.png 768w\" sizes=\"auto, (max-width: 1280px) 100vw, 1280px\" \/><\/figure>\n\n\n\n<p>AMD metrics have 2.5 cores on average, a low frontend stall rate and backend memory-bound stalls. This workload has a large amount of floating point code.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>elapsed              318.710\non_cpu               0.156          # 2.50 \/ 16 cores\nutime                737.522\nstime                58.055\nnvcsw                35946          # 62.29%\nnivcsw               21758          # 37.71%\ninblock              8              # 0.03\/sec\nonblock              2734304        # 8579.29\/sec\ncpu-clock            796090077692   # 796.090 seconds\ntask-clock           796163209420   # 796.163 seconds\npage faults          19068517       # 23950.513\/sec\ncontext switches     58917          # 74.001\/sec\ncpu migrations       1547           # 1.943\/sec\nmajor page faults    1013           # 1.272\/sec\nminor page faults    19067504       # 23949.240\/sec\nalignment faults     0              # 0.000\/sec\nemulation faults     0              # 0.000\/sec\nbranches             268134978685   # 79.288 branches per 1000 inst\nbranch misses        7152723323     # 2.67% branch miss\nconditional          200250495977   # 59.215 conditional branches per 1000 inst\nindirect             10094382421    # 2.985 indirect branches per 1000 inst\ncpu-cycles           3209534826821  # 0.58 GHz\ninstructions         3434442494493  # 1.07 IPC\nslots                6459127457736  #\nretiring             1178756730721  # 18.2% (23.8%)\n-- ucode             1722488775     #     0.0%\n-- fastpath          1177034241946  #    18.2%\nfrontend             509373878078   #  7.9% (10.3%)\n-- latency           331597892352   #     5.1%\n-- bandwidth         177775985726   #     2.8%\nbackend              3179350583579  # 49.2% (64.1%)\n-- cpu               1196276616296  #    18.5%\n-- memory            1983073967283  #    30.7%\nspeculation          91606138822    #  1.4% ( 1.8%)\n-- branch mispredict 89770227189    #     1.4%\n-- pipeline restart  1835911633     #     0.0%\nsmt-contention       1500034133018  # 23.2% ( 0.0%)\ncpu-cycles           3004312300770  # 0.75 GHz\ninstructions         3172733040890  # 1.06 IPC\ninstructions         1057887047426  # 35.418 l2 access per 1000 inst\nl2 hit from l1       21896760191    # 15.47% l2 miss\nl2 miss from l1      2039049679     #\nl2 hit from l2 pf    11815001082    #\nl3 hit from l2 pf    1765059884     #\nl3 miss from l2 pf   1991532654     #\ninstructions         1058376511518  # 540.731 float per 1000 inst\nfloat 512            117            # 0.000 AVX-512 per 1000 inst\nfloat 256            1006           # 0.000 AVX-256 per 1000 inst\nfloat 128            572297164157   # 540.731 AVX-128 per 1000 inst\nfloat MMX            0              # 0.000 MMX per 1000 inst\nfloat scalar         90             # 0.000 scalar per 1000 inst\n<\/code><\/pre>\n\n\n\n<p>Intel metrics<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>elapsed              312.031\non_cpu               0.252          # 4.03 \/ 16 cores\nutime                1208.602\nstime                47.772\nnvcsw                30863          # 59.03%\nnivcsw               21420          # 40.97%\ninblock              221888         # 711.11\/sec\nonblock              2140232        # 6859.03\/sec\ncpu-clock            1256750837194  # 1256.751 seconds\ntask-clock           1256786792414  # 1256.787 seconds\npage faults          22902743       # 18223.252\/sec\ncontext switches     53430          # 42.513\/sec\ncpu migrations       3496           # 2.782\/sec\nmajor page faults    1326           # 1.055\/sec\nminor page faults    22901417       # 18222.197\/sec\nalignment faults     0              # 0.000\/sec\nemulation faults     0              # 0.000\/sec\nbranches             376573690433   # 67.205 branches per 1000 inst\nbranch misses        3641086802     # 0.97% branch miss\nconditional          376573750433   # 67.205 conditional branches per 1000 inst\nindirect             111927884967   # 19.975 indirect branches per 1000 inst\nslots                6764155658858  #\nretiring             2794454922645  # 41.3% (41.3%)\n-- ucode             122503399321   #     1.8%\n-- fastpath          2671951523324  #    39.5%\nfrontend             1042775302935  # 15.4% (15.4%)\n-- latency           870858587139   #    12.9%\n-- bandwidth         171916715796   #     2.5%\nbackend              2616276822011  # 38.7% (38.7%)\n-- cpu               1470293134285  #    21.7%\n-- memory            1145983687726  #    16.9%\nspeculation          337831189831   #  5.0% ( 5.0%)\n-- branch mispredict 300555284759   #     4.4%\n-- pipeline restart  37275905072    #     0.6%\nsmt-contention       0              #  0.0% ( 0.0%)\ncpu-cycles           3048556218080  # 0.76 GHz\ninstructions         4131891600459  # 1.36 IPC\nl2 access            63172361667    # 22.699 l2 access per 1000 inst\nl2 miss              16933081355    # 26.80% l2 miss\n<\/code><\/pre>\n\n\n\n<p>Process overview shows things being exercised from darktable-cli and three processes for primary operations. In this and other profiles, interesting to see &#8220;lua thread&#8221; have a large amount of system time and no user time.<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>2083 processes\n\t1253 darktable-cli        22637.81  1777.15\n\t 37 gdbus                  751.43    58.06\n\t 37 pool-darktable-        751.43    58.06\n\t 40 gmain                  751.42    58.06\n\t238 clinfo                  63.17    22.21\n\t 38 vulkaninfo               0.94     1.33\n\t  6 php                      0.12     0.22\n\t  6 glxinfo:gdrv0            0.11     0.07\n\t  6 glxinfo:gl0              0.11     0.07\n\t  4 vulkani:disk$0           0.10     0.14\n\t  2 glxinfo                  0.06     0.04\n\t  2 llvmpipe-0               0.05     0.07\n\t  2 llvmpipe-1               0.05     0.07\n\t  2 llvmpipe-10              0.05     0.07\n\t  2 llvmpipe-11              0.05     0.07\n\t  2 llvmpipe-12              0.05     0.07\n\t  2 llvmpipe-13              0.05     0.07\n\t  2 llvmpipe-14              0.05     0.07\n\t  2 llvmpipe-15              0.05     0.07\n\t  2 llvmpipe-2               0.05     0.07\n\t  2 llvmpipe-3               0.05     0.07\n\t  2 llvmpipe-4               0.05     0.07\n\t  2 llvmpipe-5               0.05     0.07\n\t  2 llvmpipe-6               0.05     0.07\n\t  2 llvmpipe-7               0.05     0.07\n\t  2 llvmpipe-8               0.05     0.07\n\t  2 llvmpipe-9               0.05     0.07\n\t  2 glxinfo:cs0              0.05     0.03\n\t  2 glxinfo:disk$0           0.05     0.03\n\t  2 glxinfo:sh0              0.05     0.03\n\t  2 glxinfo:shlo0            0.05     0.03\n\t  3 rocminfo                 0.03     0.00\n\t  6 clang                    0.02     0.06\n\t  1 lspci                    0.01     0.01\n\t 37 lua thread               0.00   751.28\n\t  1 ps                       0.00     0.01\n\t100 sh                       0.00     0.00\n\t 37 awk                      0.00     0.00\n\t 37 darktable                0.00     0.00\n\t 37 head                     0.00     0.00\n\t 37 rm                       0.00     0.00\n\t 12 gcc                      0.00     0.00\n\t 12 gsettings                0.00     0.00\n\t  8 stat                     0.00     0.00\n\t  8 systemd-detect-          0.00     0.00\n\t  6 llvm-link                0.00     0.00\n\t  5 phoronix-test-s          0.00     0.00\n\t  2 lscpu                    0.00     0.00\n\t  2 uname                    0.00     0.00\n\t  2 which                    0.00     0.00\n\t  2 xset                     0.00     0.00\n\t  1 cc                       0.00     0.00\n\t  1 date                     0.00     0.00\n\t  1 dconf worker             0.00     0.00\n\t  1 dirname                  0.00     0.00\n\t  1 dmesg                    0.00     0.00\n\t  1 dmidecode                0.00     0.00\n\t  1 grep                     0.00     0.00\n\t  1 ifconfig                 0.00     0.00\n\t  1 ip                       0.00     0.00\n\t  1 lsmod                    0.00     0.00\n\t  1 mktemp                   0.00     0.00\n\t  1 qdbus                    0.00     0.00\n\t  1 readlink                 0.00     0.00\n\t  1 realpath                 0.00     0.00\n\t  1 sed                      0.00     0.00\n\t  1 sort                     0.00     0.00\n\t  1 stty                     0.00     0.00\n\t  1 systemctl                0.00     0.00\n\t  1 template.sh              0.00     0.00\n\t  1 wc                       0.00     0.00\n\t  1 xrandr                   0.00     0.00\n0 processes running\n47 maximum processes\n<\/code><\/pre>\n\n\n\n<p>Example computation block<\/p>\n\n\n\n<pre class=\"wp-block-code\"><code>      2442841) darktable        cpu=9 start=6.38  finish=13.11\n        2442842) rm               cpu=14 start=6.38  finish=6.39 \n        2442843) darktable-cli    cpu=2 start=6.39  finish=13.04\n          2442844) gmain            cpu=6 start=6.43  finish=13.04\n          2442845) gdbus            cpu=8 start=6.43  finish=13.04\n          2442848) darktable-cli    cpu=11 start=6.51  finish=13.04\n          2442849) darktable-cli    cpu=4 start=6.51  finish=6.51 \n          2442850) darktable-cli    cpu=7 start=6.51  finish=6.51 \n          2442851) darktable-cli    cpu=13 start=6.51  finish=13.03\n          2442852) lua thread       cpu=-1 start=6.97  finish=12.95\n            2442853) pool-darktable-  cpu=14 start=6.97  finish=13.04\n          2442854) darktable-cli    cpu=4 start=7.11  finish=13.04\n          2442855) darktable-cli    cpu=5 start=7.11  finish=13.04\n          2442856) darktable-cli    cpu=7 start=7.11  finish=13.04\n          2442857) darktable-cli    cpu=9 start=7.11  finish=13.04\n          2442858) darktable-cli    cpu=1 start=7.11  finish=13.04\n          2442859) darktable-cli    cpu=3 start=7.11  finish=13.04\n          2442860) darktable-cli    cpu=15 start=7.11  finish=13.04\n          2442861) darktable-cli    cpu=10 start=7.11  finish=13.04\n          2442862) darktable-cli    cpu=12 start=7.11  finish=13.04\n          2442863) darktable-cli    cpu=0 start=7.11  finish=13.04\n          2442864) darktable-cli    cpu=13 start=7.11  finish=13.04\n          2442865) darktable-cli    cpu=8 start=7.11  finish=13.04\n          2442866) darktable-cli    cpu=14 start=7.11  finish=13.04\n          2442867) darktable-cli    cpu=3 start=7.11  finish=13.04\n          2442868) darktable-cli    cpu=13 start=7.11  finish=13.04\n        2442873) darktable-cli    cpu=3 start=13.08 finish=13.10\n        2442874) head             cpu=13 start=13.08 finish=13.10\n        2442875) awk              cpu=0 start=13.08 finish=13.10\n<\/code><\/pre>\n","protected":false},"excerpt":{"rendered":"<p>A photography workflow program. Looks to be mostly single-threaded with small sections of multi-threaded routines. There are eight workloads overall. Topdown profile shows backend stalls as highest amount but also variation through the workload. AMD metrics have 2.5 cores on <span class=\"excerpt-dots\">&hellip;<\/span> <a class=\"more-link\" href=\"https:\/\/mvermeulen.org\/perf\/workloads\/phoronix\/darktable\/\"><span class=\"more-msg\">Continue reading &rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":58,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-1135","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/1135","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/comments?post=1135"}],"version-history":[{"count":3,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/1135\/revisions"}],"predecessor-version":[{"id":1188,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/1135\/revisions\/1188"}],"up":[{"embeddable":true,"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/pages\/58"}],"wp:attachment":[{"href":"https:\/\/mvermeulen.org\/perf\/wp-json\/wp\/v2\/media?parent=1135"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}