Query processing time for queries of an OLAP data management system. Appears that each test had distinct phases of more and less parallel activity
Topdown profile also shows the phases with an interesting blend of frontend and backend stages
AMD metrics overall shows on average only 1.3 cores busy, more backend/memory stalls and relatively low floating point.
elapsed 960.074
on_cpu 0.083 # 1.33 / 16 cores
utime 1050.202
stime 223.703
nvcsw 182921 # 96.17%
nivcsw 7293 # 3.83%
inblock 428117168 # 445920.81/sec
onblock 14064 # 14.65/sec
cpu-clock 9062722205373 # 9062.722 seconds
task-clock 9085391684374 # 9085.392 seconds
page faults 125632193 # 13827.934/sec
context switches 80772494 # 8890.370/sec
cpu migrations 7056537 # 776.690/sec
major page faults 87 # 0.010/sec
minor page faults 125632106 # 13827.924/sec
alignment faults 0 # 0.000/sec
emulation faults 0 # 0.000/sec
branches 7589246834681 # 172.854 branches per 1000 inst
branch misses 196395901361 # 2.59% branch miss
conditional 5507529190694 # 125.441 conditional branches per 1000 inst
indirect 356469729953 # 8.119 indirect branches per 1000 inst
cpu-cycles 37036879736615 # 2.43 GHz
instructions 44072109601039 # 1.19 IPC
slots 73730064178218 #
retiring 14063016807866 # 19.1% (22.1%)
-- ucode 71601765390 # 0.1%
-- fastpath 13991415042476 # 19.0%
frontend 15752422857947 # 21.4% (24.8%)
-- latency 10417400144580 # 14.1%
-- bandwidth 5335022713367 # 7.2%
backend 31122778866231 # 42.2% (48.9%)
-- cpu 4439924407384 # 6.0%
-- memory 26682854458847 # 36.2%
speculation 2650850523671 # 3.6% ( 4.2%)
-- branch mispredict 2622235580370 # 3.6%
-- pipeline restart 28614943301 # 0.0%
smt-contention 10135178456104 # 13.7% ( 0.0%)
cpu-cycles 37080085833937 # 2.44 GHz
instructions 44036533320560 # 1.19 IPC
instructions 14570618208965 # 30.513 l2 access per 1000 inst
l2 hit from l1 317014346372 # 23.13% l2 miss
l2 miss from l1 35934414613 #
l2 hit from l2 pf 60663061403 #
l3 hit from l2 pf 23003739509 #
l3 miss from l2 pf 43907858942 #
instructions 14556681449273 # 44.261 float per 1000 inst
float 512 242 # 0.000 AVX-512 per 1000 inst
float 256 1264 # 0.000 AVX-256 per 1000 inst
float 128 644292753045 # 44.261 AVX-128 per 1000 inst
float MMX 0 # 0.000 MMX per 1000 inst
float scalar 1123 # 0.000 scalar per 1000 inst
instructions 2646816 #
opcache 981664 # 370.885 opcache per 1000 inst
opcache miss 524554 # 53.4% opcache miss rate
l1 dTLB miss 4803 # 1.815 L1 dTLB per 1000 inst
l2 dTLB miss 1023 # 0.387 L2 dTLB per 1000 inst
instructions 2672615 #
icache 1295488 # 484.727 icache per 1000 inst
icache miss 110556 # 8.5% icache miss rate
l1 iTLB miss 13 # 0.005 L1 iTLB per 1000 inst
l2 iTLB miss 0 # 0.000 L2 iTLB per 1000 inst
tlb flush 19 # 0.007 TLB flush per 1000 inst
Intel metrics
elapsed 1374.763
on_cpu 0.043 # 0.68 / 16 cores
utime 796.202
stime 145.509
nvcsw 424427 # 91.93%
nivcsw 37273 # 8.07%
inblock 437802064 # 318456.44/sec
onblock 2664 # 1.94/sec
cpu-clock 9889890146722 # 9889.890 seconds
task-clock 9901821096493 # 9901.821 seconds
page faults 145004155 # 14644.191/sec
context switches 64420418 # 6505.916/sec
cpu migrations 3817346 # 385.520/sec
major page faults 12835 # 1.296/sec
minor page faults 144991320 # 14642.894/sec
alignment faults 0 # 0.000/sec
emulation faults 0 # 0.000/sec
branches 7494281421376 # 170.479 branches per 1000 inst
branch misses 131701279317 # 1.76% branch miss
conditional 7494281482688 # 170.479 conditional branches per 1000 inst
indirect 1701207301554 # 38.699 indirect branches per 1000 inst
slots 117679341351368 #
retiring 45920805761942 # 39.0% (39.0%)
-- ucode 2071606390469 # 1.8%
-- fastpath 43849199371473 # 37.3%
frontend 15208522024469 # 12.9% (12.9%)
-- latency 7486087889483 # 6.4%
-- bandwidth 7722434134986 # 6.6%
backend 39841002160783 # 33.9% (33.9%)
-- cpu 8222436983285 # 7.0%
-- memory 31618565177498 # 26.9%
speculation 21118708940051 # 17.9% (17.9%) high
-- branch mispredict 20590473635436 # 17.5%
-- pipeline restart 528235304615 # 0.4%
smt-contention 0 # 0.0% ( 0.0%)
cpu-cycles 95249425375812 # 1.42 GHz
instructions 161207153689135 # 1.69 IPC
l2 access 1882074708088 # 22.041 l2 access per 1000 inst
l2 miss 800276946596 # 42.52% l2 miss
cpu-cycles 16776072624718 # 43.4% memory latency
load stalls 6771705251692 # 3.6% l1 bound
l1 miss 6174069101775 # 6.3% l2 bound
l2 miss 5110846415218 # 4.0% l3 bound
l3 miss 4442788325447 # 26.5% dram bound
store_stalls 508058730601 # 3.0% store bound
Process summary shows mix of processes in the application
1896 processes
384 BgSchPool 832938.24 132876.96
279 ThreadPool 532398.14 85425.54
48 MergeMutate 104117.22 16609.76
429 clickhouse 66127.54 10586.94
24 Fetch 52058.64 8304.85
24 Common 52058.64 8304.83
24 Move 52058.62 8304.88
6 ExterLdrReload 13014.66 2076.22
6 ConfigReloader 13014.64 2076.20
3 BgSchPool/D 6507.33 1038.11
3 TCPHandler 6507.33 1038.11
3 AsyncMetrics 6507.32 1038.10
68 clinfo 16.79 6.00
38 vulkaninfo 1.70 0.95
4 vulkani:disk$0 0.18 0.10
6 php 0.15 0.15
6 glxinfo:gdrv0 0.12 0.06
6 glxinfo:gl0 0.12 0.06
2 llvmpipe-0 0.09 0.05
2 llvmpipe-1 0.09 0.05
2 llvmpipe-10 0.09 0.05
2 llvmpipe-11 0.09 0.05
2 llvmpipe-12 0.09 0.05
2 llvmpipe-13 0.09 0.05
2 llvmpipe-14 0.09 0.05
2 llvmpipe-15 0.09 0.05
2 llvmpipe-2 0.09 0.05
2 llvmpipe-3 0.09 0.05
2 llvmpipe-4 0.09 0.05
2 llvmpipe-5 0.09 0.05
2 llvmpipe-6 0.09 0.05
2 llvmpipe-7 0.09 0.05
2 llvmpipe-8 0.09 0.05
2 llvmpipe-9 0.09 0.05
48 rm 0.06 11.24
2 glxinfo 0.06 0.02
2 glxinfo:cs0 0.06 0.02
2 glxinfo:disk$0 0.06 0.02
2 glxinfo:sh0 0.06 0.02
2 glxinfo:shlo0 0.06 0.02
6 clang 0.04 0.08
3 clckhouse-watch 0.03 0.03
3 rocminfo 0.00 0.03
1 lspci 0.00 0.02
1 ps 0.00 0.01
129 seq 0.00 0.00
129 sync 0.00 0.00
81 sh 0.00 0.00
14 gsettings 0.00 0.00
12 gcc 0.00 0.00
8 stat 0.00 0.00
8 systemd-detect- 0.00 0.00
6 llvm-link 0.00 0.00
6 sleep 0.00 0.00
5 phoronix-test-s 0.00 0.00
3 cat 0.00 0.00
2 lscpu 0.00 0.00
2 uname 0.00 0.00
2 which 0.00 0.00
2 xset 0.00 0.00
1 cc 0.00 0.00
1 date 0.00 0.00
1 dconf worker 0.00 0.00
1 dirname 0.00 0.00
1 dmesg 0.00 0.00
1 dmidecode 0.00 0.00
1 gmain 0.00 0.00
1 grep 0.00 0.00
1 ifconfig 0.00 0.00
1 ip 0.00 0.00
1 lsmod 0.00 0.00
1 mktemp 0.00 0.00
1 qdbus 0.00 0.00
1 readlink 0.00 0.00
1 realpath 0.00 0.00
1 sed 0.00 0.00
1 sort 0.00 0.00
1 stty 0.00 0.00
1 systemctl 0.00 0.00
1 template.sh 0.00 0.00
1 wc 0.00 0.00
1 xrandr 0.00 0.00
0 processes running
280 maximum processes
Example computation blocks show a backend set of processes such as thread pools and then a sequence of frontend application threads.
26414) clickhouse cpu=9 start=5.74 finish=315.77
26415) rm cpu=10 start=5.74 finish=5.74
26416) rm cpu=13 start=5.74 finish=5.74
26417) rm cpu=14 start=5.74 finish=5.74
26418) rm cpu=10 start=5.75 finish=5.75
26419) rm cpu=3 start=5.75 finish=5.75
26420) rm cpu=13 start=5.75 finish=5.75
26421) rm cpu=14 start=5.75 finish=5.75
26422) rm cpu=10 start=5.75 finish=5.75
26423) clckhouse-watch cpu=3 start=5.75 finish=309.88
26425) clickhouse cpu=12 start=5.78 finish=309.90
26426) clickhouse cpu=7 start=5.78 finish=309.90
26427) TCPHandler cpu=0 start=5.83 finish=309.90
26667) ThreadPool cpu=2 start=180.26 finish=309.89
26702) ThreadPool cpu=6 start=180.52 finish=309.89
26673) ThreadPool cpu=13 start=180.36 finish=309.89
26674) ThreadPool cpu=4 start=180.36 finish=309.89
26692) ThreadPool cpu=14 start=180.37 finish=309.89
26675) ThreadPool cpu=7 start=180.36 finish=309.89
26688) ThreadPool cpu=10 start=180.37 finish=309.89
26676) ThreadPool cpu=11 start=180.36 finish=309.89
26714) ThreadPool cpu=1 start=180.74 finish=309.89
26677) ThreadPool cpu=13 start=180.36 finish=309.89
26695) ThreadPool cpu=13 start=180.38 finish=309.89
26720) ThreadPool cpu=7 start=181.11 finish=309.89
26721) ThreadPool cpu=1 start=181.11 finish=309.89
26722) ThreadPool cpu=4 start=181.11 finish=309.89
26723) ThreadPool cpu=9 start=181.11 finish=309.89
26724) ThreadPool cpu=3 start=181.11 finish=309.89
26725) ThreadPool cpu=14 start=181.11 finish=309.89
26726) ThreadPool cpu=5 start=181.11 finish=309.89
26727) ThreadPool cpu=6 start=181.11 finish=309.89
26728) ThreadPool cpu=12 start=181.11 finish=309.89
26729) ThreadPool cpu=6 start=181.11 finish=309.89
26730) ThreadPool cpu=11 start=181.11 finish=309.89
26731) ThreadPool cpu=0 start=181.11 finish=309.89
26732) ThreadPool cpu=10 start=181.12 finish=309.89
26733) ThreadPool cpu=5 start=181.12 finish=309.89
26734) ThreadPool cpu=11 start=181.12 finish=309.89
26735) ThreadPool cpu=0 start=181.12 finish=309.89
26678) ThreadPool cpu=7 start=180.36 finish=309.89
26696) ThreadPool cpu=12 start=180.38 finish=309.89
26679) ThreadPool cpu=6 start=180.36 finish=309.89
26693) ThreadPool cpu=3 start=180.38 finish=309.89
26713) ThreadPool cpu=12 start=180.74 finish=309.89
26680) ThreadPool cpu=14 start=180.36 finish=309.89
26681) ThreadPool cpu=4 start=180.36 finish=309.89
26705) ThreadPool cpu=2 start=180.52 finish=309.89
26682) ThreadPool cpu=2 start=180.36 finish=309.89
26689) ThreadPool cpu=11 start=180.37 finish=309.89
26704) ThreadPool cpu=8 start=180.52 finish=309.89
26683) ThreadPool cpu=11 start=180.36 finish=309.89
26684) ThreadPool cpu=9 start=180.36 finish=309.89
26694) ThreadPool cpu=7 start=180.38 finish=309.89
26712) ThreadPool cpu=10 start=180.74 finish=309.89
26685) ThreadPool cpu=8 start=180.36 finish=309.89
26690) ThreadPool cpu=13 start=180.37 finish=309.89
26711) ThreadPool cpu=1 start=180.70 finish=309.89
26686) ThreadPool cpu=0 start=180.36 finish=309.89
26691) ThreadPool cpu=12 start=180.37 finish=309.89
26687) ThreadPool cpu=11 start=180.36 finish=309.89
26703) ThreadPool cpu=14 start=180.52 finish=309.89
26428) clickhouse cpu=14 start=5.83 finish=309.90
26429) clickhouse cpu=1 start=5.83 finish=309.90
26430) ExterLdrReload cpu=10 start=6.03 finish=309.90
26431) ExterLdrReload cpu=9 start=6.03 finish=309.90
26432) Move cpu=15 start=6.04 finish=309.90
26433) Move cpu=11 start=6.04 finish=309.90
26434) MergeMutate cpu=0 start=6.04 finish=309.90
26435) Move cpu=5 start=6.04 finish=309.90
26436) MergeMutate cpu=2 start=6.04 finish=309.90
26437) MergeMutate cpu=13 start=6.04 finish=309.90
26438) MergeMutate cpu=4 start=6.04 finish=309.90
26439) MergeMutate cpu=6 start=6.04 finish=309.90
26440) MergeMutate cpu=8 start=6.04 finish=309.90
26441) MergeMutate cpu=0 start=6.04 finish=309.90
26442) MergeMutate cpu=11 start=6.04 finish=309.90
26443) MergeMutate cpu=4 start=6.04 finish=309.90
26444) Move cpu=10 start=6.04 finish=309.90
26445) Move cpu=15 start=6.04 finish=309.90
26446) MergeMutate cpu=13 start=6.04 finish=309.90
26447) MergeMutate cpu=12 start=6.04 finish=309.90
26448) MergeMutate cpu=6 start=6.04 finish=309.90
26449) MergeMutate cpu=11 start=6.04 finish=309.90
26450) MergeMutate cpu=9 start=6.04 finish=309.90
26658) ThreadPool cpu=11 start=88.55 finish=309.89
26451) MergeMutate cpu=1 start=6.04 finish=309.90
26661) ThreadPool cpu=4 start=137.03 finish=309.89
26452) Move cpu=1 start=6.04 finish=309.90
26453) MergeMutate cpu=7 start=6.04 finish=309.90
26454) Move cpu=4 start=6.04 finish=309.90
26455) Move cpu=0 start=6.04 finish=309.90
26456) Fetch cpu=13 start=6.04 finish=309.90
26457) BgSchPool cpu=1 start=6.04 finish=309.90
26458) BgSchPool cpu=3 start=6.04 finish=309.90
26459) BgSchPool cpu=3 start=6.04 finish=309.90
26460) Fetch cpu=0 start=6.04 finish=309.90
26461) Fetch cpu=0 start=6.04 finish=309.90
26462) Common cpu=9 start=6.04 finish=309.90
26463) BgSchPool cpu=3 start=6.04 finish=309.90
26464) BgSchPool cpu=5 start=6.04 finish=309.90
26465) ThreadPool cpu=14 start=6.04 finish=309.90
26466) Fetch cpu=2 start=6.04 finish=309.90
26467) ThreadPool cpu=2 start=6.04 finish=309.90
26468) BgSchPool cpu=8 start=6.04 finish=309.90
26469) BgSchPool cpu=1 start=6.04 finish=309.90
26470) BgSchPool cpu=3 start=6.04 finish=309.90
26471) BgSchPool cpu=13 start=6.04 finish=309.90
26472) BgSchPool/D cpu=2 start=6.04 finish=309.90
26473) Fetch cpu=0 start=6.04 finish=309.90
26474) Common cpu=3 start=6.04 finish=309.90
26475) ThreadPool cpu=1 start=6.04 finish=309.90
26476) ThreadPool cpu=1 start=6.04 finish=309.90
26477) BgSchPool cpu=1 start=6.04 finish=309.90
26478) BgSchPool cpu=4 start=6.04 finish=309.90
26479) BgSchPool cpu=3 start=6.04 finish=309.90
26480) BgSchPool cpu=12 start=6.04 finish=309.90
26481) BgSchPool cpu=10 start=6.04 finish=309.90
26482) BgSchPool cpu=11 start=6.04 finish=309.90
26483) BgSchPool cpu=3 start=6.04 finish=309.90
26484) Common cpu=4 start=6.04 finish=309.90
26485) BgSchPool cpu=14 start=6.04 finish=309.90
26486) BgSchPool cpu=12 start=6.04 finish=309.90
26487) BgSchPool cpu=6 start=6.04 finish=309.90
26488) BgSchPool cpu=3 start=6.04 finish=309.90
26489) BgSchPool cpu=7 start=6.04 finish=309.90
26490) BgSchPool cpu=2 start=6.04 finish=309.90
26491) BgSchPool cpu=8 start=6.04 finish=309.90
26492) BgSchPool cpu=9 start=6.04 finish=309.90
26493) BgSchPool cpu=10 start=6.04 finish=309.90
26494) BgSchPool cpu=4 start=6.04 finish=309.90
26495) BgSchPool cpu=14 start=6.04 finish=309.90
26496) BgSchPool cpu=12 start=6.04 finish=309.90
26497) BgSchPool cpu=11 start=6.04 finish=309.90
26498) BgSchPool cpu=3 start=6.04 finish=309.90
26499) BgSchPool cpu=5 start=6.04 finish=309.90
26500) BgSchPool cpu=6 start=6.04 finish=309.90
26501) ThreadPool cpu=2 start=6.04 finish=309.90
26502) ThreadPool cpu=4 start=6.04 finish=309.90
26503) Common cpu=6 start=6.04 finish=309.90
26504) ThreadPool cpu=14 start=6.04 finish=309.90
26505) BgSchPool cpu=1 start=6.04 finish=309.90
26506) BgSchPool cpu=7 start=6.04 finish=309.90
26507) BgSchPool cpu=15 start=6.04 finish=309.90
26508) BgSchPool cpu=5 start=6.04 finish=309.90
26509) BgSchPool cpu=3 start=6.04 finish=309.90
26510) BgSchPool cpu=14 start=6.04 finish=309.90
26511) BgSchPool cpu=12 start=6.04 finish=309.90
26512) BgSchPool cpu=10 start=6.04 finish=309.90
26513) BgSchPool cpu=5 start=6.04 finish=309.90
26514) ThreadPool cpu=13 start=6.04 finish=309.90
26515) BgSchPool cpu=9 start=6.04 finish=309.90
26516) BgSchPool cpu=6 start=6.04 finish=309.90
26517) BgSchPool cpu=3 start=6.04 finish=309.90
26518) BgSchPool cpu=4 start=6.04 finish=309.90
26519) BgSchPool cpu=1 start=6.04 finish=309.90
26520) BgSchPool cpu=9 start=6.04 finish=309.90
26521) BgSchPool cpu=15 start=6.04 finish=309.90
26522) BgSchPool cpu=14 start=6.04 finish=309.90
26523) BgSchPool cpu=7 start=6.04 finish=309.90
26524) BgSchPool cpu=8 start=6.04 finish=309.90
26525) BgSchPool cpu=9 start=6.04 finish=309.90
26526) BgSchPool cpu=12 start=6.04 finish=309.90
26527) BgSchPool cpu=6 start=6.04 finish=309.90
26528) BgSchPool cpu=15 start=6.04 finish=309.90
26529) BgSchPool cpu=6 start=6.04 finish=309.90
26530) BgSchPool cpu=11 start=6.04 finish=309.90
26531) BgSchPool cpu=3 start=6.04 finish=309.90
26532) BgSchPool cpu=13 start=6.04 finish=309.90
26533) BgSchPool cpu=5 start=6.04 finish=309.90
26534) BgSchPool cpu=10 start=6.04 finish=309.90
26535) BgSchPool cpu=6 start=6.04 finish=309.90
26536) BgSchPool cpu=4 start=6.04 finish=309.90
26537) BgSchPool cpu=9 start=6.04 finish=309.90
26538) ThreadPool cpu=14 start=6.04 finish=309.90
26539) ThreadPool cpu=15 start=6.04 finish=309.90
26540) Common cpu=10 start=6.04 finish=309.90
26541) Fetch cpu=10 start=6.04 finish=309.90
26542) ThreadPool cpu=12 start=6.04 finish=309.90
26543) ThreadPool cpu=13 start=6.04 finish=309.90
26544) BgSchPool cpu=3 start=6.04 finish=309.90
26545) BgSchPool cpu=6 start=6.04 finish=309.90
26546) BgSchPool cpu=4 start=6.04 finish=309.90
26547) BgSchPool cpu=9 start=6.04 finish=309.90
26548) BgSchPool cpu=3 start=6.04 finish=309.90
26549) BgSchPool cpu=10 start=6.04 finish=309.90
26550) BgSchPool cpu=15 start=6.04 finish=309.90
26551) BgSchPool cpu=1 start=6.04 finish=309.90
26552) BgSchPool cpu=9 start=6.04 finish=309.90
26553) BgSchPool cpu=10 start=6.05 finish=309.90
26554) BgSchPool cpu=8 start=6.05 finish=309.90
26555) BgSchPool cpu=0 start=6.05 finish=309.90
26556) BgSchPool cpu=14 start=6.05 finish=309.90
26557) BgSchPool cpu=5 start=6.05 finish=309.90
26558) BgSchPool cpu=10 start=6.05 finish=309.90
26559) BgSchPool cpu=9 start=6.05 finish=309.90
26560) BgSchPool cpu=11 start=6.05 finish=309.90
26561) BgSchPool cpu=12 start=6.05 finish=309.89
26562) BgSchPool cpu=6 start=6.05 finish=309.89
26563) BgSchPool cpu=3 start=6.05 finish=309.89
26564) BgSchPool cpu=4 start=6.05 finish=309.89
26565) BgSchPool cpu=14 start=6.05 finish=309.89
26566) BgSchPool cpu=3 start=6.05 finish=309.89
26567) BgSchPool cpu=2 start=6.05 finish=309.89
26568) BgSchPool cpu=3 start=6.05 finish=309.89
26569) BgSchPool cpu=7 start=6.05 finish=309.89
26570) BgSchPool cpu=7 start=6.05 finish=309.89
26571) BgSchPool cpu=8 start=6.05 finish=309.89
26572) BgSchPool cpu=5 start=6.05 finish=309.89
26573) BgSchPool cpu=7 start=6.05 finish=309.89
26574) BgSchPool cpu=11 start=6.05 finish=309.89
26575) BgSchPool cpu=5 start=6.05 finish=309.89
26576) BgSchPool cpu=8 start=6.05 finish=309.89
26577) BgSchPool cpu=2 start=6.05 finish=309.89
26578) BgSchPool cpu=8 start=6.05 finish=309.89
26579) BgSchPool cpu=2 start=6.05 finish=309.89
26580) BgSchPool cpu=9 start=6.05 finish=309.89
26581) BgSchPool cpu=14 start=6.05 finish=309.89
26582) BgSchPool cpu=15 start=6.05 finish=309.89
26583) BgSchPool cpu=15 start=6.05 finish=309.89
26584) BgSchPool cpu=13 start=6.05 finish=309.89
26585) BgSchPool cpu=3 start=6.05 finish=309.89
26586) BgSchPool cpu=5 start=6.05 finish=309.89
26587) BgSchPool cpu=12 start=6.05 finish=309.89
26588) BgSchPool cpu=11 start=6.05 finish=309.89
26589) BgSchPool cpu=13 start=6.05 finish=309.89
26590) BgSchPool cpu=6 start=6.05 finish=309.89
26591) BgSchPool cpu=9 start=6.05 finish=309.89
26592) BgSchPool cpu=3 start=6.05 finish=309.89
26593) BgSchPool cpu=9 start=6.05 finish=309.89
26594) BgSchPool cpu=10 start=6.05 finish=309.89
26595) BgSchPool cpu=1 start=6.05 finish=309.89
26596) BgSchPool cpu=8 start=6.05 finish=309.89
26597) BgSchPool cpu=1 start=6.05 finish=309.89
26598) BgSchPool cpu=1 start=6.05 finish=309.89
26599) BgSchPool cpu=5 start=6.05 finish=309.89
26600) BgSchPool cpu=10 start=6.05 finish=309.89
26601) BgSchPool cpu=2 start=6.05 finish=309.89
26602) BgSchPool cpu=15 start=6.05 finish=309.89
26603) BgSchPool cpu=13 start=6.05 finish=309.89
26604) BgSchPool cpu=12 start=6.05 finish=309.89
26605) BgSchPool cpu=5 start=6.05 finish=309.89
26606) BgSchPool cpu=6 start=6.05 finish=309.89
26607) BgSchPool cpu=2 start=6.05 finish=309.89
26608) ThreadPool cpu=0 start=6.05 finish=309.89
26609) ThreadPool cpu=11 start=6.05 finish=309.89
26610) ThreadPool cpu=9 start=6.05 finish=309.89
26611) ThreadPool cpu=11 start=6.05 finish=309.89
26612) Common cpu=11 start=6.05 finish=309.89
26613) Common cpu=8 start=6.05 finish=309.89
26614) Common cpu=5 start=6.05 finish=309.89
26615) Fetch cpu=9 start=6.05 finish=309.89
26616) Fetch cpu=13 start=6.05 finish=309.89
26617) ThreadPool cpu=11 start=6.17 finish=309.89
26618) ThreadPool cpu=5 start=6.17 finish=309.89
26619) ThreadPool cpu=8 start=6.17 finish=309.89
26620) ThreadPool cpu=15 start=6.17 finish=309.89
26621) ThreadPool cpu=5 start=6.17 finish=309.89
26622) ThreadPool cpu=7 start=6.17 finish=309.89
26623) ThreadPool cpu=7 start=6.17 finish=309.89
26624) ThreadPool cpu=11 start=6.17 finish=309.89
26625) ConfigReloader cpu=3 start=6.17 finish=309.89
26626) ThreadPool cpu=5 start=6.17 finish=309.89
26627) ConfigReloader cpu=11 start=6.17 finish=309.89
26628) ThreadPool cpu=7 start=6.17 finish=309.89
26629) ThreadPool cpu=13 start=6.17 finish=309.89
26630) ThreadPool cpu=4 start=6.17 finish=309.89
26631) ThreadPool cpu=12 start=6.17 finish=309.89
26632) AsyncMetrics cpu=1 start=6.17 finish=309.89
26633) clickhouse cpu=8 start=6.34 finish=309.89
26634) clickhouse cpu=0 start=6.34 finish=309.89
26635) clickhouse cpu=7 start=6.34 finish=309.89
26636) clickhouse cpu=5 start=6.34 finish=309.89
26637) clickhouse cpu=7 start=6.34 finish=309.89
26638) clickhouse cpu=6 start=6.34 finish=309.89
26424) sleep cpu=13 start=5.75 finish=10.76
26641) clickhouse cpu=9 start=10.76 finish=10.81
26642) clickhouse cpu=4 start=10.81 finish=179.97
26643) ThreadPool cpu=1 start=10.85 finish=179.95
26644) ThreadPool cpu=3 start=10.85 finish=179.97
26645) ThreadPool cpu=3 start=10.88 finish=179.97
26646) ThreadPool cpu=9 start=10.96 finish=179.96
26647) ThreadPool cpu=14 start=10.97 finish=179.94
26648) ThreadPool cpu=7 start=11.21 finish=179.97
26649) ThreadPool cpu=8 start=11.23 finish=179.97
26650) ThreadPool cpu=6 start=11.25 finish=179.97
26651) ThreadPool cpu=2 start=11.82 finish=179.97
26652) ThreadPool cpu=13 start=13.10 finish=179.97
26653) ThreadPool cpu=11 start=34.79 finish=179.97
26654) ThreadPool cpu=15 start=34.80 finish=179.96
26655) ThreadPool cpu=15 start=34.81 finish=179.97
26656) ThreadPool cpu=5 start=34.84 finish=179.97
26662) cat cpu=12 start=179.98 finish=179.98
26663) clickhouse cpu=0 start=179.98 finish=309.88
26664) sync cpu=12 start=179.98 finish=180.22
26665) seq cpu=10 start=180.22 finish=180.23
26666) clickhouse cpu=4 start=180.23 finish=180.26
26668) clickhouse cpu=1 start=180.26 finish=180.29
26669) clickhouse cpu=0 start=180.29 finish=180.32
26670) sync cpu=6 start=180.32 finish=180.33
26671) seq cpu=0 start=180.33 finish=180.33
26672) clickhouse cpu=9 start=180.33 finish=180.39
26697) clickhouse cpu=3 start=180.40 finish=180.44
26698) clickhouse cpu=14 start=180.44 finish=180.48
26699) sync cpu=5 start=180.48 finish=180.49
26700) seq cpu=11 start=180.49 finish=180.49
26701) clickhouse cpu=0 start=180.49 finish=180.55
26706) clickhouse cpu=11 start=180.55 finish=180.61
26707) clickhouse cpu=9 start=180.61 finish=180.66
26708) sync cpu=15 start=180.66 finish=180.67
26709) seq cpu=2 start=180.67 finish=180.67
26710) clickhouse cpu=10 start=180.67 finish=180.75
26715) clickhouse cpu=12 start=180.75 finish=180.81
26716) clickhouse cpu=13 start=180.81 finish=180.87
26717) sync cpu=15 start=180.87 finish=180.88
26718) seq cpu=12 start=180.88 finish=180.88
26719) clickhouse cpu=0 start=180.88 finish=181.27
26736) clickhouse cpu=1 start=181.28 finish=181.64
26737) clickhouse cpu=10 start=181.65 finish=182.01
26738) sync cpu=15 start=182.01 finish=182.03
26739) seq cpu=10 start=182.03 finish=182.03
26740) clickhouse cpu=1 start=182.03 finish=182.58
26741) clickhouse cpu=4 start=182.58 finish=183.08
26742) clickhouse cpu=15 start=183.09 finish=183.58
26743) sync cpu=1 start=183.58 finish=183.59
26744) seq cpu=14 start=183.59 finish=183.59
26745) clickhouse cpu=8 start=183.59 finish=183.63
26746) clickhouse cpu=15 start=183.63 finish=183.67
26747) clickhouse cpu=12 start=183.68 finish=183.71
26748) sync cpu=13 start=183.72 finish=183.72
26749) seq cpu=14 start=183.72 finish=183.72
26750) clickhouse cpu=15 start=183.72 finish=183.76
26751) clickhouse cpu=11 start=183.77 finish=183.81
26752) clickhouse cpu=13 start=183.81 finish=183.85
26753) sync cpu=2 start=183.86 finish=183.87
26754) seq cpu=2 start=183.87 finish=183.87
26755) clickhouse cpu=5 start=183.87 finish=184.44
26756) clickhouse cpu=7 start=184.44 finish=184.99
26757) clickhouse cpu=1 start=185.00 finish=185.53
26758) sync cpu=2 start=185.54 finish=185.57
26759) seq cpu=11 start=185.57 finish=185.57
26760) clickhouse cpu=1 start=185.57 finish=186.19
26761) clickhouse cpu=2 start=186.20 finish=186.82
26762) clickhouse cpu=14 start=186.82 finish=187.43
26763) sync cpu=14 start=187.44 finish=187.47
26764) seq cpu=13 start=187.47 finish=187.47
26765) clickhouse cpu=0 start=187.47 finish=187.65
26766) clickhouse cpu=8 start=187.66 finish=187.84
26767) clickhouse cpu=15 start=187.84 finish=188.01
26768) sync cpu=9 start=188.01 finish=188.03
26769) seq cpu=11 start=188.03 finish=188.03
26770) clickhouse cpu=6 start=188.03 finish=188.23
26771) clickhouse cpu=0 start=188.23 finish=188.43
26772) clickhouse cpu=8 start=188.44 finish=188.63
26773) sync cpu=12 start=188.63 finish=188.65
26774) seq cpu=0 start=188.66 finish=188.66
26775) clickhouse cpu=12 start=188.66 finish=189.24
26776) clickhouse cpu=2 start=189.25 finish=189.83
26777) clickhouse cpu=6 start=189.83 finish=190.41
26778) sync cpu=13 start=190.42 finish=190.45
26779) seq cpu=0 start=190.46 finish=190.46
26780) clickhouse cpu=5 start=190.46 finish=191.38
26781) clickhouse cpu=5 start=191.38 finish=192.29
26782) clickhouse cpu=13 start=192.29 finish=193.19
26783) sync cpu=11 start=193.20 finish=193.27