== native_expert_bench <shard1> 0,5,11,17,23,29,35,41,47 18 2 0 2 200
layer  0 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   346.9 us  gu   229.3 us ( 98 GB/s)  down  116.2 us (143 GB/s) | mode 2: all   576.7 us  gu   349.3 us ( 65 GB/s)  down  227.3 us ( 73 GB/s) | bitwise equal
layer  5 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   288.9 us  gu   171.6 us (110 GB/s)  down  116.0 us (143 GB/s) | mode 2: all   602.8 us  gu   375.7 us ( 50 GB/s)  down  226.7 us ( 73 GB/s) | bitwise equal
layer 11 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   288.9 us  gu   171.5 us (110 GB/s)  down  116.0 us (143 GB/s) | mode 2: all   603.5 us  gu   375.8 us ( 50 GB/s)  down  226.8 us ( 73 GB/s) | bitwise equal
layer 17 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   388.9 us  gu   271.2 us ( 93 GB/s)  down  116.2 us (143 GB/s) | mode 2: all   683.4 us  gu   454.8 us ( 56 GB/s)  down  228.0 us ( 73 GB/s) | bitwise equal
layer 23 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   288.9 us  gu   171.6 us (110 GB/s)  down  116.0 us (143 GB/s) | mode 2: all   602.8 us  gu   375.7 us ( 50 GB/s)  down  226.8 us ( 73 GB/s) | bitwise equal
layer 29 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   389.1 us  gu   271.1 us ( 93 GB/s)  down  116.2 us (143 GB/s) | mode 2: all   683.4 us  gu   455.0 us ( 56 GB/s)  down  228.0 us ( 73 GB/s) | bitwise equal
layer 35 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   389.0 us  gu   271.1 us ( 93 GB/s)  down  116.2 us (143 GB/s) | mode 2: all   683.3 us  gu   454.9 us ( 56 GB/s)  down  228.0 us ( 73 GB/s) | bitwise equal
layer 41 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   347.1 us  gu   229.6 us ( 98 GB/s)  down  116.2 us (143 GB/s) | mode 2: all   576.8 us  gu   349.4 us ( 65 GB/s)  down  227.3 us ( 73 GB/s) | bitwise equal
layer 47 iq4_xs /iq4_nl G 18 T 2 | mode 0: all   327.8 us  gu   211.3 us (148 GB/s)  down  116.1 us (143 GB/s) | mode 2: all   608.2 us  gu   379.8 us ( 83 GB/s)  down  228.2 us ( 73 GB/s) | bitwise equal
native_expert_bench: 0 differing
== native_expert_bench <shard1> 0,5,11,17,23,29,35,41,47 18 2 0 5 200
layer  0 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   347.0 us  gu   229.4 us ( 98 GB/s)  down  116.3 us (143 GB/s) | mode 5: all   348.9 us  gu   231.2 us ( 98 GB/s)  down  116.2 us (143 GB/s) | bitwise equal
layer  5 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   289.6 us  gu   171.5 us (110 GB/s)  down  116.1 us (143 GB/s) | mode 5: all   317.2 us  gu   200.0 us ( 94 GB/s)  down  116.0 us (143 GB/s) | bitwise equal
layer 11 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   289.4 us  gu   171.5 us (110 GB/s)  down  116.1 us (143 GB/s) | mode 5: all   317.4 us  gu   200.0 us ( 94 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
layer 17 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   388.4 us  gu   271.4 us ( 93 GB/s)  down  116.2 us (143 GB/s) | mode 5: all   383.3 us  gu   266.5 us ( 95 GB/s)  down  116.3 us (143 GB/s) | bitwise equal
layer 23 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   289.0 us  gu   171.4 us (110 GB/s)  down  116.0 us (143 GB/s) | mode 5: all   317.0 us  gu   200.0 us ( 94 GB/s)  down  116.0 us (143 GB/s) | bitwise equal
layer 29 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   387.8 us  gu   270.8 us ( 94 GB/s)  down  116.0 us (143 GB/s) | mode 5: all   382.9 us  gu   266.3 us ( 95 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
layer 35 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   387.7 us  gu   270.8 us ( 94 GB/s)  down  116.1 us (143 GB/s) | mode 5: all   382.6 us  gu   266.4 us ( 95 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
layer 41 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   346.7 us  gu   229.3 us ( 98 GB/s)  down  116.0 us (143 GB/s) | mode 5: all   348.8 us  gu   230.9 us ( 98 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
layer 47 iq4_xs /iq4_nl G 18 T 2 | mode 0: all   328.2 us  gu   210.7 us (149 GB/s)  down  116.0 us (143 GB/s) | mode 5: all   410.1 us  gu   293.8 us (107 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
native_expert_bench: 0 differing
== native_expert_bench <shard1> 0,5,11,17,23,29,35,41,47 18 2 0 6 200
layer  0 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   347.4 us  gu   229.7 us ( 98 GB/s)  down  116.3 us (143 GB/s) | mode 6: all   347.1 us  gu   229.4 us ( 98 GB/s)  down  116.4 us (143 GB/s) | bitwise equal
layer  5 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   289.0 us  gu   171.2 us (110 GB/s)  down  115.9 us (143 GB/s) | mode 6: all   320.8 us  gu   203.9 us ( 93 GB/s)  down  115.9 us (143 GB/s) | bitwise equal
layer 11 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   289.1 us  gu   171.2 us (110 GB/s)  down  115.9 us (143 GB/s) | mode 6: all   321.0 us  gu   203.9 us ( 93 GB/s)  down  115.9 us (143 GB/s) | bitwise equal
layer 17 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   387.7 us  gu   270.6 us ( 94 GB/s)  down  116.1 us (143 GB/s) | mode 6: all   379.4 us  gu   262.4 us ( 97 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
layer 23 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   289.2 us  gu   171.4 us (110 GB/s)  down  115.9 us (143 GB/s) | mode 6: all   321.0 us  gu   204.1 us ( 93 GB/s)  down  116.0 us (143 GB/s) | bitwise equal
layer 29 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   387.8 us  gu   270.8 us ( 94 GB/s)  down  116.1 us (143 GB/s) | mode 6: all   379.2 us  gu   262.2 us ( 97 GB/s)  down  116.0 us (143 GB/s) | bitwise equal
layer 35 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   387.8 us  gu   270.7 us ( 94 GB/s)  down  116.0 us (143 GB/s) | mode 6: all   379.2 us  gu   262.1 us ( 97 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
layer 41 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   346.9 us  gu   229.5 us ( 98 GB/s)  down  116.2 us (143 GB/s) | mode 6: all   346.5 us  gu   229.1 us ( 99 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
layer 47 iq4_xs /iq4_nl G 18 T 2 | mode 0: all   327.1 us  gu   210.6 us (149 GB/s)  down  116.1 us (143 GB/s) | mode 6: all   410.2 us  gu   293.9 us (107 GB/s)  down  116.1 us (143 GB/s) | bitwise equal
native_expert_bench: 0 differing
== native_expert_bench <shard1> 0,5,11,17,23,29,35,41,47 18 2 0 7 200
layer  0 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   346.7 us  gu   229.2 us ( 99 GB/s)  down  116.1 us (143 GB/s) | mode 7: all   259.9 us  gu   149.3 us (151 GB/s)  down  108.8 us (153 GB/s) | bitwise equal
layer  5 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   288.6 us  gu   171.4 us (110 GB/s)  down  115.9 us (143 GB/s) | mode 7: all   244.8 us  gu   135.2 us (140 GB/s)  down  109.1 us (152 GB/s) | bitwise equal
layer 11 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   288.7 us  gu   171.3 us (110 GB/s)  down  116.0 us (143 GB/s) | mode 7: all   245.0 us  gu   135.4 us (140 GB/s)  down  109.1 us (152 GB/s) | bitwise equal
layer 17 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   388.8 us  gu   271.0 us ( 94 GB/s)  down  116.3 us (143 GB/s) | mode 7: all   270.8 us  gu   161.2 us (157 GB/s)  down  109.4 us (152 GB/s) | bitwise equal
layer 23 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   288.6 us  gu   171.4 us (110 GB/s)  down  116.0 us (143 GB/s) | mode 7: all   244.8 us  gu   135.2 us (140 GB/s)  down  109.0 us (152 GB/s) | bitwise equal
layer 29 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   388.8 us  gu   270.9 us ( 94 GB/s)  down  116.2 us (143 GB/s) | mode 7: all   270.9 us  gu   161.2 us (157 GB/s)  down  109.4 us (152 GB/s) | bitwise equal
layer 35 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   389.0 us  gu   270.9 us ( 94 GB/s)  down  116.2 us (143 GB/s) | mode 7: all   270.9 us  gu   161.5 us (157 GB/s)  down  109.4 us (152 GB/s) | bitwise equal
layer 41 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   347.0 us  gu   229.5 us ( 98 GB/s)  down  116.2 us (143 GB/s) | mode 7: all   260.0 us  gu   149.3 us (151 GB/s)  down  108.8 us (152 GB/s) | bitwise equal
layer 47 iq4_xs /iq4_nl G 18 T 2 | mode 0: all   328.1 us  gu   210.9 us (149 GB/s)  down  116.2 us (143 GB/s) | mode 7: all   270.9 us  gu   161.0 us (195 GB/s)  down  109.5 us (151 GB/s) | bitwise equal
native_expert_bench: 0 differing
== native_expert_bench <shard1> 0,5,11,17,23,29,35,41,47 18 2 0 8 200
layer  0 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   345.0 us  gu   227.4 us ( 99 GB/s)  down  116.3 us (143 GB/s) | mode 8: all   252.0 us  gu   142.5 us (158 GB/s)  down  108.8 us (153 GB/s) | bitwise equal
layer  5 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   290.0 us  gu   172.6 us (109 GB/s)  down  116.0 us (143 GB/s) | mode 8: all   237.5 us  gu   127.5 us (148 GB/s)  down  108.9 us (152 GB/s) | bitwise equal
layer 11 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   290.1 us  gu   172.8 us (109 GB/s)  down  116.0 us (143 GB/s) | mode 8: all   237.6 us  gu   127.5 us (148 GB/s)  down  109.0 us (152 GB/s) | bitwise equal
layer 17 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   389.6 us  gu   272.0 us ( 93 GB/s)  down  116.1 us (143 GB/s) | mode 8: all   254.8 us  gu   145.6 us (174 GB/s)  down  109.6 us (151 GB/s) | bitwise equal
layer 23 iq2_s  /iq4_nl G 18 T 2 | mode 0: all   290.2 us  gu   172.7 us (109 GB/s)  down  116.0 us (143 GB/s) | mode 8: all   237.4 us  gu   127.5 us (148 GB/s)  down  109.0 us (152 GB/s) | bitwise equal
layer 29 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   389.6 us  gu   272.0 us ( 93 GB/s)  down  116.2 us (143 GB/s) | mode 8: all   254.8 us  gu   145.3 us (174 GB/s)  down  110.6 us (150 GB/s) | bitwise equal
layer 35 iq3_s  /iq4_nl G 18 T 2 | mode 0: all   390.4 us  gu   272.6 us ( 93 GB/s)  down  116.5 us (142 GB/s) | mode 8: all   255.3 us  gu   145.4 us (174 GB/s)  down  110.4 us (150 GB/s) | bitwise equal
layer 41 iq3_xxs/iq4_nl G 18 T 2 | mode 0: all   345.3 us  gu   227.7 us ( 99 GB/s)  down  116.3 us (143 GB/s) | mode 8: all   252.0 us  gu   142.4 us (159 GB/s)  down  108.8 us (152 GB/s) | bitwise equal
layer 47 iq4_xs /iq4_nl G 18 T 2 | mode 0: all   327.8 us  gu   211.3 us (148 GB/s)  down  116.2 us (143 GB/s) | mode 8: all   261.0 us  gu   151.5 us (207 GB/s)  down  109.5 us (151 GB/s) | bitwise equal
native_expert_bench: 0 differing
