Sat Sep 7 08:53:33 PM JST 2024 HPCG-NVIDIA 24.6.0 -- NVIDIA accelerated HPCG benchmark -- NVIDIA Build v0.5.3 Start of application (GPU-Only) ... Initial Residual = 97442.9 Iteration = 1 Scaled Residual = 0.191622 Iteration = 2 Scaled Residual = 0.106027 Iteration = 3 Scaled Residual = 0.0733516 Iteration = 4 Scaled Residual = 0.0560819 Iteration = 5 Scaled Residual = 0.0453513 Iteration = 6 Scaled Residual = 0.0380465 Iteration = 7 Scaled Residual = 0.0327741 Iteration = 8 Scaled Residual = 0.0288164 Iteration = 9 Scaled Residual = 0.0257536 Iteration = 10 Scaled Residual = 0.0233135 Iteration = 11 Scaled Residual = 0.0213113 Iteration = 12 Scaled Residual = 0.0196196 Iteration = 13 Scaled Residual = 0.0181532 Iteration = 14 Scaled Residual = 0.0168648 Iteration = 15 Scaled Residual = 0.0157309 Iteration = 16 Scaled Residual = 0.0147374 Iteration = 17 Scaled Residual = 0.0138738 Iteration = 18 Scaled Residual = 0.0131263 Iteration = 19 Scaled Residual = 0.0124749 Iteration = 20 Scaled Residual = 0.0118978 Iteration = 21 Scaled Residual = 0.0113732 Iteration = 22 Scaled Residual = 0.0108836 Iteration = 23 Scaled Residual = 0.0104228 Iteration = 24 Scaled Residual = 0.0099935 Iteration = 25 Scaled Residual = 0.00960232 Iteration = 26 Scaled Residual = 0.00925669 Iteration = 27 Scaled Residual = 0.00895872 Iteration = 28 Scaled Residual = 0.00870251 Iteration = 29 Scaled Residual = 0.00847586 Iteration = 30 Scaled Residual = 0.00826155 Iteration = 31 Scaled Residual = 0.00804443 Iteration = 32 Scaled Residual = 0.00781978 Iteration = 33 Scaled Residual = 0.00759217 Iteration = 34 Scaled Residual = 0.00737097 Iteration = 35 Scaled Residual = 0.00716364 Iteration = 36 Scaled Residual = 0.00696918 Iteration = 37 Scaled Residual = 0.0067804 Iteration = 38 Scaled Residual = 0.00659019 Iteration = 39 Scaled Residual = 0.00639654 Iteration = 40 Scaled Residual = 0.00620602 Iteration = 41 Scaled Residual = 0.00602989 Iteration = 42 Scaled Residual = 0.0058769 Iteration = 43 Scaled Residual = 0.00575092 Iteration = 44 Scaled Residual = 0.00564912 Iteration = 45 Scaled Residual = 0.00556105 Iteration = 46 Scaled Residual = 0.00547371 Iteration = 47 Scaled Residual = 0.00537769 Iteration = 48 Scaled Residual = 0.00527052 Iteration = 49 Scaled Residual = 0.00515814 Iteration = 50 Scaled Residual = 0.0050493 GPU Rank Info: | cuSPARSE version 12.2 | Reference CPU memory = 25813.50 MB | GPU Name: 'NVIDIA H100' | GPU Memory Use: 54270 MB / 95244 MB | Process Grid: 8x17x7 | Local Domain: 512x512x256 | Number of CPU Threads: 8 | Slice Size: 2048 WARNING: PERFORMING UNPRECONDITIONED ITERATIONS Call [0] Number of Iterations [11] Scaled Residual [1.19805e-14] WARNING: PERFORMING UNPRECONDITIONED ITERATIONS Call [1] Number of Iterations [11] Scaled Residual [1.19805e-14] Call [0] Number of Iterations [2] Scaled Residual [1.49959e-17] Call [1] Number of Iterations [2] Scaled Residual [1.49959e-17] Departure from symmetry (scaled) for SpMV abs(x'*A*y - y'*A*x) = 9.2926e-16 Departure from symmetry (scaled) for MG abs(x'*Minv*y - y'*Minv*x) = 0 SpMV call [0] Residual [0] SpMV call [1] Residual [0] Initial Residual = 97442.9 Iteration = 1 Scaled Residual = 0.2201 Iteration = 2 Scaled Residual = 0.118943 Iteration = 3 Scaled Residual = 0.0809879 Iteration = 4 Scaled Residual = 0.0614088 Iteration = 5 Scaled Residual = 0.0495242 Iteration = 6 Scaled Residual = 0.041496 Iteration = 7 Scaled Residual = 0.0357246 Iteration = 8 Scaled Residual = 0.0313811 Iteration = 9 Scaled Residual = 0.0279799 Iteration = 10 Scaled Residual = 0.0252497 Iteration = 11 Scaled Residual = 0.0230101 Iteration = 12 Scaled Residual = 0.0211356 Iteration = 13 Scaled Residual = 0.0195488 Iteration = 14 Scaled Residual = 0.018187 Iteration = 15 Scaled Residual = 0.0170037 Iteration = 16 Scaled Residual = 0.0159687 Iteration = 17 Scaled Residual = 0.0150557 Iteration = 18 Scaled Residual = 0.0142459 Iteration = 19 Scaled Residual = 0.0135238 Iteration = 20 Scaled Residual = 0.0128761 Iteration = 21 Scaled Residual = 0.0122935 Iteration = 22 Scaled Residual = 0.0117678 Iteration = 23 Scaled Residual = 0.011292 Iteration = 24 Scaled Residual = 0.0108596 Iteration = 25 Scaled Residual = 0.0104638 Iteration = 26 Scaled Residual = 0.0100998 Iteration = 27 Scaled Residual = 0.00976261 Iteration = 28 Scaled Residual = 0.00944659 Iteration = 29 Scaled Residual = 0.00914781 Iteration = 30 Scaled Residual = 0.00886221 Iteration = 31 Scaled Residual = 0.00858705 Iteration = 32 Scaled Residual = 0.00832203 Iteration = 33 Scaled Residual = 0.00806631 Iteration = 34 Scaled Residual = 0.0078206 Iteration = 35 Scaled Residual = 0.00758666 Iteration = 36 Scaled Residual = 0.00736519 Iteration = 37 Scaled Residual = 0.00715704 Iteration = 38 Scaled Residual = 0.00696281 Iteration = 39 Scaled Residual = 0.00678166 Iteration = 40 Scaled Residual = 0.00661352 Iteration = 41 Scaled Residual = 0.00645805 Iteration = 42 Scaled Residual = 0.00631366 Iteration = 43 Scaled Residual = 0.00617911 Iteration = 44 Scaled Residual = 0.00605286 Iteration = 45 Scaled Residual = 0.00593263 Iteration = 46 Scaled Residual = 0.00581664 Iteration = 47 Scaled Residual = 0.00570229 Iteration = 48 Scaled Residual = 0.00558727 Iteration = 49 Scaled Residual = 0.00547151 Iteration = 50 Scaled Residual = 0.00535528 Iteration = 51 Scaled Residual = 0.00523969 Iteration = 52 Scaled Residual = 0.00512748 Iteration = 53 Scaled Residual = 0.00502041 Call [0] Scaled Residual [0.00502041] Call [1] Scaled Residual [0.00502041] Call [2] Scaled Residual [0.00502041] Call [3] Scaled Residual [0.00502041] Call [4] Scaled Residual [0.00502041] Call [5] Scaled Residual [0.00502041] Call [6] Scaled Residual [0.00502041] Call [7] Scaled Residual [0.00502041] Call [8] Scaled Residual [0.00502041] Call [9] Scaled Residual [0.00502041] Call [10] Scaled Residual [0.00502041] Call [11] Scaled Residual [0.00502041] Call [12] Scaled Residual [0.00502041] Call [13] Scaled Residual [0.00502041] Call [14] Scaled Residual [0.00502041] Call [15] Scaled Residual [0.00502041] Call [16] Scaled Residual [0.00502041] Call [17] Scaled Residual [0.00502041] Call [18] Scaled Residual [0.00502041] Call [19] Scaled Residual [0.00502041] Call [20] Scaled Residual [0.00502041] Call [21] Scaled Residual [0.00502041] Call [22] Scaled Residual [0.00502041] Call [23] Scaled Residual [0.00502041] Call [24] Scaled Residual [0.00502041] Call [25] Scaled Residual [0.00502041] Call [26] Scaled Residual [0.00502041] Call [27] Scaled Residual [0.00502041] Call [28] Scaled Residual [0.00502041] Call [29] Scaled Residual [0.00502041] Call [30] Scaled Residual [0.00502041] Call [31] Scaled Residual [0.00502041] Call [32] Scaled Residual [0.00502041] Call [33] Scaled Residual [0.00502041] Call [34] Scaled Residual [0.00502041] Call [35] Scaled Residual [0.00502041] Call [36] Scaled Residual [0.00502041] Call [37] Scaled Residual [0.00502041] Call [38] Scaled Residual [0.00502041] Call [39] Scaled Residual [0.00502041] Call [40] Scaled Residual [0.00502041] Call [41] Scaled Residual [0.00502041] Call [42] Scaled Residual [0.00502041] Call [43] Scaled Residual [0.00502041] Call [44] Scaled Residual [0.00502041] Call [45] Scaled Residual [0.00502041] Call [46] Scaled Residual [0.00502041] Call [47] Scaled Residual [0.00502041] Call [48] Scaled Residual [0.00502041] Call [49] Scaled Residual [0.00502041] Call [50] Scaled Residual [0.00502041] Call [51] Scaled Residual [0.00502041] Call [52] Scaled Residual [0.00502041] Call [53] Scaled Residual [0.00502041] Call [54] Scaled Residual [0.00502041] Call [55] Scaled Residual [0.00502041] Call [56] Scaled Residual [0.00502041] Call [57] Scaled Residual [0.00502041] Call [58] Scaled Residual [0.00502041] Call [59] Scaled Residual [0.00502041] Call [60] Scaled Residual [0.00502041] Call [61] Scaled Residual [0.00502041] Call [62] Scaled Residual [0.00502041] Call [63] Scaled Residual [0.00502041] Call [64] Scaled Residual [0.00502041] Call [65] Scaled Residual [0.00502041] Call [66] Scaled Residual [0.00502041] Call [67] Scaled Residual [0.00502041] Call [68] Scaled Residual [0.00502041] Call [69] Scaled Residual [0.00502041] Call [70] Scaled Residual [0.00502041] Call [71] Scaled Residual [0.00502041] Call [72] Scaled Residual [0.00502041] Call [73] Scaled Residual [0.00502041] Call [74] Scaled Residual [0.00502041] Call [75] Scaled Residual [0.00502041] Call [76] Scaled Residual [0.00502041] Call [77] Scaled Residual [0.00502041] Call [78] Scaled Residual [0.00502041] Call [79] Scaled Residual [0.00502041] Call [80] Scaled Residual [0.00502041] Call [81] Scaled Residual [0.00502041] Call [82] Scaled Residual [0.00502041] Call [83] Scaled Residual [0.00502041] Call [84] Scaled Residual [0.00502041] Call [85] Scaled Residual [0.00502041] Call [86] Scaled Residual [0.00502041] Call [87] Scaled Residual [0.00502041] Call [88] Scaled Residual [0.00502041] Call [89] Scaled Residual [0.00502041] Call [90] Scaled Residual [0.00502041] Call [91] Scaled Residual [0.00502041] Call [92] Scaled Residual [0.00502041] Call [93] Scaled Residual [0.00502041] Call [94] Scaled Residual [0.00502041] Call [95] Scaled Residual [0.00502041] Call [96] Scaled Residual [0.00502041] Call [97] Scaled Residual [0.00502041] Call [98] Scaled Residual [0.00502041] Call [99] Scaled Residual [0.00502041] Call [100] Scaled Residual [0.00502041] Call [101] Scaled Residual [0.00502041] Call [102] Scaled Residual [0.00502041] Call [103] Scaled Residual [0.00502041] Call [104] Scaled Residual [0.00502041] Call [105] Scaled Residual [0.00502041] Call [106] Scaled Residual [0.00502041] Call [107] Scaled Residual [0.00502041] Call [108] Scaled Residual [0.00502041] Call [109] Scaled Residual [0.00502041] Call [110] Scaled Residual [0.00502041] Call [111] Scaled Residual [0.00502041] Call [112] Scaled Residual [0.00502041] Call [113] Scaled Residual [0.00502041] Call [114] Scaled Residual [0.00502041] Call [115] Scaled Residual [0.00502041] Call [116] Scaled Residual [0.00502041] Call [117] Scaled Residual [0.00502041] Call [118] Scaled Residual [0.00502041] Call [119] Scaled Residual [0.00502041] Call [120] Scaled Residual [0.00502041] Call [121] Scaled Residual [0.00502041] Call [122] Scaled Residual [0.00502041] Call [123] Scaled Residual [0.00502041] Call [124] Scaled Residual [0.00502041] Call [125] Scaled Residual [0.00502041] Call [126] Scaled Residual [0.00502041] Call [127] Scaled Residual [0.00502041] Call [128] Scaled Residual [0.00502041] Call [129] Scaled Residual [0.00502041] Call [130] Scaled Residual [0.00502041] Call [131] Scaled Residual [0.00502041] Call [132] Scaled Residual [0.00502041] Call [133] Scaled Residual [0.00502041] Call [134] Scaled Residual [0.00502041] Call [135] Scaled Residual [0.00502041] Call [136] Scaled Residual [0.00502041] Call [137] Scaled Residual [0.00502041] Call [138] Scaled Residual [0.00502041] Call [139] Scaled Residual [0.00502041] Call [140] Scaled Residual [0.00502041] Call [141] Scaled Residual [0.00502041] Call [142] Scaled Residual [0.00502041] Call [143] Scaled Residual [0.00502041] Call [144] Scaled Residual [0.00502041] Call [145] Scaled Residual [0.00502041] Call [146] Scaled Residual [0.00502041] Call [147] Scaled Residual [0.00502041] Call [148] Scaled Residual [0.00502041] Call [149] Scaled Residual [0.00502041] Call [150] Scaled Residual [0.00502041] Call [151] Scaled Residual [0.00502041] Call [152] Scaled Residual [0.00502041] Call [153] Scaled Residual [0.00502041] Call [154] Scaled Residual [0.00502041] Call [155] Scaled Residual [0.00502041] Call [156] Scaled Residual [0.00502041] Call [157] Scaled Residual [0.00502041] Call [158] Scaled Residual [0.00502041] Call [159] Scaled Residual [0.00502041] Call [160] Scaled Residual [0.00502041] Call [161] Scaled Residual [0.00502041] Call [162] Scaled Residual [0.00502041] Call [163] Scaled Residual [0.00502041] Call [164] Scaled Residual [0.00502041] Call [165] Scaled Residual [0.00502041] Call [166] Scaled Residual [0.00502041] Call [167] Scaled Residual [0.00502041] Call [168] Scaled Residual [0.00502041] Call [169] Scaled Residual [0.00502041] Call [170] Scaled Residual [0.00502041] Call [171] Scaled Residual [0.00502041] Call [172] Scaled Residual [0.00502041] Call [173] Scaled Residual [0.00502041] Call [174] Scaled Residual [0.00502041] Call [175] Scaled Residual [0.00502041] Call [176] Scaled Residual [0.00502041] Call [177] Scaled Residual [0.00502041] Call [178] Scaled Residual [0.00502041] Call [179] Scaled Residual [0.00502041] Call [180] Scaled Residual [0.00502041] Call [181] Scaled Residual [0.00502041] Call [182] Scaled Residual [0.00502041] Call [183] Scaled Residual [0.00502041] Call [184] Scaled Residual [0.00502041] Call [185] Scaled Residual [0.00502041] Call [186] Scaled Residual [0.00502041] Call [187] Scaled Residual [0.00502041] Call [188] Scaled Residual [0.00502041] Call [189] Scaled Residual [0.00502041] Call [190] Scaled Residual [0.00502041] Call [191] Scaled Residual [0.00502041] Call [192] Scaled Residual [0.00502041] Call [193] Scaled Residual [0.00502041] Call [194] Scaled Residual [0.00502041] Call [195] Scaled Residual [0.00502041] Call [196] Scaled Residual [0.00502041] Call [197] Scaled Residual [0.00502041] Call [198] Scaled Residual [0.00502041] Call [199] Scaled Residual [0.00502041] Call [200] Scaled Residual [0.00502041] Call [201] Scaled Residual [0.00502041] Call [202] Scaled Residual [0.00502041] Call [203] Scaled Residual [0.00502041] Call [204] Scaled Residual [0.00502041] Call [205] Scaled Residual [0.00502041] Call [206] Scaled Residual [0.00502041] Call [207] Scaled Residual [0.00502041] Call [208] Scaled Residual [0.00502041] Call [209] Scaled Residual [0.00502041] Call [210] Scaled Residual [0.00502041] Call [211] Scaled Residual [0.00502041] Call [212] Scaled Residual [0.00502041] Call [213] Scaled Residual [0.00502041] Call [214] Scaled Residual [0.00502041] Call [215] Scaled Residual [0.00502041] Call [216] Scaled Residual [0.00502041] Call [217] Scaled Residual [0.00502041] Call [218] Scaled Residual [0.00502041] Call [219] Scaled Residual [0.00502041] Call [220] Scaled Residual [0.00502041] Call [221] Scaled Residual [0.00502041] Call [222] Scaled Residual [0.00502041] Call [223] Scaled Residual [0.00502041] Call [224] Scaled Residual [0.00502041] Call [225] Scaled Residual [0.00502041] Call [226] Scaled Residual [0.00502041] Call [227] Scaled Residual [0.00502041] Call [228] Scaled Residual [0.00502041] Call [229] Scaled Residual [0.00502041] Call [230] Scaled Residual [0.00502041] Call [231] Scaled Residual [0.00502041] Call [232] Scaled Residual [0.00502041] Call [233] Scaled Residual [0.00502041] Call [234] Scaled Residual [0.00502041] Call [235] Scaled Residual [0.00502041] Call [236] Scaled Residual [0.00502041] Call [237] Scaled Residual [0.00502041] Call [238] Scaled Residual [0.00502041] Call [239] Scaled Residual [0.00502041] Call [240] Scaled Residual [0.00502041] Call [241] Scaled Residual [0.00502041] Call [242] Scaled Residual [0.00502041] Call [243] Scaled Residual [0.00502041] Call [244] Scaled Residual [0.00502041] Call [245] Scaled Residual [0.00502041] Call [246] Scaled Residual [0.00502041] Call [247] Scaled Residual [0.00502041] Call [248] Scaled Residual [0.00502041] Call [249] Scaled Residual [0.00502041] Call [250] Scaled Residual [0.00502041] Call [251] Scaled Residual [0.00502041] Call [252] Scaled Residual [0.00502041] Call [253] Scaled Residual [0.00502041] Call [254] Scaled Residual [0.00502041] Call [255] Scaled Residual [0.00502041] Call [256] Scaled Residual [0.00502041] Call [257] Scaled Residual [0.00502041] Call [258] Scaled Residual [0.00502041] Call [259] Scaled Residual [0.00502041] Call [260] Scaled Residual [0.00502041] Call [261] Scaled Residual [0.00502041] Call [262] Scaled Residual [0.00502041] Call [263] Scaled Residual [0.00502041] Call [264] Scaled Residual [0.00502041] Call [265] Scaled Residual [0.00502041] Call [266] Scaled Residual [0.00502041] Call [267] Scaled Residual [0.00502041] Call [268] Scaled Residual [0.00502041] Call [269] Scaled Residual [0.00502041] Call [270] Scaled Residual [0.00502041] Call [271] Scaled Residual [0.00502041] Call [272] Scaled Residual [0.00502041] Call [273] Scaled Residual [0.00502041] Call [274] Scaled Residual [0.00502041] Call [275] Scaled Residual [0.00502041] Call [276] Scaled Residual [0.00502041] Call [277] Scaled Residual [0.00502041] Call [278] Scaled Residual [0.00502041] Call [279] Scaled Residual [0.00502041] Call [280] Scaled Residual [0.00502041] Call [281] Scaled Residual [0.00502041] Call [282] Scaled Residual [0.00502041] Call [283] Scaled Residual [0.00502041] Call [284] Scaled Residual [0.00502041] Call [285] Scaled Residual [0.00502041] Call [286] Scaled Residual [0.00502041] Call [287] Scaled Residual [0.00502041] Call [288] Scaled Residual [0.00502041] Call [289] Scaled Residual [0.00502041] Call [290] Scaled Residual [0.00502041] Call [291] Scaled Residual [0.00502041] Call [292] Scaled Residual [0.00502041] Call [293] Scaled Residual [0.00502041] Call [294] Scaled Residual [0.00502041] Call [295] Scaled Residual [0.00502041] Call [296] Scaled Residual [0.00502041] Call [297] Scaled Residual [0.00502041] Call [298] Scaled Residual [0.00502041] Call [299] Scaled Residual [0.00502041] Call [300] Scaled Residual [0.00502041] Call [301] Scaled Residual [0.00502041] Call [302] Scaled Residual [0.00502041] Call [303] Scaled Residual [0.00502041] Call [304] Scaled Residual [0.00502041] Call [305] Scaled Residual [0.00502041] Call [306] Scaled Residual [0.00502041] Call [307] Scaled Residual [0.00502041] Call [308] Scaled Residual [0.00502041] Call [309] Scaled Residual [0.00502041] Call [310] Scaled Residual [0.00502041] Call [311] Scaled Residual [0.00502041] Call [312] Scaled Residual [0.00502041] Call [313] Scaled Residual [0.00502041] Call [314] Scaled Residual [0.00502041] Call [315] Scaled Residual [0.00502041] Call [316] Scaled Residual [0.00502041] Call [317] Scaled Residual [0.00502041] Call [318] Scaled Residual [0.00502041] Call [319] Scaled Residual [0.00502041] Call [320] Scaled Residual [0.00502041] Call [321] Scaled Residual [0.00502041] Call [322] Scaled Residual [0.00502041] Call [323] Scaled Residual [0.00502041] Call [324] Scaled Residual [0.00502041] Call [325] Scaled Residual [0.00502041] Call [326] Scaled Residual [0.00502041] Call [327] Scaled Residual [0.00502041] Call [328] Scaled Residual [0.00502041] Call [329] Scaled Residual [0.00502041] Call [330] Scaled Residual [0.00502041] Call [331] Scaled Residual [0.00502041] Call [332] Scaled Residual [0.00502041] Call [333] Scaled Residual [0.00502041] Call [334] Scaled Residual [0.00502041] Call [335] Scaled Residual [0.00502041] Call [336] Scaled Residual [0.00502041] Call [337] Scaled Residual [0.00502041] Call [338] Scaled Residual [0.00502041] Call [339] Scaled Residual [0.00502041] Call [340] Scaled Residual [0.00502041] Call [341] Scaled Residual [0.00502041] Call [342] Scaled Residual [0.00502041] Call [343] Scaled Residual [0.00502041] Call [344] Scaled Residual [0.00502041] Call [345] Scaled Residual [0.00502041] Call [346] Scaled Residual [0.00502041] Call [347] Scaled Residual [0.00502041] Call [348] Scaled Residual [0.00502041] Call [349] Scaled Residual [0.00502041] Call [350] Scaled Residual [0.00502041] Call [351] Scaled Residual [0.00502041] Call [352] Scaled Residual [0.00502041] Call [353] Scaled Residual [0.00502041] Call [354] Scaled Residual [0.00502041] Call [355] Scaled Residual [0.00502041] Call [356] Scaled Residual [0.00502041] Call [357] Scaled Residual [0.00502041] Call [358] Scaled Residual [0.00502041] Call [359] Scaled Residual [0.00502041] Call [360] Scaled Residual [0.00502041] Call [361] Scaled Residual [0.00502041] Call [362] Scaled Residual [0.00502041] Call [363] Scaled Residual [0.00502041] Call [364] Scaled Residual [0.00502041] Call [365] Scaled Residual [0.00502041] Call [366] Scaled Residual [0.00502041] Call [367] Scaled Residual [0.00502041] Call [368] Scaled Residual [0.00502041] Call [369] Scaled Residual [0.00502041] Call [370] Scaled Residual [0.00502041] Call [371] Scaled Residual [0.00502041] Call [372] Scaled Residual [0.00502041] Call [373] Scaled Residual [0.00502041] Call [374] Scaled Residual [0.00502041] Call [375] Scaled Residual [0.00502041] Call [376] Scaled Residual [0.00502041] Call [377] Scaled Residual [0.00502041] Call [378] Scaled Residual [0.00502041] Call [379] Scaled Residual [0.00502041] Call [380] Scaled Residual [0.00502041] Call [381] Scaled Residual [0.00502041] Call [382] Scaled Residual [0.00502041] Call [383] Scaled Residual [0.00502041] Call [384] Scaled Residual [0.00502041] Call [385] Scaled Residual [0.00502041] Call [386] Scaled Residual [0.00502041] Call [387] Scaled Residual [0.00502041] Call [388] Scaled Residual [0.00502041] Call [389] Scaled Residual [0.00502041] Call [390] Scaled Residual [0.00502041] Call [391] Scaled Residual [0.00502041] Call [392] Scaled Residual [0.00502041] Call [393] Scaled Residual [0.00502041] Call [394] Scaled Residual [0.00502041] Call [395] Scaled Residual [0.00502041] Call [396] Scaled Residual [0.00502041] Call [397] Scaled Residual [0.00502041] Call [398] Scaled Residual [0.00502041] Call [399] Scaled Residual [0.00502041] Call [400] Scaled Residual [0.00502041] Call [401] Scaled Residual [0.00502041] Call [402] Scaled Residual [0.00502041] Call [403] Scaled Residual [0.00502041] Call [404] Scaled Residual [0.00502041] Call [405] Scaled Residual [0.00502041] Call [406] Scaled Residual [0.00502041] Call [407] Scaled Residual [0.00502041] Call [408] Scaled Residual [0.00502041] Call [409] Scaled Residual [0.00502041] Call [410] Scaled Residual [0.00502041] Call [411] Scaled Residual [0.00502041] Call [412] Scaled Residual [0.00502041] Call [413] Scaled Residual [0.00502041] Call [414] Scaled Residual [0.00502041] Call [415] Scaled Residual [0.00502041] Call [416] Scaled Residual [0.00502041] Call [417] Scaled Residual [0.00502041] Call [418] Scaled Residual [0.00502041] Call [419] Scaled Residual [0.00502041] Call [420] Scaled Residual [0.00502041] Call [421] Scaled Residual [0.00502041] Call [422] Scaled Residual [0.00502041] Call [423] Scaled Residual [0.00502041] Call [424] Scaled Residual [0.00502041] Call [425] Scaled Residual [0.00502041] Call [426] Scaled Residual [0.00502041] Call [427] Scaled Residual [0.00502041] Call [428] Scaled Residual [0.00502041] Call [429] Scaled Residual [0.00502041] Call [430] Scaled Residual [0.00502041] Call [431] Scaled Residual [0.00502041] Call [432] Scaled Residual [0.00502041] Call [433] Scaled Residual [0.00502041] Call [434] Scaled Residual [0.00502041] Call [435] Scaled Residual [0.00502041] Call [436] Scaled Residual [0.00502041] Call [437] Scaled Residual [0.00502041] Call [438] Scaled Residual [0.00502041] Call [439] Scaled Residual [0.00502041] Call [440] Scaled Residual [0.00502041] Call [441] Scaled Residual [0.00502041] Call [442] Scaled Residual [0.00502041] Call [443] Scaled Residual [0.00502041] Call [444] Scaled Residual [0.00502041] Call [445] Scaled Residual [0.00502041] Call [446] Scaled Residual [0.00502041] Call [447] Scaled Residual [0.00502041] Call [448] Scaled Residual [0.00502041] Call [449] Scaled Residual [0.00502041] Call [450] Scaled Residual [0.00502041] Call [451] Scaled Residual [0.00502041] Call [452] Scaled Residual [0.00502041] Call [453] Scaled Residual [0.00502041] Call [454] Scaled Residual [0.00502041] Call [455] Scaled Residual [0.00502041] Call [456] Scaled Residual [0.00502041] Call [457] Scaled Residual [0.00502041] Call [458] Scaled Residual [0.00502041] Call [459] Scaled Residual [0.00502041] Call [460] Scaled Residual [0.00502041] Call [461] Scaled Residual [0.00502041] Call [462] Scaled Residual [0.00502041] Call [463] Scaled Residual [0.00502041] Call [464] Scaled Residual [0.00502041] Call [465] Scaled Residual [0.00502041] Call [466] Scaled Residual [0.00502041] Call [467] Scaled Residual [0.00502041] Call [468] Scaled Residual [0.00502041] Call [469] Scaled Residual [0.00502041] Call [470] Scaled Residual [0.00502041] Call [471] Scaled Residual [0.00502041] Call [472] Scaled Residual [0.00502041] Call [473] Scaled Residual [0.00502041] Call [474] Scaled Residual [0.00502041] Call [475] Scaled Residual [0.00502041] Call [476] Scaled Residual [0.00502041] Call [477] Scaled Residual [0.00502041] Call [478] Scaled Residual [0.00502041] Call [479] Scaled Residual [0.00502041] Call [480] Scaled Residual [0.00502041] Call [481] Scaled Residual [0.00502041] Call [482] Scaled Residual [0.00502041] Call [483] Scaled Residual [0.00502041] Call [484] Scaled Residual [0.00502041] Call [485] Scaled Residual [0.00502041] Call [486] Scaled Residual [0.00502041] Call [487] Scaled Residual [0.00502041] Call [488] Scaled Residual [0.00502041] Call [489] Scaled Residual [0.00502041] Call [490] Scaled Residual [0.00502041] Call [491] Scaled Residual [0.00502041] Call [492] Scaled Residual [0.00502041] Call [493] Scaled Residual [0.00502041] Call [494] Scaled Residual [0.00502041] Call [495] Scaled Residual [0.00502041] Call [496] Scaled Residual [0.00502041] Call [497] Scaled Residual [0.00502041] Call [498] Scaled Residual [0.00502041] Call [499] Scaled Residual [0.00502041] Call [500] Scaled Residual [0.00502041] Call [501] Scaled Residual [0.00502041] Call [502] Scaled Residual [0.00502041] Call [503] Scaled Residual [0.00502041] Call [504] Scaled Residual [0.00502041] Call [505] Scaled Residual [0.00502041] Call [506] Scaled Residual [0.00502041] Call [507] Scaled Residual [0.00502041] Call [508] Scaled Residual [0.00502041] Call [509] Scaled Residual [0.00502041] Call [510] Scaled Residual [0.00502041] Call [511] Scaled Residual [0.00502041] Call [512] Scaled Residual [0.00502041] Call [513] Scaled Residual [0.00502041] Call [514] Scaled Residual [0.00502041] Call [515] Scaled Residual [0.00502041] Call [516] Scaled Residual [0.00502041] Call [517] Scaled Residual [0.00502041] Call [518] Scaled Residual [0.00502041] Call [519] Scaled Residual [0.00502041] Call [520] Scaled Residual [0.00502041] Call [521] Scaled Residual [0.00502041] Call [522] Scaled Residual [0.00502041] Call [523] Scaled Residual [0.00502041] Call [524] Scaled Residual [0.00502041] Call [525] Scaled Residual [0.00502041] Call [526] Scaled Residual [0.00502041] Call [527] Scaled Residual [0.00502041] Call [528] Scaled Residual [0.00502041] Call [529] Scaled Residual [0.00502041] Call [530] Scaled Residual [0.00502041] Call [531] Scaled Residual [0.00502041] Call [532] Scaled Residual [0.00502041] Call [533] Scaled Residual [0.00502041] Call [534] Scaled Residual [0.00502041] Call [535] Scaled Residual [0.00502041] Call [536] Scaled Residual [0.00502041] Call [537] Scaled Residual [0.00502041] Call [538] Scaled Residual [0.00502041] Call [539] Scaled Residual [0.00502041] Call [540] Scaled Residual [0.00502041] Call [541] Scaled Residual [0.00502041] Call [542] Scaled Residual [0.00502041] Call [543] Scaled Residual [0.00502041] Call [544] Scaled Residual [0.00502041] Call [545] Scaled Residual [0.00502041] Call [546] Scaled Residual [0.00502041] Call [547] Scaled Residual [0.00502041] Call [548] Scaled Residual [0.00502041] Call [549] Scaled Residual [0.00502041] Call [550] Scaled Residual [0.00502041] Call [551] Scaled Residual [0.00502041] Call [552] Scaled Residual [0.00502041] Call [553] Scaled Residual [0.00502041] Call [554] Scaled Residual [0.00502041] Call [555] Scaled Residual [0.00502041] Call [556] Scaled Residual [0.00502041] Call [557] Scaled Residual [0.00502041] Call [558] Scaled Residual [0.00502041] Call [559] Scaled Residual [0.00502041] Call [560] Scaled Residual [0.00502041] Call [561] Scaled Residual [0.00502041] Call [562] Scaled Residual [0.00502041] Call [563] Scaled Residual [0.00502041] Call [564] Scaled Residual [0.00502041] Call [565] Scaled Residual [0.00502041] Call [566] Scaled Residual [0.00502041] Call [567] Scaled Residual [0.00502041] Call [568] Scaled Residual [0.00502041] Call [569] Scaled Residual [0.00502041] Call [570] Scaled Residual [0.00502041] Call [571] Scaled Residual [0.00502041] Call [572] Scaled Residual [0.00502041] Call [573] Scaled Residual [0.00502041] Call [574] Scaled Residual [0.00502041] Call [575] Scaled Residual [0.00502041] HPCG-Benchmark version=3.1 Release date=March 28, 2019 Machine Summary= Machine Summary::Distributed Processes=952 Machine Summary::Threads per processes=8 Global Problem Dimensions= Global Problem Dimensions::Global nx=4096 Global Problem Dimensions::Global ny=8704 Global Problem Dimensions::Global nz=1792 Processor Dimensions= Processor Dimensions::npx=8 Processor Dimensions::npy=17 Processor Dimensions::npz=7 Local Domain Dimensions= Local Domain Dimensions::nx=512 Local Domain Dimensions::ny=512 ########## Problem Summary ##########= Setup Information= Setup Information::Setup Time=1.08958 Linear System Information= Linear System Information::Number of Equations=63887638528 Linear System Information::Number of Nonzero Terms=1723911810040 Multigrid Information= Multigrid Information::Number of coarse grid levels=3 Multigrid Information::Coarse Grids= Multigrid Information::Coarse Grids::Grid Level=1 Multigrid Information::Coarse Grids::Number of Equations=7985954816 Multigrid Information::Coarse Grids::Number of Nonzero Terms=215357216248 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=2 Multigrid Information::Coarse Grids::Number of Equations=998244352 Multigrid Information::Coarse Grids::Number of Nonzero Terms=26886728440 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 Multigrid Information::Coarse Grids::Grid Level=3 Multigrid Information::Coarse Grids::Number of Equations=124780544 Multigrid Information::Coarse Grids::Number of Nonzero Terms=3352618360 Multigrid Information::Coarse Grids::Number of Presmoother Steps=1 Multigrid Information::Coarse Grids::Number of Postsmoother Steps=1 ########## Memory Use Summary ##########= Memory Use Information= Memory Use Information::Total memory used for data (Gbytes)=45670.5 Memory Use Information::Memory used for OptimizeProblem data (Gbytes)=0 Memory Use Information::Bytes per equation (Total memory / Number of Equations)=714.856 Memory Use Information::Memory used for linear system and CG (Gbytes)=40193.3 Memory Use Information::Coarse Grids= Memory Use Information::Coarse Grids::Grid Level=1 Memory Use Information::Coarse Grids::Memory used=4801.57 Memory Use Information::Coarse Grids::Grid Level=2 Memory Use Information::Coarse Grids::Memory used=600.449 Memory Use Information::Coarse Grids::Grid Level=3 Memory Use Information::Coarse Grids::Memory used=75.1204 ########## V&V Testing Summary ##########= Spectral Convergence Tests= Spectral Convergence Tests::Result=PASSED Spectral Convergence Tests::Unpreconditioned= Spectral Convergence Tests::Unpreconditioned::Maximum iteration count=11 Spectral Convergence Tests::Unpreconditioned::Expected iteration count=12 Spectral Convergence Tests::Preconditioned= Spectral Convergence Tests::Preconditioned::Maximum iteration count=2 Spectral Convergence Tests::Preconditioned::Expected iteration count=2 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon= Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Result=PASSED Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for SpMV=9.2926e-16 Departure from Symmetry |x'Ay-y'Ax|/(2*||x||*||A||*||y||)/epsilon::Departure for MG=0 ########## Iterations Summary ##########= Iteration Count Information= Iteration Count Information::Result=PASSED Iteration Count Information::Reference CG iterations per set=50 Iteration Count Information::Optimized CG iterations per set=53 Iteration Count Information::Total number of reference iterations=28800 Iteration Count Information::Total number of optimized iterations=30528 ########## Reproducibility Summary ##########= Reproducibility Information= Reproducibility Information::Result=PASSED Reproducibility Information::Scaled residual mean=0.00502041 Reproducibility Information::Scaled residual variance=0 ########## Performance Summary (times in sec) ##########= Benchmark Time Summary= Benchmark Time Summary::Optimization phase=0.524245 Benchmark Time Summary::DDOT=56.9871 Benchmark Time Summary::WAXPBY=66.2365 Benchmark Time Summary::SpMV=333.59 Benchmark Time Summary::MG=1404.65 Benchmark Time Summary::Total=1861.49 Floating Point Operations Summary= Floating Point Operations Summary::Raw DDOT=1.17758e+16 Floating Point Operations Summary::Raw WAXPBY=1.17758e+16 Floating Point Operations Summary::Raw SpMV=1.07241e+17 Floating Point Operations Summary::Raw MG=6.00637e+17 Floating Point Operations Summary::Total=7.3143e+17 Floating Point Operations Summary::Total with convergence overhead=6.90028e+17 GB/s Summary= GB/s Summary::Raw Read B/W=2.42011e+06 GB/s Summary::Raw Write B/W=559334 GB/s Summary::Raw Total B/W=2.97944e+06 GB/s Summary::Total with convergence and optimization phase overhead=2.67711e+06 GFLOP/s Summary= GFLOP/s Summary::Raw DDOT=206639 GFLOP/s Summary::Raw WAXPBY=177784 GFLOP/s Summary::Raw SpMV=321476 GFLOP/s Summary::Raw MG=427607 GFLOP/s Summary::Raw Total=392928 GFLOP/s Summary::Total with convergence overhead=370687 GFLOP/s Summary::Total with convergence and optimization phase overhead=353056 User Optimization Overheads= User Optimization Overheads::Optimization phase time (sec)=0.524245 User Optimization Overheads::Optimization phase time vs reference SpMV+MG time=0.0515972 DDOT Timing Variations= DDOT Timing Variations::Min DDOT MPI_Allreduce time=5.78831 DDOT Timing Variations::Max DDOT MPI_Allreduce time=16.4822 DDOT Timing Variations::Avg DDOT MPI_Allreduce time=9.22201 Final Summary= Final Summary::HPCG result is VALID with a GFLOP/s rating of=353056 Final Summary::HPCG 2.4 rating for historical reasons is=364769 Final Summary::Please upload results from the YAML file contents to=http://hpcg-benchmark.org real 2587.77 user 11262.77 sys 957.78 Sat Sep 7 09:36:41 PM JST 2024