Results for MPI perforance tests on t3depcc
Contents
memcpy
Determining delivered memory performance
mpicc -o memcpy -O memcpy.c
Size (bytes) Time (sec) Rate (MB/sec)
8 0.000000 17.268261
16 0.000001 18.045135
32 0.000001 33.154629
64 0.000001 64.651462
128 0.000001 110.992539
256 0.000001 176.482683
512 0.000002 248.623748
1024 0.000003 315.716504
2048 0.000014 141.822355
4096 0.000028 145.526495
8192 0.000045 181.559875
16384 0.000087 189.269119
32768 0.000177 185.533745
65536 0.000353 185.668203
131072 0.000706 185.696948
262144 0.001406 186.457979
524288 0.002801 187.180785
1048576 0.005599 187.294375
2097152 0.011273 186.028314
4194304 0.022569 185.839658
Determining delivered memory performance with unaligned data
mpicc -o memcpy memcpy.c
Size (bytes) Time (sec) Rate (MB/sec)
8 0.000000 17.268372
16 0.000004 3.859888
32 0.000005 6.982633
64 0.000005 13.042668
128 0.000005 23.534996
256 0.000006 40.442558
512 0.000008 63.569757
1024 0.000011 91.327547
2048 0.000013 159.832751
4096 0.000024 171.620471
8192 0.000048 171.916109
16384 0.000149 110.164607
32768 0.000394 83.108240
65536 0.000864 75.836451
131072 0.001725 75.981224
262144 0.003447 76.052612
524288 0.006845 76.592331
1048576 0.013757 76.219506
2097152 0.027504 76.249816
4194304 0.055060 76.177466
pingpong
Benchmarking point to point performance
mpicc -o pingpong -O pingpong.c
Kind n time (sec) Rate (MB/sec)
Send/Recv 1 0.000031 0.259338
Send/Recv 2 0.000035 0.455133
Send/Recv 4 0.000040 0.805782
Send/Recv 8 0.000044 1.458179
Send/Recv 16 0.000045 2.841633
Send/Recv 32 0.000049 5.207497
Send/Recv 64 0.000057 8.942725
Send/Recv 128 0.000076 13.557576
Send/Recv 256 0.000127 16.068467
Send/Recv 512 0.000196 20.846193
Send/Recv 1024 0.000396 20.671397
Send/Recv 2048 0.000648 25.270320
Send/Recv 4096 0.001189 27.559445
Send/Recv 8192 0.002269 28.877711
Send/Recv 16384 0.004424 29.628246
Send/Recv 32768 0.008799 29.793379
Send/Recv 65536 0.017583 29.817568
Send/Recv 131072 0.035179 29.806668
Send/Recv 262144 0.070094 29.919250
Send/Recv 524288 0.140471 29.858877
Send/Recv 1048576 0.273330 30.690443
Benchmarking point to point performance with nonblocking operations
mpicc -o pingpong -O pingpong.c
Kind n time (sec) Rate (MB/sec)
Isend/Irecv 1 0.000045 0.177308
Isend/Irecv 2 0.000046 0.345768
Isend/Irecv 4 0.000053 0.602570
Isend/Irecv 8 0.000055 1.162375
Isend/Irecv 16 0.000057 2.262910
Isend/Irecv 32 0.000060 4.235230
Isend/Irecv 64 0.000068 7.510325
Isend/Irecv 128 0.000085 11.981577
Isend/Irecv 256 0.000139 14.757753
Isend/Irecv 512 0.000206 19.875481
Isend/Irecv 1024 0.000400 20.465168
Isend/Irecv 2048 0.000653 25.101859
Isend/Irecv 4096 0.001194 27.451760
Isend/Irecv 8192 0.002275 28.802819
Isend/Irecv 16384 0.004445 29.484737
Isend/Irecv 32768 0.008820 29.720597
Isend/Irecv 65536 0.017637 29.726573
Isend/Irecv 131072 0.035145 29.835912
Isend/Irecv 262144 0.070244 29.855292
Isend/Irecv 524288 0.140657 29.819340
Isend/Irecv 1048576 0.273915 30.624804
Benchmarking point to point performance with nonblocking operations, head-to-head
mpicc -o pingpong -O pingpong.c
Kind n time (sec) Rate (MB/sec)
head-to-head Isend/Irecv 1 0.000070 0.227114
head-to-head Isend/Irecv 2 0.000071 0.452706
head-to-head Isend/Irecv 4 0.000099 0.644553
head-to-head Isend/Irecv 8 0.000102 1.259817
head-to-head Isend/Irecv 16 0.000112 2.279746
head-to-head Isend/Irecv 32 0.000117 4.366164
head-to-head Isend/Irecv 64 0.000131 7.798869
head-to-head Isend/Irecv 128 0.000150 13.646034
head-to-head Isend/Irecv 256 0.000261 15.713295
head-to-head Isend/Irecv 512 0.000349 23.493838
head-to-head Isend/Irecv 1024 0.000474 34.582362
head-to-head Isend/Irecv 2048 0.000748 43.833186
head-to-head Isend/Irecv 4096 0.001408 46.541160
head-to-head Isend/Irecv 8192 0.002420 54.169806
head-to-head Isend/Irecv 16384 0.004688 55.921351
head-to-head Isend/Irecv 32768 0.010279 51.006776
head-to-head Isend/Irecv 65536 0.019169 54.701306
head-to-head Isend/Irecv 131072 0.038696 54.196256
head-to-head Isend/Irecv 262144 0.079056 53.054871
head-to-head Isend/Irecv 524288 0.154591 54.263134
head-to-head Isend/Irecv 1048576 0.303681 55.246191
Benchmarking point to point performance with unaligned data
mpicc -o pingpong -O pingpong.c
Kind char n time (sec) Rate (MB/sec)
Send/Recv 1 0.000032 0.031275
Send/Recv 2 0.000032 0.062748
Send/Recv 4 0.000032 0.124998
Send/Recv 8 0.000032 0.252601
Send/Recv 16 0.000036 0.448459
Send/Recv 32 0.000040 0.790782
Send/Recv 64 0.000044 1.467696
Send/Recv 128 0.000045 2.819938
Send/Recv 256 0.000051 5.011630
Send/Recv 512 0.000060 8.492273
Send/Recv 1024 0.000077 13.366947
Send/Recv 2048 0.000129 15.887060
Send/Recv 4096 0.000199 20.613266
Send/Recv 8192 0.000387 21.150149
Send/Recv 16384 0.000665 24.641677
Send/Recv 32768 0.001209 27.098587
Send/Recv 65536 0.002289 28.633302
Send/Recv 131072 0.004476 29.285168
Send/Recv 262144 0.008864 29.575646
Send/Recv 524288 0.017777 29.492497
Send/Recv 1048576 0.035485 29.549491
Kind double n time (sec) Rate (MB/sec)
Send/Recv 1 0.000032 0.248314
Send/Recv 2 0.000036 0.441297
Send/Recv 4 0.000041 0.780729
Send/Recv 8 0.000044 1.452235
Send/Recv 16 0.000045 2.828247
Send/Recv 32 0.000049 5.173151
Send/Recv 64 0.000059 8.727687
Send/Recv 128 0.000075 13.634044
Send/Recv 256 0.000127 16.136383
Send/Recv 512 0.000195 21.024775
Send/Recv 1024 0.000386 21.236753
Send/Recv 2048 0.000661 24.788899
Send/Recv 4096 0.001195 27.420610
Send/Recv 8192 0.002268 28.899153
Send/Recv 16384 0.004433 29.566600
Send/Recv 32768 0.008772 29.883109
Send/Recv 65536 0.017563 29.852430
Send/Recv 131072 0.035086 29.886040
Send/Recv 262144 0.069951 29.980263
Send/Recv 524288 0.140082 29.941729
Send/Recv 1048576 0.280156 29.942680
Kind int n time (sec) Rate (MB/sec)
Send/Recv 1 0.000035 0.228041
Send/Recv 2 0.000039 0.411481
Send/Recv 4 0.000045 0.704677
Send/Recv 8 0.000048 1.330858
Send/Recv 16 0.000049 2.595311
Send/Recv 32 0.000054 4.767743
Send/Recv 64 0.000063 8.130430
Send/Recv 128 0.000079 12.953021
Send/Recv 256 0.000129 15.862001
Send/Recv 512 0.000200 20.510215
Send/Recv 1024 0.000387 21.182746
Send/Recv 2048 0.000662 24.743713
Send/Recv 4096 0.001194 27.452103
Send/Recv 8192 0.002268 28.894407
Send/Recv 16384 0.004430 29.587087
Send/Recv 32768 0.008788 29.831219
Send/Recv 65536 0.017593 29.800420
Send/Recv 131072 0.035113 29.862907
Send/Recv 262144 0.069959 29.976789
Send/Recv 524288 0.140211 29.914280
Send/Recv 1048576 0.274470 30.562974
Benchmarking point to point performance with contention
mpicc -o pingpong -O pingpong.c
Kind (np=2) n time (sec) Rate (MB/sec)
Send/Recv 1 0.000032 0.247438
Send/Recv 2 0.000036 0.441900
Send/Recv 4 0.000040 0.794033
Send/Recv 8 0.000044 1.458932
Send/Recv 16 0.000045 2.852255
Send/Recv 32 0.000049 5.241270
Send/Recv 64 0.000057 8.965905
Send/Recv 128 0.000073 13.961698
Send/Recv 256 0.000127 16.142069
Send/Recv 512 0.000195 21.055374
Send/Recv 1024 0.000390 21.016737
Send/Recv 2048 0.000629 26.037502
Send/Recv 4096 0.001164 28.160835
Send/Recv 8192 0.002222 29.498877
Send/Recv 16384 0.004314 30.386365
Send/Recv 32768 0.008573 30.578620
Send/Recv 65536 0.017149 30.572695
Send/Recv 131072 0.034263 30.604101
Send/Recv 262144 0.068386 30.666506
Send/Recv 524288 0.136905 30.636495
Send/Recv 1048576 0.273151 30.710516
Kind (np=4) n time (sec) Rate (MB/sec)
Send/Recv 1 0.000033 0.244457
Send/Recv 2 0.000037 0.437703
Send/Recv 4 0.000040 0.793011
Send/Recv 8 0.000044 1.456917
Send/Recv 16 0.000045 2.855482
Send/Recv 32 0.000049 5.198297
Send/Recv 64 0.000057 8.946761
Send/Recv 128 0.000075 13.712943
Send/Recv 256 0.000129 15.875437
Send/Recv 512 0.000208 19.690394
Send/Recv 1024 0.000398 20.599364
Send/Recv 2048 0.000645 25.387601
Send/Recv 4096 0.001191 27.516339
Send/Recv 8192 0.002272 28.844945
Send/Recv 16384 0.004430 29.590471
Send/Recv 32768 0.008785 29.839062
Send/Recv 65536 0.017550 29.873290
Send/Recv 131072 0.035077 29.893163
Send/Recv 262144 0.070083 29.923633
Send/Recv 524288 0.140555 29.841030
Send/Recv 1048576 0.279877 29.972486
Kind (np=8) n time (sec) Rate (MB/sec)
Send/Recv 1 0.000032 0.246357
Send/Recv 2 0.000036 0.443249
Send/Recv 4 0.000040 0.795371
Send/Recv 8 0.000043 1.480194
Send/Recv 16 0.000044 2.880798
Send/Recv 32 0.000049 5.253264
Send/Recv 64 0.000057 8.971680
Send/Recv 128 0.000075 13.682909
Send/Recv 256 0.000129 15.933104
Send/Recv 512 0.000211 19.395844
Send/Recv 1024 0.000396 20.662851
Send/Recv 2048 0.000645 25.385257
Send/Recv 4096 0.001190 27.530463
Send/Recv 8192 0.002275 28.809800
Send/Recv 16384 0.004445 29.487801
Send/Recv 32768 0.008789 29.824898
Send/Recv 65536 0.017587 29.810393
Send/Recv 131072 0.035132 29.847023
Send/Recv 262144 0.070032 29.945771
Send/Recv 524288 0.140500 29.852594
Send/Recv 1048576 0.280533 29.902412
Kind (np=16) n time (sec) Rate (MB/sec)
Send/Recv 1 0.000033 0.243963
Send/Recv 2 0.000036 0.438465
Send/Recv 4 0.000041 0.787476
Send/Recv 8 0.000044 1.455077
Send/Recv 16 0.000045 2.842679
Send/Recv 32 0.000049 5.198246
Send/Recv 64 0.000057 8.984034
Send/Recv 128 0.000075 13.657269
Send/Recv 256 0.000130 15.748104
Send/Recv 512 0.000210 19.542010
Send/Recv 1024 0.000411 19.915081
Send/Recv 2048 0.000674 24.321712
Send/Recv 4096 0.001247 26.270482
Send/Recv 8192 0.002390 27.415995
Send/Recv 16384 0.004670 28.067920
Send/Recv 32768 0.009261 28.304873
Send/Recv 65536 0.018536 28.284872
Send/Recv 131072 0.037151 28.224505
Send/Recv 262144 0.074118 28.294755
Send/Recv 524288 0.148433 28.257155
Send/Recv 1048576 0.296172 28.323431
Kind (np=32) n time (sec) Rate (MB/sec)
Send/Recv 1 0.000033 0.240775
Send/Recv 2 0.000037 0.429720
Send/Recv 4 0.000042 0.767226
Send/Recv 8 0.000045 1.416083
Send/Recv 16 0.000046 2.774295
Send/Recv 32 0.000050 5.075923
Send/Recv 64 0.000059 8.738044
Send/Recv 128 0.000076 13.551465
Send/Recv 256 0.000134 15.274389
Send/Recv 512 0.000215 19.033230
Send/Recv 1024 0.000411 19.926631
Send/Recv 2048 0.000674 24.308807
Send/Recv 4096 0.001248 26.246965
Send/Recv 8192 0.002388 27.442339
Send/Recv 16384 0.004661 28.122570
Send/Recv 32768 0.009250 28.340668
Send/Recv 65536 0.018552 28.260563
Send/Recv 131072 0.037110 28.256239
Send/Recv 262144 0.074078 28.309951
Send/Recv 524288 0.148511 28.242389
Send/Recv 1048576 0.296423 28.299491
barrier
Benchmarking collective barrier
mpicc -o barrier -O barrier.c
Kind np time (sec)
Barrier 1 0.000001
Barrier 2 0.000002
Barrier 4 0.000002
Barrier 8 0.000002
Barrier 16 0.000002
Barrier 32 0.000002
Benchmarking collective Allreduce
mpicc -o barrier -O barrier.c
Kind np time (sec)
Allreduce 1 0.000022
Allreduce 2 0.000098
Allreduce 4 0.000133
Allreduce 8 0.000167
Allreduce 16 0.000200
Allreduce 32 0.000231
vector
Comparing the performance of MPI vector datatypes
mpicc -o vector -O vector.c
Kind n stride time (sec) Rate (MB/sec)
Vector 1000 24 0.000626 12.788496
Struct 1000 24 0.020583 0.388672
User 1000 24 0.000740 10.811335
User(add) 1000 24 0.000739 10.821752
circulate
Pipelining pitfalls
mpicc -c -O circulate.c
mpicc -o circulate -O circulate.o -lm
For n = 20000, m = 20000, T_comm = 0.000940, T_compute = 0.036371, sum = 0.037310, T_both = 0.037537
For n = 500, m = 500, T_comm = 0.000098, T_compute = 0.000864, sum = 0.000963, T_both = 0.000927
3way
Exploring the cost of synchronization delays
mpicc -c -O bad.c
mpicc -o bad -O bad.o -lm
[2] Litsize = 8, Time for first send = 0.000032, for second = 0.000009
[2] Litsize = 9, Time for first send = 0.000031, for second = 0.000009
[2] Litsize = 511, Time for first send = 0.000067, for second = 0.000052
[2] Litsize = 512, Time for first send = 0.000066, for second = 0.000052
[2] Litsize = 513, Time for first send = 0.000101, for second = 0.000078
jacobi
Jacobi Iteration - Example Parallel Mesh
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
send/recv: 6 iterations in 0.000405 secs (1.038072 MFlops); diffnorm 0.008134, m=7 n=4 np=1
send/recv: 7 iterations in 0.073226 secs (5.481746 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
send/recv: 24 iterations in 0.008283 secs (0.811284 MFlops); diffnorm 0.009895, m=7 n=10 np=4
send/recv: 25 iterations in 0.335028 secs (17.116197 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
send/recv: 25 iterations in 0.010352 secs (2.704678 MFlops); diffnorm 0.036615, m=7 n=34 np=16
send/recv: 25 iterations in 0.343764 secs (66.724932 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
send/recv: 25 iterations in 0.011204 secs (4.998133 MFlops); diffnorm 0.055291, m=7 n=66 np=32
send/recv: 25 iterations in 0.348401 secs (131.673455 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Shift up and down
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
shift/sendrecv: 6 iterations in 0.000403 secs (1.043220 MFlops); diffnorm 0.008134, m=7 n=4 np=1
shift/sendrecv: 7 iterations in 0.073227 secs (5.481690 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
shift/sendrecv: 24 iterations in 0.007461 secs (0.900664 MFlops); diffnorm 0.009895, m=7 n=10 np=4
shift/sendrecv: 25 iterations in 0.333797 secs (17.179308 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
shift/sendrecv: 25 iterations in 0.009682 secs (2.891938 MFlops); diffnorm 0.036615, m=7 n=34 np=16
shift/sendrecv: 25 iterations in 0.343012 secs (66.871199 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
shift/sendrecv: 25 iterations in 0.010580 secs (5.293034 MFlops); diffnorm 0.055291, m=7 n=66 np=32
shift/sendrecv: 25 iterations in 0.346898 secs (132.243985 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Exchange head-to-head
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
head-to-head sendrecv: 6 iterations in 0.000451 secs (0.931452 MFlops); diffnorm 0.008134, m=7 n=4 np=1
head-to-head sendrecv: 7 iterations in 0.073266 secs (5.478792 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
head-to-head sendrecv: 24 iterations in 0.007900 secs (0.850649 MFlops); diffnorm 0.009895, m=7 n=10 np=4
head-to-head sendrecv: 25 iterations in 0.337048 secs (17.013619 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
head-to-head sendrecv: 25 iterations in 0.009789 secs (2.860417 MFlops); diffnorm 0.036615, m=7 n=34 np=16
head-to-head sendrecv: 25 iterations in 0.341918 secs (67.085116 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
head-to-head sendrecv: 25 iterations in 0.010634 secs (5.266169 MFlops); diffnorm 0.055291, m=7 n=66 np=32
head-to-head sendrecv: 25 iterations in 0.346055 secs (132.566039 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Nonblocking send/recv
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
irecv/isend: 6 iterations in 0.000471 secs (0.892349 MFlops); diffnorm 0.008134, m=7 n=4 np=1
irecv/isend: 7 iterations in 0.073304 secs (5.475920 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
irecv/isend: 24 iterations in 0.007527 secs (0.892811 MFlops); diffnorm 0.009895, m=7 n=10 np=4
irecv/isend: 25 iterations in 0.340959 secs (16.818447 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
irecv/isend: 25 iterations in 0.009413 secs (2.974552 MFlops); diffnorm 0.036615, m=7 n=34 np=16
irecv/isend: 25 iterations in 0.342298 secs (67.010587 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
irecv/isend: 25 iterations in 0.010331 secs (5.420373 MFlops); diffnorm 0.055291, m=7 n=66 np=32
irecv/isend: 25 iterations in 0.346965 secs (132.218654 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Nonblocking send/recv for receiver pull
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
isend/irecv: 6 iterations in 0.000471 secs (0.891502 MFlops); diffnorm 0.008134, m=7 n=4 np=1
isend/irecv: 7 iterations in 0.073308 secs (5.475602 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
isend/irecv: 24 iterations in 0.008612 secs (0.780274 MFlops); diffnorm 0.009895, m=7 n=10 np=4
isend/irecv: 25 iterations in 0.335173 secs (17.108764 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
isend/irecv: 25 iterations in 0.010377 secs (2.698262 MFlops); diffnorm 0.036615, m=7 n=34 np=16
isend/irecv: 25 iterations in 0.341237 secs (67.219063 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
isend/irecv: 25 iterations in 0.011247 secs (4.978970 MFlops); diffnorm 0.055291, m=7 n=66 np=32
isend/irecv: 25 iterations in 0.343636 secs (133.499410 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Synchronous send
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
ssend/irecv: 6 iterations in 0.000454 secs (0.925214 MFlops); diffnorm 0.008134, m=7 n=4 np=1
ssend/irecv: 7 iterations in 0.073278 secs (5.477860 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
ssend/irecv: 24 iterations in 0.009956 secs (0.674966 MFlops); diffnorm 0.009895, m=7 n=10 np=4
ssend/irecv: 25 iterations in 0.293455 secs (19.540989 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
ssend/irecv: 25 iterations in 0.011647 secs (2.404037 MFlops); diffnorm 0.036615, m=7 n=34 np=16
ssend/irecv: 25 iterations in 0.301037 secs (76.195380 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
ssend/irecv: 25 iterations in 0.012464 secs (4.492987 MFlops); diffnorm 0.055291, m=7 n=66 np=32
ssend/irecv: 25 iterations in 0.308954 secs (148.485492 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Ready send
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064c10
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000006 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d60f1f38a1 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d60f1f38a1
f03:0x41a9b4d60f1ef84c f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f11580000000000 f11:0x3f80a88865903544
f12:0x3f80a88865903545 f13:0x3f1157ffffffffff f14:0x3f1157ffffffffff
f15:0xbbd0000000000000 f16:0x3f11580000000000 f17:0x3ff0000000000000
f18:0x3fd4400000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x404ebc414efb607a f23:0x3f88fccc98561dcf
f24:0x3f70a888658bd115 f25:0x4060000000000000 f26:0x3cb0000000000000
f27:0x3c40000000000000 f28:0x40009937258f3ca1 f29:0xbff0eed847a3911c
f30:0x405ebc414efb607a fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6755 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bf0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064c18 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000007 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d61a9f5d52 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d61a9f5d52
f03:0x41a9b4d61a7a33db f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f08f40000000000 f11:0x3f7c41fb66456959
f12:0x3f7c41fb6645695b f13:0x3f08f40000000000 f14:0x3f08f40000000002
f15:0x0000000000000000 f16:0x3f08f40000000000 f17:0x3ff0000000000000
f18:0x3fd4740000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x40521e7211ce9219 f23:0x3f85317c8cb40f03
f24:0x3f6c41fb66456958 f25:0x4060000000000000 f26:0x3cb0000000000000
f27:0x3c30000000000000 f28:0x3ff9271b63a6a929 f29:0xbff0eed847a3911c
f30:0x40621e7211ce9219 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6769 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bf0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bd8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000018 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d62638b153 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d62638b153
f03:0x41a9b4d62634c9b3 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f19aab76ce5406a f11:0x3f8443d652b0baab
f12:0x3f8443d652b0baad f13:0x3f19aab76ce5406a f14:0x3f19aab76ce5406d
f15:0x0000000000000000 f16:0x3f19aab76ce5406a f17:0x3fe88aa67be6be00
f18:0x3fc44ba66463f200 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x404943e760423bf0 f23:0x3f8e65c17c08b84c
f24:0x3f7443d652affb41 f25:0x4060000000000000 f26:0x3cb0000000000000
f27:0x3c40000000000000 f28:0x40102edb29a92532 f29:0xbff0eed847a3911c
f30:0x405943e760423bf0 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6786 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0xfffffffffffffc02 t13:0x0000000000000000
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d632087775 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d632087775
f03:0x41a9b4d63158857f f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f93bbce179cee76 f11:0x3fc1c4de05aa0587
f12:0x3fc1c4de05aa0589 f13:0x3f93bbce179cee77 f14:0x3f93bbce179cee79
f15:0x3c50000000000000 f16:0x3f93bbce179cee76 f17:0x3fe87b96d44c38a0
f18:0x3fc35d32eee31900 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x400cd06fd2bbe320 f23:0x3fcaa74d087f06f8
f24:0x3fb1c4de05aa02e1 f25:0x4020000000000000 f26:0x3cb0000000000000
f27:0x3c80000000000000 f28:0x4003fa4e9e17d999 f29:0xbff0eed847a3911c
f30:0x401cd06fd2bbe320 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6802 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d63cfd3294 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d63cfd3294
f03:0x41a9b4d63cf84b21 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f55f739f73981d7 f11:0x3fa2bf3e43707ca5
f12:0x3fa2bf3e43707ca7 f13:0x3f55f739f73981d8 f14:0x3f55f739f73981da
f15:0x3c10000000000000 f16:0x3f55f739f73981d7 f17:0x3fe8708df2950fe0
f18:0x3fc40525a336bc00 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x402b4f9be68119bb f23:0x3fac1edd6523c7ea
f24:0x3f92bf3e43669689 f25:0x4040000000000000 f26:0x3cb0000000000000
f27:0x3c60000000000000 f28:0x4007f827604dbc5b f29:0xbff0eed847a3911c
f30:0x403b4f9be68119bb fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6821 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0xfffffffffffffc02 t13:0x0000000000000000
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d648cfc70f f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d648cfc70f
f03:0x41a9b4d6481e924d f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3fcc238004d7933a f11:0x3fde01ddd195cb85
f12:0x3fde01ddd195cb87 f13:0x3fcc238004d79338 f14:0x3fcc238004d7933a
f15:0xbc90000000000000 f16:0x3fcc238004d7933a f17:0x3fe84e2b32eaea00
f18:0x3fc2b904b872d000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x3ff110014e93f95f f23:0x3fe681665d2e64d6
f24:0x3fce01ddd18dfc4d f25:0x4000000000000000 f26:0x3cb0000000000000
f27:0x3c90000000000000 f28:0x3ffaf0cb49c11ca2 f29:0xbff0eed847a3911c
f30:0x400110014e93f95f fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6840 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d65457a82a f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d65457a82a
f03:0x41a9b4d6545251cb f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f690b25a0f0d78e f11:0x3fac4f138de942c4
f12:0x3fac4f138de942c5 f13:0x3f690b25a0f0d78b f14:0x3f690b25a0f0d78b
f15:0xbc38000000000000 f16:0x3f690b25a0f0d78e f17:0x3fe8708df2950fe0
f18:0x3fc40525a336bc00 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x402216108b4184e2 f23:0x3fb53b4eaa6ef214
f24:0x3f9c4f138de942c7 f25:0x4030000000000000 f26:0x3cb0000000000000
f27:0x3c60000000000000 f28:0x3ff931328352a223 f29:0xbff0eed847a3911c
f30:0x403216108b4184e2 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6861 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b95c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021dc ci: 0x00002d0000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0xfffffffffffffc02 t13:0x0000000000000000
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d6609af36d f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d6609af36d
f03:0x41a9b4d65fe9fb88 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3fcc5b88017f6edc f11:0x3fde1faf456b2a54
f12:0x3fde1faf456b2a56 f13:0x3fcc5b88017f6edb f14:0x3fcc5b88017f6edd
f15:0xbc80000000000000 f16:0x3fcc5b88017f6edc f17:0x3fe84e2b32eaea00
f18:0x3fc2b904b872d000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x3ff0ff1d9d169a6c f23:0x3fe697c3740e04fb
f24:0x3fce1faf4561bf42 f25:0x4000000000000000 f26:0x3cb0000000000000
f27:0x3c90000000000000 f28:0x3ffb17f6b55f4196 f29:0xbff0eed847a3911c
f30:0x4000ff1d9d169a6c fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6885 Operand range error
Jacobi Iteration - Nonblocking Ready send
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064c10
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000006 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d691c77ff2 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d691c77ff2
f03:0x41a9b4d691c73b94 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f11580000000000 f11:0x3f80a88865903544
f12:0x3f80a88865903545 f13:0x3f1157ffffffffff f14:0x3f1157ffffffffff
f15:0xbbd0000000000000 f16:0x3f11580000000000 f17:0x3ff0000000000000
f18:0x3fd4400000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x404ebc414efb607a f23:0x3f88fccc98561dcf
f24:0x3f70a888658bd115 f25:0x4060000000000000 f26:0x3cb0000000000000
f27:0x3c40000000000000 f28:0x40009937258f3ca1 f29:0xbff0eed847a3911c
f30:0x405ebc414efb607a fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6923 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bf0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064c18 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000007 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d69d49bcf6 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d69d49bcf6
f03:0x41a9b4d69d243152 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f08f40000000000 f11:0x3f7c41fb66456959
f12:0x3f7c41fb6645695b f13:0x3f08f40000000000 f14:0x3f08f40000000002
f15:0x0000000000000000 f16:0x3f08f40000000000 f17:0x3ff0000000000000
f18:0x3fd4740000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x40521e7211ce9219 f23:0x3f85317c8cb40f03
f24:0x3f6c41fb66456958 f25:0x4060000000000000 f26:0x3cb0000000000000
f27:0x3c30000000000000 f28:0x3ff9271b63a6a929 f29:0xbff0eed847a3911c
f30:0x40621e7211ce9219 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6937 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bf0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bd8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000018 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d6a7f49456 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d6a7f49456
f03:0x41a9b4d6a7f06f6b f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f19aab76ce5406a f11:0x3f8443d652b0baab
f12:0x3f8443d652b0baad f13:0x3f19aab76ce5406a f14:0x3f19aab76ce5406d
f15:0x0000000000000000 f16:0x3f19aab76ce5406a f17:0x3fe88aa67be6be00
f18:0x3fc44ba66463f200 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x404943e760423bf0 f23:0x3f8e65c17c08b84c
f24:0x3f7443d652affb41 f25:0x4060000000000000 f26:0x3cb0000000000000
f27:0x3c40000000000000 f28:0x40102edb29a92532 f29:0xbff0eed847a3911c
f30:0x405943e760423bf0 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6954 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0xfffffffffffffc02 t13:0x0000000000000000
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d6b37bd393 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d6b37bd393
f03:0x41a9b4d6b2c98c36 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f93bbce179cee76 f11:0x3fc1c4de05aa0587
f12:0x3fc1c4de05aa0589 f13:0x3f93bbce179cee77 f14:0x3f93bbce179cee79
f15:0x3c50000000000000 f16:0x3f93bbce179cee76 f17:0x3fe87b96d44c38a0
f18:0x3fc35d32eee31900 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x400cd06fd2bbe320 f23:0x3fcaa74d087f06f8
f24:0x3fb1c4de05aa02e1 f25:0x4020000000000000 f26:0x3cb0000000000000
f27:0x3c80000000000000 f28:0x4003fa4e9e17d999 f29:0xbff0eed847a3911c
f30:0x401cd06fd2bbe320 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6970 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d6be4c4e6f f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d6be4c4e6f
f03:0x41a9b4d6be473c9e f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f55f739f73981d7 f11:0x3fa2bf3e43707ca5
f12:0x3fa2bf3e43707ca7 f13:0x3f55f739f73981d8 f14:0x3f55f739f73981da
f15:0x3c10000000000000 f16:0x3f55f739f73981d7 f17:0x3fe8708df2950fe0
f18:0x3fc40525a336bc00 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x402b4f9be68119bb f23:0x3fac1edd6523c7ea
f24:0x3f92bf3e43669689 f25:0x4040000000000000 f26:0x3cb0000000000000
f27:0x3c60000000000000 f28:0x4007f827604dbc5b f29:0xbff0eed847a3911c
f30:0x403b4f9be68119bb fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 6989 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0xfffffffffffffc02 t13:0x0000000000000000
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d6ca50a3ef f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d6ca50a3ef
f03:0x41a9b4d6c99f4cf9 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3fcc238004d7933a f11:0x3fde01ddd195cb85
f12:0x3fde01ddd195cb87 f13:0x3fcc238004d79338 f14:0x3fcc238004d7933a
f15:0xbc90000000000000 f16:0x3fcc238004d7933a f17:0x3fe84e2b32eaea00
f18:0x3fc2b904b872d000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x3ff110014e93f95f f23:0x3fe681665d2e64d6
f24:0x3fce01ddd18dfc4d f25:0x4000000000000000 f26:0x3cb0000000000000
f27:0x3c90000000000000 f28:0x3ffaf0cb49c11ca2 f29:0xbff0eed847a3911c
f30:0x400110014e93f95f fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7008 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000000038
t12:0x000000000000000d t13:0x000000400006a390
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d6d59ef3a8 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d6d59ef3a8
f03:0x41a9b4d6d5995ac5 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3f690b25a0f0d78e f11:0x3fac4f138de942c4
f12:0x3fac4f138de942c5 f13:0x3f690b25a0f0d78b f14:0x3f690b25a0f0d78b
f15:0xbc38000000000000 f16:0x3f690b25a0f0d78e f17:0x3fe8708df2950fe0
f18:0x3fc40525a336bc00 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x402216108b4184e2 f23:0x3fb53b4eaa6ef214
f24:0x3f9c4f138de942c7 f25:0x4030000000000000 f26:0x3cb0000000000000
f27:0x3c60000000000000 f28:0x3ff931328352a223 f29:0xbff0eed847a3911c
f30:0x403216108b4184e2 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7030 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000000 pa1: 0x0000000000001600 pa2: 0x0000000000000000
pc: 0x000000200003b97c sp: 0x00000060ffffec40 fp: 0x00000060ffffed40
v0: 0x0000000000000000 ra: 0x00000020000021fc ci: 0x0000300000000101
a0: 0x00000060ffffeeb8 a1: 0x0000000000000000 a2: 0x0000004000064bd0
a3: 0x0000004000064840 a4: 0x0000ffffffffffff a5: 0x0000000000000030
t0: 0x0000000000000000 t1: 0x0000004000029470 t2: 0x00000000000000fe
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000000588
t6: 0x0000000000000000 t7: 0x0000004000064bf8 t8: 0x0000000000000001
t9: 0x0000000000000001 t10:0x0000000000000000 t11:0x0000000000008010
t12:0xfffffffffffffc02 t13:0x0000000000000000
s0: 0x00000060ffffee78 s1: 0x0000000000000000 s2: 0x0000000000000002
s3: 0x0000000000000019 s4: 0x0000004000000398 s5: 0x0000000000000000
f00:0x41a9b4d6e18b48b9 f01:0x3e3c58c6d8a67ba9 f02:0x41a9b4d6e18b48b9
f03:0x41a9b4d6e0d8bedc f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x3fcc5b88017f6edc f11:0x3fde1faf456b2a54
f12:0x3fde1faf456b2a56 f13:0x3fcc5b88017f6edb f14:0x3fcc5b88017f6edd
f15:0xbc80000000000000 f16:0x3fcc5b88017f6edc f17:0x3fe84e2b32eaea00
f18:0x3fc2b904b872d000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x3ff0ff1d9d169a6c f23:0x3fe697c3740e04fb
f24:0x3fce1faf4561bf42 f25:0x4000000000000000 f26:0x3cb0000000000000
f27:0x3c90000000000000 f28:0x3ffb17f6b55f4196 f29:0xbff0eed847a3911c
f30:0x4000ff1d9d169a6c fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7078 Operand range error
Jacobi Iteration - Overlapping communication
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
isend/overlap: 6 iterations in 0.000484 secs (0.867146 MFlops); diffnorm 0.008134, m=7 n=4 np=1
isend/overlap: 7 iterations in 0.073551 secs (5.457540 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
isend/overlap: 24 iterations in 0.007798 secs (0.861774 MFlops); diffnorm 0.009895, m=7 n=10 np=4
isend/overlap: 25 iterations in 0.339263 secs (16.902538 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
isend/overlap: 25 iterations in 0.009587 secs (2.920470 MFlops); diffnorm 0.036615, m=7 n=34 np=16
isend/overlap: 25 iterations in 0.344060 secs (66.667389 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
isend/overlap: 25 iterations in 0.010373 secs (5.398586 MFlops); diffnorm 0.055291, m=7 n=66 np=32
isend/overlap: 25 iterations in 0.348687 secs (131.565393 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Overlapping communication (sends first)
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
send first/overlap: 6 iterations in 0.000480 secs (0.875877 MFlops); diffnorm 0.008134, m=7 n=4 np=1
send first/overlap: 7 iterations in 0.073561 secs (5.456819 MFlops); diffnorm 0.006899, m=4098 n=4 np=1
send first/overlap: 24 iterations in 0.008630 secs (0.778721 MFlops); diffnorm 0.009895, m=7 n=10 np=4
send first/overlap: 25 iterations in 0.336819 secs (17.025180 MFlops); diffnorm 0.138820, m=4098 n=10 np=4
send first/overlap: 25 iterations in 0.010557 secs (2.652247 MFlops); diffnorm 0.036615, m=7 n=34 np=16
send first/overlap: 25 iterations in 0.342447 secs (66.981411 MFlops); diffnorm 0.468864, m=4098 n=34 np=16
send first/overlap: 25 iterations in 0.011267 secs (4.970238 MFlops); diffnorm 0.055291, m=7 n=66 np=32
send first/overlap: 25 iterations in 0.345109 secs (132.929693 MFlops); diffnorm 0.470684, m=4098 n=66 np=32
Jacobi Iteration - Persistent send/recv
mpicc -c -O jacobi.c
mpicc -c -O cmdline.c
mpicc -c -O setupmesh.c
mpicc -c -O exchng.c
mpicc -o jacobi -O jacobi.o cmdline.o setupmesh.o exchng.o -lm
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000009
a3: 0xffffffffffffffff a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000001
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x000000400006fc68
t6: 0x000000400006fd68 t7: 0x000000400006fdb0 t8: 0x000000400006fdb0
t9: 0x000000400006fdb0 t10:0x00000060fffff72d t11:0x00000040000003d5
t12:0x000000000000000d t13:0x000000400006fcc0
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d82263531f f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d82263531f f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x4000000000000000 f11:0x3ff0000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7454 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000009
a3: 0xffffffffffffffff a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000001
t3: 0x0000000000000001 t4: 0x0000000000000000 t5: 0x0000004000087bf0
t6: 0x00000040000a7c70 t7: 0x00000040000afcb0 t8: 0x00000040000afcb0
t9: 0x00000040000afcb0 t10:0x00000060fffff72a t11:0x00000040000003d5
t12:0x000000000000000d t13:0x000000400008fc40
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d82e2b69af f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d82e2b69af f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x4000000000000000 f11:0x3ff0000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7468 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000000
a3: 0x0000000000000000 a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000000
t3: 0x0000000000000001 t4: 0x0000000000000008 t5: 0x0000000000000001
t6: 0x000000560003f540 t7: 0x0000004000070df0 t8: 0x0000004000070df0
t9: 0x0000004000070df0 t10:0x00000060fffff72d t11:0x00000040000003d5
t12:0x000000000000000d t13:0x0000004000070d00
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d8394b57de f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d8394b57de f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x0000000000000002 f11:0x4010000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7485 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000000
a3: 0x0000000000000000 a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000000
t3: 0x0000000000000001 t4: 0x0000000000000008 t5: 0x0000000000000001
t6: 0x000000560003f540 t7: 0x00000040000b0cf0 t8: 0x00000040000b0cf0
t9: 0x00000040000b0cf0 t10:0x00000060fffff72a t11:0x00000040000003d5
t12:0x000000000000000d t13:0x0000004000090c80
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d8441385cf f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d8441385cf f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x0000000000000002 f11:0x4010000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7501 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000000
a3: 0x0000000000000000 a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000000
t3: 0x0000000000000001 t4: 0x0000000000000008 t5: 0x0000000000000001
t6: 0x000000560003f540 t7: 0x000000400006ffb0 t8: 0x000000400006ffb0
t9: 0x000000400006ffb0 t10:0x00000060fffff72d t11:0x00000040000003d5
t12:0x000000000000000d t13:0x000000400006fec0
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d84f3ae3fa f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d84f3ae3fa f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x0000000000000002 f11:0x4030000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7520 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000000
a3: 0x0000000000000000 a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000000
t3: 0x0000000000000001 t4: 0x0000000000000008 t5: 0x0000000000000001
t6: 0x000000560003f540 t7: 0x00000040000afeb0 t8: 0x00000040000afeb0
t9: 0x00000040000afeb0 t10:0x00000060fffff72a t11:0x00000040000003d5
t12:0x000000000000000d t13:0x000000400008fe40
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d85a6213b9 f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d85a6213b9 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x0000000000000002 f11:0x4030000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7539 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000000
a3: 0x0000000000000000 a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000000
t3: 0x0000000000000001 t4: 0x0000000000000008 t5: 0x0000000000000001
t6: 0x000000560003f540 t7: 0x0000004000070130 t8: 0x0000004000070130
t9: 0x0000004000070130 t10:0x00000060fffff72d t11:0x00000040000003d5
t12:0x000000000000000d t13:0x0000004000070040
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d8658afcc8 f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d8658afcc8 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x0000000000000002 f11:0x4040000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7560 Operand range error
Agent printing core file information:
user exiting after receiving signal 11
Exit message came from virtual PE 0, logical PE 0x0
Register dump
pa0: 0x0000000000000068 pa1: 0x0000000000001610 pa2: 0x0000000000000000
pc: 0x000000200003e79c sp: 0x00000060ffffea00 fp: 0x00000060ffffeb80
v0: 0x0000000000000000 ra: 0x0000002000044284 ci: 0x000b120000000101
a0: 0x00000060ffffee88 a1: 0x00000060ffffee88 a2: 0x0000000000000000
a3: 0x0000000000000000 a4: 0x0000000000000001 a5: 0x0000000000000002
t0: 0x00000060ffffee88 t1: 0x0000004000029470 t2: 0x0000000000000000
t3: 0x0000000000000001 t4: 0x0000000000000008 t5: 0x0000000000000001
t6: 0x000000560003f540 t7: 0x00000040000b0030 t8: 0x00000040000b0030
t9: 0x00000040000b0030 t10:0x00000060fffff72a t11:0x00000040000003d5
t12:0x000000000000000d t13:0x000000400008ffc0
s0: 0x0000000000000000 s1: 0x00000060ffffee88 s2: 0x000000400001ee80
s3: 0x0000000000000000 s4: 0x0000000000000000 s5: 0x0000000000000000
f00:0x41a9b4d8713a9221 f01:0x3e3c58c6d8a67ba9 f02:0x0000000000000000
f03:0x41a9b4d8713a9221 f04:0x0000000000000000 f05:0x0000000000000000
f06:0x0000000000000000 f07:0x0000000000000000 f08:0x0000000000000000
f09:0x0000000000000000 f10:0x0000000000000002 f11:0x4040000000000000
f12:0x0000000000000000 f13:0x0000000000000000 f14:0x0000000000000000
f15:0x0000000000000000 f16:0x0000000000000000 f17:0x0000000000000000
f18:0x0000000000000000 f19:0x0000000000000000 f20:0x0000000000000000
f21:0x0000000000000000 f22:0x0000000000000000 f23:0x0000000000000000
f24:0x0000000000000000 f25:0x0000000000000000 f26:0x0000000000000000
f27:0x0000000000000000 f28:0x0000000000000000 f29:0x0000000000000000
f30:0x0000000000000000 fpcr:0x8900000000000000
Agent finished printing core file information.
User core dump completed (./mppcore)
/u4/gropp/mpiexmpl/maint/envs/t3d-epcc/mpirun[83]: 7584 Operand range error