Skip to content
Snippets Groups Projects
Commit f469e59c authored by Simon Schwitanski's avatar Simon Schwitanski :slight_smile:
Browse files

Add itac and must logs

parent 7f566b14
No related branches found
No related tags found
No related merge requests found
Showing
with 651 additions and 0 deletions
/* ///////////////////////// The MPI Bug Bench ////////////////////////
Description: Call Ordering: probe for message before it is going to be send
Version of MPI: 3.0
BEGIN_MBB_TESTS
$ mpirun -np 2 ${EXE}
| ERROR CallOrdering
| CallOrdering-mpi_improbe-mpi_send
END_MBB_TESTS
////////////////////// End of MBI headers /////////////////// */
#include <mpi.h>
#include <stddef.h>
#include <stdint.h>
#include <stdio.h>
#include <stdlib.h>
int main(int argc, char **argv) {
int nprocs = -1;
int rank = -1;
MPI_Message mpi_message_0 = MPI_MESSAGE_NULL;
int int_0 = 0;
MPI_Init(&argc, &argv);
MPI_Comm_size(MPI_COMM_WORLD, &nprocs);
MPI_Comm_rank(MPI_COMM_WORLD, &rank);
if (nprocs < 2)
printf(
"MBB ERROR: This test needs at least 2 processes to produce a bug!\n");
int *buf = (int *)calloc(10, sizeof(int));
if (rank == 0) {
MPI_Recv(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
MPI_Send(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD);
}
if (rank == 1) {
int flag = 0;
while (!flag) {
/*MBBERROR_BEGIN*/ MPI_Improbe(0, 0, MPI_COMM_WORLD, &int_0,
&mpi_message_0,
MPI_STATUS_IGNORE); /*MBBERROR_END*/
}
MPI_Send(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD);
MPI_Mrecv(buf, 10, MPI_INT, &mpi_message_0, MPI_STATUS_IGNORE);
}
free(buf);
MPI_Finalize();
printf("Rank %d finished normally\n", rank);
return 0;
}
95.75380849838257
\ No newline at end of file
13b8c536aa09435381db48d15c69f63b
\ No newline at end of file
Running #1802 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_improbe-mpi_send-001.c
Wait up to 180 seconds
Compiling CallOrdering-mpi_improbe-mpi_send-001.c (batchinfo:1/1)
$ mpiicc /MBI/scripts/gencodes/P2P/CallOrdering-mpi_improbe-mpi_send-001.c -O0 -g -o CallOrdering-mpi_improbe-mpi_send-001
| icc: remark #10441: The Intel(R) C++ Compiler Classic (ICC) is deprecated and will be removed from product release in the second half of 2023. The Intel(R) oneAPI DPC++/C++ Compiler (ICX) is the recommended compiler moving forward. Please transition to use this compiler. Use '-diag-disable=10441' to disable this message.
|
Executing the command (cwd: None)
$ mpirun -check_mpi -genv VT_CHECK_TRACING on -np 2 ./CallOrdering-mpi_improbe-mpi_send-001
|
| [0] INFO: CHECK LOCAL:EXIT:SIGNAL ON
| [0] INFO: CHECK LOCAL:EXIT:BEFORE_MPI_FINALIZE ON
| [0] INFO: CHECK LOCAL:MPI:CALL_FAILED ON
| [0] INFO: CHECK LOCAL:MEMORY:OVERLAP ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_MODIFICATION ON
| [0] INFO: CHECK LOCAL:MEMORY:INACCESSIBLE ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_ACCESS OFF
| [0] INFO: CHECK LOCAL:MEMORY:INITIALIZATION OFF
| [0] INFO: CHECK LOCAL:REQUEST:ILLEGAL_CALL ON
| [0] INFO: CHECK LOCAL:REQUEST:NOT_FREED ON
| [0] INFO: CHECK LOCAL:REQUEST:PREMATURE_FREE ON
| [0] INFO: CHECK LOCAL:DATATYPE:NOT_FREED ON
| [0] INFO: CHECK LOCAL:BUFFER:INSUFFICIENT_BUFFER ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:HARD ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:POTENTIAL ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:NO_PROGRESS ON
| [0] INFO: CHECK GLOBAL:MSG:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:MSG:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:MSG:PENDING ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:SIZE_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:REDUCTION_OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:ROOT_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:INVALID_PARAMETER ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:COMM_FREE_MISMATCH ON
| [0] INFO: maximum number of errors before aborting: CHECK-MAX-ERRORS 1
| [0] INFO: maximum number of reports before aborting: CHECK-MAX-REPORTS 0 (= unlimited)
| [0] INFO: maximum number of times each error is reported: CHECK-SUPPRESSION-LIMIT 10
| [0] INFO: timeout for deadlock detection: DEADLOCK-TIMEOUT 60s
| [0] INFO: timeout for deadlock warning: DEADLOCK-WARNING 300s
| [0] INFO: maximum number of reported pending messages: CHECK-MAX-PENDING 20
|
| [1] INFO: 502.00MB trace data in RAM + 0.00MB trace data flushed = 502.00MB total
| [0] ERROR: no progress observed in any process for over 1:00 minutes, aborting application
| [0] WARNING: starting emergency trace file writing
| [0] WARNING: proceeding although 1 out of 2 processes are in an unknown state
|
| [0] ERROR: GLOBAL:DEADLOCK:HARD: fatal error
| [0] ERROR: Application aborted because no progress was observed for over 1:00 minutes,
| [0] ERROR: check for real deadlock (cycle of processes waiting for data) or
| [0] ERROR: potential deadlock (processes sending data to each other and getting blocked
| [0] ERROR: because the MPI might wait for the corresponding receive).
| [0] ERROR: [0] no progress observed for over 1:00 minutes, process is currently in MPI call:
| [0] ERROR: MPI_Recv(*buf=0x470700, count=10, datatype=MPI_INT, source=1, tag=0, comm=MPI_COMM_WORLD, *status=0x1)
| [0] ERROR: (/MBI/scripts/gencodes/P2P/CallOrdering-mpi_improbe-mpi_send-001.c:36)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/home/ss540294/mpi-bugbench/logs-claix23/itac/CallOrdering-mpi_improbe-mpi_send-001)
| [0] ERROR: [1] last MPI call:
| [0] ERROR: MPI_Improbe(source=0, tag=0, comm=MPI_COMM_WORLD, *flag=0x7ffda83e819c->0, *message, *status=0x7ffda83e8198)=MPI_SUCCESS
| [0] INFO: Writing tracefile CallOrdering-mpi_improbe-mpi_send-001.stf in /home/ss540294/mpi-bugbench/logs-claix23/itac
|
| [0] INFO: GLOBAL:DEADLOCK:HARD: found 1 time (1 error + 0 warnings), 0 reports were suppressed
| [0] INFO: Found 1 problem (1 error + 0 warnings), 0 reports were suppressed.
|
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 0 PID 274788 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 1 PID 274789 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
Command return code: 255, elapsed time: 95.75380849838257
Finished #1802 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_improbe-mpi_send-001.c
/* ///////////////////////// The MPI Bug Bench ////////////////////////
Description: Call Ordering: probe for message before it is going to be send
Version of MPI: 1.0
BEGIN_MBB_TESTS
$ mpirun -np 2 ${EXE}
| ERROR CallOrdering
| CallOrdering-mpi_iprobe-mpi_send
END_MBB_TESTS
////////////////////// End of MBI headers /////////////////// */
#include <mpi.h>
#include <stddef.h>
#include <stdint.h>
#include <stdio.h>
#include <stdlib.h>
int main(int argc, char **argv) {
int nprocs = -1;
int rank = -1;
int int_0 = 0;
MPI_Init(&argc, &argv);
MPI_Comm_size(MPI_COMM_WORLD, &nprocs);
MPI_Comm_rank(MPI_COMM_WORLD, &rank);
if (nprocs < 2)
printf(
"MBB ERROR: This test needs at least 2 processes to produce a bug!\n");
int *buf = (int *)calloc(10, sizeof(int));
if (rank == 0) {
int_0 = 0;
while (!int_0) {
/*MBBERROR_BEGIN*/ MPI_Iprobe(0, 0, MPI_COMM_WORLD, &int_0,
MPI_STATUS_IGNORE); /*MBBERROR_END*/
}
MPI_Recv(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
MPI_Send(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD);
}
if (rank == 1) {
MPI_Send(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD);
MPI_Recv(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
}
free(buf);
MPI_Finalize();
printf("Rank %d finished normally\n", rank);
return 0;
}
180.20575785636902
\ No newline at end of file
4b0982d455b35fbe007c2bc70bd35e70
\ No newline at end of file
180.00383305549622 seconds
\ No newline at end of file
Running #1904 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_iprobe-mpi_send-001.c
Wait up to 180 seconds
Compiling CallOrdering-mpi_iprobe-mpi_send-001.c (batchinfo:1/1)
$ mpiicc /MBI/scripts/gencodes/P2P/CallOrdering-mpi_iprobe-mpi_send-001.c -O0 -g -o CallOrdering-mpi_iprobe-mpi_send-001
| icc: remark #10441: The Intel(R) C++ Compiler Classic (ICC) is deprecated and will be removed from product release in the second half of 2023. The Intel(R) oneAPI DPC++/C++ Compiler (ICX) is the recommended compiler moving forward. Please transition to use this compiler. Use '-diag-disable=10441' to disable this message.
|
Executing the command (cwd: None)
$ mpirun -check_mpi -genv VT_CHECK_TRACING on -np 2 ./CallOrdering-mpi_iprobe-mpi_send-001
|
| [0] INFO: CHECK LOCAL:EXIT:SIGNAL ON
| [0] INFO: CHECK LOCAL:EXIT:BEFORE_MPI_FINALIZE ON
| [0] INFO: CHECK LOCAL:MPI:CALL_FAILED ON
| [0] INFO: CHECK LOCAL:MEMORY:OVERLAP ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_MODIFICATION ON
| [0] INFO: CHECK LOCAL:MEMORY:INACCESSIBLE ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_ACCESS OFF
| [0] INFO: CHECK LOCAL:MEMORY:INITIALIZATION OFF
| [0] INFO: CHECK LOCAL:REQUEST:ILLEGAL_CALL ON
| [0] INFO: CHECK LOCAL:REQUEST:NOT_FREED ON
| [0] INFO: CHECK LOCAL:REQUEST:PREMATURE_FREE ON
| [0] INFO: CHECK LOCAL:DATATYPE:NOT_FREED ON
| [0] INFO: CHECK LOCAL:BUFFER:INSUFFICIENT_BUFFER ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:HARD ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:POTENTIAL ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:NO_PROGRESS ON
| [0] INFO: CHECK GLOBAL:MSG:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:MSG:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:MSG:PENDING ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:SIZE_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:REDUCTION_OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:ROOT_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:INVALID_PARAMETER ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:COMM_FREE_MISMATCH ON
| [0] INFO: maximum number of errors before aborting: CHECK-MAX-ERRORS 1
| [0] INFO: maximum number of reports before aborting: CHECK-MAX-REPORTS 0 (= unlimited)
| [0] INFO: maximum number of times each error is reported: CHECK-SUPPRESSION-LIMIT 10
| [0] INFO: timeout for deadlock detection: DEADLOCK-TIMEOUT 60s
| [0] INFO: timeout for deadlock warning: DEADLOCK-WARNING 300s
| [0] INFO: maximum number of reported pending messages: CHECK-MAX-PENDING 20
|
| [0] INFO: 502.00MB trace data in RAM + 0.00MB trace data flushed = 502.00MB total
Command killed by signal 15, elapsed time: 180.20575785636902
Finished #1904 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_iprobe-mpi_send-001.c
/* ///////////////////////// The MPI Bug Bench ////////////////////////
Description: Call Ordering: probe for message before it is going to be send
Version of MPI: 3.0
BEGIN_MBB_TESTS
$ mpirun -np 2 ${EXE}
| ERROR CallOrdering
| CallOrdering-mpi_mprobe-mpi_send
END_MBB_TESTS
////////////////////// End of MBI headers /////////////////// */
#include <mpi.h>
#include <stddef.h>
#include <stdint.h>
#include <stdio.h>
#include <stdlib.h>
int main(int argc, char **argv) {
int nprocs = -1;
int rank = -1;
MPI_Message mpi_message_0 = MPI_MESSAGE_NULL;
MPI_Init(&argc, &argv);
MPI_Comm_size(MPI_COMM_WORLD, &nprocs);
MPI_Comm_rank(MPI_COMM_WORLD, &rank);
if (nprocs < 2)
printf(
"MBB ERROR: This test needs at least 2 processes to produce a bug!\n");
int *buf = (int *)calloc(10, sizeof(int));
if (rank == 0) {
MPI_Recv(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
MPI_Send(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD);
}
if (rank == 1) {
/*MBBERROR_BEGIN*/ MPI_Mprobe(0, 0, MPI_COMM_WORLD, &mpi_message_0,
MPI_STATUS_IGNORE); /*MBBERROR_END*/
MPI_Send(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD);
MPI_Mrecv(buf, 10, MPI_INT, &mpi_message_0, MPI_STATUS_IGNORE);
}
free(buf);
MPI_Finalize();
printf("Rank %d finished normally\n", rank);
return 0;
}
62.30473232269287
\ No newline at end of file
e8382977931267dd261d52299d029e76
\ No newline at end of file
Running #1718 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_mprobe-mpi_send-001.c
Wait up to 180 seconds
Compiling CallOrdering-mpi_mprobe-mpi_send-001.c (batchinfo:1/1)
$ mpiicc /MBI/scripts/gencodes/P2P/CallOrdering-mpi_mprobe-mpi_send-001.c -O0 -g -o CallOrdering-mpi_mprobe-mpi_send-001
| icc: remark #10441: The Intel(R) C++ Compiler Classic (ICC) is deprecated and will be removed from product release in the second half of 2023. The Intel(R) oneAPI DPC++/C++ Compiler (ICX) is the recommended compiler moving forward. Please transition to use this compiler. Use '-diag-disable=10441' to disable this message.
|
Executing the command (cwd: None)
$ mpirun -check_mpi -genv VT_CHECK_TRACING on -np 2 ./CallOrdering-mpi_mprobe-mpi_send-001
|
| [0] INFO: CHECK LOCAL:EXIT:SIGNAL ON
| [0] INFO: CHECK LOCAL:EXIT:BEFORE_MPI_FINALIZE ON
| [0] INFO: CHECK LOCAL:MPI:CALL_FAILED ON
| [0] INFO: CHECK LOCAL:MEMORY:OVERLAP ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_MODIFICATION ON
| [0] INFO: CHECK LOCAL:MEMORY:INACCESSIBLE ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_ACCESS OFF
| [0] INFO: CHECK LOCAL:MEMORY:INITIALIZATION OFF
| [0] INFO: CHECK LOCAL:REQUEST:ILLEGAL_CALL ON
| [0] INFO: CHECK LOCAL:REQUEST:NOT_FREED ON
| [0] INFO: CHECK LOCAL:REQUEST:PREMATURE_FREE ON
| [0] INFO: CHECK LOCAL:DATATYPE:NOT_FREED ON
| [0] INFO: CHECK LOCAL:BUFFER:INSUFFICIENT_BUFFER ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:HARD ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:POTENTIAL ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:NO_PROGRESS ON
| [0] INFO: CHECK GLOBAL:MSG:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:MSG:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:MSG:PENDING ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:SIZE_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:REDUCTION_OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:ROOT_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:INVALID_PARAMETER ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:COMM_FREE_MISMATCH ON
| [0] INFO: maximum number of errors before aborting: CHECK-MAX-ERRORS 1
| [0] INFO: maximum number of reports before aborting: CHECK-MAX-REPORTS 0 (= unlimited)
| [0] INFO: maximum number of times each error is reported: CHECK-SUPPRESSION-LIMIT 10
| [0] INFO: timeout for deadlock detection: DEADLOCK-TIMEOUT 60s
| [0] INFO: timeout for deadlock warning: DEADLOCK-WARNING 300s
| [0] INFO: maximum number of reported pending messages: CHECK-MAX-PENDING 20
|
| [0] ERROR: no progress observed in any process for over 1:00 minutes, aborting application
| [0] WARNING: starting emergency trace file writing
|
| [0] ERROR: GLOBAL:DEADLOCK:HARD: fatal error
| [0] ERROR: Application aborted because no progress was observed for over 1:00 minutes,
| [0] ERROR: check for real deadlock (cycle of processes waiting for data) or
| [0] ERROR: potential deadlock (processes sending data to each other and getting blocked
| [0] ERROR: because the MPI might wait for the corresponding receive).
| [0] ERROR: [0] no progress observed for over 1:00 minutes, process is currently in MPI call:
| [0] ERROR: MPI_Recv(*buf=0x470640, count=10, datatype=MPI_INT, source=1, tag=0, comm=MPI_COMM_WORLD, *status=0x1)
| [0] ERROR: (/MBI/scripts/gencodes/P2P/CallOrdering-mpi_mprobe-mpi_send-001.c:35)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/home/ss540294/mpi-bugbench/logs-claix23/itac/CallOrdering-mpi_mprobe-mpi_send-001)
| [0] ERROR: [1] no progress observed for over 1:00 minutes, process is currently in MPI call:
| [0] ERROR: MPI_Mprobe(source=0, tag=0, comm=MPI_COMM_WORLD, *message, *status=0x7fffed72ba08)
| [0] ERROR: (/MBI/scripts/gencodes/P2P/CallOrdering-mpi_mprobe-mpi_send-001.c:39)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/home/ss540294/mpi-bugbench/logs-claix23/itac/CallOrdering-mpi_mprobe-mpi_send-001)
| [0] INFO: Writing tracefile CallOrdering-mpi_mprobe-mpi_send-001.stf in /home/ss540294/mpi-bugbench/logs-claix23/itac
|
| [0] INFO: GLOBAL:DEADLOCK:HARD: found 1 time (1 error + 0 warnings), 0 reports were suppressed
| [0] INFO: Found 1 problem (1 error + 0 warnings), 0 reports were suppressed.
|
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 0 PID 278381 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 1 PID 278382 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
Command return code: 255, elapsed time: 62.30473232269287
Finished #1718 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_mprobe-mpi_send-001.c
/* ///////////////////////// The MPI Bug Bench ////////////////////////
Description: Call Ordering: probe for message before it is going to be send
Version of MPI: 1.0
BEGIN_MBB_TESTS
$ mpirun -np 2 ${EXE}
| ERROR CallOrdering
| CallOrdering-mpi_probe-mpi_send
END_MBB_TESTS
////////////////////// End of MBI headers /////////////////// */
#include <mpi.h>
#include <stddef.h>
#include <stdint.h>
#include <stdio.h>
#include <stdlib.h>
int main(int argc, char **argv) {
int nprocs = -1;
int rank = -1;
MPI_Init(&argc, &argv);
MPI_Comm_size(MPI_COMM_WORLD, &nprocs);
MPI_Comm_rank(MPI_COMM_WORLD, &rank);
if (nprocs < 2)
printf(
"MBB ERROR: This test needs at least 2 processes to produce a bug!\n");
int *buf = (int *)calloc(10, sizeof(int));
if (rank == 0) {
/*MBBERROR_BEGIN*/ MPI_Probe(0, 0, MPI_COMM_WORLD,
MPI_STATUS_IGNORE); /*MBBERROR_END*/
MPI_Recv(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
MPI_Send(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD);
}
if (rank == 1) {
MPI_Send(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD);
MPI_Recv(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
}
free(buf);
MPI_Finalize();
printf("Rank %d finished normally\n", rank);
return 0;
}
62.467649936676025
\ No newline at end of file
6fe97689a46ac1377ca5dc217a0755c3
\ No newline at end of file
Running #1238 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_probe-mpi_send-001.c
Wait up to 180 seconds
Compiling CallOrdering-mpi_probe-mpi_send-001.c (batchinfo:1/1)
$ mpiicc /MBI/scripts/gencodes/P2P/CallOrdering-mpi_probe-mpi_send-001.c -O0 -g -o CallOrdering-mpi_probe-mpi_send-001
| icc: remark #10441: The Intel(R) C++ Compiler Classic (ICC) is deprecated and will be removed from product release in the second half of 2023. The Intel(R) oneAPI DPC++/C++ Compiler (ICX) is the recommended compiler moving forward. Please transition to use this compiler. Use '-diag-disable=10441' to disable this message.
|
Executing the command (cwd: None)
$ mpirun -check_mpi -genv VT_CHECK_TRACING on -np 2 ./CallOrdering-mpi_probe-mpi_send-001
|
| [0] INFO: CHECK LOCAL:EXIT:SIGNAL ON
| [0] INFO: CHECK LOCAL:EXIT:BEFORE_MPI_FINALIZE ON
| [0] INFO: CHECK LOCAL:MPI:CALL_FAILED ON
| [0] INFO: CHECK LOCAL:MEMORY:OVERLAP ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_MODIFICATION ON
| [0] INFO: CHECK LOCAL:MEMORY:INACCESSIBLE ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_ACCESS OFF
| [0] INFO: CHECK LOCAL:MEMORY:INITIALIZATION OFF
| [0] INFO: CHECK LOCAL:REQUEST:ILLEGAL_CALL ON
| [0] INFO: CHECK LOCAL:REQUEST:NOT_FREED ON
| [0] INFO: CHECK LOCAL:REQUEST:PREMATURE_FREE ON
| [0] INFO: CHECK LOCAL:DATATYPE:NOT_FREED ON
| [0] INFO: CHECK LOCAL:BUFFER:INSUFFICIENT_BUFFER ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:HARD ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:POTENTIAL ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:NO_PROGRESS ON
| [0] INFO: CHECK GLOBAL:MSG:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:MSG:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:MSG:PENDING ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:SIZE_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:REDUCTION_OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:ROOT_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:INVALID_PARAMETER ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:COMM_FREE_MISMATCH ON
| [0] INFO: maximum number of errors before aborting: CHECK-MAX-ERRORS 1
| [0] INFO: maximum number of reports before aborting: CHECK-MAX-REPORTS 0 (= unlimited)
| [0] INFO: maximum number of times each error is reported: CHECK-SUPPRESSION-LIMIT 10
| [0] INFO: timeout for deadlock detection: DEADLOCK-TIMEOUT 60s
| [0] INFO: timeout for deadlock warning: DEADLOCK-WARNING 300s
| [0] INFO: maximum number of reported pending messages: CHECK-MAX-PENDING 20
|
| [0] ERROR: no progress observed in any process for over 1:00 minutes, aborting application
| [0] WARNING: starting emergency trace file writing
|
| [0] ERROR: GLOBAL:DEADLOCK:HARD: fatal error
| [0] ERROR: Application aborted because no progress was observed for over 1:00 minutes,
| [0] ERROR: check for real deadlock (cycle of processes waiting for data) or
| [0] ERROR: potential deadlock (processes sending data to each other and getting blocked
| [0] ERROR: because the MPI might wait for the corresponding receive).
| [0] ERROR: [0] no progress observed for over 1:00 minutes, process is currently in MPI call:
| [0] ERROR: MPI_Probe(source=0, tag=0, comm=MPI_COMM_WORLD, *status=0x1)
| [0] ERROR: (/MBI/scripts/gencodes/P2P/CallOrdering-mpi_probe-mpi_send-001.c:34)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/home/ss540294/mpi-bugbench/logs-claix23/itac/CallOrdering-mpi_probe-mpi_send-001)
| [0] ERROR: [1] no progress observed for over 1:00 minutes, process is currently in MPI call:
| [0] ERROR: MPI_Send(*buf=0x46abc0, count=10, datatype=MPI_INT, dest=0, tag=0, comm=MPI_COMM_WORLD)
| [0] ERROR: (/MBI/scripts/gencodes/P2P/CallOrdering-mpi_probe-mpi_send-001.c:40)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/usr/lib/x86_64-linux-gnu/libc.so.6)
| [0] ERROR: (/home/ss540294/mpi-bugbench/logs-claix23/itac/CallOrdering-mpi_probe-mpi_send-001)
| [0] INFO: Writing tracefile CallOrdering-mpi_probe-mpi_send-001.stf in /home/ss540294/mpi-bugbench/logs-claix23/itac
|
| [0] INFO: GLOBAL:DEADLOCK:HARD: found 1 time (1 error + 0 warnings), 0 reports were suppressed
| [0] INFO: Found 1 problem (1 error + 0 warnings), 0 reports were suppressed.
|
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 0 PID 265339 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 1 PID 265340 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
Command return code: 255, elapsed time: 62.467649936676025
Finished #1238 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_probe-mpi_send-001.c
/* ///////////////////////// The MPI Bug Bench ////////////////////////
Description: Call Ordering: both ranks try to receive before sending
Version of MPI: 1.0
BEGIN_MBB_TESTS
$ mpirun -np 2 ${EXE}
| OK
| CallOrdering-mpi_send-mpi_irecv
END_MBB_TESTS
////////////////////// End of MBI headers /////////////////// */
#include <mpi.h>
#include <stddef.h>
#include <stdint.h>
#include <stdio.h>
#include <stdlib.h>
int main(int argc, char **argv) {
int nprocs = -1;
int rank = -1;
MPI_Request mpi_request_0 = MPI_REQUEST_NULL;
MPI_Init(&argc, &argv);
MPI_Comm_size(MPI_COMM_WORLD, &nprocs);
MPI_Comm_rank(MPI_COMM_WORLD, &rank);
if (nprocs < 2)
printf(
"MBB ERROR: This test needs at least 2 processes to produce a bug!\n");
int *buf = (int *)calloc(10, sizeof(int));
if (rank == 0) {
MPI_Irecv(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD, &mpi_request_0);
MPI_Wait(&mpi_request_0, MPI_STATUS_IGNORE);
MPI_Send(buf, 10, MPI_INT, 1, 0, MPI_COMM_WORLD);
}
if (rank == 1) {
MPI_Send(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD);
MPI_Recv(buf, 10, MPI_INT, 0, 0, MPI_COMM_WORLD, MPI_STATUS_IGNORE);
}
free(buf);
MPI_Finalize();
printf("Rank %d finished normally\n", rank);
return 0;
}
1.1136653423309326
\ No newline at end of file
Running #1804 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_send-mpi_irecv-001.c
Wait up to 180 seconds
Compiling CallOrdering-mpi_send-mpi_irecv-001.c (batchinfo:1/1)
$ mpiicc /MBI/scripts/gencodes/P2P/CallOrdering-mpi_send-mpi_irecv-001.c -O0 -g -o CallOrdering-mpi_send-mpi_irecv-001
| icc: remark #10441: The Intel(R) C++ Compiler Classic (ICC) is deprecated and will be removed from product release in the second half of 2023. The Intel(R) oneAPI DPC++/C++ Compiler (ICX) is the recommended compiler moving forward. Please transition to use this compiler. Use '-diag-disable=10441' to disable this message.
|
Executing the command (cwd: None)
$ mpirun -check_mpi -genv VT_CHECK_TRACING on -np 2 ./CallOrdering-mpi_send-mpi_irecv-001
|
| [0] INFO: CHECK LOCAL:EXIT:SIGNAL ON
| [0] INFO: CHECK LOCAL:EXIT:BEFORE_MPI_FINALIZE ON
| [0] INFO: CHECK LOCAL:MPI:CALL_FAILED ON
| [0] INFO: CHECK LOCAL:MEMORY:OVERLAP ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_MODIFICATION ON
| [0] INFO: CHECK LOCAL:MEMORY:INACCESSIBLE ON
| [0] INFO: CHECK LOCAL:MEMORY:ILLEGAL_ACCESS OFF
| [0] INFO: CHECK LOCAL:MEMORY:INITIALIZATION OFF
| [0] INFO: CHECK LOCAL:REQUEST:ILLEGAL_CALL ON
| [0] INFO: CHECK LOCAL:REQUEST:NOT_FREED ON
| [0] INFO: CHECK LOCAL:REQUEST:PREMATURE_FREE ON
| [0] INFO: CHECK LOCAL:DATATYPE:NOT_FREED ON
| [0] INFO: CHECK LOCAL:BUFFER:INSUFFICIENT_BUFFER ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:HARD ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:POTENTIAL ON
| [0] INFO: CHECK GLOBAL:DEADLOCK:NO_PROGRESS ON
| [0] INFO: CHECK GLOBAL:MSG:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:MSG:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:MSG:PENDING ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATATYPE:MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:DATA_TRANSMISSION_CORRUPTED ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:SIZE_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:REDUCTION_OPERATION_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:ROOT_MISMATCH ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:INVALID_PARAMETER ON
| [0] INFO: CHECK GLOBAL:COLLECTIVE:COMM_FREE_MISMATCH ON
| [0] INFO: maximum number of errors before aborting: CHECK-MAX-ERRORS 1
| [0] INFO: maximum number of reports before aborting: CHECK-MAX-REPORTS 0 (= unlimited)
| [0] INFO: maximum number of times each error is reported: CHECK-SUPPRESSION-LIMIT 10
| [0] INFO: timeout for deadlock detection: DEADLOCK-TIMEOUT 60s
| [0] INFO: timeout for deadlock warning: DEADLOCK-WARNING 300s
| [0] INFO: maximum number of reported pending messages: CHECK-MAX-PENDING 20
|
| [1] ERROR: Signal 11 caught in ITC code section.
| [1] ERROR: Either ITC is faulty or (more likely in a release version)
| [1] ERROR: the application has corrupted ITC's internal data structures.
| [1] ERROR: Giving up now...
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 0 PID 527 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
| ===================================================================================
| = BAD TERMINATION OF ONE OF YOUR APPLICATION PROCESSES
| = RANK 1 PID 528 RUNNING AT n23m0013.hpc.itc.rwth-aachen.de
| = KILLED BY SIGNAL: 9 (Killed)
| ===================================================================================
|
Command return code: 255, elapsed time: 1.1136653423309326
Finished #1804 /MBI/scripts/gencodes/P2P/CallOrdering-mpi_send-mpi_irecv-001.c
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment