A lot of models within the MONAI framework such as ResNet use inplace operations, such as ReLU(inplace=True) or somthing like x += MPL(x), which is not allowed in distributed mode. It would be great to have a an option to set inplace operations to false to allow distributed training
A lot of models within the MONAI framework such as ResNet use inplace operations, such as
ReLU(inplace=True)or somthing likex += MPL(x), which is not allowed in distributed mode. It would be great to have a an option to set inplace operations to false to allow distributed training