This happens to me currently when trying to upgrade a customer site from GP 18.3.1036 to the latest February hotfix 18.3.1245 after GP Utilities ran thru a couple of objects for a few minutes:
Scrolling down the error message provide not much more details.. the usual out of range message.
I had to kill GPU as it freezes there and then enabled the DEXSQL tracing in the DEX.ini
That confirmed to me that the issue is somewhat related to the CoA framework, as the last few lines from the DEXSQL.log file where related to the SY00302 & SY03001 SP's.
/* Date: 03/26/2021 Time: 18:02:41
stmt(54978752):*/
{CALL DYNAMICS.dbo.zDP_SY003001F_1(NULL,NULL)}
/* Date: 03/26/2021 Time: 18:02:41
stmt(54978752):*/
{CALL DYNAMICS.dbo.zDP_SY00302F_1(NULL,NULL)}
/* Date: 03/26/2021 Time: 18:02:41
stmt(54978752):*/
{CALL DYNAMICS.dbo.zDP_SY003001F_1(NULL,NULL)}
/* Date: 03/26/2021 Time: 18:02:41
stmt(54978752):*/
{CALL DYNAMICS.dbo.zDP_SY003001F_1(NULL,NULL)}
/* Date: 03/26/2021 Time: 18:02:41
stmt(54978752):*/
{CALL DYNAMICS.dbo.zDP_SY00302F_1(NULL,NULL)}
/* Date: 03/26/2021 Time: 18:02:41
stmt(54978752):*/
{ CALL DYNAMICS.dbo.zDP_SY00302SS_1 ( 1 ) }
However, it doesn't provide much hint on what's wrong, nor does the SP's above when executed in SQL return any errors.. they execute just fine.
My guess is that it could be something with the GP client itself ?