Ok so this morning at 10:38 AM, the master server stops executing groups, my custom app restarted it, it would come up and still not initialize and so kept on restarting…
at this time, even the bacup server was in “failed to post message, not enoughquota is available” error constantly.
the problem was resolved when I restarted the backup server and then the primary server. Suffice to say a very very bad situation.
i am attaching the thread dump also which had some blocks along with the wrapper logs of master and backup. in the master log, the restarts are due to the custom app.
we went into factorysql to replace RSSQL and FactoryTalk transaction manager and for more than an year factorysql perform superbly in repalcing and enhancing our datalogging requirements. With ignition, these problems of “unexplained” data loss of the same project are really difficult. please help.
backup wrapper.zip (84.9 KB)
wrapper.zip (293 KB)
thread-dump.txt (48 KB)