Connections dropped with Postgres Database

0
We have a batch processing process that is stumping us.  We have a self hosted application that runs a regular batch processing job.   We repeatedly run into problems resulting in the error pasted below.  The postgres logs show the following: LOG: could not receive data from client: Connection timed out.  It seems as if the connection is dropped before the process is finished.  Any ideas? ull:com.mendix.core.CoreRuntimeException: com.mendix.systemwideinterfaces.MendixRuntimeException: com.mendix.core.CoreException: com.mendix.modules.microflowengine.MicroflowException: Failed to commit     at Campaign.ETLPROC_AFMember (Commit : 'Commit 'AF_Member' ') Advanced stacktrace:     at com.mendix.basis.component.InternalCoreBase.execute(InternalCoreBase.java:418) Caused by: com.mendix.systemwideinterfaces.MendixRuntimeException: com.mendix.core.CoreException: com.mendix.modules.microflowengine.MicroflowException: Failed to commit     at Campaign.ETLPROC_AFMember (Commit : 'Commit 'AF_Member' ') Advanced stacktrace:     at com.mendix.basis.actionmanagement.ActionManagerBase.executeSync(ActionManagerBase.java:159) Caused by: com.mendix.core.CoreException: com.mendix.modules.microflowengine.MicroflowException: Failed to commit     at Campaign.ETLPROC_AFMember (Commit : 'Commit 'AF_Member' ') Advanced stacktrace:     at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:36) Caused by: com.mendix.modules.microflowengine.MicroflowException: Failed to commit     at Campaign.ETLPROC_AFMember (Commit : 'Commit 'AF_Member' ') Advanced stacktrace:     at com.mendix.basis.component.InternalCoreBase.execute(InternalCoreBase.java:389) Caused by: Failed to commit     at Campaign.ETLPROC_AFMember (Commit : 'Commit 'AF_Member' ') Advanced stacktrace:     at com.mendix.modules.microflowengine.MicroflowUtil.processException(MicroflowUtil.java:146) Caused by: Failed to commit     at com.mendix.basis.component.CommitHandler.commit(CommitHandler.scala:155) Caused by: com.mendix.core.CoreRuntimeException: com.mendix.systemwideinterfaces.MendixRuntimeException: com.mendix.core.CoreException: com.mendix.core.CoreRuntimeException: com.mendix.systemwideinterfaces.MendixRuntimeException: java.lang.NullPointerException     at com.mendix.basis.actionmanagement.ActionManagerBase.executeInTransactionSync(ActionManagerBase.java:125) Caused by: com.mendix.systemwideinterfaces.MendixRuntimeExce
asked
2 answers
2

We have seen some similar problems. Replace the communitycommons actions like executeMicroflowAsUser and ExecuteInBackground and start using the process queue module. Create one queued item per max. 5K records in order to process a large set. 

answered
0

Love your blog man. Thanks for this stuff . . .
 

answered