Hi all, I am getting the below errors and warnings in my app logs. Although the runtime allows more database connections, is the database limited? ConnectionPoolingMaxActive is set to 200 ConnectionPoolingMaxIdle is set to 50 (default) 2019-01-27T14:47:07.371022 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 53 active, 29 idle. 2019-01-27T14:47:07.371430 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.373625 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 53 active, 29 idle. 2019-01-27T14:47:07.373649 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.379929 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 54 active, 28 idle. 2019-01-27T14:47:07.379974 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.382331 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 52 active, 30 idle. 2019-01-27T14:47:07.382355 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.382668 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 53 active, 29 idle. 2019-01-27T14:47:07.382688 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.385250 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 53 active, 29 idle. 2019-01-27T14:47:07.385270 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.398458 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 50 active, 32 idle. 2019-01-27T14:47:07.398492 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.399738 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 49 active, 33 idle. 2019-01-27T14:47:07.399757 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: sorry, too many clients already Retrying...(1/4) 2019-01-27T14:47:07.415369 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 49 active, 33 idle. 2019-01-27T14:47:07.415405 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: remaining connection slots are reserved for non-replication superuser connections Retrying...(1/4) 2019-01-27T14:47:07.415423 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 49 active, 33 idle. 2019-01-27T14:47:07.415451 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: remaining connection slots are reserved for non-replication superuser connections Retrying...(1/4) 2019-01-27T14:47:07.421245 [APP/PROC/WEB/0] WARNING - ConnectionBus: Database connections: 48 active, 34 idle. 2019-01-27T14:47:07.421274 [APP/PROC/WEB/0] ERROR - ConnectionBus: Opening JDBC connection to Some(dbnecb5epp658tvlc.co6tarrr5izg.eu-central-1.rds.amazonaws.com:5432) failed with SQLState: 53300 Error code: 0 Message: FATAL: remaining connection slots are reserved for non-replication superuser connections Retrying...(1/4) Would this setting help? When looking into the logs I found this sort of thing: 2019-01-27T14:42:39.395429 [APP/PROC/WEB/0] WARNING - ConnectionBus_Queries: Query executed in 93 seconds and 66 milliseconds: SELECT "system$session"."id", 2019-01-27T14:42:39.395502 [APP/PROC/WEB/0] "system$session"."readonlyhashkey", 2019-01-27T14:42:39.395513 [APP/PROC/WEB/0] "system$session"."createddate", 2019-01-27T14:42:39.395522 [APP/PROC/WEB/0] "system$session"."csrftoken", 2019-01-27T14:42:39.395530 [APP/PROC/WEB/0] "system$session"."lastactive", 2019-01-27T14:42:39.395557 [APP/PROC/WEB/0] "system$session"."sessionid" 2019-01-27T14:42:39.395566 [APP/PROC/WEB/0] FROM "system$session" 2019-01-27T14:42:39.395574 [APP/PROC/WEB/0] WHERE "system$session"."id" = ? There are about 40-50 similar logs. Then I get a lot of these ERROR - ConnectionBus_Retrieve: org.postgresql.util.PSQLException: An I/O error occurred while sending to the backend. 2019-01-27T14:51:58.027943 [APP/PROC/WEB/0] at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:335) 2019-01-27T14:51:58.027958 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) 2019-01-27T14:51:58.027976 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) 2019-01-27T14:51:58.027992 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) 2019-01-27T14:51:58.028013 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) 2019-01-27T14:51:58.028029 [APP/PROC/WEB/0] at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:83) 2019-01-27T14:51:58.028047 [APP/PROC/WEB/0] at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:83) 2019-01-27T14:51:58.028063 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.execRetrieveQuery(JdbcDataStore.java:309) 2019-01-27T14:51:58.028085 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.execRetrieveQueries(JdbcDataStore.java:195) 2019-01-27T14:51:58.028102 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.retrieve(JdbcDataStore.java:155) 2019-01-27T14:51:58.028120 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.retrieve(JdbcDataStore.java:150) 2019-01-27T14:51:58.028143 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.InternalRequest.executeQueries(QueryRequestType.scala:75) 2019-01-27T14:51:58.028160 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.InternalRequest.execute(QueryRequestType.scala:54) 2019-01-27T14:51:58.028196 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.$anonfun$processOqlGetRequest$1(DataStoreCaller.scala:49) 2019-01-27T14:51:58.028216 [APP/PROC/WEB/0] at scala.Option.map(Option.scala:146) 2019-01-27T14:51:58.028233 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.processOqlGetRequest(DataStoreCaller.scala:43) 2019-01-27T14:51:58.028248 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.$anonfun$getResult$1(DataStoreCaller.scala:36) 2019-01-27T14:51:58.028264 [APP/PROC/WEB/0] at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:240) 2019-01-27T14:51:58.028279 [APP/PROC/WEB/0] at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:32) 2019-01-27T14:51:58.028456 [APP/PROC/WEB/0] at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:29) 2019-01-27T14:51:58.028468 [APP/PROC/WEB/0] at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:37) 2019-01-27T14:51:58.028477 [APP/PROC/WEB/0] at scala.collection.TraversableLike.flatMap(TraversableLike.scala:240) 2019-01-27T14:51:58.028493 [APP/PROC/WEB/0] at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:237) 2019-01-27T14:51:58.028503 [APP/PROC/WEB/0] at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104) 2019-01-27T14:51:58.028511 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.getResult(DataStoreCaller.scala:36) 2019-01-27T14:51:58.028706 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.getResult(DataStoreCaller.scala:34) 2019-01-27T14:51:58.028755 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.GetRequestHandler.doRequest(GetRequestHandler.java:75) 2019-01-27T14:51:58.028766 [APP/PROC/WEB/0] at com.mendix.connectionbus.RequestAnalyzer.doRequest(RequestAnalyzer.java:50) 2019-01-27T14:51:58.028786 [APP/PROC/WEB/0] at com.mendix.connectionbus.ConnectionBusImpl.doRequest(ConnectionBusImpl.java:447) 2019-01-27T14:51:58.028797 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathRawAction.retrieveXPathRaw(RetrieveXPathRawAction.java:132) 2019-01-27T14:51:58.028808 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathRawAction.executeAction(RetrieveXPathRawAction.java:72) 2019-01-27T14:51:58.028920 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathAction.executeAction(RetrieveXPathAction.java:58) 2019-01-27T14:51:58.028940 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathAction.executeAction(RetrieveXPathAction.java:16) 2019-01-27T14:51:58.028950 [APP/PROC/WEB/0] at com.mendix.systemwideinterfaces.core.UserAction.execute(UserAction.java:46) 2019-01-27T14:51:58.028989 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.doCall(CoreActionHandlerImpl.scala:79) 2019-01-27T14:51:58.029000 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.call(CoreActionHandlerImpl.scala:57) 2019-01-27T14:51:58.029008 [APP/PROC/WEB/0] at com.mendix.core.actionmanagement.CoreAction.call(CoreAction.java:55) 2019-01-27T14:51:58.029018 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.DefaultActionMonitor$.$anonfun$run$1(CustomMonitoredAction.scala:18) 2019-01-27T14:51:58.029222 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.IMonitoredAction$$anon$1.execute(IMonitoredAction.scala:47) 2019-01-27T14:51:58.029241 [APP/PROC/WEB/0] at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:32) 2019-01-27T14:51:58.029251 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.IMonitoredAction.monitor(IMonitoredAction.scala:49) 2019-01-27T14:51:58.029259 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.IMonitoredAction.monitor$(IMonitoredAction.scala:25) 2019-01-27T14:51:58.029281 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CustomMonitoredAction.monitor(CustomMonitoredAction.scala:22) 2019-01-27T14:51:58.029310 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.DefaultActionMonitor$.run(CustomMonitoredAction.scala:18) 2019-01-27T14:51:58.029319 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.runMonitoredAction(CoreActionHandlerImpl.scala:68) 2019-01-27T14:51:58.029330 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.call(CoreActionHandlerImpl.scala:55) 2019-01-27T14:51:58.029339 [APP/PROC/WEB/0] at com.mendix.core.actionmanagement.CoreAction.call(CoreAction.java:55) 2019-01-27T14:51:58.029536 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.ActionManagerBase$1.execute(ActionManagerBase.java:150) 2019-01-27T14:51:58.029557 [APP/PROC/WEB/0] at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:32) 2019-01-27T14:51:58.029567 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.ActionManagerBase.executeSync(ActionManagerBase.java:155) 2019-01-27T14:51:58.029576 [APP/PROC/WEB/0] at com.mendix.basis.action.InternalXPathQuery.execute(InternalXPathQuery.scala:51) 2019-01-27T14:51:58.029584 [APP/PROC/WEB/0] at com.mendix.basis.session.User.addUserRole(User.java:181) 2019-01-27T14:51:58.029592 [APP/PROC/WEB/0] at com.mendix.basis.session.User.createGuestUser(User.java:79) 2019-01-27T14:51:58.029601 [APP/PROC/WEB/0] at com.mendix.basis.component.InternalCoreBase.initializeGuestSession(InternalCoreBase.java:774) 2019-01-27T14:51:58.029610 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.helpers.SessionHandling.initializeGuestSession(SessionHandling.scala:53) 2019-01-27T14:51:58.029790 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.helpers.SessionHandling.initializeGuestSession$(SessionHandling.scala:51) 2019-01-27T14:51:58.029814 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.initializeGuestSession(GetSessionDataAction.scala:29) 2019-01-27T14:51:58.029829 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.$anonfun$execute$4(GetSessionDataAction.scala:46) 2019-01-27T14:51:58.029843 [APP/PROC/WEB/0] at scala.Option.orElse(Option.scala:289) 2019-01-27T14:51:58.029860 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.$anonfun$execute$1(GetSessionDataAction.scala:46) 2019-01-27T14:51:58.029874 [APP/PROC/WEB/0] at scala.util.Try$.apply(Try.scala:209) 2019-01-27T14:51:58.029891 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.execute(GetSessionDataAction.scala:46) 2019-01-27T14:51:58.029922 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.ClientRequestHandler.handleAction(ClientRequestHandler.scala:124) 2019-01-27T14:51:58.029936 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.ClientRequestHandler.processRequest(ClientRequestHandler.scala:101) 2019-01-27T14:51:58.029945 [APP/PROC/WEB/0] at com.mendix.externalinterface.connector.RequestHandler.doProcessRequest(RequestHandler.java:40) 2019-01-27T14:51:58.029953 [APP/PROC/WEB/0] at com.mendix.external.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:72) 2019-01-27T14:51:58.030032 [APP/PROC/WEB/0] at com.mendix.external.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:69) 2019-01-27T14:51:58.030044 [APP/PROC/WEB/0] at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:32) 2019-01-27T14:51:58.030053 [APP/PROC/WEB/0] at com.mendix.external.connector.MxRuntimeConnector.processRequest(MxRuntimeConnector.java:75) 2019-01-27T14:51:58.030061 [APP/PROC/WEB/0] at com.mendix.basis.impl.MxRuntimeImpl.processRequest(MxRuntimeImpl.java:872) 2019-01-27T14:51:58.030077 [APP/PROC/WEB/0] at com.mendix.m2ee.appcontainer.server.handler.RuntimeHandler.service(RuntimeHandler.java:42) 2019-01-27T14:51:58.030086 [APP/PROC/WEB/0] at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) 2019-01-27T14:51:58.030094 [APP/PROC/WEB/0] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:867) 2019-01-27T14:51:58.030332 [APP/PROC/WEB/0] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) 2019-01-27T14:51:58.030357 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) 2019-01-27T14:51:58.030370 [APP/PROC/WEB/0] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588) 2019-01-27T14:51:58.030385 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) 2019-01-27T14:51:58.030415 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) 2019-01-27T14:51:58.030627 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) 2019-01-27T14:51:58.031082 [APP/PROC/WEB/0] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) 2019-01-27T14:51:58.031106 [APP/PROC/WEB/0] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557) 2019-01-27T14:51:58.031120 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) 2019-01-27T14:51:58.031146 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) 2019-01-27T14:51:58.031160 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) 2019-01-27T14:51:58.031173 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) 2019-01-27T14:51:58.031186 [APP/PROC/WEB/0] at org.eclipse.jetty.server.Server.handle(Server.java:502) 2019-01-27T14:51:58.031197 [APP/PROC/WEB/0] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364) 2019-01-27T14:51:58.031205 [APP/PROC/WEB/0] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) 2019-01-27T14:51:58.031214 [APP/PROC/WEB/0] at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) 2019-01-27T14:51:58.031223 [APP/PROC/WEB/0] at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) 2019-01-27T14:51:58.031231 [APP/PROC/WEB/0] at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) 2019-01-27T14:51:58.031249 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) 2019-01-27T14:51:58.031258 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) 2019-01-27T14:51:58.031406 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) 2019-01-27T14:51:58.031423 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) 2019-01-27T14:51:58.031450 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) 2019-01-27T14:51:58.031465 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) 2019-01-27T14:51:58.031479 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) 2019-01-27T14:51:58.031488 [APP/PROC/WEB/0] at java.lang.Thread.run(Thread.java:748) 2019-01-27T14:51:58.031498 [APP/PROC/WEB/0] Caused by: java.net.SocketException: Connection reset 2019-01-27T14:51:58.031714 [APP/PROC/WEB/0] at java.net.SocketInputStream.read(SocketInputStream.java:210) 2019-01-27T14:51:58.031731 [APP/PROC/WEB/0] at java.net.SocketInputStream.read(SocketInputStream.java:141) 2019-01-27T14:51:58.031740 [APP/PROC/WEB/0] at sun.security.ssl.InputRecord.readFully(InputRecord.java:465) 2019-01-27T14:51:58.031761 [APP/PROC/WEB/0] at sun.security.ssl.InputRecord.read(InputRecord.java:503) 2019-01-27T14:51:58.031771 [APP/PROC/WEB/0] at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983) 2019-01-27T14:51:58.031784 [APP/PROC/WEB/0] at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:940) 2019-01-27T14:51:58.031796 [APP/PROC/WEB/0] at sun.security.ssl.AppInputStream.read(AppInputStream.java:105) 2019-01-27T14:51:58.031810 [APP/PROC/WEB/0] at org.postgresql.core.VisibleBufferedInputStream.readMore(VisibleBufferedInputStream.java:140) 2019-01-27T14:51:58.031825 [APP/PROC/WEB/0] at org.postgresql.core.VisibleBufferedInputStream.ensureBytes(VisibleBufferedInputStream.java:109) 2019-01-27T14:51:58.031839 [APP/PROC/WEB/0] at org.postgresql.core.VisibleBufferedInputStream.read(VisibleBufferedInputStream.java:67) 2019-01-27T14:51:58.032016 [APP/PROC/WEB/0] at org.postgresql.core.PGStream.receiveChar(PGStream.java:306) 2019-01-27T14:51:58.032047 [APP/PROC/WEB/0] at org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1952) 2019-01-27T14:51:58.032057 [APP/PROC/WEB/0] at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:308) 2019-01-27T14:51:58.032077 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:441) 2019-01-27T14:51:58.032086 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgStatement.execute(PgStatement.java:365) 2019-01-27T14:51:58.032094 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:143) 2019-01-27T14:51:58.032102 [APP/PROC/WEB/0] at org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:106) 2019-01-27T14:51:58.032112 [APP/PROC/WEB/0] at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:83) 2019-01-27T14:51:58.032120 [APP/PROC/WEB/0] at org.apache.commons.dbcp2.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:83) 2019-01-27T14:51:58.032324 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.execRetrieveQuery(JdbcDataStore.java:309) 2019-01-27T14:51:58.032336 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.execRetrieveQueries(JdbcDataStore.java:195) 2019-01-27T14:51:58.032345 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.retrieve(JdbcDataStore.java:155) 2019-01-27T14:51:58.032353 [APP/PROC/WEB/0] at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.retrieve(JdbcDataStore.java:150) 2019-01-27T14:51:58.032361 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.InternalRequest.executeQueries(QueryRequestType.scala:75) 2019-01-27T14:51:58.032379 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.InternalRequest.execute(QueryRequestType.scala:54) 2019-01-27T14:51:58.032388 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.$anonfun$processOqlGetRequest$1(DataStoreCaller.scala:49) 2019-01-27T14:51:58.032397 [APP/PROC/WEB/0] at scala.Option.map(Option.scala:146) 2019-01-27T14:51:58.032602 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.processOqlGetRequest(DataStoreCaller.scala:43) 2019-01-27T14:51:58.032614 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.$anonfun$getResult$1(DataStoreCaller.scala:36) 2019-01-27T14:51:58.032622 [APP/PROC/WEB/0] at scala.collection.TraversableLike.$anonfun$flatMap$1(TraversableLike.scala:240) 2019-01-27T14:51:58.032631 [APP/PROC/WEB/0] at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:32) 2019-01-27T14:51:58.032639 [APP/PROC/WEB/0] at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:29) 2019-01-27T14:51:58.032657 [APP/PROC/WEB/0] at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:37) 2019-01-27T14:51:58.032666 [APP/PROC/WEB/0] at scala.collection.TraversableLike.flatMap(TraversableLike.scala:240) 2019-01-27T14:51:58.032676 [APP/PROC/WEB/0] at scala.collection.TraversableLike.flatMap$(TraversableLike.scala:237) 2019-01-27T14:51:58.032911 [APP/PROC/WEB/0] at scala.collection.AbstractTraversable.flatMap(Traversable.scala:104) 2019-01-27T14:51:58.032931 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.getResult(DataStoreCaller.scala:36) 2019-01-27T14:51:58.032942 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.getResult(DataStoreCaller.scala:34) 2019-01-27T14:51:58.032962 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.GetRequestHandler.doRequest(GetRequestHandler.java:75) 2019-01-27T14:51:58.032972 [APP/PROC/WEB/0] at com.mendix.connectionbus.RequestAnalyzer.doRequest(RequestAnalyzer.java:50) 2019-01-27T14:51:58.032980 [APP/PROC/WEB/0] at com.mendix.connectionbus.ConnectionBusImpl.doRequest(ConnectionBusImpl.java:447) 2019-01-27T14:51:58.032989 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathRawAction.retrieveXPathRaw(RetrieveXPathRawAction.java:132) 2019-01-27T14:51:58.032998 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathRawAction.executeAction(RetrieveXPathRawAction.java:72) 2019-01-27T14:51:58.033180 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathAction.executeAction(RetrieveXPathAction.java:58) 2019-01-27T14:51:58.033192 [APP/PROC/WEB/0] at com.mendix.basis.action.user.RetrieveXPathAction.executeAction(RetrieveXPathAction.java:16) 2019-01-27T14:51:58.033201 [APP/PROC/WEB/0] at com.mendix.systemwideinterfaces.core.UserAction.execute(UserAction.java:46) 2019-01-27T14:51:58.033210 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.doCall(CoreActionHandlerImpl.scala:79) 2019-01-27T14:51:58.033228 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.call(CoreActionHandlerImpl.scala:57) 2019-01-27T14:51:58.033244 [APP/PROC/WEB/0] at com.mendix.core.actionmanagement.CoreAction.call(CoreAction.java:55) 2019-01-27T14:51:58.033259 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.DefaultActionMonitor$.$anonfun$run$1(CustomMonitoredAction.scala:18) 2019-01-27T14:51:58.033273 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.IMonitoredAction$$anon$1.execute(IMonitoredAction.scala:47) 2019-01-27T14:51:58.033461 [APP/PROC/WEB/0] at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:32) 2019-01-27T14:51:58.033474 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.IMonitoredAction.monitor(IMonitoredAction.scala:49) 2019-01-27T14:51:58.033482 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.IMonitoredAction.monitor$(IMonitoredAction.scala:25) 2019-01-27T14:51:58.033491 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CustomMonitoredAction.monitor(CustomMonitoredAction.scala:22) 2019-01-27T14:51:58.033508 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.DefaultActionMonitor$.run(CustomMonitoredAction.scala:18) 2019-01-27T14:51:58.033517 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.runMonitoredAction(CoreActionHandlerImpl.scala:68) 2019-01-27T14:51:58.033527 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.CoreActionHandlerImpl.call(CoreActionHandlerImpl.scala:55) 2019-01-27T14:51:58.033535 [APP/PROC/WEB/0] at com.mendix.core.actionmanagement.CoreAction.call(CoreAction.java:55) 2019-01-27T14:51:58.033713 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.ActionManagerBase$1.execute(ActionManagerBase.java:150) 2019-01-27T14:51:58.033725 [APP/PROC/WEB/0] at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:32) 2019-01-27T14:51:58.033733 [APP/PROC/WEB/0] at com.mendix.basis.actionmanagement.ActionManagerBase.executeSync(ActionManagerBase.java:155) 2019-01-27T14:51:58.033742 [APP/PROC/WEB/0] at com.mendix.basis.action.InternalXPathQuery.execute(InternalXPathQuery.scala:51) 2019-01-27T14:51:58.033759 [APP/PROC/WEB/0] at com.mendix.basis.session.User.addUserRole(User.java:181) 2019-01-27T14:51:58.033768 [APP/PROC/WEB/0] at com.mendix.basis.session.User.createGuestUser(User.java:79) 2019-01-27T14:51:58.033778 [APP/PROC/WEB/0] at com.mendix.basis.component.InternalCoreBase.initializeGuestSession(InternalCoreBase.java:774) 2019-01-27T14:51:58.034103 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.helpers.SessionHandling.initializeGuestSession(SessionHandling.scala:53) 2019-01-27T14:51:58.034792 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.helpers.SessionHandling.initializeGuestSession$(SessionHandling.scala:51) 2019-01-27T14:51:58.034809 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.initializeGuestSession(GetSessionDataAction.scala:29) 2019-01-27T14:51:58.034818 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.$anonfun$execute$4(GetSessionDataAction.scala:46) 2019-01-27T14:51:58.034828 [APP/PROC/WEB/0] at scala.Option.orElse(Option.scala:289) 2019-01-27T14:51:58.034850 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.$anonfun$execute$1(GetSessionDataAction.scala:46) 2019-01-27T14:51:58.034859 [APP/PROC/WEB/0] at scala.util.Try$.apply(Try.scala:209) 2019-01-27T14:51:58.034868 [APP/PROC/WEB/0] at com.mendix.webui.actions.client.GetSessionDataAction.execute(GetSessionDataAction.scala:46) 2019-01-27T14:51:58.034877 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.ClientRequestHandler.handleAction(ClientRequestHandler.scala:124) 2019-01-27T14:51:58.034886 [APP/PROC/WEB/0] at com.mendix.webui.requesthandling.ClientRequestHandler.processRequest(ClientRequestHandler.scala:101) 2019-01-27T14:51:58.034894 [APP/PROC/WEB/0] at com.mendix.externalinterface.connector.RequestHandler.doProcessRequest(RequestHandler.java:40) 2019-01-27T14:51:58.034903 [APP/PROC/WEB/0] at com.mendix.external.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:72) 2019-01-27T14:51:58.034911 [APP/PROC/WEB/0] at com.mendix.external.connector.MxRuntimeConnector$1.execute(MxRuntimeConnector.java:69) 2019-01-27T14:51:58.034920 [APP/PROC/WEB/0] at com.mendix.util.classloading.Runner.doRunUsingClassLoaderOf(Runner.java:32) 2019-01-27T14:51:58.035098 [APP/PROC/WEB/0] at com.mendix.external.connector.MxRuntimeConnector.processRequest(MxRuntimeConnector.java:75) 2019-01-27T14:51:58.035623 [APP/PROC/WEB/0] at com.mendix.basis.impl.MxRuntimeImpl.processRequest(MxRuntimeImpl.java:872) 2019-01-27T14:51:58.035674 [APP/PROC/WEB/0] at com.mendix.m2ee.appcontainer.server.handler.RuntimeHandler.service(RuntimeHandler.java:42) 2019-01-27T14:51:58.035718 [APP/PROC/WEB/0] at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) 2019-01-27T14:51:58.035737 [APP/PROC/WEB/0] at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:867) 2019-01-27T14:51:58.035753 [APP/PROC/WEB/0] at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:542) 2019-01-27T14:51:58.035769 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) 2019-01-27T14:51:58.035786 [APP/PROC/WEB/0] at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1588) 2019-01-27T14:51:58.035802 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) 2019-01-27T14:51:58.035819 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1345) 2019-01-27T14:51:58.037635 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) 2019-01-27T14:51:58.037664 [APP/PROC/WEB/0] at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) 2019-01-27T14:51:58.037675 [APP/PROC/WEB/0] at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1557) 2019-01-27T14:51:58.037684 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) 2019-01-27T14:51:58.037692 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1247) 2019-01-27T14:51:58.037701 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) 2019-01-27T14:51:58.037709 [APP/PROC/WEB/0] at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) 2019-01-27T14:51:58.037718 [APP/PROC/WEB/0] at org.eclipse.jetty.server.Server.handle(Server.java:502) 2019-01-27T14:51:58.037726 [APP/PROC/WEB/0] at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:364) 2019-01-27T14:51:58.037748 [APP/PROC/WEB/0] at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:260) 2019-01-27T14:51:58.037765 [APP/PROC/WEB/0] at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) 2019-01-27T14:51:58.037812 [APP/PROC/WEB/0] at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) 2019-01-27T14:51:58.037822 [APP/PROC/WEB/0] at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:118) 2019-01-27T14:51:58.037831 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) 2019-01-27T14:51:58.037855 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) 2019-01-27T14:51:58.037864 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) 2019-01-27T14:51:58.037889 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) 2019-01-27T14:51:58.037899 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) 2019-01-27T14:51:58.037921 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:765) 2019-01-27T14:51:58.037931 [APP/PROC/WEB/0] at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:683) 2019-01-27T14:51:58.037949 [APP/PROC/WEB/0] at java.lang.Thread.run(Thread.java:748) 2019-01-27T14:51:58.037967 [APP/PROC/WEB/0] INFO - ConnectionBus_Retrieve: Trying to clean up and reset connection pooling mechanism...
asked
Garion Swann
1 answers
0
Looks like the app is executing a lot of heavy concurrent queries.
Few things I would check based on these logs:
2019-01-27T14:42:39.395429 [APP/PROC/WEB/0] WARNING - ConnectionBus_Queries: Query executed in 93 seconds and 66 milliseconds: SELECT "system$session"."id",
and
ERROR - ConnectionBus_Retrieve: org.postgresql.util.PSQLException: An I/O error occurred while sending to the backend.
Are the running scheduled events?
What is the set interval?
And based on this one and further log:
2019-01-27T14:51:58.028196 [APP/PROC/WEB/0] at com.mendix.connectionbus.retrieve.DataStoreCaller.$anonfun$processOqlGetRequest$1(DataStoreCaller.scala:49)