Excel Importer allowing import in batches - Mendix Forum

Excel Importer allowing import in batches

9

We have an on-premise Mendix application with Sql server as database. We are using excel importer module to import data from excel to Mendix persistent entities, with 1 key at main object and 3 keys at associated/reference object.

Mendix Modeler version : 7.23.8

Excel Importer version: 8.1.0

In our experience, we are unable to import more than 400-500 rows at a time. When we try to import more than that (say 1000 rows), we get an error caused because of the limitation of 2100 parameters in one request.

Following is an excerpt from Mendix log:

Caused by: com.mendix.basis.connectionbus.ConnectionBusException: Exception occurred while retrieving data. (SQL State: S0001, Error Code: 8003)
at com.mendix.connectionbus.connections.jdbc.JdbcDataStore.getCorrectException(JdbcDataStore.java:736)

Caused by: com.microsoft.sqlserver.jdbc.SQLServerException: The incoming tabular data stream (TDS) remote procedure call (RPC) protocol stream is incorrect. Too many parameters were provided in this RPC request. The maximum is 2100.

 

My idea or suggestion would be to have Mendix Excel importer allow import in batches (in order to avoid limitation of parameters). The system should allow user to enter following values (ideally in “Template details”):

  1. Import From row nr (Already part of template details)
  2. Import To row nr
  3. Batching required?
  4. If yes,  how many loans to process in each batch.

 

I believe this batching approach allowing user to import in batches would help a lot of Mendix users to overcome performance issues and/or with limitation of number of rows they can currently import.

 

asked
0 answers