awareim causing issues with 200 users loggedIn

mrbdrm

BenHayat wrote
You simply run the "InstallService.bat" in the bin folder as Administrator account (while Aware is not running). Then you go to Windows services and start AwareIM. Be sure it is set to Automatic, so when Windows start, it will automatically starts Aware.

Note: Please check with support on memory settings for Aware and Tomcat when they are run as "service".

Thank you Will do

Jaymer

mrbdrm wrote
one user in the office thinks the app was moved to local network 🙂 never seen my app this fast.

😃 Awesome!!!

But I'm not really sure what you changed that would speed it up so much.
The default timeout in [mysqld] section of the ini is 10 seconds (i thought).
So why is 5 mins helping?

mrbdrm

Jaymer wrote
😃 Awesome!!!

But I'm not really sure what you changed that would speed it up so much.
The default timeout in [mysqld] section of the ini is 10 seconds (i thought).
So why is 5 mins helping?

on my fresh install the settings was not set, so inactive connections are left on to infinity

BenHayat

Jaymer wrote
The default timeout in [mysqld] section of the ini is 10 seconds (i thought).

This sounds more normal to me and IF there are any internal connection problem, with 10 seconds, they should show up.

aware_support

If you install as a service don't forget to adjust memory settings - this is done in separate files (*.conf) - this is explained in the tutorials and in the documentation.

mrbdrm

aware_support wrote
If you install as a service don't forget to adjust memory settings - this is done in separate files (*.conf) - this is explained in the tutorials and in the documentation.

Where is the log files located.

aware_support

AwareIM/logs - server, Tomcat/logs - Tomcat

Files names wrapper.log

johntalbott

mrbdrm wrote
Jaymer wrote
😃 Awesome!!!

But I'm not really sure what you changed that would speed it up so much.
The default timeout in [mysqld] section of the ini is 10 seconds (i thought).
So why is 5 mins helping?

on my fresh install the settings was not set, so inactive connections are left on to infinity

Yes. It looks like 10 seconds is the default.

johntalbott

I hope you can read that tiny print. I'll be sure to post a larger screen shot next time. As they say .. size matters.

mrbdrm

johntalbott wrote
mrbdrm wrote
Jaymer wrote
😃 Awesome!!!

But I'm not really sure what you changed that would speed it up so much.
The default timeout in [mysqld] section of the ini is 10 seconds (i thought).
So why is 5 mins helping?

on my fresh install the settings was not set, so inactive connections are left on to infinity

Yes. It looks like 10 seconds is the default.

[attachment=0]mysqltimeout.PNG[/attachment]

you don't want to change that setting. i was talking about "sleep" connections timeout:

interactive_timeout
wait_timeout

witch both have 8 hours wait by default.

mrbdrm

aware_support wrote
AwareIM/logs - server, Tomcat/logs - Tomcat

Files names wrapper.log

Got them.
is there anything i need to change if i have a custom plugin developed? my plugin doesn't work when i run aware as a service. works fine if i run aware from the control panel

mrbdrm

mrbdrm wrote
is there anything i need to change if i have a custom plugin developed? my plugin doesn't work when i run aware as a service. works fine if i run aware from the control panel

i have add a line for the plugin jar to awareim.conf and its working now.

BenHayat

mrbdrm wrote
mrbdrm wrote
is there anything i need to change if i have a custom plugin developed? my plugin doesn't work when i run aware as a service. works fine if i run aware from the control panel

i have add a line for the plugin jar to awareim.conf and its working now.

You need to add to these files
C:\AwareIM\bin\awareim.conf
C:\AwareIM\bin\warpper.conf

For example, these three lines should be in above files. Pay attention to line numbers, 42.43,44 according to your numbers.
wrapper.java.classpath.42=\AwareIM\CustomJars\gson-2.2.4.jar
wrapper.java.classpath.43=\AwareIM\CustomJars\stripe.jar
wrapper.java.classpath.44=\AwareIM\CustomJars\stripe-java-1.27.0.jar

mrbdrm

BenHayat wrote
You need to add to these files
C:\AwareIM\bin\awareim.conf
C:\AwareIM\bin\warpper.conf

For example, these three lines should be in above files. Pay attention to line numbers, 42.43,44 according to your numbers.
wrapper.java.classpath.42=\AwareIM\CustomJars\gson-2.2.4.jar
wrapper.java.classpath.43=\AwareIM\CustomJars\stripe.jar
wrapper.java.classpath.44=\AwareIM\CustomJars\stripe-java-1.27.0.jar

Thank you didn't know about the warpper.conf change 🙂

mrbdrm

did some logging today. it looks like a memory leak?
before testing:
aware memory set @ 2GB
tomcat memory set @ 2GB
did a restart to awareim and MySQL
connections to the database now @ 4
total test time 40-45 minutes

started test with request using DISPLAY DOCUMENT rule, 20 requests then wait 5 minutes
result:
connections to the database now around 20
Server Log:

INFO   | jvm 1    | 2017/10/20 15:12:39 | INFO: InputAdaptor1.Controller has commited 200 transactions
INFO   | jvm 1    | 2017/10/20 15:13:50 | INFO: OutputAdaptor1.Controller has commited 300 transactions

waited a couple of minutes
then another 20 request later
result:
connections to the database around 46
Server Log:

INFO   | jvm 1    | 2017/10/20 15:19:46 | 2017-10-20 15:19:45,991 ERROR com#1058152123 -Transaction exception during commit or rollback No operations allowed after connection closed.Connection was implicitly closed due to underlying exception/error:
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 | ** BEGIN NESTED EXCEPTION ** 
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 | java.lang.OutOfMemoryError
INFO   | jvm 1    | 2017/10/20 15:19:46 | MESSAGE: Java heap space
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 | STACKTRACE:
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 | java.lang.OutOfMemoryError: Java heap space
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 | ** END NESTED EXCEPTION **
INFO   | jvm 1    | 2017/10/20 15:19:46 | 
INFO   | jvm 1    | 2017/10/20 15:19:46 |

Tomcat Log:

INFO   | jvm 2    | 2017/10/20 15:19:49 | com.bas.connectionserver.server.D: Unknown system error
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.connectionserver.server.ConnectionFactory.A(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.connectionserver.server.ConnectionFactory.sendMessage(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.webapp.common.WebAppUtils.sendMessageToExecutionEngine(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.webapp.thin.A.O.A(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.webapp.thin.handlers.B.C.A(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.webapp.thin.handlers.XMLRequestHandler.A(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.webapp.thin.handlers.XMLRequestHandler.handleRequest(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at com.bas.webapp.thin.servlets.WebInterfaceServlet.doPost(Unknown Source)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:644)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at javax.servlet.http.HttpServlet.service(HttpServlet.java:725)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:291)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:239)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:219)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:106)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:506)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:142)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:610)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:88-)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:537)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:1081)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:658-)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:222)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1566)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1523)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
INFO   | jvm 2    | 2017/10/20 15:19:49 | 	at java.lang.Thread.run(Thread.java:745)

30 minutes later connections are increasing with every request to the server now at 54
Execution context have 36 rows, Queue time from MySQL workbench 24 seconds
aware is slow, same out of memory errors in aware and tomcat log repeating.

BenHayat

Good job! Hopefully you can get to the bottom of this and get it resolved once for all. I'm sure the final outcome will be useful for many.

ACDC

aware is slow, same out of memory errors in aware and tomcat log repeating.

So you are running out of memory 😮 , I was expecting something more sinister or am I missing something ?

mrbdrm

ACDC wrote
aware is slow, same out of memory errors in aware and tomcat log repeating.

So you are running out of memory 😮 , I was expecting something more sinister or am I missing something ?

its not the your normal out of memory, with this no matter how much memory you have it will be over in minutes

aware_support

If you are running out of memory very quickly then most probably you haven't allocated memory to the Aware IM Server properly. You need to change aware.conf and wrapper.conf. This is documented in multiple places.

You need to restart the services after this.

mrbdrm

aware_support wrote
If you are running out of memory very quickly then most probably you haven't allocated memory to the Aware IM Server properly. You need to change aware.conf and wrapper.conf. This is documented in multiple places.

You need to restart the services after this.

it was set to 2 gb and checked with task manager to confirm.

« Previous Page Next Page »