Gateway connection lost frequently, Ignition becomes usuable

At times the gateway connection is lost , then restored so frequently that Ignition becomes unusable.[/b]Connection to gateway lost, due to exception Gateway error 600:

WARN [GatewayConnectionManager-QueryExecuter 4] Connection to Gateway lost, due to exception.
com.inductiveautomation.ignition.client.gateway_interface.GatewayException: Gateway Error 600: Connection refused: connect
at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.newGatewayException(GatewayInterface.java:280)
at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.getResponse(GatewayInterface.java:398)
at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.sendMessage(GatewayInterface.java:219)
at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.sendMessage(GatewayInterface.java:214)
at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runLimitQuery(GatewayInterface.java:586)
at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.runQuery(GatewayInterface.java:551)
at com.inductiveautomation.factorypmi.application.gateway.SQLQuery.execute(SQLQuery.java:48)
at com.inductiveautomation.factorypmi.application.gateway.QueryManager$Query.execute(QueryManager.java:697)
at com.inductiveautomation.factorypmi.application.gateway.QueryManager$Query.access$500(QueryManager.java:670)
at com.inductiveautomation.factorypmi.application.gateway.QueryManager$QueryExecutor.run(QueryManager.java:314)
at java.lang.Thread.run(Unknown Source)
Caused by: java.net.ConnectException: Connection refused: connect
at java.net.PlainSocketImpl.socketConnect(Native Method)
at java.net.PlainSocketImpl.doConnect(Unknown Source)
at java.net.PlainSocketImpl.connectToAddress(Unknown Source)
at java.net.PlainSocketImpl.connect(Unknown Source)
at java.net.SocksSocketImpl.connect(Unknown Source)
at java.net.Socket.connect(Unknown Source)
at sun.net.NetworkClient.doConnect(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.openServer(Unknown Source)
at sun.net.www.http.HttpClient.(Unknown Source)
at sun.net.www.http.HttpClient.New(Unknown Source)
at sun.net.www.http.HttpClient.New(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.connect(Unknown Source)
at sun.net.www.protocol.http.HttpURLConnection.getOutputStream(Unknown Source)
at com.inductiveautomation.ignition.client.gateway_interface.GatewayInterface.getResponse(GatewayInterface.java:303)
… 9 more
INFO [Lew_Disposer_Dash_Board-QueryExecuter 4] Pausing scripts…
INFO [GatewayConnectionManager-QueryExecuter 4] Starting reconnect thread.
ERROR [AbstractPropertyAdapter-AWT-EventQueue-0]

Can you give us some more information?

Version of Ignition
Version of Java
OS, 32 bit or 64 bit
any other details to include error messages

version 7.29

64 bit

java 1.6 _ 31

Can you upgrade to 7.2.11 and see if that works?

Yes I will install it today

Running 7.2.11 64 bit . Exact same problem after upgrade, “Gateway Lost Connection errors”

32 clients running, Multiple locations all see the same issues.

Why is only Ignition software effected, if it is some kind of a network problem?

First thing I check anymore is that someone (or some other software install) didn’t install a server using the same TCP ports as Ignition. Once had an IT vendor install IIS role for quickie testing on a server that knocked Ignition out of the game. Was difficult at first to detect what was going on as Ignition’s web server and IIS battled it out for access to the port and got errors similar to those you are reporting. Just a thought…

This VM server is dedicated to Ignition.

How much RAM and CPU are allocated to the Ignition VM? How much RAM and CPU does the host machine have? Are you sure you haven’t over-allocated the resources? How many VMs are running on this machine?

4 ea Xeon 2.27 GHZ
8 gig Ram

Cpu usage 50 - 80%
5 gig ram used

[quote=“Bassafish”]4 ea Xeon 2.27 GHZ
8 gig Ram

Cpu usage 50 - 80%
5 gig ram used[/quote]

Is that the specs of the host machine or the specs of the VM Ignition is running on?

How many VMs are running on the host?

50-80% CPU usage is suspiciously high. Is there a database running on the same VM as well?

The spec is for the VM Machine,

Sql server is running with a couple of databases as well as 4 other remote database connections from remote locations.

[quote=“Bassafish”]The spec is for the VM Machine,

Sql server is running with a couple of databases as well as 4 other remote database connections from remote locations.[/quote]

Okay, what resources has the Ignition VM been setup to receive though? And how many other VMs are running on the same host machine?

Please explain (what resources has the Ignition VM been setup to receive though?) what details you want.

I have to go through the Corporate IT group the get the requested details.

Have had 3 clients lock up today and had to ctl alt del to kill the Ignition Project and restart it.

Gateway Connection Lost numerous times before they locked up.

[quote=“Bassafish”]Please explain (what resources has the Ignition VM been setup to receive though?) what details you want.

I have to go through the Corporate IT group the get the requested details.[/quote]

You’ve explained that the host machine is running on a quad-core xeon, 8GB ram. This is a finite amount of computing resources.

When you provision a new VM part of the configuration is how many cpus, how many cores per cpu, and how much memory is allocated to that VM instance.

Each VM instance running on the host machine consumes some of those finite computing resources. If you’ve configured too many VMs using too many resources on one host, then the performance of all VMs will be severely degraded.

The Vm Machine has quad cores assigned and 8 gig of ram. I am trying to get info on the host and how many Vm are running on it.

What would cause clients to freeze up?

Clients on the Local network are freezing up as well as clients at remote locations. They all get the gateway lost connection errors.

[quote=“Bassafish”]The Vm Machine has quad cores assigned and 8 gig of ram. I am trying to get info on the host and how many Vm are running on it.

What would cause clients to freeze up?

Clients on the Local network are freezing up as well as clients at remote locations. They all get the gateway lost connection errors.[/quote]

If the VM the Ignition Gateway is over-provisioned and running slow (50-80% cpu could be an indicator, depends on your project(s) setup though), then that could cause the connection errors in the client as it probably can’t respond in a timely manner and it is busy/backed up responding to previous requests from other clients.

[quote=“Kevin.Herron”]When you provision a new VM part of the configuration is how many cpus, how many cores per cpu, and how much memory is allocated to that VM instance.[/quote][quote=“Bassafish”]I have to go through the Corporate IT group the get the requested details.[/quote]@Bassafish I believe you can get some of this information yourself by going to Control Panel > System and Security > System, (or right-clicking Computer > Properties). I’m able to determine the amount of memory and processors allocated to a virtual machine I have by glancing at the information listed under System heading.

EDIT: Oops, sorry … just noticed your clarification.[quote=“Bassafish”]The Vm Machine has quad cores assigned and 8 gig of ram. I am trying to get info on the host and how many Vm are running on it.[/quote]