HM freezes completely
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
HM freezes completely
Hi,
every couple of days HM freezes, i have to kill the process.
OS: server 2012
HM: ver. 9.90
2557 active items (from audit)
What kind of info do you need so we can dig into this problem further?
As you can imagine, when we can't trust our monitoring software it constitutes a quite big problem.
Thanks!
P.S.: Sometimes it seems related to a connection by the RCI, but not always.
every couple of days HM freezes, i have to kill the process.
OS: server 2012
HM: ver. 9.90
2557 active items (from audit)
What kind of info do you need so we can dig into this problem further?
As you can imagine, when we can't trust our monitoring software it constitutes a quite big problem.
Thanks!
P.S.: Sometimes it seems related to a connection by the RCI, but not always.
In 99% of all cases such problems caused by bad Antivirus monitor or buggy ODBC driver.
So, as usually first questions are:
- Do you use ODBC logging or ODBC test method? If yes, what ODBC driver do you use?
- Do you have installed some antivirus monitors, personal firewall, content monitoring software? Non stanard winsock components?
- Any errors/warning displayed by Auditing Tool (menu View)?
- Did you setup HostMonitor to store logs or reports on network drive?
Also, could you check resource usage for each process? You may use standard Windows Task Manager to check Handles, GDI and USER objects.
What is the total resource usage on the system?
How many handles/threads/GDI objects used by hostmon.exe process?
Could you setup HostMonitor to check for resources as well using Memory and Dominant Process test methods (check handles, threads, VMem)? Use Private log file with Full logging mode
Regards
Alex
So, as usually first questions are:
- Do you use ODBC logging or ODBC test method? If yes, what ODBC driver do you use?
- Do you have installed some antivirus monitors, personal firewall, content monitoring software? Non stanard winsock components?
- Any errors/warning displayed by Auditing Tool (menu View)?
- Did you setup HostMonitor to store logs or reports on network drive?
Also, could you check resource usage for each process? You may use standard Windows Task Manager to check Handles, GDI and USER objects.
What is the total resource usage on the system?
How many handles/threads/GDI objects used by hostmon.exe process?
Could you setup HostMonitor to check for resources as well using Memory and Dominant Process test methods (check handles, threads, VMem)? Use Private log file with Full logging mode
Regards
Alex
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
Hi,
thank you for the quick reply.
Yes i used ODBC, however i already suspected it and disabled it. Would disabling the logging not be enough?
Standard windows ODBC driver.
The HM VM is "naked", it only has HM and Teamviewer installed, no antivirus etc.
Audit displays a warning about a missing audio file (there was a test that used it).
All logs/reports are stored locally.
No nonstandard winsock components.
Sorry i can't give you more info right now, not at work anymore.
thank you for the quick reply.
Yes i used ODBC, however i already suspected it and disabled it. Would disabling the logging not be enough?
Standard windows ODBC driver.
The HM VM is "naked", it only has HM and Teamviewer installed, no antivirus etc.
Audit displays a warning about a missing audio file (there was a test that used it).
All logs/reports are stored locally.
No nonstandard winsock components.
Sorry i can't give you more info right now, not at work anymore.
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
Good morning.
Yes ODBC logging, Microsoft SQL server 12
As i said above i already had ODBC logging disabled
About the test methods i added a screenshot of the audit tool
http://imgur.com/3zOruue
I could provide a Teamviewer session if that would help
Yes ODBC logging, Microsoft SQL server 12
As i said above i already had ODBC logging disabled
About the test methods i added a screenshot of the audit tool
http://imgur.com/3zOruue
I could provide a Teamviewer session if that would help
-
- Posts: 2832
- Joined: Tue May 16, 2006 4:41 am
- Contact:
As I can see, you also have 2 ODBC Query test items.
What ODBC driver is used for these 2 test items? Same as for logging?
Could you also disable these 2 test items?
When HostMonitor will freez, could you check the following:
- resource usage for each process. You may use standard Windows Task Manager to check Handles, Threads, USER objects.
- total resource usage on the system
- How many handles/threads/User & GDI objects used by hostmon.exe process.
You may also setup Dominant Process test methods (check handles, threads, VMem) and use Private log file(s) with Full logging mode for these tests.
What ODBC driver is used for these 2 test items? Same as for logging?
Could you also disable these 2 test items?
When HostMonitor will freez, could you check the following:
- resource usage for each process. You may use standard Windows Task Manager to check Handles, Threads, USER objects.
- total resource usage on the system
- How many handles/threads/User & GDI objects used by hostmon.exe process.
You may also setup Dominant Process test methods (check handles, threads, VMem) and use Private log file(s) with Full logging mode for these tests.
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
Hi, i send you an email with the requested files.
Next time the HM freezes i will collect the other data.
The two ODBC tests are Veeam tests, they check two fields in its Microsoft SQL DB. Yes it is the same ODBC driver (standard Windows). Those tests are quite old, only in use at some legacy system (Server 2003 shudder). They will be phased out as soon as the client has a newer Veeam where i can test it with a Powershell snapin. We had a lot of those in use before we updated our HM, without any problems.
The current HM runs in a server 2012 VM, 4 vCPUs and 4 GB RAM.
Next time the HM freezes i will collect the other data.
The two ODBC tests are Veeam tests, they check two fields in its Microsoft SQL DB. Yes it is the same ODBC driver (standard Windows). Those tests are quite old, only in use at some legacy system (Server 2003 shudder). They will be phased out as soon as the client has a newer Veeam where i can test it with a Powershell snapin. We had a lot of those in use before we updated our HM, without any problems.
The current HM runs in a server 2012 VM, 4 vCPUs and 4 GB RAM.
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
Thank you for the files.
However we cannot reproduce the problem on our systems (yes, we cannot check your servers, we setup similar tests).
Could you setup RMA agent (on the same or different system) and switch part of test methods to RMA agent?
E.g. you may use View to select test items and quickly change "Test by" option (to RMA agent).
This way we may see what exactly test method or test item may cause the issue.
Another option - can you move HostMonitor to another system or update HostMonitor to version 10.08?
Regards
Alex
However we cannot reproduce the problem on our systems (yes, we cannot check your servers, we setup similar tests).
Could you setup RMA agent (on the same or different system) and switch part of test methods to RMA agent?
E.g. you may use View to select test items and quickly change "Test by" option (to RMA agent).
This way we may see what exactly test method or test item may cause the issue.
Another option - can you move HostMonitor to another system or update HostMonitor to version 10.08?
Regards
Alex
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
Hi,
i can't move HM to another system easely.
I am not surprised you can't reroduce the issue, you don't have any load on your system.
What do you mean to switch test methods to rma agent? which agent? which client? which tests?
Do i have to updat the RMA t o actually use the benefits of HM 10.08?
Also i have to check if we have a lifetime license
And what about a Teamviewer session?
i can't move HM to another system easely.
I am not surprised you can't reroduce the issue, you don't have any load on your system.
What do you mean to switch test methods to rma agent? which agent? which client? which tests?
Do i have to updat the RMA t o actually use the benefits of HM 10.08?
Also i have to check if we have a lifetime license
And what about a Teamviewer session?
We don't have any load?I am not surprised you can't reroduce the issue, you don't have any load on your system.
You have 2,556 active tests, we setup over 10,000
Your setup runs 18 tests/sec, we are running 95 tests/sec
However we do not have 300 Active RMA running with this setup...
(on the other hand some customers use even more agents without problem)
As I see you used HostMonitor for 8 years without problems.
Am I right?
So what kind of change caused this problem? You updated just HostMonitor? What version was installed before update?
Some tests performed by HostMonitor: 210 tests, 144 enabled, 6 of them depends on 3rd party DLLsWhat do you mean to switch test methods to rma agent? which agent? which client? which tests?
- 5 Certificate Expiration tests use OpenSSL
- 1 URL test uses IE related DLL
May be some bugs in these DLLs lead to the problem - HostMonitor 9.86 and 9.90 uses different OpenSSL version (different from HostMonitor 9.80, 9.50, etc)
If you setup agent (any agent, e.g. install RMA on HostMonitor system) and transfer these tests to agent, we will see if this theory right. Or just disable these tests for a week.
Yes, you should update agents as well.Do i have to updat the RMA t o actually use the benefits of HM 10.08?
RMA Manager allows you to update many RMA at once
http://ks-soft.net/hostmon.eng/rma-mana ... ow_upgrade
We need our tools and source codes to see what is going on inside HostMonitor process. We can't do this on your system.And what about a Teamviewer session?
Regards
Alex
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am
-
- Posts: 12
- Joined: Wed Feb 03, 2016 8:56 am