[ZBX-21158] "Something Impossible Has Just Happened" Created: 2022 Jun 02  Updated: 2023 Aug 25  Resolved: 2023 Aug 25

Status: Closed
Project: ZABBIX BUGS AND ISSUES
Component/s: None
Affects Version/s: 6.0.5
Fix Version/s: None

Type: Problem report Priority: Trivial
Reporter: Zach Ryder Assignee: Andrey Tocko (Inactive)
Resolution: Fixed Votes: 1
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Ubuntu 20.04 Server, POSTGRES Database


Attachments: File audit_log_patch.diff     PNG File image-2022-06-02-09-44-04-825.png     PNG File image-2022-06-30-12-19-38-011.png     Text File site-log-zabbix.txt     Zip Archive zab-logs-something-impossible.zip    
Issue Links:
Sub-task
part of ZBX-21058 zabbix_server [1106328]: ERROR [file ... Closed

 Description   

Steps to reproduce:

  1. Check both nodes in 2 VM Zabbix 6 HA cluster are working
  2. Notice Zabbix Alarms "Change in system" on localhost, meaning MASTER cluster node has changed
  3. Something impossible has just happened.  MASTER Node restarts itself, MASTER Role is changed to slave.

Result:

Expected:
See screenshot....
See attached patch file...

 

Similiar issue here - https://support.zabbix.com/browse/ZBX-21058



 Comments   
Comment by Edgar Akhmetshin [ 2022 Jun 03 ]

Hello Zach,

Could you please provide:

  • log before crash - at least 1-5 minutes before crash, if it's happening on regular basis - increase debug log to level 5 and attach to the issue;
  • operating system name and version;
Comment by Zach Ryder [ 2022 Jun 07 ]

site-log-zabbix.txt  here is the log.

 

admin@zabbix:/var/log/zabbix$ cat /etc/lsb-release
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=20.04
DISTRIB_CODENAME=focal
DISTRIB_DESCRIPTION="Ubuntu 20.04.4 LTS"

Comment by Zach Ryder [ 2022 Jun 09 ]

Details above

Comment by Zach Ryder [ 2022 Jun 15 ]

Please provide a status update.  Is there a patch in the works? @Edgar Akhemtshin

Comment by Andrey Tocko (Inactive) [ 2022 Jun 16 ]

Thank you for the update.
Sorry for the delay, we will be back to you.

Comment by Andrey Tocko (Inactive) [ 2022 Jun 21 ]

Hello Zach!
Please apply this patch audit_log_patch.diff, compile server and gather 5minutes of debug log=5 after starting server.
Need your help here, since it is not reproducible.

Regards,
Andrey

Comment by Zach Ryder [ 2022 Jun 29 ]

Hi Andrey. Thank you for replying.  I have applied the patch.  I believe I have gathered even more than 5 minutes of logs.  I will attach both logs to both nodes in my cluster, respectively.  I hope this helps us understand the culprit.  I have expanded my Zabbix disk's to more than 500 GB each.  I am unable to even attach the logs because they are so big, so here they are in a .zip file.  Cheers. 

Comment by Andrey Tocko (Inactive) [ 2022 Jun 30 ]

Hello Zach and thank you for the effort.
Zip is not attached. Limit here is up to 15MB perf file.
You can split archive in parts first and attach as multiple.

Regards,
Andrey

Comment by Zach Ryder [ 2022 Jun 30 ]

Comment by Zach Ryder [ 2022 Jun 30 ]

@Andrey Tocko Please see the image above.  I can see the .zip which I attached to this ticket.  Please let me know if you still cant see it. 

Comment by Andrey Tocko (Inactive) [ 2022 Jul 01 ]

Thank you. Got it.

Comment by Zach Ryder [ 2022 Jul 20 ]

Can you please provide a patch for 6.2 so that I don't have to downgrade? (Ubuntu 20, PostGres). @Andrey Tocko 

Comment by Andrey Tocko (Inactive) [ 2022 Dec 21 ]

Should be fixed in 6.2
Please upgrade to the latest minor and report back.

Generated at Thu Apr 03 08:39:31 EEST 2025 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.