-
Incident report
-
Resolution: Fixed
-
Critical
-
2.0.2
-
OS:
cat /etc/centos-release
CentOS release 6.3 (Final)
ZABBIX:
zabbix_server -V
Zabbix server v2.0.2 (revision 30485) (03 October 2012)
Compilation time: Oct 22 2012 21:24:20
ORACLE:
select * from V$VERSION;
BANNER
--------------------------------------------------------------------------------
Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
PL/SQL Release 11.2.0.3.0 - Production
CORE 11.2.0.3.0 Production
TNS for Linux: Version 11.2.0.3.0 - Production
NLSRTL Version 11.2.0.3.0 - Production
SQL*CLIENT (istant client):
rpm -qa | grep oracle-instant
oracle-instantclient11.2-devel-11.2.0.3.0-1.x86_64
oracle-instantclient11.2-basic-11.2.0.3.0-1.x86_64
oracle-instantclient11.2-sqlplus-11.2.0.3.0-1.x86_64
oracle-instantclient11.2-odbc-11.2.0.3.0-1.x86_64
oracle-instantclient11.2-jdbc-11.2.0.3.0-1.x86_64
NSL_LANG:
PARAMETER VALUE
----------------------------------------------------------------------------------------------------------------------------------------------------------------
NLS_LANGUAGE AMERICAN
NLS_TERRITORY AMERICA
NLS_CURRENCY $
NLS_ISO_CURRENCY AMERICA
NLS_NUMERIC_CHARACTERS .,
NLS_CALENDAR GREGORIAN
NLS_DATE_FORMAT DD-MON-RR
NLS_DATE_LANGUAGE AMERICAN
NLS_SORT BINARY
NLS_TIME_FORMAT HH.MI.SSXFF AM
NLS_TIMESTAMP_FORMAT DD-MON-RR HH.MI.SSXFF AM
PARAMETER VALUE
----------------------------------------------------------------------------------------------------------------------------------------------------------------
NLS_TIME_TZ_FORMAT HH.MI.SSXFF AM TZR
NLS_TIMESTAMP_TZ_FORMAT DD-MON-RR HH.MI.SSXFF AM TZR
NLS_DUAL_CURRENCY $
NLS_COMP BINARY
NLS_LENGTH_SEMANTICS BYTE
NLS_NCHAR_CONV_EXCP FALSEOS: cat /etc/centos-release CentOS release 6.3 (Final) ZABBIX: zabbix_server -V Zabbix server v2.0.2 (revision 30485) (03 October 2012) Compilation time: Oct 22 2012 21:24:20 ORACLE: select * from V$VERSION; BANNER -------------------------------------------------------------------------------- Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production PL/SQL Release 11.2.0.3.0 - Production CORE 11.2.0.3.0 Production TNS for Linux: Version 11.2.0.3.0 - Production NLSRTL Version 11.2.0.3.0 - Production SQL*CLIENT (istant client): rpm -qa | grep oracle-instant oracle-instantclient11.2-devel-11.2.0.3.0-1.x86_64 oracle-instantclient11.2-basic-11.2.0.3.0-1.x86_64 oracle-instantclient11.2-sqlplus-11.2.0.3.0-1.x86_64 oracle-instantclient11.2-odbc-11.2.0.3.0-1.x86_64 oracle-instantclient11.2-jdbc-11.2.0.3.0-1.x86_64 NSL_LANG: PARAMETER VALUE ---------------------------------------------------------------------------------------------------------------------------------------------------------------- NLS_LANGUAGE AMERICAN NLS_TERRITORY AMERICA NLS_CURRENCY $ NLS_ISO_CURRENCY AMERICA NLS_NUMERIC_CHARACTERS ., NLS_CALENDAR GREGORIAN NLS_DATE_FORMAT DD-MON-RR NLS_DATE_LANGUAGE AMERICAN NLS_SORT BINARY NLS_TIME_FORMAT HH.MI.SSXFF AM NLS_TIMESTAMP_FORMAT DD-MON-RR HH.MI.SSXFF AM PARAMETER VALUE ---------------------------------------------------------------------------------------------------------------------------------------------------------------- NLS_TIME_TZ_FORMAT HH.MI.SSXFF AM TZR NLS_TIMESTAMP_TZ_FORMAT DD-MON-RR HH.MI.SSXFF AM TZR NLS_DUAL_CURRENCY $ NLS_COMP BINARY NLS_LENGTH_SEMANTICS BYTE NLS_NCHAR_CONV_EXCP FALSE
Zabbix with configuration for a large environment have too many problems with oracle in backend. One over all is the connections (1 for process?????) and too many session opened and never closed.
zabbix_server.conf (for the connections):
StartPingers=10
StartPollers=350
StartTrappers=5
StartDiscoverers=1
StartDBSyncers=20
StartJavaPollers=10
StartPollersUnreachable=10
Connections from Apache are maximum 20 (from the httpd.conf, we must use prefork and not worker):
<IfModule prefork.c>
StartServers 1
MinSpareServers 2
MaxSpareServers 2
ServerLimit 10
MaxClients 10
MaxRequestsPerChild 1000
</IfModule>
When zabbix start (fronted and server) we have 420 (minimum ) connection (in oracle "process") to database (most of this are marked as INACTIVE) and 4000 cursors that grow to 8000 and more ... We have a big RAC system and zabbix, for now, is the most used resource process for oracle ...
For me (using backend oracle) the important thinks are:
- CLOSE CURSORS (reason because i have opened the bug req!)
- USE OF "CONNECTION POOL APPROACH" to better manage the connections effectively required (so process are never too much)