Although Zabbix itself doesn't use or read snmp.conf, net-snmp does. 
Currently, it is possible to specify clientaddr= parameter in the SNMP config file, and it is respected by Zabbix until snmp cache is reloaded. Afterwards, this setting is ignored.
 
This is undocumented behavior, and most importantly - it is not consistent.