[ZBXNEXT-3336] Distributed repository for (Debian) packages. Created: 2016 Jul 10  Updated: 2018 Apr 21

Status: Open
Project: ZABBIX FEATURE REQUESTS
Component/s: Installation (I)
Affects Version/s: None
Fix Version/s: None

Type: Change Request Priority: Trivial
Reporter: Paweł Różański Assignee: Gatis Rumbens
Resolution: Unresolved Votes: 2
Labels: debian, mirror, repo
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Debian/Ubuntu. May work for CentOS too.


Issue Links:
Sub-task
Epic Link: DEV-680

 Description   

Last days there were problems with repo.zabbix.com. Some unofficial mirrors appeared https://github.com/monitoringartist/repo.zabbix.com but this requires explicit change in sources.list.

Instead, we could use the same method as http://httpredir.debian.org/ (I use it since very begginging and I'm happy with the solution), which ensures up to date and only working backends, provides load balancing.

People interested in running mirror (and there are some, including myself) would need some information/stats:
1. How much disk space does current mirror use? If partial mirrors are OK, it would be nice to provide information about space needed by deb repo only, rpm repo only, sources. Or only by current (newest stable) version.
2. How much traffic does repo need? Monthly transfer or typical bandwidth used should be OK. Of course mirrors in distributed repo will receive less traffic, but in pessimistic scenario each might be hit by full traffic.
3. Official recommendations how to create mirror and info how to join the project would be nice. There are descriptions for creating Debian mirrors, but there might be some changes and recommendations regarding frequency of updates.



 Comments   
Comment by Tim Meusel [ 2016 Jul 10 ]

+1 for this. I opened https://support.zabbix.com/browse/ZBXNEXT-3050 a few months back. I'm happy to sponsor a mirror. Offering rsync would allow everybody to also create their own private mirror.

Comment by Jan Garaj [ 2016 Jul 11 ]

1.) Disk space requirement

wget ‐‐execute robots=off ‐‐recursive \
  ‐‐no-parent ‐‐continue ‐‐no-clobber \
  -l 100 --reject-regex "=" http://repo.zabbix.com

=> 9.2GB (html files included) ~= 10GB

BTW: 10GB of AWS S3 standard storage (99.99% availability, 99.999999999% durability) = $0.3/month
Only traffic is a question.

Comment by Paweł Różański [ 2016 Jul 12 ]

Well, 10-20 GB of space and 10-30 Mbps of traffic I can donate as a person, not as company (on kimsufi, but this is enough).

I believe we can have better availability if we make this the same way as httpredir.debian.org is made: round robin DNS and a swarm of backends.

Another advantage: if company uses Zabbix repo a lot, making public mirror and using redirector makes perfect sense - their machines should be pointed to their repo. If it is running, but when it isn't, packages still will be retrived from another repo.

Another advantage: better geographical coverage.

I know, we can make private mirrors, move to servers with better availability etc. but if we are changing things, why not make it really good? Especially that not available repository is PITA when things are automated.

Generated at Fri Apr 26 21:32:23 EEST 2024 using Jira 9.12.4#9120004-sha1:625303b708afdb767e17cb2838290c41888e9ff0.