Commit b0698c28 authored by Wágner Ferenc's avatar Wágner Ferenc
Browse files

Migration plan, execution, some problems and ideas

parent 5a6d4425
......@@ -96,20 +96,35 @@
# Migration of the Test list:
# - stop exim4, apache2 and mailman services, disable /etc/cron.d/mailman (or do this in the afternoon)
# - wferi@listserv2:/var/lib/mailman$ tar -cvzf /tmp/test.tgz archives/private/test archives/private/test.mbox archive/public/test lists/test
# - wferi@listserv2:/var/lib/mailman$ tar -cvzf /tmp/test.tgz archives/private/test archives/private/test.mbox archives/public/test lists/test
# - wferi@lilac:/var/lib/mailman$ sudo tar -xvf ~/test.tgz
# - no archive regeneration to keep the URLs (in case of past mbox modifications) and to reduce migration load
# Planned migration of all lists except test and mailman (run in a screen session):
# - wferi@lilac:~$ sudo rsync -vaz --super --exclude /lists/test --exclude /lists/mailman --exclude /archives/private/test --exclude /archives/private/test.mbox --exclude /archives/private/mailman --exclude /archives/private/mailman.mbox listserv2.niif.hu:/var/lib/mailman/archives :/var/lib/mailman/data :/var/lib/mailman/lists /var/lib/mailman 2>&1 | tee >(gzip --stdout > rsync.log.gz)
# rsync+sshd saturates CPU on listserv2?
# sent 60,490,702 bytes received 99,447,023,926 bytes 2,841,975.66 bytes/sec
# total size is 181,666,346,642 speedup is 1.83
# rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1677) [generator=3.1.3]
# repeat from at 23:04, result:
# -rw-rw-r-- 1 wferi wferi 11525 Jul 8 00:11 rsync.log.2.gz
# sent 3,267,532 bytes received 63,007,941 bytes 16,513.14 bytes/sec
# total size is 181,679,920,306 speedup is 2,741.28
# rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1677) [generator=3.1.3]
# (probably fixed by making nep.mbox.extra readable)
# Note:
# - the list of lists depends on the used HTTP domain (internal virtual hosting)
# - hbone-ticketing@listserv.niif.hu sender whitelist makes no sense (wiki change 32 and 33), omitted
# TODO
# - check out https://www.msapiro.net/scripts/
# - route local mail to redirector
# - Why does this show the mailman role twice? Dependency infelicity...
# ansible-playbook -i inventory listserv.yml -K --check --diff
# - check that outgoing traffic isn't sent to rspamd
# - Namazu
# - linzer.ki.iif.hu leterelése a 10027-es portról
# - test@lista.edu.hu? Működik. Érdemes lenne spéci routert csinálni erre a domainre is?
# - install auth (ident) daemon
# - skip or fail on rspamd failure?
# 2021-06-09 12:29:36 1lqvSZ-0000oZ-9V spam acl condition: spamd: failed to connect to any address for rspamd.mail.einfra.hu: Connection timed out
......@@ -120,3 +135,43 @@
# - why was the system_aliases router moved forward?
# - DEFAULT_CHARSET for the archives
# - MX changes: listserv.niif.hu, ipv6forum.hu
# Takeover:
# wferi@lilac:~$ sudoedit /etc/apache2/apache2.conf # catch-all
# wferi@lilac:~$ sudo systemctl reload apache2.service
# wferi@listserv2:~$ sudo service exim4 stop
# [sudo] password for wferi:
# [ ok ] Stopping MTA: exim4_listener.
# wferi@listserv2:~$ sudo service apache2 stop
# [ ok ] Stopping web server: apache2 ... waiting .
# wferi@listserv2:~$ sudo service mailman stop
# [ ok ] Stopping Mailman master qrunner: mailmanctl.
# wferi@listserv2:/etc/cron.d$ sudo mv mailman mailman.disabled
# wferi@lilac:~$ sudo systemctl stop exim4.service
# wferi@lilac:~$ sudo systemctl stop mailman.service
# wferi@pdns1:~$ pdnsutil edit-zone niif.hu
# [...]
# -niif.hu 86400 IN SOA ns2.iif.hu hostmaster.iif.hu 2021070501 43200 7200 172800 3600
# +niif.hu 86400 IN SOA ns2.iif.hu hostmaster.iif.hu 2021071301 43200 7200 172800 3600
# -listserv.niif.hu 300 IN A 193.225.14.155
# +listserv.niif.hu 300 IN A 195.111.92.17
# -listserv.niif.hu 300 IN MX 10 listserv2.niif.hu
# +listserv.niif.hu 300 IN MX 10 lilac.mail.einfra.hu
# -listserv.niif.hu 300 IN AAAA 2001:738:0:701:216:3eff:fe01:0
# +listserv.niif.hu 300 IN AAAA 2001:738:0:415::6
#
# RSYNC
#
# wferi@lilac:~$ sudoedit /etc/apache2/apache2.conf # remove catch-all
# wferi@lilac:~$ sudo systemctl reload apache2.service
# wferi@lilac:~$ sudo systemctl start mailman.service
# wferi@lilac:~$ sudo systemctl start exim4.service
#
# PROBLEMS
#
# listserv2 /etc/aliases contains stuff
# - abuse list is no more
#
# Apache inconsistencies - why not the same size?
# 193.6.168.233 - - [13/Jul/2021:17:26:52 +0200] "GET /mailman/admindb/fekosz HTTP/1.1" 200 5312 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36"
# 193.6.168.233 - - [13/Jul/2021:17:27:04 +0200] "GET /mailman/admindb/elnokseg HTTP/1.1" 200 1214 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36"
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment