[RESOLVED] [BAN] Temporary ban to protect map-server, 151 characters affected
Posted: 28 Dec 2018, 06:39
Over the last few days the map server has suffered repeated oomkills due to the write queue of too many sockets becoming too big all at once.
Typical incident:
The following characters are affected:
The IP from which all of these characters have been connecting from has been temporarily banned.
This is a technical ban rather than a personal ban, made to protect the uptime of the server. The intention is this ban will be reversed once the owner can be contacted and told to tone it down a bit, and/or sane sendq/recvq limits are implemented on the server. (Any evasion prior to contact, however, *is* potentially liable for a personal ban.)
This is completely separate from any actions the game masters may or may not decide to take independently, based on their best judgment and any particulars of the case.
---Freeyorp
Typical incident:
Code: Select all
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 47 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 74 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 32 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 43 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 63 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 24 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 13 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 69 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 19 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 27 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 78 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw kernel: kworker/u8:1 invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null), order=1, oom_score_adj=0
[oomkiller details]
Dec 28 04:28:50 tmw kernel: Out of memory: Kill process 3968 (tmwa-map) score 804 or sacrifice child
Dec 28 04:28:50 tmw kernel: Killed process 3968 (tmwa-map) total-vm:11620596kB, anon-rss:11536760kB, file-rss:1204kB, shmem-rss:0kB
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 23 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 15 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 53 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 54 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 58 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 25 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 112 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 81 wdata expanded to 134217728 bytes.
[delayed log output of many, *many* other sockets also increasing their write queue]
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 46 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 90 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 50 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 56 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 120 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 95 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 34 wdata expanded to 134217728 bytes.
Dec 28 04:28:50 tmw tmwa-map[3968]: socket: 79 wdata expanded to 134217728 bytes.
Dec 28 04:28:51 tmw kernel: oom_reaper: reaped process 3968 (tmwa-map), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Code: Select all
'Aamon'
'Abezethibou'
'Abraxax'
'Abyzou'
'Adrammelech'
'Aeshma'
'Agaliarept'
'Agiel'
'Agrat'
'Alloces'
'Allu'
'Amaymon'
'Amdusias'
'Anammelech'
'Ancitif'
'Andhaka'
'Andrealphus'
'Anzu'
'Armaros'
'Arunasura'
'Asag'
'Asakku'
'Bael'
'Bakasura'
'Baku'
'Balberith'
'Bali'
'Barbas'
'Barbatos'
'Barong'
'Bathin'
'Beleth'
'Berith'
'Bifrons'
'Botis'
'Buer'
'Bukavac'
'Bune'
'Bushyasta'
'Chax'
'Chemosh'
'Cimejes'
'Corson'
'Crocell'
'Culsu'
'Daeva'
'Dajjal'
'Danjal'
'Dantalion'
'Decarabia'
'Demiurge'
'Drekavac'
'Dzoavits'
'Eblis'
'Eisheth'
'Eligos'
'Foras'
'Forcas'
'Forneus'
'Forras'
'Furcas'
'Gaap'
'Gaderel'
'Gaki'
'Gamigin'
'Glasya'
'Gremory'
'Grigori'
'Gualichu'
'Guayota'
'Haagenti'
'Haborym'
'Hauras'
'Haures'
'Havres'
'Hinn'
'Ipos'
'Jikininki'
'Kabandha'
'Kasadya'
'Killakee'
'Kroni'
'Kukudh'
'Kumbhakarna'
'Lechies'
'Lempo'
'Leraie'
'Leraje'
'Leyak'
'Lilin'
'Ljubi'
'Lucifuge'
'Marchosias'
'Maricha'
'Masih'
'Mastema'
'Merihem'
'Morax'
'Murmur'
'Naamah'
'Naberus'
'Namtar'
'Ninurta'
'Onoskelis'
'Ordog'
'Orias'
'Oriax'
'Orobas'
'Otokata'
'Paimon'
'Pelesit'
'Penemue'
'Phenex'
'Pithius'
'playerone'
'Pocong'
'Pontianak'
'Preta'
'Pruflas'
'Puloman'
'Rahab'
'Rakshasa'
'Rangda'
'Ronove'
'Rusalka'
'Sabnock'
'Saleos'
'Seir'
'Semyaza'
'Shedim'
'Sitri'
'Sthenno'
'Stihi'
'Stolas'
'Suanggi'
'Surgat'
'Titivillus'
'Toyol'
'Tuchulcha'
'Ukobach'
'Valac'
'Valefar'
'Vapula'
'Vassago'
'Vepar'
'Vine'
'Wechuge'
'Yeqon'
'Zagan'
'Zepar'
'Ziminiar'
This is a technical ban rather than a personal ban, made to protect the uptime of the server. The intention is this ban will be reversed once the owner can be contacted and told to tone it down a bit, and/or sane sendq/recvq limits are implemented on the server. (Any evasion prior to contact, however, *is* potentially liable for a personal ban.)
This is completely separate from any actions the game masters may or may not decide to take independently, based on their best judgment and any particulars of the case.
This thread will be updated with any further developments.#themanaworld wrote: (16:58:57) < John_H> Anyone up?
(17:01:13) < John_H> If there is a dev/admin on, the server has been kicking players a lot for the last couple of days
[...]
(18:31:26) < Freeyorp> If John_H comes back and sticks around for any amount of time, let them know that the map server got dunked on by the oomkiller about half an hour before they sent their messages
(18:32:48) < Freeyorp> (and about 5.5h before that, and about 2.5h before /that/... etc, etc)
(18:44:08) < Freeyorp> https://ncry.pt/p/GxOn#Vm05i9Tt5Rkw9LKf ... cfBW0ugU2A ... those make for some pretty inflated buffers all in the moments right before oomkiller
(18:45:14) < Freeyorp> 11 connections wanting a 134M buffer? Yeah, that'd do it
(18:46:40) < Freeyorp> shitloads of accounts connecting in the seconds before oomkill, all in alphabetical order, as if read out from a dictionary somewhere... yeah, looks like a DoS
(18:48:37) < gumi> that's not really an intentional DoS, it's just a player that has been experimenting controlling an army of 100+ bots all at once
(18:48:46) < Freeyorp> what
---Freeyorp