Upcoming prune

Where game and project announcements are made.
Locked
User avatar
jesusalva
Moubootaur Legends
Moubootaur Legends
Posts: 1438
Joined: 14 Nov 2016, 22:20
Location: Brazil
Contact:

Upcoming prune

Post by jesusalva »

Greetings,

We will be doing a "minor" prune/purge on the upcoming days.


Accounts which fit the following criteria will be purged:

  • Less than 2 logins, AND

  • Older than five days

Also, any storage or bank account without owner will be deleted.


Additionally, any account which did not login after 2019-01-01 will have a bunch of variables removed.
Most of these variables have been deprecated since 2011 and were automatically being removed as players logged in, but because I want to reduce the database size "here and now", we'll be running all of that once, against the whole player database.

List of removed variables:

Code: Select all

'QUEST_xmas07_state', 'QUEST_xmas07_milk', 'QUEST_xmas07_cookies', 'QUEST_xmas07_presents',
'QUEST_Halloween07_state',
'XMASQUEST1', 'XMASQUEST2', 'XMASQUEST3', 'XMASQUEST4', 'XMASQUEST5', 'XMASQUEST6', 'XMASQUEST7', 'XMASQUEST8', 'XMASQUEST9', 'XMASQUEST10', 'XMASQUEST11', 'XMASQUEST12', 'XMASQUEST13', 'XMASQUEST14', 'XMASQUEST15', 'XMASQUEST16', 'XMASQUEST17', 'XMASQUEST18', 'XMASQUEST19', 'XMASQUEST20',
'HWQUEST1', 'HWQUEST2', 'HWQUEST3', 'HWQUEST4', 'HWQUEST5', 'HWQUEST6', 'HWQUEST7', 'HWQUEST8', 'HWQUEST9', 'HWQUEST10', 'HWQUEST11', 'HWQUEST12', 'HWQUEST13', 'HWQUEST14', 'HWQUEST15', 'HWQUEST16', 'HWQUEST17', 'HWQUEST18', 'HWQUEST19', 'HWQUEST20',
'EasterQuest', 'QUEST_Easter08_state', 'Halloween08', 'QUEST_xmas08_state',
'QUEST_Easter09', 'QUEST_Easter09_slots', 'Candyman', 'QUEST_Christmas09_state',
'Easter_2010_QuestState', 'Easter_2010_EggState1', 'Easter_2010_EggState2', 'Easter_2010_EggState3', 'Easter_2010_EggState4', 'Easter_2010_EggState5',
'hween10', 'hween10_collect_canpump', 'hween10_credits', 'hween10_collect', 'hween10_collect_mmallow', 'hween10_collect_jelskul', 'hween10_bonecount', 'hween10_collect_tondel', 'hween10_paid',
'hween16', 'hween16_collect_canpump', 'hween16_credits', 'hween16_collect', 'hween16_collect_mmallow', 'hween16_collect_jelskul', 'hween16_bonecount', 'hween16_collect_tondel', 'hween16_paid',
'Count_Yellow', 'Count_White', 'Maze', 'Yellow', 'White', 'Xmas2010', 'Golbenez_Inn_Cost', 'QUEST_Easter11', 'hw2011', 'xmas2011', 'QUEST_Easter12', 'xmas2012',
'QUEST_clothdyer_angus', 'QUEST_clothdyer_state',
'Death_Kill', 'Scorp', 'Bugleg', 'KatzeBeenOutside', 'LastHiss', 'CaveSnakeLamp', 'MAGIC_CAST_TICK',
'sorfina', 'tanisha', 'hasan', 'kaan'

We just reached 86,000 chars the other day and we are way past 105,000 accounts.
The char file have 50.5 Mb and the account file, 12.8 Mb.

This "small" purge will remove accounts which did not play or gave up on playing, as well as artifacts from partly deleted accounts. This will free to us some more variables slots on TMWA, which in turn, allow us to develop new quests.

Server will be offline during 5 minutes while the purge script run.
It'll also take slightly longer to start while it cleans up the parties accordingly.


Expected Results
→ 52,898 accounts will be deleted
→ 23,872 characters will be deleted
→ 47,425 accounts will be checked for outdated variables
→ 36,508 variables will be effectively deleted (avg 0.77/user)
→ 6,278 accounts will have their variables updated
→ 3,164 orphan storage accounts filled with items will be destroyed
→ 3,890 bank accounts with no owner will be closed
→ 7 Mb reduction on char and account files
→ 200 Mb saved on RAM memory
→ No player, active or inactive, will lose their accounts or chars.

In the attachments, you can find the projected log about the upcoming purge. "Cleaning" should be harmless.

Backups will be kept for at least a month in case anything goes wrong, but I tested with a local copy of player data and the purge did not cause any major issues.

However, ManaMarket and Guilds were not tested, and while I highly doubt an account which only logged in once would be on either of those, you never know :alt-8:

Attachments
purge-2022-11-15.characters.txt
(414.3 KiB) Downloaded 65 times
purge-2022-11-15.txt
(1.54 MiB) Downloaded 53 times

Jesusalva (aka. Jesusaves)
Donate to the project! ─ (Note: If you want to support me instead, Buy me a coffee!)

Former system administrator, project lead and developer.
Do not contact me regarding The Mana World inquiries.

User avatar
Hello=)
TMW Classic
TMW Classic
Posts: 657
Joined: 11 Jun 2009, 12:46

Re: Upcoming prune

Post by Hello=) »

If I got this right it only removes some quite empty dummies who weren't playing. So it sounds great at first glance, saving 200 megz of ram is really appreciable achievement any day.

Though I've got some questions: how server handles "gaps" in account IDs? Would new accounts go under max ID server knows, keeping that incremented anyway? Or it would put some accounts under unused IDs? I care of few aspects: whether its safe (e.g. if it uses gaps, hope it wouldnt overwrite existing accounts as next regs, etc?), whether it brings some confusion on acct age <-> ID being some quite linear relation and then does it even tracks logins # for e.g. old accounts, etc? Has it tracked e.g. achieved level to maybe keep high lvl ppl (if they're in list) and so on?

User avatar
jesusalva
Moubootaur Legends
Moubootaur Legends
Posts: 1438
Joined: 14 Nov 2016, 22:20
Location: Brazil
Contact:

Re: Upcoming prune

Post by jesusalva »

We already have lots if gaps. It pretty much ignores them, the first account id is 2000085 for example.

I don't know how you will reach a high level in a single login unless you're a bot, to be honest. And yes, number of logins is tracked since eAthena 2001 I think; We're using eA 2004.

Jesusalva (aka. Jesusaves)
Donate to the project! ─ (Note: If you want to support me instead, Buy me a coffee!)

Former system administrator, project lead and developer.
Do not contact me regarding The Mana World inquiries.

User avatar
jesusalva
Moubootaur Legends
Moubootaur Legends
Posts: 1438
Joined: 14 Nov 2016, 22:20
Location: Brazil
Contact:

Re: Upcoming prune

Post by jesusalva »

Summary

Purged 52989/106799 accounts
Purged 23937/86083 chars
Pruned 47419/53810 accounts
-----
Purged 3165 storages
Purged 3956 accreg entries
Erased 36507 variables (avg 0.77/user)

Jesusalva (aka. Jesusaves)
Donate to the project! ─ (Note: If you want to support me instead, Buy me a coffee!)

Former system administrator, project lead and developer.
Do not contact me regarding The Mana World inquiries.

Locked