mod LocalRatings mod - evaluate players' skills based on previous games

[sarcoma]

LR error when opening leaderboard?
functions utility 88 44

[Mentula]

On 07/02/2025 at 7:58 AM, sarcoma said:

LR error when opening leaderboard?
functions utility 88 44

Thanks for reporting. The error can be ignored, it does not impact any game functionality. There is a fix for it.

[Stan`]

I'm still missing the last chart btw, but i don't know how to implement it. PRs to do that and to implement the latest local ratings features are welcome.

[ffm2]

I modified the mod so it calculates a glicko-2 rating. Glicko-2 should get a bit faster to a correct rating than elo (which I tried before). The old local rating is preserved and in the graphs still shown. I only display the glicko-2 rating in the lobby and game setup. Glicko-2 starts at 1500. The other number next to it is volatility. Volatility starts at 200 and goes lower to find the accurate rating and stabilize there. Games are only evaluated if the victory state of all players are won or defeated.

The result is not satisfying yet for me. I have played/spectated a lot of games this alpha, more than one could demand of another mod-user. I release it anyway for testing or if anyone else want to play around with it.

It could be that this works better if:

• Team pairings are consequently made by this glicko-2 rating. This way if underrated players gets teamed up occasionally they could gain rating. This feedback loop could benefit the rating. On the other hand if e.g. one player is very strong and known for it, he might get paired with many very bad players and lose rating.
• Maybe it should not be done locally as then the rating pool gets bigger and better connected. Atm. good players only play with good players and the rating of them doesn't get elevated as high.

Atm. I'm a bit disappointed and may not follow up on this but wanted to drop it here. But I mean, if you doubt the team game pairing this could be used as a guide and if it is wrong rating got distributed so it should work better next time. But before one trusts the algorithm I wouldn't put in the work to include the graphs.

localratings_glicko2.zip

[Seleucids]

How do you account for RD increasing over time? do you factor in the replay date?

[ffm2]

there's a template for the decay, but not used actually atm. LR gets the time by the replay folder. But downloaded replays from replay-palas don't have the date in their name like the ones from the game. Like with "2025-05-21_0001", another shared replay would have another game 0001 on that day.

[ffm2]

LR checks metadata.json, which doesn't store the date. commands.txt does, but would be another step costing time. I appended to my replays also a string so I can mix replays of different pcs but I can change that to cater to LR too.