forum

osu!Bancho stats and logs!

posted
Total Posts
129
show more
Topic Starter
Corin
php broke, I was pissing about with php execution in certain dirs and forgot about that one >.>

Should work fine now.
- Marco -


this don't work :c
Saten
any idea why the logs in skandinavian doesn't work?
Juuryoushin
Seems like all logs/quotes are completely freezed and not updated since Wednesday. (there are no logs from Thursday and today)
Did something bad happened? :I

EDIT: okay nvm
Topic Starter
Corin
It's temporarily not generating stats, the logs are fine juts not being sync'd to the log folders, I need to work on a few things on it because at the moment it's pushing full load on my servers CPU and I have an inkling that the HDD is on its last legs due to constant IO.

Anyways once I finish my build-scripts I'll finish the stats stuff, but I'll re-enable log syncing for now.

Saten wrote:

any idea why the logs in skandinavian doesn't work?
It doesn't? o.O

EDIT: Oh re-read
Topic Starter
Corin
Herro!

So what I did to counter this issue is put more load on it to ease off the big burden!

So there's a few new things; one is that that stats are now split into 2 sections.
Yearly and combined.

Combined will be filed in the same place as normal however they will be generated once a day only. Not every hour, this will generally ease off the load

Yearly will be filed in http://osu.corin.me/stats/yearly/ so you can view the past stats of 2013 and this years current stats.
Before you moan that /np counts as an action, I'm aware I just can't tell what changed.

2014's yearly stats will now be generated every 10 mins once again but is more likely to be changed to 20 in the near future.

Logs have started syncing once again as normal aaand I think that's all! Enjoy :D
Juuryoushin
And all the avatars are back !
Grats \:D/
Topic Starter
Corin

Didou wrote:

And all the avatars are back !
Grats \:D/
Yeup, automatically adding themselves and updating, there's a few glitches here and there but the majority of it works!
Topic Starter
Corin
Did a quick but fairly decent modification
Thanks to peppy pointing out to me that the osu!API can get uid's; avatars no longer are cached locally on the server but use your current osu! one directly so it'll never be out of date!

This will lower load and generation times greatly meaning I can re-enable #osu's combined stats generation!

#osu's 2014 statistics will be generated hourly
#osu's combined statistics will now be generated daily rather than whenever it feels like it.

Have fun!

Also if anyone wants it a copy of the UID cache can be found here: http://corin.me/uid_cache It's always up to date.
Format is Username:UID
seasonS

Vext wrote:

Pretty nifty. If only I ever spoke in #osu or anywhere.
True
Topic Starter
Corin
So I did a few changes which is why this was down for a few days.

1: I moved everything to a new dedi so now instead of #osu taking 3 hours and 10 mins to generate on combine stats and dragging a load of other shit down because of; it takes 10 mins and drags nothing down with it. 2x E5's are nice.
So now I once more re-enabled #osu combined stats.

2: I redid the way I have logs laid out. While moving everything I somewhat was confused and had to ask myself what the fuck I was doing.
Every night it would rsync the logfiles over to another directory. So it used to copy them and overwrite, for some reason rsync didn't like checking if the files were the exact same in both destinations so what it did was overwrote them ALL so that's every channel, copying 500 files ($chancount * 500) every night which I'm sure the HDD did not like.
It's a very dumb thing to do, especially seeing as the old dedi itself was not very powerful and low on HDD space (45GB total in logs * 2 due to them being in 2 locations).

So now I replaced that shit with something much more simplistic. I created a symlink to the actual files and every night at 12.01AM it'll create a symlink for that day bringing the overall HDD load to 0 and bringing down space requirements.

This also gave another boon; the logs are now updated in realtime so you don't have to wait an hour for that stuff to update anymore.
Looking back I knew how to do all this back then and I'm wondering why I didn't do it. Oh well.

Anyways, enjoy. \o\ Everything should be overall faster

TL;DR
Chan stats generate zoom zoom now
Chan stats are back up
#osu combined now works
Logs are updated in realtime
Juuryoushin
I was wondering about the eternal maintenance ....
Welp, I pretty much didn't expect a complete update lol, gg, keep going \:D/
- Marco -
Topic Starter
Corin

marcostudios wrote:

http://osu.ppy.sh/u/-MasterCraft- is banned

http://osu.ppy.sh/u/Mastercraft2012 was the name before the namechange
There's a lot that can go wrong there. Because peppy removed the "previous username" on the profile it's hard to see if they're banned or they changed their nickname or whatever.
Tempted to have a submission feature for this as it needs to be done manually (can be automated however later on).
At the same time I can't prove all this stuff.

plus the cache needs to be regenerated for it to take effect too. so yeah.
- Marco -


:c
Topic Starter
Corin
Caused by networking outage and corin panicing, unfortuantly there's no backlog, but it's fixed.
Granger
This is glorious. A new stalking tool for me! :>

Is it possible to search for specific users?
Topic Starter
Corin

Granger wrote:

This is glorious. A new stalking tool for me! :>

Is it possible to search for specific users?
Not really, other than CTRL + F and just remember what channels you chat in most :P
Bara-
The logs don't work anymore.
It says 'File not found' >.<
Topic Starter
Corin
Fixed, I think I just hit another Y2K type bug. Huh.
Either way it fucked over my whole webserver for no reason. All fixed :D
[-Sophie-]_old
Some directories are broken with a file not found
also, why isn't my avatar showing up?
Pawsu
Looks like that bug is back!
Can't view the whole site. "File not found."
Topic Starter
Corin
aaaaaaaaaaaaaaaaaa

Yeah I'm fixing it now, it's caused by my rewrite including the indexes as php for no reason, most other things work.... sorta.

You can still go directly to the pages though.
Howl

Corin wrote:

You can still go directly to the pages though.
nope
Topic Starter
Corin

Howl wrote:

Corin wrote:

You can still go directly to the pages though.
nope
You're going directly to the index, that's technically not a page. If you want stats,
http://osu.corin.me/stats/channelnamehere
For 2014 stats
http://osu.corin.me/stats/yearly/2014/channelnamehere
IE
http://osu.corin.me/stats/yearly/2014/ctb


EDIT: nmlol fixed.
Pawsu
Alright, thanks!
Looks like this would be pretty difficult to run... Would be hard ;___;
- Marco -

CanadianPaws wrote:

Alright, thanks!
Looks like this would be pretty difficult to run... Would be hard ;___;
i think corin use pisg
Topic Starter
Corin

marcostudios wrote:

CanadianPaws wrote:

Alright, thanks!
Looks like this would be pretty difficult to run... Would be hard ;___;
i think corin use pisg
A heavily modified version of pisg yes. The only real hard part is the magnitude resources it uses.
Howl
muh 2015
Neil Watts
Please update it <3 very useful for a lot of players, thanks for your work!
xxdeathx
Nutella
2015 make it happen
XgenSlayer

xxdeathx wrote:

http://osu.corin.me/stats/yearly/2014/modhelp.html

LOL
Reborn--

it's something \:v/
Oinari-sama
The log seems to have stopped on 5th Jan.
Topic Starter
Corin
My bad, I never got the email about this thread being posted in.

Anyways it's up now :)
http://osu.corin.me/stats/yearly/2015/

I completely forgot I had to update this for 2015 but hey ho there we are, have fun! :D


Aaaand 6th > today was lost thanks to me being parted the channels, dunno how that happened but whatever, sorry about that! D:
Nutella

Corin wrote:

My bad, I never got the email about this thread being posted in.

Anyways it's up now :)
http://osu.corin.me/stats/yearly/2015/

I completely forgot I had to update this for 2015 but hey ho there we are, have fun! :D


Aaaand 6th > today was lost thanks to me being parted the channels, dunno how that happened but whatever, sorry about that! D:
2014 #osu has transformed into 2015. There isn't an actual 2015 #osu when you look up but its replacing 2014.
Topic Starter
Corin

Nutella wrote:

Corin wrote:

My bad, I never got the email about this thread being posted in.

Anyways it's up now :)
http://osu.corin.me/stats/yearly/2015/

I completely forgot I had to update this for 2015 but hey ho there we are, have fun! :D


Aaaand 6th > today was lost thanks to me being parted the channels, dunno how that happened but whatever, sorry about that! D:
2014 #osu has transformed into 2015. There isn't an actual 2015 #osu when you look up but its replacing 2014.
fug :^DDD
Fixed. I did kinda wonder where #osu was on 2015
Reileky
How I did not know about this?!
Pawsu
A little bug, changing your username will result in your old username to remain inactive. You basically have to regain all your stats
Example, I changed my name to Pawsu, and now my old username, CanadianPaws, is inactive
http://rainy.s-ul.eu/O4QvyzYC
show more
Please sign in to reply.

New reply