Purple Jaguar wrote:

The discord link for me is invalid. Looks like a cool project that i'd be willing to help out with after I finish some things.

I AM VERY SMART wrote:

The only thing I'm scared of is the AI detecting a cheater that isn't even one, like an offline player or something similar.

1. VACNet required a lot of data and it was funneled through the Overwatch system because AI can't always accurately detect cheats or not, thus Valve decided that instead of letting the AI hallucinate, they decided to let players do some of the work and verify
2. VACNet, in CSGO, didn't progress past detecting spinbots
3. To my knowledge, CS2 still has a large cheating problem and while there are improvements with bans being delivered, cheaters are still at it
4. There are rumors that cheaters made a bot to make Overwatch cases, then through an exploit, gain the data from the anonymized replays in order to save the skin of their customers (since in CS and other big games, this is a serious business and outlet to make money)

Winnyace wrote:

Are some interesting nuggets for you about VACNet:

1. VACNet required a lot of data and it was funneled through the Overwatch system because AI can't always accurately detect cheats or not, thus Valve decided that instead of letting the AI hallucinate, they decided to let players do some of the work and verify
2. VACNet, in CSGO, didn't progress past detecting spinbots
3. To my knowledge, CS2 still has a large cheating problem and while there are improvements with bans being delivered, cheaters are still at it
4. There are rumors that cheaters made a bot to make Overwatch cases, then through an exploit, gain the data from the anonymized replays in order to save the skin of their customers (since in CS and other big games, this is a serious business and outlet to make money)

The amount of data required for this AI is very large and it needs to be sifted through. AI isn't ready for any new cheating methods innately. You would need to make sure this data is correct and accurate and kept updated with new behavior and cheats. You would need to find a way to constantly retrain bits and pieces of it in order to not hallucinate and ban or detect players that aren't cheating too.

Thus, I frankly believe this is going nowhere. I'm sorry, but I don't see future in this, at the moment.

hyperastro wrote:

I am currently talking to different people who host replay mirrors to send me all the replays on their servers, which I will then filter through using various techniques.

Winnyace wrote:

hyperastro wrote:

I am currently talking to different people who host replay mirrors to send me all the replays on their servers, which I will then filter through using various techniques.

That's a lot of data that needs to be categorized. I am not sure what techniques you could to do this accurately, besides getting a lot of people to do that manually alongside you. I believe any automated techniques can add errors by mistake, thus making the model for the AI wrong, thus leading to it making the wrong decisions. Humans can do that too, however... I don't know.

hyperastro wrote:

I’m really tired of cheaters, and I think we all are (unless you're a cheater, lol). So, I decided to start developing an Osu AI anti-cheat system similar to VAC-net in CS2.

I'm trying to collect as many cheated and non-cheated replays as possible to train an AI model (BERT in this case because of its bi-directional tokenization) to detect, with a high degree of accuracy, whether a replay or score is cheated.
This AI will be trained to detect not only top players cheating but also the lower-ranked players who set impressive scores that go unnoticed. To achieve this, I need a lot of replay data from both high and low-level players.

My goal for this project is to have a AI model scan over replays from maps and then notifying the Osu! team of possible cheated scores to help with catching cheaters

if you want to join the project join our Discord
https://discord.gg/BDU3W22HEW

or our github
https://github.com/160IQAstro/Osu-AI-Anti-Cheat-Project/tree/main

P.S. : This is still very early in development so don't expect to see much on the github as of yet but for anyone who wants to submit replays please join the discord

hyperastro wrote:

I’m really tired of cheaters, and I think we all are (unless you're a cheater, lol). So, I decided to start developing an Osu AI anti-cheat system similar to VAC-net in CS2.

I'm trying to collect as many cheated and non-cheated replays as possible to train an AI model (BERT in this case because of its bi-directional tokenization) to detect, with a high degree of accuracy, whether a replay or score is cheated.
This AI will be trained to detect not only top players cheating but also the lower-ranked players who set impressive scores that go unnoticed. To achieve this, I need a lot of replay data from both high and low-level players.

My goal for this project is to have a AI model scan over replays from maps and then notifying the Osu! team of possible cheated scores to help with catching cheaters

if you want to join the project join our Discord
https://discord.gg/BDU3W22HEW

or our github
https://github.com/160IQAstro/Osu-AI-Anti-Cheat-Project/tree/main

P.S. : This is still very early in development so don't expect to see much on the github as of yet but for anyone who wants to submit replays please join the discord

Phaeth0n wrote:

would that be a little to dangerous since it is AI it needs a starting point or it could go horribly wrong and accidently do a ban wave