Rate limiting server access
- johu
- Site Admin
- Posts: 5886
- Joined: Thu Nov 08, 2018 10:52 pm
- Location: Kassel/Germany
- Has thanked: 173 times
- Been thanked: 1095 times
- Contact:
Rate limiting server access
Starting yesterday I noticed an excessive number of accesses from a specific IP address. They seemed to be downloading the entire forum or whatnot.
By the time I noticed it had been going on for 12 hours, the access log file had swollen to 700 MB instead of the usual 20 MB or so!
I have now implemented rate limiting. So if a given IP address makes too many requests within a certain time it will be completely blocked after a while.
By the time I noticed it had been going on for 12 hours, the access log file had swollen to 700 MB instead of the usual 20 MB or so!
I have now implemented rate limiting. So if a given IP address makes too many requests within a certain time it will be completely blocked after a while.
Support R/D and forum on Patreon: https://patreon.com/openinverter - Subscribe on odysee: https://odysee.com/@openinverter:9
- johu
- Site Admin
- Posts: 5886
- Joined: Thu Nov 08, 2018 10:52 pm
- Location: Kassel/Germany
- Has thanked: 173 times
- Been thanked: 1095 times
- Contact:
Re: Rate limiting server access
Unless he moved the head quarters to Darmstadt, Germany, no Was thinking maybe TOR exit node?
Support R/D and forum on Patreon: https://patreon.com/openinverter - Subscribe on odysee: https://odysee.com/@openinverter:9
- janosch
- Posts: 312
- Joined: Tue Jun 30, 2020 9:23 am
- Location: London, UK
- Has thanked: 77 times
- Been thanked: 61 times
- Contact:
Re: Rate limiting server access
Slight tangent:
Are forum & wiki dumps available actually (w/ user table reduced to nickname & PMs stripped out obviously)?
If it's easy to setup I would be interested to keep some local backups, otherwise we have to rely on archive.org if something ever happens to this website.
I noticed recently that for certain short search terms the forum search isn't producing the best results, so I have gone to google:
"site:openinverter.org BMS" to find short or specific terms.
Are forum & wiki dumps available actually (w/ user table reduced to nickname & PMs stripped out obviously)?
If it's easy to setup I would be interested to keep some local backups, otherwise we have to rely on archive.org if something ever happens to this website.
I noticed recently that for certain short search terms the forum search isn't producing the best results, so I have gone to google:
"site:openinverter.org BMS" to find short or specific terms.
- johu
- Site Admin
- Posts: 5886
- Joined: Thu Nov 08, 2018 10:52 pm
- Location: Kassel/Germany
- Has thanked: 173 times
- Been thanked: 1095 times
- Contact:
Re: Rate limiting server access
I do a more or less weekly backup of the entire data base and web server content. It sits here on a raid5 array (3 disks)
Current configuration wouldn't allow a dump to be pulled externally, at least not without rate limit from the client side.
Current configuration wouldn't allow a dump to be pulled externally, at least not without rate limit from the client side.
Support R/D and forum on Patreon: https://patreon.com/openinverter - Subscribe on odysee: https://odysee.com/@openinverter:9
-
- Posts: 93
- Joined: Fri Feb 25, 2022 3:16 pm
- Has thanked: 23 times
- Been thanked: 13 times
Re: Rate limiting server access
Johu, I think it’s worth considering distributing backups between a small number of trusted members, who are known to the community. I have been in situations where forums just disappear when the admin loses interest or just ghosts. It’s a terrible loss, and sometimes the community never recovers.
- TheSilverBuick
- Posts: 187
- Joined: Mon Jun 08, 2020 5:01 pm
- Location: Nevada, United States
- Has thanked: 3 times
- Been thanked: 1 time
Re: Rate limiting server access
Probably someone paranoid that with Damien's departure/hiatus that this forum will vanish off the internet.
Need to learn. Starting from the basics.
Re: Rate limiting server access
Please do not use RAID5 for anything you care about. RAID6 cost you just one more disk, and will save you a lot of agony.
- johu
- Site Admin
- Posts: 5886
- Joined: Thu Nov 08, 2018 10:52 pm
- Location: Kassel/Germany
- Has thanked: 173 times
- Been thanked: 1095 times
- Contact:
Re: Rate limiting server access
Why?
Support R/D and forum on Patreon: https://patreon.com/openinverter - Subscribe on odysee: https://odysee.com/@openinverter:9