I started around November last year (oh you might wonder why).

I found it good to keep running in the background, if a little bit of an internet hog. I've banked about 10% of this site here, though if I didn't have a setback and a pause on it I'm sure I'd have more. Going to restart it to collect more soon.

I've seen people set up their own local booru, though I've not done that myself.

I just tried it out this morning and so far am pleased with what it can do. Keeping my scope more narrow than the entire site, just my favorites. I was going to set up the recurring updates thing for it so as I keep faving stuff, it keeps on top of it without me having to.

I was looking on the forums here, to see if they had any bandwidth limits for it

ryggy said:
I just tried it out this morning and so far am pleased with what it can do. Keeping my scope more narrow than the entire site, just my favorites. I was going to set up the recurring updates thing for it so as I keep faving stuff, it keeps on top of it without me having to.

I was looking on the forums here, to see if they had any bandwidth limits for it

There are bandwidth limits. https://e621.net/help/api
Rate Limiting

E621/E926 have a hard rate limit of two requests per second.
This is a hard upper limit, and if you are hitting it, you are already going way too fast.
Hitting the rate limit will result in a 503 HTTP response code.

I put some favorite artists and kinks in the download subscriptions too. Using the order:score too to make sure I get top stuff first. Also a daily fetch for order:rank.

fistpup said:
There are bandwidth limits. https://e621.net/help/api
Rate Limiting

E621/E926 have a hard rate limit of two requests per second.
This is a hard upper limit, and if you are hitting it, you are already going way too fast.
Hitting the rate limit will result in a 503 HTTP response code.

That only applies to the api, not to the static server

You should be able to download from the static server as fast as your network can handle

donovan_dmc said:

That only applies to the api, not to the static server

You should be able to download from the static server as fast as your network can handle
[/quote]

Thanks for clarifying!

Hydrus does have its own download system which only gradually pings less it starts getting errors and makes the internet unhappy, also to be kinder on slower boorus too. It's parsing entire pages after all. Can totally set it to unrestricted but it does bog things.

https://hydrusnetwork.github.io/hydrus/getting_started_downloading.html#bandwidth

I was thinking about getting hydrus a while ago to pull up media in my local storage, but something I read about it has had me hesitating. I'm probably misunderstanding what I read, but is it true that hydrus makes a copy of every file? Like every pic, video, etc. needs to be copied into it's own folders to open them?

Maybe what I read was just talking about thumbnails because it would be wildly space inefficient otherwise, right? I don't want my library to take up twice the room it already is.