Topic: Help with a local installation of e621

Posted under e621 Tools and Applications

Greetings. I am not familiar with docker or with hosting any other booru site but out of curiosity I have managed to follow the instructions here: https://github.com/e621ng/e621ng and now I have a local installation of e621. I have populated it with the

docker exec -it e621ng-e621-1 /app/bin/populate command 

and now it has a small amount of posts. I have also uploaded a few random miscellaneous images into it. But now I am curious as to where these images are stored in my computer. I have not been able to find any of them, they do no appear when I search on the e621ng directory for any *.jpg or *.png file. I have tried running this same search on my home folder and on the root directory, and likewise I can't find them. I know the search program (KFind) is working just fine because it finds pngs and jpgs in various random locations in my computer, but none of them are the images that I have on e621ng. I have also seen the e621ng/public/data/ folder, but it is completely empty.
So to summarize, my questions are as follows:

Where are images stored in a local instance of e621 running on docker?
Where are the tags for each post stored?

Donovan DMC

Former Staff

Look up on Google wherever docker volumes are located for your operating system, on Linux they're in /var/lib/docker/volumes (you need sudo to access this), and the volume name will be e621ng_post_data, with the files further in the _data folder (/var/lib/docker/volumes/e621ng_post_data/_data), you're on your own for windows and mac

donovan_dmc said:
Look up on Google wherever docker volumes are located for your operating system, on Linux they're in /var/lib/docker/volumes (you need sudo to access this), and the volume name will be e621ng_post_data, with the files further in the _data folder (/var/lib/docker/volumes/e621ng_post_data/_data), you're on your own for windows and mac

This is precisely it. thank you very much

donovan_dmc said:
Look up on Google wherever docker volumes are located for your operating system, on Linux they're in /var/lib/docker/volumes (you need sudo to access this), and the volume name will be e621ng_post_data, with the files further in the _data folder (/var/lib/docker/volumes/e621ng_post_data/_data), you're on your own for windows and mac

hello i am not a programmer , but i have a luxury windows servers with 60T harddriver . i want build a local E621 for myself , have any manuel guide for normal-people ? plzzzzzzzzzzzz

mirovichka said:
hello i am not a programmer , but i have a luxury windows servers with 60T harddriver . i want build a local E621 for myself , have any manuel guide for normal-people ? plzzzzzzzzzzzz

This is one of my personal gripes too, in my case, the localhost would always give a failbooru, even through multiple fresh installations of my OS. Because of this, I'm currently working on creating a python script that allows users to download ALL (~9.6TB) of E621's posts, along with applicable metadata on the media, with the goal that any non-techie can simply launch the program as they would any other program. One challenge I have yet to solve is how to get a visually pleasing and familiar interface for E6's users, for that matter, I'm inexperienced with creating an interface at all, so I've no clue how big an undertaking this next step'll be, but I already have the code to handle the downloading in an operational state.

If you try importing all posts here you'll quickly find issues with many files, as issues get fixed files that previously worked fine here no longer work when uploading (large APNGS, WEBMs with non 1:1 SAR, etc)
You'll also likely have an insane amount of throttling from the static server eventually, I know the most I've sustained is ~1,000,000 posts over 24 hours, and that was just previews because I was creating an iqdb clone

Also with running an e621ng instance locally, just.. don't use windows and it will work fine 99.9% of the time
if you must use windows use WSL2

donovan_dmc said:
If you try importing all posts here you'll quickly find issues with many files, as issues get fixed files that previously worked fine here no longer work when uploading (large APNGS, WEBMs with non 1:1 SAR, etc)
You'll also likely have an insane amount of throttling from the static server eventually, I know the most I've sustained is ~1,000,000 posts over 24 hours, and that was just previews because I was creating an iqdb clone

Also with running an e621ng instance locally, just.. don't use windows and it will work fine 99.9% of the time
if you must use windows use WSL2

also if your plan is just a readonly archive, running an entire copy of e6ng seems a bit overkill, given that there are db exports then again i don't know if theres any publically available software to deal with them, and good luck opening a multi GB CSV file in Excel (my query/suggestion/subscription thing takes a bit to run through it and i've got a relatively decent CPU. then again, most performance optimised JS i've ever written, but still room for improvement)

and of course, getting the actual media files is a whole other story