Granberia
Contributor
4 months ago
2015 animal_humanoid apron blush clothing dragon dragon_humanoid female granberia green_scales hair hi_res humanoid looking_at_viewer monster_girl monster_girl_(genre) monster_girl_quest naked_apron red_hair scales simple_background solo standing tau_1111 video_games yellow_eyes

Rating: Safe
Score: 8
User: Granberia
Date: September 02, 2017

Well, there goes my low deletion count. Fortunately I didn't use tumblr as a source that much.


Genjar said:
No need to check the ones that aren't either source:tumblr*1280 width:1280 or source:tumblr*1280 height:1280, so that'll narrow it down a bit. Still 14000 posts, though...

And since most posts aren't sourced directly to the original anyway, it might be worth checking all of source:tumblr* width:1280 and source:tumblr* height:1280. Which is a whole lot of posts. :/

Kinda glad that I haven't uploaded much from Tumblr. Even so, this'll ruin my upload/deletion ratio.

I knew it!
Adding the direct link to the sources is good for something.

Strongbird
Contributor
4 months ago

I'm not even remotely salty about this. Better image quality is better for the site, regardless of some egos being smashed by deletion count.

Thank you for bringing the better res versions to everyone's attention.


Genjar said:
No need to check the ones that aren't either source:tumblr*1280 width:1280 or source:tumblr*1280 height:1280, so that'll narrow it down a bit. Still 14000 posts, though...

And since most posts aren't sourced directly to the original anyway, it might be worth checking all of source:tumblr* width:1280 and source:tumblr* height:1280. Which is a whole lot of posts. :/

Kinda glad that I haven't uploaded much from Tumblr. Even so, this'll ruin my upload/deletion ratio.

good grief...500+ pages of posts to look through and check? where's slyroon when we need him?

also, something else that i predict will make this situation even harder to deal with is how to handle tumblr's that have been deleted over the years (like anything related to that molestia tumblr for example). can you still get the pics from a wiped tumblr blog? if not then some of the older stuff might not be replaceable like this.

edit: sure enough... post #182820 the source page is "not found" so it can't be replaced with a larger version through this "raw" method. :/ that's bound to happen a lot when checking older tumblr's.

actually, that tumblr is still there but there's no posts on it so just as bad as it being gone.

edit2: also, there's the case of braeburned's site. the tumblr link(s) now redirect to http://braeburned.com/ instead of http://braeburned.tumblr.com/

leomole
Privileged
4 months ago
2014 anthro bottle bottomless cat chair clothed clothing computer desk feline fur girly headphones hoodie inside jailbird leaning leaning_back legwear liam looking_at_viewer looking_back male mammal reclining sitting smile socks solo tan_fur

Rating: Safe
Score: 117
User: Onii-chan
Date: May 09, 2014

treos said:
the source page is "not found" so it can't be replaced with a larger version through this "raw" method.

Not so fast! If you have the direct image link you can update the image even if the source post is gone. For example post #1039922 had the image http://68.media.tumblr.com/820e9d1aa6b4f349b9a09a5de17a4554/tumblr_og3u3kigom1vn7pt5o3_1280.png. The source post (http://the-mary-berry.tumblr.com/post/152718323953) is gone. But change 1280 to raw and you get http://68.media.tumblr.com/820e9d1aa6b4f349b9a09a5de17a4554/tumblr_og3u3kigom1vn7pt5o3_raw.png which is bigger than the old post so I uploaded it as post #1247649.

And don't forget

Lance_Armstrong said:
One tip: If an old source link doesn't work, try changing the subdomain to "68.media"

Genjar
Former Staff
4 months ago
2011 annoyed antennae arthropod biped black_markings blue_eyes clear_membrane clothed clothing crossed_arms cute duo feral front_view green_body human insect insect_wings lifting lol_comments male mammal markings moth nisimawari pellucid_hawk_moth portrait quadruped shirt shorts simple_background solo_focus spread_wings standing three-quarter_portrait three-quarter_view traditional_media_(artwork) watercolor_(artwork) white_background wings

Rating: Safe
Score: 244
User: Genjar
Date: May 29, 2013

Munkelzahn said:
I knew it!
Adding the direct link to the sources is good for something.

Yep.. Those would've been extremely useful now.
Old direct links still work if you change the subdomain, but same cannot be said about other Tumblr sources: tons of deleted or moved accounts, etc. The images are probably still out there somewhere, but in many cases we have no way to find them.

Reverse image searches don't work, and Tumblr is excluded from Internet Archive, etc. Nothing that can be done now, as far as I can see.

leomole
Privileged
4 months ago
2014 anthro bottle bottomless cat chair clothed clothing computer desk feline fur girly headphones hoodie inside jailbird leaning leaning_back legwear liam looking_at_viewer looking_back male mammal reclining sitting smile socks solo tan_fur

Rating: Safe
Score: 117
User: Onii-chan
Date: May 09, 2014

Munkelzahn said:
I knew it!
Adding the direct link to the sources is good for something.

You were right. I never anticipated a situation like this but you were right. I hope other uploaders did a better job of including the direct image link than me.

Strongbird
Contributor
4 months ago

Important Notes:

1) Images are limited to 1280x1920 using '1280' format.

Proof: post #913410, 1280 version vs raw version

This means your standard search query for finding and replacing images should be source:tumblr*1280 width:1280 and source:tumblr*1280 height:1920, not height:1280, although it's worth checking the latter as an afterthought

2) Images can still be salvaged from old direct links.

Proof: post #913410, sourced 1280 version vs fixed source 1280 version

From that pool, all 'lost' older images have been recovered by replacing the '65' or '67' at the start with '66', although more testing may be required. If need be, you can always brute-force prefix numbers in ascending order until you find one that works.


Strongbird said:
I'm not even remotely salty about this. Better image quality is better for the site, regardless of some egos being smashed by deletion count.

Thank you for bringing the better res versions to everyone's attention.

Could always delete it without having it effect the count.


Lance_Armstrong said:
It won't be used by too many. Maybe if e621 checked Upload by URL links for a larger raw version of a 1280 tumblr link, and then added a warning, the problem could be mitigated.

Actually, since every 1280 link has a raw link, e621 could just replace "1280" with "raw" before grabbing an image. I now have THREE feature suggestions for the Upload page so I will post a thread.

You can do the same for pixiv then too. (replacing part of string to get original image instead of preview)

For example:
https://i.pximg.net/c/128x128/img-master/img/2016/12/29/10/10/25/60625109_p0_square1200.jpg
https://i.pximg.net/img-master/img/2016/12/29/10/10/25/60625109_p0_master1200.jpg

get changed to
https://i.pximg.net/img-original/img/2016/12/29/10/10/25/60625109_p0.jpg

"/c/128x128" deleted if it exists
"/img-master/" replaced with "/img-original/"
"_square1200" and "_master1200" deleted (there are multiple ways to deal with those)

After that is done, check if .png version exists, if it doesn't then use .jpg


Plot twist: Tumblr may now be the superior source in many cases. As has already been demonstrated, direct Tumblr links can also be salvaged from deleted posts' source links. We may have some cases where an old 1280px Tumblr-sourced post was deleted in favor of a superior resolution post from elsewhere, but Tumblr's raw version may be even better.

How much work would it be to retroactively transfer or merge post scores/votes in cases where lower quality posts were deleted? Score is a useful metric and discarding old scores/votes is a waste.

Comment transferring or merging would be secondary. To avoid potential reader dissonance (i.e., confusion over merged comments that no longer make sense), add to merged comments' formatting "(merged from deleted post)" somewhere. I would probably still keep the original comments' timestamps as is usually done for thread merging.


So this is why I havent actually been able to view any actual new uploads for hours. I knew the forum would have my answers.


abadbird said:
Plot twist: Tumblr may now be the superior source in many cases. As has already been demonstrated, direct Tumblr links can also be salvaged from deleted posts' source links. We may have some cases where an old 1280px Tumblr-sourced post was deleted in favor of a superior resolution post from elsewhere, but Tumblr's raw version may be even better.

How much work would it be to retroactively transfer or merge post scores/votes in cases where lower quality posts were deleted? Score is a useful metric and discarding old scores/votes is a waste.

Comment transferring or merging would be secondary. To avoid potential reader dissonance (i.e., confusion over merged comments that no longer make sense), add to merged comments' formatting "(merged from deleted post)" somewhere. I would probably still keep the original comments' timestamps as is usually done for thread merging.

Yup, here's a case of that first point. post #1191124 and post #1248487 First one is from twitter, second one is from tumblr and actually higher quality. Slightly related for anyone: there's no way to search two URLs at once, right? source:URL doesnt seem to work when you try to use it twice to include or exclude so it'll make finding low quality twitter posts with tumblr sources harder.


Are there any artists that won't allow their better-than-old-Tumblr resolution images to be uploaded due to Patreon? Or is that just a non-problem?


Blind_Guardian said:
Yup, here's a case of that first point. post #1191124 and post #1248487 First one is from twitter, second one is from tumblr and actually higher quality. Slightly related for anyone: there's no way to search two URLs at once, right? source:URL doesnt seem to work when you try to use it twice to include or exclude so it'll make finding low quality twitter posts with tumblr sources harder.

The tilda


Lance_Armstrong said:
Are there any artists that won't allow their better-than-old-Tumblr resolution images to be uploaded due to Patreon? Or is that just a non-problem?

I doubt many artists have realised higher-resolution versions are being uploaded here yet, but when they do I'm sure there will be problems. A lot of artists do resize the non-Patreon images themselves, but I'm sure there's many that just rely on the automatic downscaling of Tumblr, just like people do with Fur Affinity.


Lance_Armstrong said:
Are there any artists that won't allow their better-than-old-Tumblr resolution images to be uploaded due to Patreon? Or is that just a non-problem?

I'm pretty sure even if this wasn't their intention, if we did respect this ideology and only host the _1280 version, users are still absolutely free to go and get _raw version in any way. Of course it does become much more important to check that tumblr source is actually artists/other first party and not leaked HD content.

So makes much more sense to by default assume that all _raw are free game and simply educate artists using tumblr about this and of sites takedown system. Also good reminder that if you really want to keep hi res versions private/paid only, then ALWAYS downscale your content properly before sending it online anywhere. (Especially on Furaffinity which downscaling method is really bad)

And this isn't the first time that high resolution stuff happens to get public, twitter has been this kind of place for long where even if compressed, resolutions are sometimes much more insanely larger.


One more observation. I have not seen one Tumblr pic yet that legitimately had a 1280 pixel width. I have not tried 1280 height yet. Every single one of the 40 I tried so far had been uploaded in a higher resolution by the Tumblr user. The closest I got was 1290-1291 pixels instead of 1280.

It shows the massive scale of this problem and means there is no shortage of reupload work until somebody scripts it.


leomole said:
Not so fast! If you have the direct image link you can update the image even if the source post is gone. For example post #1039922 had the image http://68.media.tumblr.com/820e9d1aa6b4f349b9a09a5de17a4554/tumblr_og3u3kigom1vn7pt5o3_1280.png. The source post (http://the-mary-berry.tumblr.com/post/152718323953) is gone. But change 1280 to raw and you get http://68.media.tumblr.com/820e9d1aa6b4f349b9a09a5de17a4554/tumblr_og3u3kigom1vn7pt5o3_raw.png which is bigger than the old post so I uploaded it as post #1247649.

And don't forget

i thought that might work but i wasn't entirely sure so i didn't mention it.


kamimatsu said:
The tilda

I've found that to be buggy in the past. Maybe it works now.


Lance_Armstrong said:
One more observation. I have not seen one Tumblr pic yet that legitimately had a 1280 pixel width. I have not tried 1280 height yet. Every single one of the 40 I tried so far had been uploaded in a higher resolution by the Tumblr user. The closest I got was 1290-1291 pixels instead of 1280.

It shows the massive scale of this problem and means there is no shortage of reupload work until somebody scripts it.

Here's one post #754027
A few of my own tumblr uploads have 1280 width even as raw, some artists just like to use that dimension. Only a few however.


Lance_Armstrong said:
One more observation. I have not seen one Tumblr pic yet that legitimately had a 1280 pixel width. I have not tried 1280 height yet. Every single one of the 40 I tried so far had been uploaded in a higher resolution by the Tumblr user. The closest I got was 1290-1291 pixels instead of 1280.

It shows the massive scale of this problem and means there is no shortage of reupload work until somebody scripts it.

san_ruishin seems hard-stuck at 1280 regardless of source. san_ruishin width:>1280 height:>1280 only returns 19 posts out of 464 listed posts, and those 19 aren't much bigger.

kajinchu is similar but has uploaded a few pictures above 1280 width to Tumblr. Unfortunately, their switch to FA and near abandonment of Tumblr has brought their available works back down to 1280.

Lance_Armstrong said:
Are there any artists that won't allow their better-than-old-Tumblr resolution images to be uploaded due to Patreon? Or is that just a non-problem?

f-r95 may be such an artist. f-r95 source:*tumblr*raw order:mpixels

▼ SILVER PATRON

$6 or more per month
You get: All above rewards

+ Access to FULL SIZE of files & Alternative versions

+Discount 10% of commission ^^

Patreon

To be thorough, it seems like there's a few searches to check. Some e621 posts only source a Tumblr post without a direct image link, so tumblr.com/post/ and the alternative tumblr.com/image/ should also be searched with width:1280 or height:1920. At least direct image link reuploads could be automated.

I believe these searches can all return unique results with higher res _raw Tumblr sources:

source:tumblr.com/post/ width:1280 date:>2013-01-01
source:tumblr.com/post/ height:1920 date:>2013-01-01
source:tumblr.com/image/ width:1280 date:>2013-01-01
source:tumblr.com/image/ height:1920 date:>2013-01-01
source:tumblr*_1280 width:1280 date:>2013-01-01
source:tumblr*_1280 height:1920 date:>2013-01-01

FYI, I checked Tumblr's ##.media.tumblr.com servers, manually from 1 through 80, for alternative versions of san_ruishin's post #949466. I found around 15 mirrors of the image all at the same resolution, with the lowest hit being server #24 and the highest being #68. I think server 68 is current and a very reliable mirror to try, if a direct Tumblr image link doesn't work.

An issue reuploaders will run into quickly is an accumulation of width:1280 or height:1920 posts that have the same resolution as their _raw Tumblr counterparts. How can someone mark those posts so that anyone attempting this "project" can remove them from search results or otherwise skip them?

The scope of this project is even larger than that, however, when you consider all the artists who have uploaded to Tumblr but whose posts here don't all source link back to their Tumblr counterparts. Really, that's business as usual.

One final quirk, if checking deleted posts for Tumblr sources wasn't onerous enough. I decided to check Kajinchu's Tumblr for a superior _raw version of post #530491 only to find out that it is no longer visible on Kajinchu's Tumblr from what I could tell. I remember seeing an uncensored version of that image (still not on e621) on Kajinchu's Tumblr a while back, so I knew it existed at one point. Well, Google reverse image search found someone who reblogged the uncensored image, which is still visible, and wouldn't you know it, the _raw even goes above 1280 width.


Another way to search:

source:tumblr*1280 width:1280 status:active order:id date:>2012-12-31

I'm doing it in reverse order now to take care of the oldest stuff first and give users a chance to replace their newer uploads.

abadbird said:
An issue reuploaders will run into quickly is an accumulation of width:1280 or height:1920 posts that have the same resolution as their _raw Tumblr counterparts. How can someone mark those posts so that anyone attempting this "project" can remove them from search results or otherwise skip them?

One way would be to edit the source and just put "raw" instead of "1280". However, these images appear to have different hashes than their identical counterparts so I'm not sure if we want to do that yet.


If I see this correctly, posts that are under 1280x1920 in resolution, are identical to _raw. However if the resolution is the same or over, then the _1280 is generated preview. So this includes images which have width of 1280px exact.

With most PNG content this means that the file was simply saved again, so visual difference in most cases should be nonexisting, but the files hash difference. As reminder that dublicates are normally handled with visual difference on the site, so please make double sure that these images are actually superior before upload. With JPG content however resaving means loss in quality, so these need replacing as well.

Also another reminder which would've prevented majority of this happening beforehand: when uploading stuff, make sure you check other sites as well. FurryNetwork, Inkbunny, SoFurry, Weasyl, HicceArs and Patreon (some situations artist link to dropbox or gdrive) at least also always store artists original upload and which is directly available to be downloaded by user. Preferring these kind of sources will always prevent dublicate uploads in future as long as user presses correct button which is usually "download".

EDIT:
Nevermind most of this. There seems to actually be lots and lots of exceptions to this, even though majority of files seem to be identical, there are several posts which are altered/compressed even if resolution is way lower from resolution limits. Check the hashes and visual difference in lower resolution files in all cases.


It seem as though my thread about an armistice was locked (forum #235479). I probably ought to have made it more clear that it was merely a matter of respect among uploaders, as well as way to reduce the burden on janitors, and that it wasn't site policy or anything.


Another idea from the locked armistice thread: forum #235492.


Mario69 said:
EDIT:
Nevermind most of this. There seems to actually be lots and lots of exceptions to this, even though majority of files seem to be identical, there are several posts which are altered/compressed even if resolution is way lower from resolution limits. Check the hashes and visual difference in lower resolution files in all cases.

Do you have a good example of this? I skipped checking most of elpatrixf because the posts are usually smaller than 1280x1280.


Lance_Armstrong said:
Do you have a good example of this? I skipped checking most of elpatrixf because the posts are usually smaller than 1280x1280.

http://66.media.tumblr.com/c73f69abd2a0430f4d8babb65de3a33f/tumblr_o6nru8pETt1rld80qo1_1280.jpg
http://66.media.tumblr.com/c73f69abd2a0430f4d8babb65de3a33f/tumblr_o6nru8pETt1rld80qo1_raw.jpg
https://puu.sh/wpi2r/d4ecbdee3f.png

Also just now encountered 1280px JPG which was identical with _1280 and _raw.

Genjar
Former Staff
4 months ago
2011 annoyed antennae arthropod biped black_markings blue_eyes clear_membrane clothed clothing crossed_arms cute duo feral front_view green_body human insect insect_wings lifting lol_comments male mammal markings moth nisimawari pellucid_hawk_moth portrait quadruped shirt shorts simple_background solo_focus spread_wings standing three-quarter_portrait three-quarter_view traditional_media_(artwork) watercolor_(artwork) white_background wings

Rating: Safe
Score: 244
User: Genjar
Date: May 29, 2013

abadbird said:
Plot twist: Tumblr may now be the superior source in many cases.

Turns out that this is absolutely true. I've been slowly working through my old uploads, and in many cases Tumblr now has the best version. Even for posts that weren't sourced there..