/vt/ - Virtual YouTubers » Thread #6107379

[40 / 2 / ?]

71KiB, 675x370, image_2021-07-05_104123.png

How do I sort 40k images quickly

Anonymous Mon 05 Jul 2021 02:41:33 No.6107379 View View Reply Original Report

Quoted By: >>6107437 >>6107824 >>6107921 >>6107939 >>6107944 >>6108031 >>6108141 >>6108339 >>6111867 >>6112495 >>6112985 >>6116882 >>6118813 >>6119293 >>6122996

Been unironically collecting fan art and i'm suffering rn trying to sort them
Is there any way I can do it faster

Anonymous

Anonymous Mon 05 Jul 2021 02:42:31 No.6107437 Report

Quoted By: >>6107488 >>6108113 >>6116470

>>6107379
By Faction
then Subfaction

Anonymous

Anonymous Mon 05 Jul 2021 02:43:21 No.6107488 Report

Quoted By: >>6116852

>>6107437
No I mean I have a folder every Holomem
the problem would be actually placing the pictures into the folders

Anonymous

Anonymous Mon 05 Jul 2021 02:46:55 No.6107728 Report

Quoted By:

Nothing you can really do, unfortunately.

Anonymous

Anonymous Mon 05 Jul 2021 02:48:39 No.6107824 Report

Quoted By: >>6107913 >>6108125

>>6107379
If you figure out a way, please do let us know. I have like a million unsorted images i've hoarded over the course of 15+ years that need sorting

Anonymous

Anonymous Mon 05 Jul 2021 02:50:41 No.6107913 Report

Quoted By:

>>6107824
Holy shit, and I thought I was fucked with 100k.

Anonymous

Anonymous Mon 05 Jul 2021 02:50:47 No.6107921 Report

Quoted By:

>>6107379
I know this pain.

Anonymous

Anonymous Mon 05 Jul 2021 02:51:23 No.6107939 Report

Quoted By: >>6108026 >>6108149

>>6107379
1. If the collection were really big, you'd train an AI on it, and then you'd just have to sort the training data.
2. Pay people on Amazon Mechanical Turk to do it.
3. Just suck it up and do a bit per day. As long as you decrease the total number of unsorted images per day, you'll get there.

Anonymous

Anonymous Mon 05 Jul 2021 02:51:28 No.6107944 Report

Quoted By:

>>6107379
If you ran a Linux disto you could have tagged images booru-style

Anonymous

Anonymous Mon 05 Jul 2021 02:51:40 No.6107951 Report

Quoted By:

train a machine learning classifier

Anonymous

Anonymous Mon 05 Jul 2021 02:53:22 No.6108026 Report

Quoted By:

>>6107939
>and then you'd just have to sort the training data
You wouldn't even need that, boorus already have classified data sets.

You could train your classifier on that.

Anonymous

Anonymous Mon 05 Jul 2021 02:53:25 No.6108031 Report

Quoted By: >>6108161 >>6111480

>>6107379
https://www.tensorflow.org/tutorials/images/cnn

Anonymous

Anonymous Mon 05 Jul 2021 02:55:30 No.6108113 Report

Quoted By:

>>6107437
Based

Anonymous

Anonymous Mon 05 Jul 2021 02:55:45 No.6108125 Report

Quoted By:

>>6107824
>hoarded over the course of 15+ years
悲しい…

Anonymous

Anonymous Mon 05 Jul 2021 02:56:15 No.6108141 Report

Quoted By: >>6108220

>>6107379
Whatever you do, use a tagged system instead of folders.

Anonymous

Anonymous Mon 05 Jul 2021 02:56:28 No.6108149 Report

Quoted By:

>>6107939
>2. Pay people on Amazon Mechanical Turk to do it.
Half my images folder is loli hentai so this isn't an option I don't think.

Anonymous

Anonymous Mon 05 Jul 2021 02:56:47 No.6108161 Report

Quoted By: >>6108215

>>6108031
I have absolutely no idea what this means.

Anonymous

Anonymous Mon 05 Jul 2021 02:58:02 No.6108215 Report

Quoted By:

>>6108161
It's a machine learning library to program neural networks, which can (among other things) classify images into categories.

Anonymous

Anonymous Mon 05 Jul 2021 02:58:12 No.6108220 Report

Quoted By: >>6108270

>>6108141
can you elaborate a bit more as to why?

Anonymous

Anonymous Mon 05 Jul 2021 02:59:23 No.6108270 Report

Quoted By: >>6108325

>>6108220
Because the more shit you look at, the more you realize it never fits cleanly into one folder.

You'll have an image with multiple people in it, or an image with multiple fetishes. Tagging is the only way to properly deal with that.

Anonymous

Anonymous Mon 05 Jul 2021 03:00:49 No.6108325 Report

Quoted By:

>>6108270
Fair enough

Anonymous

Anonymous Mon 05 Jul 2021 03:01:10 No.6108339 Report

Quoted By:

>>6107379
If someone ever trains a classifier for holomem, please share.

Anonymous

Anonymous Mon 05 Jul 2021 03:24:51 No.6109074 Report

Quoted By: >>6112608 >>6116830 >>6123466

best thing i managed was hydrus with hydrus-dd
https://hydrusnetwork.github.io/hydrus/
https://gitgud.io/koto/hydrus-dd
it identifies and it misses some but it's better than not having anything, dont have to train anything either

Anonymous

Anonymous Mon 05 Jul 2021 05:01:49 No.6111480 Report

Quoted By:

>>6108031
You first need to teach the AI the difference between Kiara and Gura to make it work which you need around 500-1,000 to be feasible.

Or just write a program that can identify the image's accent color and group the images accordingly.

Anonymous

Anonymous Mon 05 Jul 2021 05:19:50 No.6111867 Report

Quoted By: >>6112311

>>6107379
Look into unsupervised image classification. This seems pretty doable, and would be a really interesting project. I might take a crack at it, but I don't have a large amount of fanart.

Anonymous

Anonymous Mon 05 Jul 2021 05:40:58 No.6112311 Report

Quoted By:

>>6111867
No need for that, boorus give him training sets

Anonymous

View Same Google ImgOps iqdb SauceNAO GodEmperor.png, 2MiB, 766x992

Anonymous Mon 05 Jul 2021 05:51:31 No.6112495 Report

Quoted By: >>6116865

>>6107379
Pray to the God Emperor

Anonymous

Anonymous Mon 05 Jul 2021 05:52:21 No.6112507 Report

Quoted By:

i bet half of them are ogey

Anonymous

Anonymous Mon 05 Jul 2021 05:57:56 No.6112608 Report

Quoted By:

>>6109074
Thanks anon, I'll try my best to make it work

Anonymous

Anonymous Mon 05 Jul 2021 06:00:29 No.6112651 Report

Quoted By:

You start today, every new pic you place in a proper folder. Put all the shit you currently have in "other", it's beyond saving.

Anonymous

Anonymous Mon 05 Jul 2021 06:19:55 No.6112985 Report

Quoted By:

>>6107379
Create a folder called "Pending" and put everything in it

Anonymous

Anonymous Mon 05 Jul 2021 09:43:41 No.6116470 Report

Quoted By:

>>6107437
/thread/

Anonymous

Anonymous Mon 05 Jul 2021 10:03:32 No.6116830 Report

Quoted By:

>>6109074
Does DD create its own tag pool or is there a chance of it messing up "My Tags"

Anonymous

Anonymous Mon 05 Jul 2021 10:04:37 No.6116852 Report

Quoted By:

>>6107488
You do it little by little everyday. Like ten minutes or so. Eventually you'll get through it.

Anonymous

Anonymous Mon 05 Jul 2021 10:05:04 No.6116865 Report

Quoted By:

>>6112495
This

Anonymous

Anonymous Mon 05 Jul 2021 10:05:48 No.6116882 Report

Quoted By:

>>6107379
upload it to drive and let anon sort it for you

Anonymous

Anonymous Mon 05 Jul 2021 11:46:31 No.6118813 Report

Quoted By:

>>6107379
Try writing a script using DeepDanbooru for tagging and sort it out

Anonymous

Anonymous Mon 05 Jul 2021 12:10:29 No.6119293 Report

Quoted By:

>>6107379
Shift+delete the entire folder
In 15 minutes you'll realize nothing of value was lost

Anonymous

Anonymous Mon 05 Jul 2021 14:31:08 No.6122996 Report

Quoted By:

>>6107379
Pay someone else to do it for you

Anonymous

Anonymous Mon 05 Jul 2021 14:43:21 No.6123466 Report

Quoted By:

>>6109074
>hydrus dd
Relevant to my interests

I've been using hydrus for years but there's some stuff I haven't imported

Capcode	All Only User Posts Only Verified Posts Only Moderator Posts Only Manager Posts Only Admin Posts Only Developer Posts Only Founder Posts
Show Posts	All Only With Images Only Without Images Only Spoiler Images Only Non-Spoiler Images
Deleted Posts	All Only Deleted Posts Only Non-Deleted Posts
Ghost Posts	All Only Ghost Posts Only Non-Ghost Posts
Post Type	All Only Sticky Threads Only Opening Posts Only Reply Posts
Results	All Grouped By Threads
Order	Latest Posts First Oldest Posts First

On these archives

Your latest searches

How do I sort 40k images quickly