>>3898404probably whatever evil shit internet dumbfucks inferred or postulated i must be hiding.
I think the idea of just brute downloading sites while ignoring robots.txt is to see if there is anything hidden, and also so you have a copy as evidence if the need arises.
...at least that's how I'd approach it.
Funny thing is that I kept having people come to talk to me who gave me the impression i was being investigated somehow. Social service workers just casually coming to chat, random individuals who were totally not just citizens talking, not one, but two senior police sergeants, a pair of detectives.. etc.
Months or maybe years later i had two cops come out on a routine check after a concerned citizen told them i was up to no good, and the constable doing the talking started out by saying he had spoken to me before and new i wasnt doing anything illegal, but had to come and talk to me anyway as a matter of procedure. He actually said he liked my pics too, which was uncharacteristically casual of them. Nice though, when they relate as a human rather than a prosecution mechanism.
Anyway, he mentioned that they (qld or maybe federal police) had cleared me as not being evil in a recently concluded investigation, operation nomad it might have been called, i forget. Basically I used to see a big mob of maori and other islander kids really often for photos, and there was an investigation to figure out why they were always sleeping in the city and how to keep them from making trouble/stealing shit, so naturally I was also investigated too.
I also noticed "queensland police service" was the resulting nslookup for an IP that downloaded the entire site when I was looking at logs one time.
Lots of little things happened around then, petitions iirc too, so I just logically assumed what was happening even before the cop conversation above.
