More Spiders Please

[Quanta]

Indexwww.simplemachines.org

Seems like they have identified way more than we have

[Sorted Echo]

I haven't seen Grok on here yet. Is he banned?

[QuantumDay]

Grok (operated by xAI) often crawls websites or fetches real-time links without cleanly or consistently identifying itself using a clear "Grok" or "xAI" user-agent string. Site owners frequently notice anonymous requests, generic user-agents, or traffic routed through residential and cloud VPN networks rather than a transparent bot signature.

TLDR: It pretends

[Poppy51]

I've never ever heard of some of them.

[WaveFunction34]

Theres 5000 online now. I dont know who they are?

[QuantumDay]

Great stuff. Its happening whilst I'm online tonight.

Not from a known spider. useragent may be pretending. could be any llm or just a scraper

[codeberg]

You will temporarily notice I've wiped the online to track the temp blocks we have put in place.

[DrewMcIntyre08]

Well done it appears to have stopped

[QuantumDay]

We put some blocks in place to stop them

[ParallelSelf99]

Seems to have calmed down

[Henry10]

Definitely was a busy evening for you QD. Whats the damage if any?

Talking of spiders. I have never seen Yahoo! ?

[QuantumDay]

Slurp hasn't graced us with their presence yet in the seven months we have been online. Its rare as hens teeth as their search is mostly bing results