Search broken on https://clarion.help

It seems the search is broken on https://clarion.help - don’t know who maintains it though - but for example searching for FileCallBackInterface results in no results

Sean maintains it (thanks Sean!) but if you have troubles just use Google:

site:clarion.help FileCallBackInterface

If you don’t use Google I am sure other search engines have similar functionality

Currently what I am already doing as I noticed the search being broken

You can also open the Contents page link with hyperlinks to most everything, the use then Browser Find to search (Ctrl+F).

I’m finding that works better because it has no issue with special characters, e.g. you can search for EVENT:Drag

Yep that’s me. I’ll have a look and see if I can sort out whats up.

The search index has been rebuilt. Search on clarion.help should give better results now :slight_smile:

Yeah search works again!

@seanh is it down now? It doesn’t load for me currently

Looks like AI bots feeding again. Every now and again it gets aggressive and essentially turns into a Denial of Service attack.

I’ve increase resources on that VPS, but even so it can occasionally take the whole server down.

I wonder if you could utilize some kind of bittorrent index sharing tech to take the load off?

All sorts of things I could do with an appropriate budget :slight_smile:

Actually found one source of problems, the AI hits create an absolute ton of temp session files, as in millions. The size of the directory itself is about 250MB (Linux tells you that sort of info ) the size of the files in that directory is several GB. So much that the normal delete command can’t handle it. I’ve resorted to deleting session files every hour now to try keep it under control.

I bet it’s mostly facebookexternalhit and other meta crawlers?
I would suggest the following - setup a robot.txt and perhaps a .htaccess to block them access - lost of hosting services are having issues with them, ignoring robots.txt and just outrageous connection counts (I myself included)