Since the dawn of LLMs it’s virtually impossible to scrape web content. Headless browsers have become basically useless. I actually have to automate keyboard inputs to simulate the navigation. I could maybe try to write the javascript cache to file but honestly it’s just faster that way.

The data is non critical and doesn’t contain indentifying info so I use ocr.space API. You could probably find ways to use the tesseract libraries locally.

A governmental-ish site I’m required to use doesn’t push notifications as mails, so you have to login daily to check for updates. Updates may happen multiple times daily or once a month. I automated my server to access the site once a day with my credentials, screenshot the notifications, parse them with ocr, and send myself a mail.

I truly did have a good bit of fun with it. It has some memorable side quests. For example you will discover the secret cave of basically space batman. Or you will explore a zero-g casino. Or chase a mutated super exo-weapon à la alien. I’ve sunk a lot of time in the ship builder as well to really make it my own. Gunplay is pretty decent and didn’t get boring. Main quest is okay-ish.

You will have to decide for yourself if you can deal with stiff animations, loading screens, a forgotten base building mechanic and badly procedural generated filler content. I ignored them mostly so I had no issues enjoying the good parts above.

XING has been my compromise. It does feel like more and more of a ghost town though. LinkedIn is where the jobs are.

One of the reasons I switched to YunoHost (the other being backups).