About this project
A proxy layer that lets bots on the server browse the web as if they were me. Normal Claude traffic comes from Anthropic's servers, and a lot of sites will filter or outright block requests coming from those. When the request goes through aiWebAccess it leaves over my home connection instead, and most sites just let it through.
It handles web search through a local SearXNG instance and fetches pages too. There is some per-domain rate limiting so bots don't hammer a site when several are running in parallel. Nothing too clever. It could be smarter, but it does the job day to day.
The thing I actually use this for a lot is shopping. I will ask a Claude to find a specific product, compare prices and shipping terms across a few retailers, and come back with a recommendation. It quietly does all the legwork before I hit the buy button. Sites with aggressive anti-bot protection will still block it, and I have not put much effort into fighting those. This hasn't affected me enough to want to do anything about it yet.
Screenshots