I am a Kagi user and have been for 7 months now. I signed up for the 300 searches per month plan because I felt like that would fit me well enough and it turns out I average 87 searches per month. That’s a lot lower than I thought it would be by quite a bit.
You must log in or register to comment.
I only hit the 300 search quota back in March, just on the last day of that month’s plan. I do like the service, but I’m uncertain on Vlad so I’ve established using other services.
Do you find that your searches are higher quality than something like, say, DuckDuckGo?
Yeah, I’d say they’re pretty comparable. And you can add filters, so like for example, I have all of Reddit blocked out from searches.
That reddit filter will have less than an effect than it used to. Reddit blocked all crawlers except google.
Brave search works for Reddit
reddit recently updated their robots.txt to disallow all crawlers Google paid a bunch of money to have access to crawl reddit
You’ll still see old stuff, but crawlers that care about robots.txt will get no new information.
The best part of that robots.txt is:
Reddit believes in an open internet, but not the misuse of public content.
Sure Jan.
Reddit believes in
an openpay to access internet, but not themisuse ofpublic contentour content we didn’t make.
https://search.brave.com/search?q=site%3Areddit.com+trump&source=web&tf=pd Past day is not that old
A few possibilities,
- brave has state in the past they use the googlebot user agent, if all reddit does is check the useragnet, it won’t block brave. This does however mean brave is violating the robots.txt file.
- I saw some mentions of google fall back, I don’t know if they still do it, but that could be another possibility.
- Brave ignores robots.txt files
- Brave paid for access
No matter the reason, well behaving crawlers will no longer crawl reddit, Everything is disallowed in the robots.txt
User-agent: * Disallow: /
