What about a search engine only for small sites and forums and the like?
I wonder how much data you need to harvest to make a search engine for just ordinary things, and not ad-related or news related (because you have to scrape often).
I mean a global (decebtralized like you do ‘a’ something sites, you do ‘b’ etc) attempt could make some sort of AI blob or just condensed data that everyone could use and let be used.
Torah I’m not at all high on this decentralized thing :-)
What about a search engine only for small sites and forums and the like?
I wonder how much data you need to harvest to make a search engine for just ordinary things, and not ad-related or news related (because you have to scrape often).
I mean a global (decebtralized like you do ‘a’ something sites, you do ‘b’ etc) attempt could make some sort of AI blob or just condensed data that everyone could use and let be used.
Torah I’m not at all high on this decentralized thing :-)
Kagi offers a small web discovery website, apparently, and promotes smaller websites in search results, too: https://blog.kagi.com/small-web