TFA specifically mentions not crawling the web, but using a curated list. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		opan on Nov 18, 2020 \| parent \| context \| favorite \| on: We can do better than DuckDuckGo TFA specifically mentions not crawling the web, but using a curated list.

rjurney on Nov 19, 2020 [–]

I don't follow. A curated list of what? You need to crawl the entire web to have the content of the entire web to index and search.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact