Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
sksxihve
9 months ago
|
parent
|
context
|
favorite
| on:
You cannot have our user's data
The LLM scrapers could publish the ip ranges they use for scraping like google does, but that would make it easier to block them so they probably wouldn't do that.
https://developers.google.com/search/docs/crawling-indexing/...
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
https://developers.google.com/search/docs/crawling-indexing/...