POST /fetch/{domain}
Fetch API reference
One endpoint per page. The first request for a path works out the selectors and settings that page needs, checks them, and stores the result. Every request after that reuses the stored config, so the same page comes back the same way each time.
- 01 memory
Your own config for the path first, then the shared one. Under a millisecond.
- 02 config store
A stored config for the same domain and path, including ones other users discovered.
- 03 discovery
Spider reads the page and writes the config. Once per domain and path.
