We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent d81b885 commit 84518eeCopy full SHA for 84518ee
README.md
@@ -190,6 +190,7 @@ running result:
190
<div align="center">
191
<img src="https://raw.githubusercontent.com/coder-hxl/x-crawl/main/assets/en/crawler-result.png" />
192
</div>
193
+
194
**Note:** Do not crawl at will, you can check the **robots.txt** protocol before crawling. This is just to demonstrate how to use x-crawl.
195
196
## Core Concepts
0 commit comments