Skip to content

Commit 06319d1

Browse files
author
evilebottnawi
committed
chore: prepare 5.0.2 release
1 parent 64a4dfd commit 06319d1

File tree

6 files changed

+1352
-279
lines changed

6 files changed

+1352
-279
lines changed

CHANGELOG.md

+4
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,10 @@ All notable changes to this project will be documented in this file.
44

55
This project adheres to [Semantic Versioning](http://semver.org).
66

7+
## 5.0.2 - 2017-12-12
8+
9+
* Chore: minimum required `node-fs` version is now `^5.0.0`.
10+
711
## 5.0.1 - 2017-11-28
812

913
* Chore: minimum required `meow` version is now `^4.0.0`.

README.md

+13-1
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,12 @@ robotstxt({
2727
disallow: "/search",
2828
crawlDelay: 2
2929
},
30+
{
31+
userAgent: "OtherBot",
32+
allow: ["/allow-for-all-bots", "/allow-only-for-other-bot"],
33+
disallow: ["/admin", "/login"],
34+
crawlDelay: 2
35+
},
3036
{
3137
userAgent: "*",
3238
allow: "/",
@@ -52,7 +58,13 @@ module.exports = {
5258
{
5359
userAgent: "Googlebot",
5460
allow: "/",
55-
disallow: "/search",
61+
disallow: ["/search"],
62+
crawlDelay: 2
63+
},
64+
{
65+
userAgent: "OtherBot",
66+
allow: ["/allow-for-all-bots", "/allow-only-for-other-bot"],
67+
disallow: ["/admin", "/login"],
5668
crawlDelay: 2
5769
},
5870
{

0 commit comments

Comments
 (0)