Replies: 2 comments
-
What crawler are you using? Have you tried v3.3.0? |
Beta Was this translation helpful? Give feedback.
0 replies
-
I haven't had time to try 3.3 yet. I'm using const links = catLinks.map((link) => {
return `${domain}${link}`;
}); And then added those links to |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
when adding a a list of relative urls to enqueueLinks, these urls aren't added and
crawlee
notifies that there is no longer any request pending and finishes:The list of relative urls looks like this:
In earlier versions of
crawlee 3.0
, this code worked, but now it doesn't. I noticed the changes inenqueueLinks
in later versions, specially those related tostrategy
, but those changes aren't related to the case when one passes a list of urls toenqueueLinks
, at least that's what I'm getting from reading the documentation/changelog.When i convert my list of relative urls to full urls, the code works as expected, but given that this wasn't necessary in previous versions, i was wondering if i should expect
crawlee
to convert these urls adding the domain by itself.I'm using
crawlee 3.2.2
Beta Was this translation helpful? Give feedback.
All reactions