[Feature Request]: Add php support for content filtering #1135
kevinher7
started this conversation in
Feature requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
What needs to be done?
First contribution here!
Update the internal dictionary
_MIME_TYPE
inContentTypeFilter
to include website with urls ending in .php. Here is a quick list that I got from Claude,I don't know if there is a reason to not provide them in the filter but if there is please let me know!
What problem does this solve?
This solves the problem where crawling websites made with php some pages are left uncrawled or it cannot be crawled at all. This just happened to me once (as far as I am aware of).
Target users/beneficiaries
No response
Current alternatives/workarounds
My current workaround is modifying the class variable of the
ContentTypeFilter
on import 💀.Proposed approach
No response
Beta Was this translation helpful? Give feedback.
All reactions