Fix robots.txt 404 endpoint when individual_posts.enabled

[hadronix]

Enhance individual post handling by updating routes with a post-type prefix to prevent errors with other .txt endpoints

[retlehs]

Is this working as expected for you? Individual posts .txt routes aren't working for me with this branch

[hadronix]

Sorry, I unnecessarily changed the route while testing with multiple post types. The llms-txt command still outputs the regex variant so you can see at a glance which post types it's active for.

[retlehs]

post-slug.txt still isn't working with that change

The sitemap generation, README, and code comments will also need updating to reflect the new pattern

[hadronix]

I can't recreate this problem; on a fresh install, it works, e.g., with posts and pages.

I added the correct url. there an other "problem" currently, the sitemap fetches all posts and within the ContentFetcher it just checks if the individual_posts are enabled, but it uses the main postTypes array from the config and not the postTypes from the individual_posts config part. I have not a complete overview of the code, for this reason i just added an filter before fetching the posts. this is only a simple suggestion, i don't thing this is the best solution. we cant just filter the posts because the postTypes from global config and individual may complete differ (i don't know if this would make sense a production environment).

I look forward to your feedback on this.