The XPath for plain text extraction should be user configurable

[nz]

Currently, we look for all text under an article element with //article//text() — this should probably be configurable as it will vary from layout to layout.

[drusellers]

A+

and use a data- attribute by default ie <div data-searchyll-content> type approach so that users can choose anything they want

[drusellers]

//article[@data-searchyll='true']/text()

<?xml version="1.0" encoding="UTF-8"?>

<div> 
  <article data-searchyll="true">abc</article> 
</div>