[BUG] praw.exceptions.DuplicateReplaceException: A duplicate comment has been detected

[Suncatcher]

• I am reporting a bug.
• I am running the latest version of BDfR
• I have read the Opening an issue

Description

I am fetching/cloning all my submissions and comments

Command

bdfr clone c:\downloads\reddit --authenticate, --user me --submitted --all-comments

Environment (please complete the following information)

• OS: Windows 11 Pro (OS Build 26100.3775)
• Python version: 3.12.6

Logs

[2025-04-09 18:40:46,134 - root - ERROR] - Scraper exited unexpectedly
Traceback (most recent call last):
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\bdfr\__main__.py", line 161, in cli_clone
    reddit_scraper.download()
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\bdfr\cloner.py", line 27, in download
    self.write_entry(submission)
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\bdfr\archiver.py", line 92, in write_entry
    self._write_entry_json(archive_entry)
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\bdfr\archiver.py", line 103, in _write_entry_json
    content = json.dumps(entry.compile())
                         ^^^^^^^^^^^^^^^
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\bdfr\archive_entry\comment_archive_entry.py", line 19, in compile
    self.post_details = self._convert_comment_to_dict(self.source)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\bdfr\archive_entry\base_archive_entry.py", line 36, in _convert_comment_to_dict
    in_comment.replies.replace_more(limit=None)
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\praw\util\deprecate_args.py", line 43, in wrapped
    return func(**dict(zip(_old_args, args)), **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\praw\models\comment_forest.py", line 195, in replace_more
    self._insert_comment(comment)
  File "C:\Users\ussss\AppData\Local\Programs\Python\Python312\Lib\site-packages\praw\models\comment_forest.py", line 80, in _insert_comment
    raise DuplicateReplaceException
praw.exceptions.DuplicateReplaceException: A duplicate comment has been detected. Are you attempting to call 'replace_more_comments' more than once?

[Suncatcher]

OK, I understand this bug is probably a consequence of this workaround, but I want to know if it's really a way to make it work until the BaseTokenManager bug is fixed. I don't think the problem is in my submissions, but more in the outdated praw

[SplitMilky]

As far as I know you have to use an older version of PRAW is the newer or newest one does not work with bdfr

[Tjerbor]

This worked for me:
pip install --force-reinstall -v "praw==7.7"

[Suncatcher]

@Tjerbor thanks, that had helped to eliminate the original error. Though I received couple of new ones:

[2025-05-22 13:29:38,309 - bdfr.cloner - ERROR] - The submission after mmok1gc failed to download due to a PRAW exception: received 429 HTTP response

and

[2025-05-22 12:43:28,657 - bdfr.downloader - ERROR] - Could not download submission 1anbcbb: No downloader module exists for url

At least the process was completed, so thank you so much!

[Suncatcher]

Seems I was wrong, original error is still there even with praw 7.7.0, but maybe became more intermittent and not happens all the time

praw.exceptions.DuplicateReplaceException: A duplicate comment has been detected. Are you attempting to call 'replace_more_comments' more than once?