Patch 0.3.3

This mostly coincides with patch 0.3.2, but has some technical improvements.

Rewrite configuration. Update version. Removes setup.py .
Updates license description in pyproject.toml.

Have to adjust the patch version because of these fixes and a strangely corrupt tar archive sent to pypi.

SHA-256 sums:
fd9fbe39b3d0a144f42914f47094d38091cf4f6299b51cb7ea48afdbf93eb768 v0.3.3.tar.gz
64493d23c75893fc6665d191047c7562fd6259014f4c4a69b171b626c8d3896d v0.3.3.zip

Full Changelog: v0.3.2...v0.3.3

Patch 0.3.2 for the new Python 3.14

What's Changed

• Update readme to improve build command. by @statzitz in #18
• Avoid including stray packages in wheel by @cjwatson in #20
• Improves testing by @ynikitenko in #21

New Contributors

• @cjwatson made their first contribution in #20

Improves documentation (README). yarsync has been successfully used on Windows.

Largely improves testing. Fixes #21: mock calls were unstable between Python versions. This has persisted for many years, but now we hope to have resolved that.

Adds support for Python 3.14. No user interface changes.

Removes tox.ini.

SHA-256 sums:
2796c1803c4ea116d30b560479f1fb7eb587a8ed43c4eea8111f796eaab8706e v0.3.2.tar.gz
2b1ad55010d6471837362fbb34a2e29f86fd9c3cc4a4d6eb4bf96c2d5ef3b3cf v0.3.2.zip

Full Changelog: v0.3.1...v0.3.2

Patch 0.3.1 for readthedocs

This patch release introduces no new features or bug fixes for distributed packages. It won't be released anywhere else.

It is solely intended to fix a bug with readthedocs, where compilation for the most recent release failed.

YARsync 0.3

YARsync minor release 0.3 was done on March 28, 2025.

This release does not add much functionality, but fixes several bugs and improves documentation and technical features of the project.

What's new

• clone command gets a --force option.

Bug fixes

• Fixes some bugs in clone_from and show connected with the synchronisation directory.

Documentation

• Adds a Developing and Contributing section.
• Updates tips on using virtual environment.

Technical changes

• Adds pyproject.toml instead of setup.py, as is required by modern Python packaging.
• Updates tests to run for Python 3.13.
• Linted out many unused imports in test files.
• This is the last release tested with Python 3.6.

Community

This release is mostly due to statzitz, who updated tests to work with the recent Python version (a serious bug which prevented many users to use the tool; thanks to complaints from AUR users as well) and added many documentation improvements.

Also thanks to Lin, Yong Xiang for several bug reports and useful discussions.

Today the project has 39 stars on GitHub and 3 contributors, which looks rather popular for me and inspires its better support and development.

Publicity

yarsync was presented in August 2024 at a conference of Python developers in high energy physics, PyHEP.dev 2024.
A video was recorded and published on YouTube (link added to the README).

SHA-256 sums:
fd47811708c3b907eea401077dba3ee8cdc9a397cdd491a162fd74f9f3ebb887 v0.3.tar.gz
7c4059ac980db5333d57a6be47329b5f821aa7b23032a54689bbfae42ce320e5 v0.3.zip

Full Changelog: v0.2.1...v0.3

YARsync 0.2.1

YARsync patch release 0.2.1 was done on 28 March 2023.

• Adds --version command.
• Improves diagnostic messages.
• Improves documentation.
• Fixes tests.

SHA-256 sums:
208c947813568b9d6d736ffadb9c510651c43a58d64ddd52afe219b1097c535c v0.2.1.tar.gz
184d2db1425d949afbefd372e8cf3c43cd21e088a0070ea6ba0234819d624a84 v0.2.1.zip
Full Changelog: v0.1.1...v0.2.1

YARsync 0.2

YARsync v0.2 was released on the 8-9th of March, 2023.
Its main features were synchronization, commit limit and cloning.

Synchronization information is now stored in the directory .ys/sync/.
It contains information on the most recent synchronized commits for each known repository.
This information is transferred between replicas during pull, push and clone.
This allows yarsync repositories to better support the 3-2-1 backup rule.

To convert an old synchronization file to the new directory format, from the working directory one can use

cat .ys/sync.txt && mkdir .ys/sync && touch .ys/sync/$(cat .ys/sync.txt|sed 's/,/_/g').txt && rm .ys/sync.txt

To properly support synchronization information, now each repository must have a unique name.
The name is no longer automatically deduced from the host name,
but contained in .ys/repo_<repo_name>.txt.
In particular, nameless repositories on external drives cannot be mixed with nameless local repositories.
One can set repository name with init (this command does not affect existing files and is always safe).

A user of yarsync was concerned about the fact that rsync does not work well with millions of files,
and proposed automatically removing old commits.
To achieve that, commit limit was introduced. It can be set using an option limit of commit.
When there appears more than that limit, older commits are removed during commit.
pull and push don't check whether destination has commits missing on source if
the local repository has commit limits
(it makes a repository with commit limit more like a central repository).

Bug fixes

• --no-inc-recursion is always active for pull and push.
  Fixes a bug when pull --new retransferred files already present in commits.
• pull --new disables automatic checkout of commits after merge.
  This prevents deletion of uncommitted files in the working directory
  (they should be preserved when using --new).

Improvements

• commit adds an option --limit.
  status shows the commit limit (if present). Commit limits are logged (during commit).

• init prompts for input when no repository name on the command line is given.

• status no longer outputs group and owner changes.
  This information is ignored by yarsync and considered noise.
  Set proper user and group for all files when needed.

• Improves output in case of errors.

• pull changes:

  • --new allows local repository to have uncommitted changes.
  • --new allows local or remote commits to be missing.

• pull and push changes:

  • Improves output for pull and push. All files for commits that are transferred as a whole (that is new ones)
    are being output on a single line (that commit name).
    This makes output more focused on the actual changes in the working directory
    and on existing commits (if they contained changes).
  • yarsync no longer updates user and group ids for pull and push (and indirectly clone).
    This allows one to have different user and group ids on different machines and storage drives, ignoring this metadata.
    yarsync repositories are supposed to contain data belonging to one user.
  • If local repository has a commit limit,
    destination can have commits missing on source.

Backward incompatible changes

• clone command and interface changed. clone allows copying to a remote.
  New repository name must be provided explicitly.
  Cloning from inside a repository with rsync-filter is allowed.
• Turns off pull/push --overwrite (rsync --ignore-existing) functionality.
  Waiting for RsyncProject/rsync#357 to be fixed.
• Repositories are not checked for changes in the working directory
  for push or pull if --force option is given.
• Name for each repository is required (to assist synchronization).
• Repository name is no longer stored in repository.txt, but in repo_.txt.
  This allows yarsync to know remote repository names from listing their configuration files.

Technical changes

Documentation has been moved to Read the Docs.

• yarsync is tested for Python 3.11.

• yarsync development classifier on PyPI becomes "5 - Production/Stable".

• Adds .gitattributes (to log revisions of functions).

• Tests improvements:

  • Adds helpers.py (for cloning test repositories).
  • Fixes hardlink fixtures.

• Implements init --merge option. It is not tested and shall be added in the next release.

• _print_command accepts lists and properly escapes commands with spaces.
  String and list representations of commands are no longer needed.

• _commit method accepts arguments explicitly.

• Adds _Config and _Sync helper classes.

• Documentation improvements:

  • Adds a how-to for synchronizing repositories after adding external data to both of them (see details section).
  • Documentation uses Sphinx. Needs fixes for pdf version.

Test coverage is 79% (253/1224 missing/total).

Publication

yarsync v0.1 was packaged for Arch Linux, Debian and PyPI (and will be updated for v0.2).

A talk on yarsync was made at the Winter seminar of the Physics Institute of the RWTH Aachen University
in Montafon on February 2023.

The program was announced on the rsync mailing list, published on Arch Wiki and Arch Forum,
and in several Russian programming Telegram chats.

SHA-256 sums:
3e877674bfd675ef6d77855e381ae9da7851623ee192ad2725e25099a227da54 v0.2.tar.gz
1eee7f5014e7bc65bae1158e71b942d945c385514813bd53a0d9c644f6d9937c v0.2.zip
Full Changelog: v0.1.1...v0.2

YARsync 0.1.1

YARsync patch release 0.1.1 was made on 30 June 2022.
It adds a manual page, improves output and supports Python 3.6.

Improvements

Tested and works for Python 3.6.
Improves output handling in commit (allows verbosity settings).
rsync always outputs error messages.

Bug fixes

pull and push print output correctly.

SHA-256 sums:
3c306c737ba96c315d6c89b7fab875eb1253527ef954f0facf1c15db72ed44c8 yarsync-0.1.1.tar.gz
9f19cd4f7915dc1d1d75a3b5888add4989f56c20b6a310ff6c49d6ee992fd148 yarsync-0.1.1.zip

Full Changelog: v0.1...v0.1.1

YARsync release 0.1

The first tagged release YARsync v0.1 was made on 21st-23rd June 2022 (released on PyPI on June 23rd).
The program works with Python 3.7, 3.8, 3.9, 3.10 and PyPy 3.
Test coverage is 76% (209/889 missing to total).

Full Changelog: https://github.com/ynikitenko/yarsync/commits/v0.1
Sha256sum for .tar.gz is e6a5c53a61dd40c4c8ded721c5217cee1e9eb5b16d6bc3e35f5f124b76f73132
for zip 62084c0121928b70bc9568f021027cc2652191f1a10eee0fbab6b4f88380d265