A Python library that provides shared utility assets used to support most other Sun Lab projects.
The primary focus of this library is to provide the unified message and error processing framework used across all other Sun lab projects instead of the built-in 'print,' 'logging,' and 'raise' assets. In addition to this framework, it also provides functions used to perform common filesystem operations (such as creating directories) and facilitate efficient parallel data processing (such as chunking iterables into batches).
- Supports Windows, Linux, and macOS.
- Provides a unified approach to message and error formatting, printing, and logging through the Console class.
- Provides a set of common utility functions frequently reused across other Sun lab projects.
- GPL 3 License.
- Dependencies
- Installation
- Usage
- API Documentation
- Developers
- Versioning
- Authors
- License
- Acknowledgements
For users, all library dependencies are installed automatically by all supported installation methods (see the Installation section).
Note! Developers should see the Developers section for information on installing additional development dependencies.
Note, installation from source is highly discouraged for anyone who is not an active project developer.
- Download this repository to the local machine using the preferred method, such as git-cloning. Use one of the stable releases that include precompiled binary and source code distribution (sdist) wheels.
- If the downloaded distribution is stored as a compressed archive, unpack it using the appropriate decompression tool.
cdto the root directory of the prepared project distribution.- Run
python -m pip install .to install the project. Alternatively, if using a distribution with precompiled binaries, usepython -m pip install WHEEL_PATH, replacing 'WHEEL_PATH' with the path to the wheel file.
Use the following command to install the library using pip: pip install ataraxis-base-utilities
The Console class provides a unified loguru-based framework for working with messages and errors to display them in the terminal and (optionally) log them to files.
Most class functionality revolves around 2 methods: echo() and error(). To make adoption as frictionless
as possible, a preconfigured Console instance is exposed as part of the library initialization via the 'console' global
variable:
from ataraxis_base_utilities import console
# All class functionality is disabled by default and must be enabled for the class to behave as expected.
console.enable()
# Use this instead of 'print'!
console.echo("This is a better 'print'.")
# Use this instead of 'raise'!
console.error("This is a 'raise' with logging.")
Note! The preconfigured class does not log processed messages and errors to files. To enable file-logging, re-initialize the Console class with the appropriate configuration parameters.
All Console’s functionality for working with messages is realized through the echo() method. Depending on class configuration, the method can be flexibly used to display the input messages in the terminal and log them to files. Each message is handed according to its LogLevel (urgency level) and the processing Console’s configuration.
from ataraxis_base_utilities import console, LogLevel
console.enable()
# By default, console is configured to NOT print debug messages. Calling echo for a message at 'Debug' level has no
# effect
console.echo(message='Debug is disabled by default.', level=LogLevel.DEBUG)
# Messages at all levels other than 'Debug' are always printed if the console is enabled.
console.echo(message='Information messages are enabled!', level=LogLevel.INFO)
console.echo(message='Error messages are enabled!', level=LogLevel.ERROR)
# Disabled console does not print any messages.
console.disable()
console.echo(message='Disabled console does not print messages.', level=LogLevel.INFO)
The Console class treats errors as a special class of messages, handled through the error() method. Error messages are always handled at the Error log level and always interrupt the normal runtime flow of the caller program by calling the built-in 'raise' method after logging the message.
from ataraxis_base_utilities import console
# The Console raises error messages even if it is disabled. However, the instance does not log messages to files when
# disabled.
console.disable()
# Specify the exception to be raised by providing it as an 'error' argument. By default, this argument is
# set to RuntimeError.
console.error(message="Error message", error=TypeError)
All Console methods format input messages to fit the Sun lab’s default width-limit of 120 characters. It is possible to directly access and use the formatter through the format_message() method:
from ataraxis_base_utilities import console
# This long message does not display well without additional formatting
message = (
"This is a long message that exceeds our default limit of 120 characters. Therefore, it needs to be wrapped to "
"appear correctly when printed to the terminal (or saved to a log file)."
)
print(message)
# Prints a line-break for easier difference visualization
print()
# This formats the message according to the current (default) Console configuration.
formatted_message = console.format_message(message)
print(formatted_message)
The default Console instance exposed via the 'console' variable is used by all other Sun lab projects. Re-initializing and overriding the console variable overrides the Console configuration used by all Sun lab projects used by the same process. Note! Overriding the default Console configuration is a prerequisite for enabling logging messages and errors to files and working with 'Debug' level messages.
from ataraxis_base_utilities import console, Console, LogLevel, LogFormats
from pathlib import Path
from tempfile import TemporaryDirectory
# Overwriting the default 'console' instance replaces the instance used by all other Sun lab projects running in the
# same process as the overridden 'console'.
console = Console() # This is equivalent to using the 'default' configuration
# Behaves like the default 'console' instance.
console.enable()
console.echo("Not printed by default.", level=LogLevel.DEBUG)
# Reinitializing the Console allows overriding default runtime parameters. For example, it can be used to enabled
# handling 'Debug' messages.
console = Console(debug=True)
console.enable() # Reinitializing the console resets it to the 'disabled' state.
console.echo("Debug messages are now enabled!", level=LogLevel.DEBUG)
# Another important configuration step that requires reinitializing the console is enabling logging messages and errors
# to files, which is disabled by default.
with TemporaryDirectory() as log_directory:
console = Console(
log_directory=Path(log_directory),
log_format=LogFormats.TXT, # LogFormats enumeration stores all currently supported log file formats.
debug=True
)
# Prints and saves the debug message to a log file.
console.enable()
console.echo("Debug messages are now logged to the debug log file!", level=LogLevel.DEBUG)
# The message can now be viewed by reading the .txt log file.
with console.debug_log_path.open("r") as file:
console.echo(file.read())
The Console class is built on top of the loguru library. As part of its initialization, each Console class automatically resets the handles used by the 'logger' exposed by Loguru. Therefore, the Console class is incompatible with any other third-party library that uses Loguru for similar purposes.
The standalone methods are a collection of utility functions that either abstract away the boilerplate code for common data manipulations or provide novel functionality not commonly available through popular Python libraries used by other Sun lab projects. Generally, these methods are straightforward to use and do not require detailed explanation. See the API documentation below for details on available standalone methods.
See the API documentation for the detailed description of the methods and classes exposed by components of this library.
This section provides installation, dependency, and build-system instructions for project developers.
Note! This installation method requires mamba version 2.3.2 or above. Currently, all Sun lab automation pipelines require that mamba is installed through the miniforge3 installer.
- Download this repository to the local machine using the preferred method, such as git-cloning.
- If the downloaded distribution is stored as a compressed archive, unpack it using the appropriate decompression tool.
cdto the root directory of the prepared project distribution.- Install the core Sun lab development dependencies into the base mamba environment via the
mamba install tox uv tox-uvcommand. - Use the
tox -e createcommand to create the project-specific development environment followed bytox -e installcommand to install the project into that environment as a library.
In addition to installing the project and all user dependencies, install the following dependencies:
- Python distributions, one for each version supported by the developed project. Currently, this library supports the three latest stable versions. It is recommended to use a tool like pyenv to install and manage the required versions.
This project comes with a fully configured set of automation pipelines implemented using
tox. Check the tox.ini file for details about the
available pipelines and their implementation. Alternatively, call tox list from the root directory of the project
to see the list of available tasks.
Note! All pull requests for this project have to successfully complete the tox task before being merged.
To expedite the task’s runtime, use the tox --parallel command to run some tasks in-parallel.
Many packages used in 'tox' automation pipelines (uv, mypy, ruff) and 'tox' itself may experience runtime failures. In most cases, this is related to their caching behavior. If an unintelligible error is encountered with any of the automation components, deleting the corresponding .cache (.tox, .ruff_cache, .mypy_cache, etc.) manually or via a CLI command typically solves the issue.
This project uses semantic versioning. See the tags on this repository for the available project releases.
- Ivan Kondratyev (Inkaros)
This project is licensed under the GPL3 License: see the LICENSE file for details.
- All Sun lab members for providing the inspiration and comments during the development of this library.
- The creators of all other dependencies and projects listed in the pyproject.toml file.