My Tools

This repository contains several simple Python tools designed for various tasks such as file manipulation, web scraping, data generation, and more.

Tools Included

• combine-txt-files.py: Combines multiple text files into one.
• concatenate-code.py: Concatenates code files with user confirmation on directories and files.
• dirfn2txt.py: Lists all files and directories in a given directory and saves the structure to a file.
• dl-transcripts.py: Downloads transcripts from a list of URLs provided in a file.
• environment.yml: Specifies the environment configuration for the project, including dependencies like Python version and libraries.
• fake_data_mysql_multiple_dbs.py: Generates fake data for multiple MySQL databases and tables.
• fetch-licenses.py: Fetches license information for Python packages listed in environment.yml and requirements.txt.
• find-imports.py: Finds and lists import statements in Python files within a specified directory.
• generate_test_stubs.py: Generates unit test stubs for functions in a Flask application.
• get-links.py: Extracts hyperlinks from a given webpage URL.
• install_scripts.py: Lists Python files in the current directory, prompts the user to make them executable, and moves them to /usr/local/bin.
• quick-cat.py: Concatenates multiple files into a markdown file, preserving the directory structure, and includes chunking and copying to clipboard options.
• remove_line_from_files.py: Searches for files with a specified extension in a directory, finds an exact line in each file, and removes that line.
• scrape-with-links.py: Scrapes content from a list of URLs and saves the content to a specified directory.
• scrape.py: Scrapes content from a single URL and saves the content to a specified output file.
• show_file_changes.py: Displays all changes made to a specific file in a Git repository.
• youtube-dl.py: Downloads YouTube videos.

Style Guide

Please refer to the Style Guide for coding consistency.

Usage Examples

combine-txt-files.py

Combines multiple text files from a specified directory into a single output file.

Example Usage:

python combine-txt-files.py output_file.txt

concatenate-code.py

Concatenates code files with user confirmation on directories and files.

Example Usage:

python concatenate-code.py

dirfn2txt.py

Lists all files and directories in a given directory and saves the structure to a file.

Example Usage:

python dirfn2txt.py output_file.txt

dl-transcripts.py

Downloads transcripts from a list of URLs provided in a file.

Example Usage:

python dl-transcripts.py url_file.txt output_dir

fake_data_mysql_multiple_dbs.py

Generates fake data for multiple MySQL databases and tables.

Example Usage:

python fake_data_mysql_multiple_dbs.py

fetch-licenses.py

Fetches license information for Python packages listed in environment.yml and requirements.txt.

Example Usage:

python fetch-licenses.py -d . -e environment.yml -r requirements.txt -o py_pkg_licenses.md

find-imports.py

Finds and lists import statements in Python files within a specified directory.

Example Usage:

python find-imports.py

generate_test_stubs.py

Generates unit test stubs for functions in a Flask application.

Example Usage:

python generate_test_stubs.py --source_dir src --test_dir tests

get-links.py

Extracts hyperlinks from a given webpage URL.

Example Usage:

python get-links.py url

install_scripts.py

Lists Python files in the current directory, prompts the user to make them executable, and moves them to /usr/local/bin.

Example Usage:

python install_scripts.py

quick-cat.py

Concatenates multiple files into a markdown file, along with the directory structure, chunking, and a prompt meant to bring an LLM up to speed on your project.

Example Usage:

python quick-cat.py "*.py" "*.js" "*.html" -o output.md --copy --recursive --skip-prompt --exclude "bootstrap*.*" "./migrations/" "./tools/" "./docker/" --chunk-size 150000 --prompt-file prompt.txt

remove_line_from_files.py

Searches for files with a specified extension in a directory, finds an exact line in each file, and removes that line.

Example Usage:

python remove_line_from_files.py --extension .txt --line "Sample line to remove"

scrape-with-links.py

Scrapes content from a list of URLs and saves the content to a specified directory.

Example Usage:

python scrape-with-links.py url_file.txt output_dir

scrape.py

Scrapes content from a single URL and saves the content to a specified output file.

Example Usage:

python scrape.py url

show_file_changes.py

Displays all changes made to a specific file in a Git repository.

Example Usage:

python show_file_changes.py file_path

youtube-dl.py

Downloads YouTube videos.

Example Usage:

python youtube-dl.py

License

This project is licensed under the Apache 2.0 License - see the LICENSE file for details.