hparams/update bootstrap version

[joellidin]

• (hparams) Update bootstrap window
• Bump run version

Description

Related Issue(s)

• Closes #[issue number]

Type of Change

• Feature (adding new functionality)
• Fix (resolving a bug or issue)
• Docs (documentation updates)
• Refactor (code changes that don't affect functionality)
• Maintenance (dependency updates or other maintenance)
• Tests (adding or improving tests)
• Breaking change (fix or feature with incompatible API changes)
• Other: _____

Branch Naming

• My branch follows the project's naming convention (e.g., feature/add-new-capability)

Commit Messages

• My commits are small, atomic, and have proper commit messages
• Commit messages are in imperative mood with a capitalized summary under 50 chars

Code Quality

• I've performed a self-review of my code
• I've added appropriate docstrings following the project's conventions
• I've added proper logging where necessary (without trailing periods)
• I've applied linting and formatting with Ruff
• My code generates no new warnings

Testing

• I've added tests for new functionality or bug fixes
• All tests pass locally with my changes
• Test coverage has not decreased

Documentation

• I've updated documentation to reflect my changes
• I've updated comments in hard-to-understand areas

If this is a breaking change

Screenshots/Examples

Additional Notes

Summary by CodeRabbit

• Chores
  • Bumped package version to 2.1.14
  • Adjusted optimization configuration including learning rate, checkpoint initialization window, and scheduler settings

[coderabbitai]

Walkthrough

Two files were updated: three hyperparameter values in hparams/hparams.json were modified (outer_learning_rate, checkpoint_init_window, and optimizer.adamw.scheduler.flatten_start_step), and the package version in src/tplr/__init__.py was incremented from 2.1.13 to 2.1.14.

Changes

Cohort / File(s)	Change Summary
Hyperparameter Configuration hparams/hparams.json	Updated three hyperparameter values: outer_learning_rate (0.6 → 0.5), checkpoint_init_window (59057 → 59147), optimizer.adamw.scheduler.flatten_start_step (2650 → 2740)
Version Bump src/tplr/__init__.py	Incremented __version__ from "2.1.13" to "2.1.14"

Estimated code review effort

🎯 1 (Trivial) | ⏱️ ~2 minutes

• These are straightforward configuration updates and a standard version bump with no logic changes or behavioral modifications to review.

Possibly related PRs

• hparams/update inactivity #594: Modifies the same checkpoint_init_window field in hparams.json and bumps the package version.
• hparams/update bootstrap version #623: Updates outer_learning_rate and checkpoint_init_window in hparams.json alongside a version increment.
• hparams/update bootstrap version #645: Adjusts both checkpoint_init_window and optimizer.adamw.scheduler.flatten_start_step with a sequential version bump.

Poem

🐰 A hop, a tune, adjustments fine,
Learning rates and checkpoints align,
Version climbs from 2.1.13,
To 2.1.14—now we're pristine!
Parameters dance in harmony's line,
flicks whiskers contentedly ✨

Pre-merge checks and finishing touches

❌ Failed checks (1 inconclusive)

Check name	Status	Explanation	Resolution
Description check	❓ Inconclusive	The description provides a brief summary of changes but lacks detailed context on 'why' these changes were made; most template sections remain unchecked and blank.	Expand the Description section to explain the rationale for the hyperparameter and version updates, and check relevant Type of Change options to clarify intent.

✅ Passed checks (1 passed)

Check name	Status	Explanation
Title check	✅ Passed	The title 'hparams/update bootstrap version' is clearly related to the main changes: updating hyperparameters and bumping the package version, with good specificity.

✨ Finishing touches

• 📝 Generate docstrings

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch hparams/update-bootstrap-version

---

📜 Recent review details

Configuration used: CodeRabbit UI

Review profile: CHILL

Plan: Pro

📥 Commits

Reviewing files that changed from the base of the PR and between eb311a8 and a05390a.

📒 Files selected for processing (2)

• hparams/hparams.json (3 hunks)
• src/tplr/__init__.py (1 hunks)

⏰ Context from checks skipped due to timeout of 90000ms. You can increase the timeout in your CodeRabbit configuration to a maximum of 15 minutes (900000ms). (2)

• GitHub Check: test (3.12)
• GitHub Check: test (3.11)

🔇 Additional comments (3)

src/tplr/__init__.py (1)

23-23: LGTM! Version bump is appropriate.

The patch version increment from 2.1.13 to 2.1.14 is appropriate for the hyperparameter changes in this PR.

hparams/hparams.json (2)

10-10: Verify the impact of the learning rate reduction.

The outer learning rate decreased from 0.6 to 0.5 (a 16.7% reduction). This change will affect training dynamics and convergence behavior. Ensure this adjustment aligns with your training objectives and has been validated through experimentation.

---

47-47: LGTM! Coordinated window and step updates.

The checkpoint initialization window advanced by 90 (from 59057 to 59147), and the scheduler's flatten start step was increased by the same delta (from 2650 to 2740). This coordinated adjustment maintains consistency between the checkpoint bootstrapping and the learning rate schedule.

Also applies to: 66-66

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.

@@           Coverage Diff           @@
##              dev     #647   +/-   ##
=======================================
  Coverage   57.91%   57.91%           
=======================================
  Files          27       27           
  Lines        4890     4890           
=======================================
  Hits         2832     2832           
  Misses       2058     2058           

Files with missing lines	Coverage Δ
src/tplr/__init__.py	100.00% <100.00%> (ø)

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.