Skip to content

feature(metrics): dump stat to a file#480

Open
rebel-minwook wants to merge 2 commits intodevfrom
feature/CLD-479
Open

feature(metrics): dump stat to a file#480
rebel-minwook wants to merge 2 commits intodevfrom
feature/CLD-479

Conversation

@rebel-minwook
Copy link
Copy Markdown

Summary of. Changes

Adding stat dump function

This pull request adds a function of dumping a file named {stat_type}_metrics.txt while printing stat metrics to stdout.

For example, in case of prefill, it will be prefill_metrics.txt.

Related Tickets

  • Related to CLD-479 (Rebellions internal issue number, not public)

How to test

  • When VLLM_RBLN_DUMP_METRICS=1, it is enough to check whether {stat_type}_metrics.txt exists.

Checklist

The PR will only be reviewed and considered for merge if the following are satisfied.

  • PR title follows Conventional Commits format
  • This PR is linked to an existing issue
  • The test method is described, and the expected result is clearly stated
  • Relevant documentation has been updated (if applicable)

def show_stats(self, stat_type: str):
stats = self.gen_stats(stat_type)
logger.info(stats)
if envs.VLLM_RBLN_DUMP_METRICS:
Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is VLLM_RBLN_DUMP_METRICS registerd in rbln_envs.py?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants