Skip to content

Smoke Test Pipeline Metrics should compare against last release sizes #4113

Open
@michael-hawker

Description

@michael-hawker

@azchohfi Hmm, was just messing with the DownloadPipelineArtifact wondering if we published it as an Artifact if we could use the specific flag to somehow grab the latest pipeline artifact from the main branch? Not sure if we can get that specific with the project guid? runVersion latestFromBranch maybe? 🤔 That looks promising. I can try it out later once I get the base script running.

Ref: https://docs.microsoft.com/en-us/azure/devops/pipelines/tasks/utility/download-pipeline-artifact?view=azure-devops

Originally posted by @michael-hawker in #3600 (comment)

  • The current script should save it's results to a file for that pipeline in DevOps
    Before the script runs the data for the last release branch (or main to start) should be fetched
    The script needs to take that data file as a potential input
    If it has input, it needs to also compare each project against the last size for that project
    If there's a change above ~15kb(TBD?), a new dependency, or a new binary, it should post a comment to the PR with a message/details of change

Activity

michael-hawker

michael-hawker commented on Jul 15, 2021

@michael-hawker
MemberAuthor

We should also investigate the retention policy on the DevOps and figure out how to ensure we retain artifacts for our rel/* branches if we start comparing against those. For a first pass of this comparing against main is acceptable as we'll be auditing it moving forward.

added this to the 7.2/8.0? milestone on Sep 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

      Participants

      @michael-hawker

      Issue actions

        Smoke Test Pipeline Metrics should compare against last release sizes · Issue #4113 · CommunityToolkit/WindowsCommunityToolkit