Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: use different color for annotations #366

Merged
merged 13 commits into from
Feb 10, 2025
Merged

Conversation

yuyutaotao
Copy link
Collaborator

  1. use different color for annotations
  2. create a new package named evaluation

Copy link

netlify bot commented Feb 10, 2025

Deploy Preview for midscene ready!

Name Link
🔨 Latest commit eba5012
🔍 Latest deploy log https://app.netlify.com/sites/midscene/deploys/67a9b9f99852d80008578f59
😎 Deploy Preview https://deploy-preview-366--midscene.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@yuyutaotao yuyutaotao requested a review from zhoushaw February 10, 2025 06:09
@yuyutaotao yuyutaotao marked this pull request as ready for review February 10, 2025 06:10
Comment on lines +16 to +54
runs-on: ubuntu-22.04
strategy:
matrix:
node-version: [18.19.0]

env:
OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
OPENAI_BASE_URL: ${{ secrets.OPENAI_BASE_URL }}
MIDSCENE_MODEL_NAME: gpt-4o-2024-11-20
CI: 1

steps:
- uses: actions/checkout@v4
with:
fetch-depth: 0
ref: ${{ github.event.inputs.branch || 'main' }}

- name: Setup pnpm
uses: pnpm/action-setup@v2
with:
version: 9.3.0

- name: Setup Node.js
uses: actions/setup-node@v4
with:
node-version: '18'
cache: 'pnpm'

- name: Install dependencies
run: pnpm install --frozen-lockfile

- name: Build project
run: pnpm run build

- name: Run evaluation
run: |
cd packages/evaluation
pnpm run evaluate:inspect
pnpm run evaluate:assertion

Check warning

Code scanning / CodeQL

Workflow does not contain permissions Medium

Actions Job or Workflow does not set permissions
ref: ${{ github.event.inputs.branch || 'main' }}

- name: Setup pnpm
uses: pnpm/action-setup@v2

Check warning

Code scanning / CodeQL

Unpinned tag for a non-immutable Action in workflow Medium

Unpinned 3rd party Action 'AI evaluation' step
Uses Step
uses 'pnpm/action-setup' with ref 'v2', not a pinned commit hash
@zhoushaw zhoushaw merged commit 2a28472 into main Feb 10, 2025
9 of 10 checks passed
@zhoushaw zhoushaw deleted the feat/colorful-markup-2 branch February 10, 2025 08:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants