Add GitHub Infrastructure and Update Documentation

[tareknaser]

adding some GH repo infrastructure and doc updates:

• Adds ArtEval to README and links benchmark directories
• Adds CI workflow for benchmark tests (pytest in parallel)
• Adds GH issue/PR templates
• Add a test for example_bench
• Scripts to be executable

Each change is in a separate commit. If any change is not needed right now, let me know and I can remove that commit and keep the others.

[tareknaser]

Added CI workflow for running benchmark tests. Had to do some debugging. I first wrote the workflow to run tests for each benchmark in parallel using a matrix but the existing test_sdk.py files were empty and broke the CI. They were also importing from the wrong directory and testing the wrong Evaluator class. Cleaned that up and removed the broken tests.

I also added a lightweight test for example_bench. It’s pretty minimal and doesn’t check much. just meant to show how to structure tests for benchmarks.

For now, the CI only runs tests for example_bench since that’s the only one with actual tests. The other benchmarks are commented out in the matrix with a TODO note. Once we add tests for them, they’ll automatically run in parallel because we have the matrix setup in place

[xuafeng]

Added CI workflow for running benchmark tests. Had to do some debugging. I first wrote the workflow to run tests for each benchmark in parallel using a matrix but the existing test_sdk.py files were empty and broke the CI. They were also importing from the wrong directory and testing the wrong Evaluator class. Cleaned that up and removed the broken tests.

I also added a lightweight test for example_bench. It’s pretty minimal and doesn’t check much. just meant to show how to structure tests for benchmarks.

For now, the CI only runs tests for example_bench since that’s the only one with actual tests. The other benchmarks are commented out in the matrix with a TODO note. Once we add tests for them, they’ll automatically run in parallel because we have the matrix setup in place

Thanks a lot. Tarek, It is very helpful. I think we can force the contributor to add test later.

[xuafeng]

@guozhongxin I already review this PR and all changes make sense to me. Can you please also take a look? Thanks.

[guozhongxin]

@guozhongxin I already review this PR and all changes make sense to me. Can you please also take a look? Thanks.

reviewed. approved with one comment