Skip to content

Issues: pytorch/executorch

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
29 Open 15 Closed
29 Open 15 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Track model pte size in the benchmark dashboard module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8810 opened Feb 28, 2025 by jackzhxng
@huydhn @guangy10
Benchmark: Fix metrics high variability from run-to-run enhancement Not as big of a feature, but technically not a bug. Should be easy to fix high priority module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triage review Items require an triage review triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8603 opened Feb 20, 2025 by guangy10 0.6.0
@shoumikhin @guangy10 @kirklandsign
43
Report avg_inference_latency from Android LLM benchmark app module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8578 opened Feb 19, 2025 by guangy10 0.6.0
@kirklandsign
1
Resolve the discrepancy of latency report between LLMs and non-LLMs enhancement Not as big of a feature, but technically not a bug. Should be easy to fix module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8576 opened Feb 19, 2025 by guangy10 0.6.0
@shoumikhin @huydhn
@kirklandsign @yangw-dev
6
[Android benchmark] Uninstall existing benchmark APK before installing module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8492 opened Feb 14, 2025 by kirklandsign
@huydhn @kirklandsign
2
Add benchmark for Llama3.2 1B w/ MPS 8da4w module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8473 opened Feb 13, 2025 by guangy10
@manuelcandales
OSS Android Benchmarking: minibench and microbench module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8402 opened Feb 12, 2025 by kirklandsign
3 tasks
@kirklandsign
9
[Android benchmarking] Add support to benchmark individual op module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8385 opened Feb 11, 2025 by kirklandsign
@kirklandsign
Run critical models & recipes on pull request enhancement Not as big of a feature, but technically not a bug. Should be easy to fix module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8348 opened Feb 10, 2025 by guangy10
@guangy10
Benchmark Hugging Face models via Optimum integration module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8294 opened Feb 6, 2025 by guangy10 0.6.0
@guangy10
1
Add Vulkan Delegate Benchmarks for Llama 3.2 (1B and 3B) and MobileNet module: benchmark Issues related to the benchmark infrastructure module: vulkan Issues related to the Vulkan delegate and code under backends/vulkan/ triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8293 opened Feb 6, 2025 by SS-JIA 0.6.0
@SS-JIA
Prototype benchmarking with private/custom devices that are not leased via AWS module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8251 opened Feb 6, 2025 by guangy10
@huydhn
2
Support benchmark with arbitrary binaries on Android module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8250 opened Feb 6, 2025 by guangy10
@kirklandsign
1
Support benchmark with arbitrary binaries on iOS module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8249 opened Feb 6, 2025 by guangy10
@shoumikhin
1
DevX: Track the benchmark infra health and usage enhancement Not as big of a feature, but technically not a bug. Should be easy to fix module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8247 opened Feb 6, 2025 by guangy10 0.6.0
@yangw-dev
8
Support benchmark using prebuilt artifacts module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8246 opened Feb 6, 2025 by guangy10
@huydhn
7
Support scheduling benchmark jobs via scripts module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8245 opened Feb 6, 2025 by guangy10 0.6.0
@huydhn @Camyll
1
Enable workflow time profiling module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8244 opened Feb 6, 2025 by guangy10 0.6.0
@guangy10
Enable framegraphs for benchmarking on iOS module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8243 opened Feb 6, 2025 by guangy10 0.6.0
@shoumikhin
Enable framegraphs for benchmarking on Android module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8242 opened Feb 6, 2025 by guangy10 0.6.0
@kirklandsign
4
Integrate mem profiler to benchmark infra module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8241 opened Feb 6, 2025 by guangy10 0.6.0
@kirklandsign
Integrate ETdump to benchmark infra module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8240 opened Feb 6, 2025 by guangy10 0.6.0
@kirklandsign
1
Support auto regression detection and bisect module: benchmark Issues related to the benchmark infrastructure module: user experience Issues related to reducing friction for users triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8239 opened Feb 6, 2025 by guangy10 0.6.0
@huydhn @wdvr @yangw-dev
2
QLora and SpintQuant recipes fail to export on CI module: benchmark Issues related to the benchmark infrastructure module: ci Issues related to continuous integration triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#8154 opened Feb 3, 2025 by guangy10
@kimishpatel
8
Benchmark: Report memory usage in Android benchmark app module: android Issues related to Android code, build, and execution module: benchmark Issues related to the benchmark infrastructure triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
#7988 opened Jan 28, 2025 by guangy10 0.6.0
@kirklandsign
1
ProTip! Add no:assignee to see everything that’s not assigned.