Code

Remove inference batching#111

Code

Merged

michaelharrisonmai merged 23 commits intomainmicrosoft/eureka-ml-insights:mainfrom mharrison/remove-inference-batchingmicrosoft/eureka-ml-insights:mharrison/remove-inference-batchingCopy head branch name to clipboardMar 17, 2025

Commits

Commits on Dec 11, 2024

• readme updates

  

  Safoora Yousefi

  committed
  bc915db

  Copy full SHA for bc915db

Commits on Dec 12, 2024

• fix links

  

  Safoora Yousefi

  committed
  e290211

  Copy full SHA for e290211

Commits on Jan 8, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  72b9b9e

  Copy full SHA for 72b9b9e

Commits on Jan 17, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  3a20480

  Copy full SHA for 3a20480

Commits on Jan 22, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  f58154e

  Copy full SHA for f58154e

Commits on Jan 24, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  9b9c5c0

  Copy full SHA for 9b9c5c0

Commits on Jan 29, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  ce1b2fe

  Copy full SHA for ce1b2fe

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  b2a8376

  Copy full SHA for b2a8376

Commits on Jan 31, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  645eefa

  Copy full SHA for 645eefa

Commits on Feb 11, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  89daef5

  Copy full SHA for 89daef5

Commits on Feb 27, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  d9988df

  Copy full SHA for d9988df

Commits on Mar 1, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  12dffdf

  Copy full SHA for 12dffdf

Commits on Mar 11, 2025

• resolve concurrency issues

  

  Safoora Yousefi

  committed
  173538a

  Copy full SHA for 173538a

Commits on Mar 12, 2025

• formatting

  

  Safoora Yousefi

  committed
  d77dfad

  Copy full SHA for d77dfad

Commits on Mar 13, 2025

• thread safety

  

  Safoora Yousefi

  committed
  382f452

  Copy full SHA for 382f452

Commits on Mar 14, 2025

• Merge branch 'main' of https://github.com/microsoft/eureka-ml-insights

  

  Safoora Yousefi

  committed
  8fa0931

  Copy full SHA for 8fa0931

• merge with main

  

  Safoora Yousefi

  committed
  03c848c

  Copy full SHA for 03c848c

Commits on Mar 15, 2025

• bug fixes

  

  Safoora Yousefi

  committed
  5c790b1

  Copy full SHA for 5c790b1

• revert to single model uinstance

  

  Safoora Yousefi

  committed
  2c45d8b

  Copy full SHA for 2c45d8b

• llava model thread safety

  

  Safoora Yousefi

  committed
  1751905

  Copy full SHA for 1751905

• refactored inference.py to not batch requests

  

  Michael Harrison

  committed
  5d391b7

  Copy full SHA for 5d391b7

• Merge branch 'main' into mharrison/remove-inference-batching

  michaelharrisonmai

  authored
  e397fe3

  Copy full SHA for e397fe3

Commits on Mar 17, 2025

• remove unused vars

  

  Michael Harrison

  committed
  114e446

  Copy full SHA for 114e446