Added support for batch embedding of multiple text strings if using the all-Mini-L6-v2 model. As it is so small it barely uses the GPU so can batch process embedding to maximize embedding performance. Runs much faster now.
Added support for batch embedding of multiple text strings if using the all-Mini-L6-v2 model. As it is so small it barely uses the GPU so can batch process embedding to maximize embedding performance. Runs much faster now.