[Release] bump v0.4.5.post3 #5616
                  
                    
                      zhyncs
                    
                  
                
                  announced in
                Announcements
              
            Replies: 1 comment
-
        # warmup DeepGEMM
SGL_ENABLE_JIT_DEEPGEMM=1 python3 -m sglang.compile_deep_gemm --model deepseek-ai/DeepSeek-V3 --tp 8 --trust-remote-code
# launch server
SGL_ENABLE_JIT_DEEPGEMM=1 python3 -m sglang.launch_server --model-path deepseek-ai/DeepSeek-V3 --tp 8 --trust-remote-code | 
  
Beta Was this translation helpful? Give feedback.
                  
                    0 replies
                  
                
            
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
The SGLang team is pleased to announce the release of v0.4.5.post3. Enjoy!
pip install "sglang[all]>=0.4.5.post3"#5611 (comment)
Beta Was this translation helpful? Give feedback.
All reactions