- 
                Notifications
    
You must be signed in to change notification settings  - Fork 28.9k
 
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
      [SPARK-54049][BUILD] Backport to Spark 4.0. Shade com.google.thirdparty package to fix Guava class conflicts in spark 4.0
        
              
                BUILD
        
      
    
        
          #52869
            opened Nov 4, 2025  by
            vinodkc
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54174][CORE][CONNECT][TESTS] Remove override of deprecated method 
    SparkThrowable#getErrorClass in Spark code
        
              
                CONNECT
              
                CORE
              
                SQL
        
      
        
          #52868
            opened Nov 4, 2025  by
            LuciferYang
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54172][SQL] Merge Into Schema Evolution should only add referenced columns
        
              
                SQL
        
      
    
        
          #52866
            opened Nov 4, 2025  by
            szehon-ho
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [MINOR][PYTHON][TESTS] Enable 
    test_pivot_exceed_max_values
        
              
                PYTHON
              
                SQL
        
      
        
          #52865
            opened Nov 4, 2025  by
            zhengruifeng
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54170] Use StructuredLogging message in Scala side
        
              
                CORE
              
                PYTHON
        
      
    
      
  
        
          #52864
            opened Nov 4, 2025  by
            ueshin
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54169][Geo][CONNECT] Introduce Geography and Geometry types in Arrow writer
        
              
                CONNECT
              
                SQL
        
      
    
      
  
        
          #52863
            opened Nov 3, 2025  by
            uros-db
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54156][PROTOBUF] Classify errors for ProtobufOptions casting failure
        
              
                PROTOBUF
              
                SQL
        
      
    
        
          #52862
            opened Nov 3, 2025  by
            nyaapa
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54161][BUILD] Upgrade 
    
      
  extra-enforcer-rules to 1.11.0
        
              
                BUILD
        
      
        
          #52859
            opened Nov 3, 2025  by
            dongjoon-hyun
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54160][Geo][SQL] Implement the ST_SetSrid expression in SQL
        
              
                SQL
        
      
    
      
  
        
          #52858
            opened Nov 3, 2025  by
            uros-db
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54159][INFRA] Fix 
    
      
  pip install commands to use proper quotation marks
        
              
                BUILD
              
                INFRA
        
      
        
          #52857
            opened Nov 3, 2025  by
            dongjoon-hyun
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54153][PYTHON] Support profiling iterator based Python UDFs
        
              
                CORE
              
                PYTHON
              
                SQL
        
      
    
      
  
        
          #52853
            opened Nov 3, 2025  by
            Kimahriman
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54165][CONNECT]Add BatchExecutePlan RPC and reattach support
        
              
                CONNECT
              
                PYTHON
              
                SQL
        
      
    
      
  
        
          #52852
            opened Nov 3, 2025  by
            grundprinzip
            
        
        
            
    •
    
      Draft
    
  
        
        
      
    
      XSS: Ensure the application name in historypage get escaped
        
              
                WEB UI
        
      
    
      
  
        
          #52851
            opened Nov 3, 2025  by
            Chhida
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54147][SQL] Set OMP_NUM_THREADS to spark.task.cpus by default in Ba…
        
              
                SQL
        
      
    
      
  
        
          #52850
            opened Nov 3, 2025  by
            TongWei1105
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54149][SQL][SS][CONNECT] Enable tail-recursion wherever possible
        
              
                CONNECT
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52847
            opened Nov 3, 2025  by
            LuciferYang
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54162][Geo][SQL] Allow casting from GeographyType to GeometryType
        
              
                SQL
        
      
    
      
  
        
          #52839
            opened Nov 2, 2025  by
            uros-db
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54136][SQL] Extract plan merging logic from 
    
      
  MergeScalarSubqueries to PlanMerger
        
              
                SQL
        
      
        
          #52835
            opened Nov 2, 2025  by
            peter-toth
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SDP][SPARK-52463] Add support for cluster_by in Python Pipelines APIs
        
              
                CONNECT
              
                PYTHON
              
                SQL
        
      
    
        
          #52831
            opened Nov 2, 2025  by
            sryza
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54106][SS] Recheckin State store row checksum implementation
        
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52829
            opened Nov 1, 2025  by
            micheal-o
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54130][SQL] Add detailed error messages for catalog assertion failures
        
              
                SQL
        
      
    
        
          #52826
            opened Nov 1, 2025  by
            ganeshashree
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54122] Implement TwsTester
        
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
        
          #52824
            opened Nov 1, 2025  by
            fedimser
            
        
        
            
    
  
    Loading…
 
        
        
      
    
      [SPARK-54117][SS] Throw better error to indicate that TWS is only supported with RocksDB state store provider
        
              
                PYTHON
              
                SQL
              
                STRUCTURED STREAMING
        
      
    
      
  
        
          #52822
            opened Oct 31, 2025  by
            fedimser
            
        
        
            
    
  
    Loading…
 
        
        
      
    Previous Next
  
  
  ProTip!
  Type g i on any issue or pull request to go back to the issue listing page.