Skip to content
Snippets Groups Projects
  • Joseph K. Bradley's avatar
    fdde7d0a
    [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for pyspark ML JVM calls · fdde7d0a
    Joseph K. Bradley authored
    ## What changes were proposed in this pull request?
    
    Issue: Omitting the full classpath can cause problems when calling JVM methods or classes from pyspark.
    
    This PR: Changed all uses of jvm.X in pyspark.ml and pyspark.mllib to use full classpath for X
    
    ## How was this patch tested?
    
    Existing unit tests.  Manual testing in an environment where this was an issue.
    
    Author: Joseph K. Bradley <joseph@databricks.com>
    
    Closes #14023 from jkbradley/SPARK-16348.
    fdde7d0a
    History
    [SPARK-16348][ML][MLLIB][PYTHON] Use full classpaths for pyspark ML JVM calls
    Joseph K. Bradley authored
    ## What changes were proposed in this pull request?
    
    Issue: Omitting the full classpath can cause problems when calling JVM methods or classes from pyspark.
    
    This PR: Changed all uses of jvm.X in pyspark.ml and pyspark.mllib to use full classpath for X
    
    ## How was this patch tested?
    
    Existing unit tests.  Manual testing in an environment where this was an issue.
    
    Author: Joseph K. Bradley <joseph@databricks.com>
    
    Closes #14023 from jkbradley/SPARK-16348.