-
- Downloads
[SPARK-20156][CORE][SQL][STREAMING][MLLIB] Java String toLowerCase "Turkish...
[SPARK-20156][CORE][SQL][STREAMING][MLLIB] Java String toLowerCase "Turkish locale bug" causes Spark problems ## What changes were proposed in this pull request? Add Locale.ROOT to internal calls to String `toLowerCase`, `toUpperCase`, to avoid inadvertent locale-sensitive variation in behavior (aka the "Turkish locale problem"). The change looks large but it is just adding `Locale.ROOT` (the locale with no country or language specified) to every call to these methods. ## How was this patch tested? Existing tests. Author: Sean Owen <sowen@cloudera.com> Closes #17527 from srowen/SPARK-20156.
Showing
- common/network-common/src/main/java/org/apache/spark/network/util/JavaUtils.java 3 additions, 2 deletions...rc/main/java/org/apache/spark/network/util/JavaUtils.java
- common/network-common/src/main/java/org/apache/spark/network/util/TransportConf.java 4 additions, 1 deletion...ain/java/org/apache/spark/network/util/TransportConf.java
- core/src/main/java/org/apache/spark/status/api/v1/TaskSorting.java 2 additions, 1 deletion...main/java/org/apache/spark/status/api/v1/TaskSorting.java
- core/src/main/scala/org/apache/spark/SparkContext.scala 1 addition, 1 deletioncore/src/main/scala/org/apache/spark/SparkContext.scala
- core/src/main/scala/org/apache/spark/SparkEnv.scala 3 additions, 1 deletioncore/src/main/scala/org/apache/spark/SparkEnv.scala
- core/src/main/scala/org/apache/spark/executor/CoarseGrainedExecutorBackend.scala 2 additions, 1 deletion.../apache/spark/executor/CoarseGrainedExecutorBackend.scala
- core/src/main/scala/org/apache/spark/io/CompressionCodec.scala 3 additions, 1 deletion...src/main/scala/org/apache/spark/io/CompressionCodec.scala
- core/src/main/scala/org/apache/spark/metrics/sink/ConsoleSink.scala 2 additions, 2 deletions...ain/scala/org/apache/spark/metrics/sink/ConsoleSink.scala
- core/src/main/scala/org/apache/spark/metrics/sink/CsvSink.scala 1 addition, 1 deletion...rc/main/scala/org/apache/spark/metrics/sink/CsvSink.scala
- core/src/main/scala/org/apache/spark/metrics/sink/GraphiteSink.scala 3 additions, 3 deletions...in/scala/org/apache/spark/metrics/sink/GraphiteSink.scala
- core/src/main/scala/org/apache/spark/metrics/sink/Slf4jSink.scala 2 additions, 2 deletions.../main/scala/org/apache/spark/metrics/sink/Slf4jSink.scala
- core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala 2 additions, 1 deletion...ala/org/apache/spark/scheduler/EventLoggingListener.scala
- core/src/main/scala/org/apache/spark/scheduler/SchedulableBuilder.scala 3 additions, 2 deletions...scala/org/apache/spark/scheduler/SchedulableBuilder.scala
- core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala 9 additions, 9 deletions.../scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala
- core/src/main/scala/org/apache/spark/serializer/KryoSerializer.scala 3 additions, 1 deletion...in/scala/org/apache/spark/serializer/KryoSerializer.scala
- core/src/main/scala/org/apache/spark/ui/exec/ExecutorThreadDumpPage.scala 3 additions, 1 deletion...ala/org/apache/spark/ui/exec/ExecutorThreadDumpPage.scala
- core/src/main/scala/org/apache/spark/ui/jobs/JobPage.scala 2 additions, 2 deletionscore/src/main/scala/org/apache/spark/ui/jobs/JobPage.scala
- core/src/test/scala/org/apache/spark/ShuffleSuite.scala 2 additions, 2 deletionscore/src/test/scala/org/apache/spark/ShuffleSuite.scala
- core/src/test/scala/org/apache/spark/broadcast/BroadcastSuite.scala 3 additions, 1 deletion...est/scala/org/apache/spark/broadcast/BroadcastSuite.scala
- core/src/test/scala/org/apache/spark/internal/config/ConfigEntrySuite.scala 2 additions, 1 deletion...a/org/apache/spark/internal/config/ConfigEntrySuite.scala
Loading
Please register or sign in to comment