Skip to content
Snippets Groups Projects
Commit 1ca0a101 authored by Tom Panning's avatar Tom Panning Committed by Andrew Or
Browse files

[SPARK-5176] The thrift server does not support cluster mode

Output an error message if the thrift server is started in cluster mode.

Author: Tom Panning <tom.panning@nextcentury.com>

Closes #4137 from tpanningnextcen/spark-5176-thrift-cluster-mode-error and squashes the following commits:

f5c0509 [Tom Panning] [SPARK-5176] The thrift server does not support cluster mode
parent c80194b3
No related branches found
No related tags found
No related merge requests found
...@@ -144,6 +144,8 @@ object SparkSubmit { ...@@ -144,6 +144,8 @@ object SparkSubmit {
printErrorAndExit("Cluster deploy mode is not applicable to Spark shells.") printErrorAndExit("Cluster deploy mode is not applicable to Spark shells.")
case (_, CLUSTER) if isSqlShell(args.mainClass) => case (_, CLUSTER) if isSqlShell(args.mainClass) =>
printErrorAndExit("Cluster deploy mode is not applicable to Spark SQL shell.") printErrorAndExit("Cluster deploy mode is not applicable to Spark SQL shell.")
case (_, CLUSTER) if isThriftServer(args.mainClass) =>
printErrorAndExit("Cluster deploy mode is not applicable to Spark Thrift server.")
case _ => case _ =>
} }
...@@ -408,6 +410,13 @@ object SparkSubmit { ...@@ -408,6 +410,13 @@ object SparkSubmit {
mainClass == "org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver" mainClass == "org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver"
} }
/**
* Return whether the given main class represents a thrift server.
*/
private[spark] def isThriftServer(mainClass: String): Boolean = {
mainClass == "org.apache.spark.sql.hive.thriftserver.HiveThriftServer2"
}
/** /**
* Return whether the given primary resource requires running python. * Return whether the given primary resource requires running python.
*/ */
......
...@@ -26,6 +26,8 @@ set -o posix ...@@ -26,6 +26,8 @@ set -o posix
# Figure out where Spark is installed # Figure out where Spark is installed
FWDIR="$(cd "`dirname "$0"`"/..; pwd)" FWDIR="$(cd "`dirname "$0"`"/..; pwd)"
# NOTE: This exact class name is matched downstream by SparkSubmit.
# Any changes need to be reflected there.
CLASS="org.apache.spark.sql.hive.thriftserver.HiveThriftServer2" CLASS="org.apache.spark.sql.hive.thriftserver.HiveThriftServer2"
function usage { function usage {
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment