-
- Downloads
[SPARK-14828][SQL] Start SparkSession in REPL instead of SQLContext
## What changes were proposed in this pull request? ``` Spark context available as 'sc' (master = local[*], app id = local-1461283768192). Spark session available as 'spark'. Welcome to ____ __ / __/__ ___ _____/ /__ _\ \/ _ \/ _ `/ __/ '_/ /___/ .__/\_,_/_/ /_/\_\ version 2.0.0-SNAPSHOT /_/ Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_51) Type in expressions to have them evaluated. Type :help for more information. scala> sql("SHOW TABLES").collect() 16/04/21 17:09:39 WARN ObjectStore: Version information not found in metastore. hive.metastore.schema.verification is not enabled so recording the schema version 1.2.0 16/04/21 17:09:39 WARN ObjectStore: Failed to get database default, returning NoSuchObjectException res0: Array[org.apache.spark.sql.Row] = Array([src,false]) scala> sql("SHOW TABLES").collect() res1: Array[org.apache.spark.sql.Row] = Array([src,false]) scala> spark.createDataFrame(Seq((1, 1), (2, 2), (3, 3))) res2: org.apache.spark.sql.DataFrame = [_1: int, _2: int] ``` Hive things are loaded lazily. ## How was this patch tested? Manual. Author: Andrew Or <andrew@databricks.com> Closes #12589 from andrewor14/spark-session-repl.
Showing
- repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkILoop.scala 9 additions, 15 deletions....10/src/main/scala/org/apache/spark/repl/SparkILoop.scala
- repl/scala-2.10/src/main/scala/org/apache/spark/repl/SparkILoopInit.scala 7 additions, 7 deletions...src/main/scala/org/apache/spark/repl/SparkILoopInit.scala
- repl/scala-2.11/src/main/scala/org/apache/spark/repl/Main.scala 10 additions, 14 deletions...cala-2.11/src/main/scala/org/apache/spark/repl/Main.scala
- repl/scala-2.11/src/main/scala/org/apache/spark/repl/SparkILoop.scala 7 additions, 7 deletions....11/src/main/scala/org/apache/spark/repl/SparkILoop.scala
- repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala 3 additions, 2 deletions...2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala
- sql/core/src/main/scala/org/apache/spark/sql/SparkSession.scala 29 additions, 5 deletions...re/src/main/scala/org/apache/spark/sql/SparkSession.scala
Loading
Please register or sign in to comment