Skip to content
Snippets Groups Projects
  • Andrew Or's avatar
    f17510e3
    [SPARK-2259] Fix highly misleading docs on cluster / client deploy modes · f17510e3
    Andrew Or authored
    The existing docs are highly misleading. For standalone mode, for example, it encourages the user to use standalone-cluster mode, which is not officially supported. The safeguards have been added in Spark submit itself to prevent bad documentation from leading users down the wrong path in the future.
    
    This PR is prompted by countless headaches users of Spark have run into on the mailing list.
    
    Author: Andrew Or <andrewor14@gmail.com>
    
    Closes #1200 from andrewor14/submit-docs and squashes the following commits:
    
    5ea2460 [Andrew Or] Rephrase cluster vs client explanation
    c827f32 [Andrew Or] Clarify spark submit messages
    9f7ed8f [Andrew Or] Clarify client vs cluster deploy mode + add safeguards
    f17510e3
    History
    [SPARK-2259] Fix highly misleading docs on cluster / client deploy modes
    Andrew Or authored
    The existing docs are highly misleading. For standalone mode, for example, it encourages the user to use standalone-cluster mode, which is not officially supported. The safeguards have been added in Spark submit itself to prevent bad documentation from leading users down the wrong path in the future.
    
    This PR is prompted by countless headaches users of Spark have run into on the mailing list.
    
    Author: Andrew Or <andrewor14@gmail.com>
    
    Closes #1200 from andrewor14/submit-docs and squashes the following commits:
    
    5ea2460 [Andrew Or] Rephrase cluster vs client explanation
    c827f32 [Andrew Or] Clarify spark submit messages
    9f7ed8f [Andrew Or] Clarify client vs cluster deploy mode + add safeguards