Importing vs Installing spark

I am new to the spark world and to some extent coding.

This question might seem too basic but please clear my confusion.

I know that we have to import spark libraries to write spark application. I use intellij and sbt. After writing the application , I can also run them and see the output on "run".

My question is, why should I install spark separately on my machine(local) if I can just import them as libraries and run them. Also what is the need for it to be installed on the cluster since we can just submit the jar file and jvm is already present in all the machines of the clustor

Thank you for the help!

https://stackoverflow.com/questions/67018828/importing-vs-installing-spark April 09, 2021 at 05:47PM