Problem with the pyspark library

(David Chavalarias) #1

There is apparently a pb with this library on Zeppelin :
The code :
import pyspark
from pyspark.sql import functions as sf

returns
console error: '.' expected but ';' found. from pyspark.sql import functions as sf

(Maziyar Panahi) #2

In order to use PySpark in Zeppelin, you need to explicitly mention the interpreter in the block (otherwise by default it’s Scala):

%pyspark
import pyspark
from pyspark.sql import functions as sf

Following explains all the available interpreters:

image

(David Chavalarias) #3

many thanks Maziyar, I indeed missed this point.