There are two phases of resolving python files path:
1) When launching spark:
the files need to be added to spark.executorEnv.PYTHONPATH
2) When executing python file via bridge:
the files need to be added to the process PYTHONPATH.
This is different than the previous phase because
this python process is spawned by datafu-spark, not by spark, and always on the driver.
There are two phases of resolving python files path:
1) When launching spark: the files need to be added to spark.executorEnv.PYTHONPATH
2) When executing python file via bridge: the files need to be added to the process PYTHONPATH. This is different than the previous phase because this python process is spawned by datafu-spark, not by spark, and always on the driver.