Notes

Notes

If you use --master local with only one thread, you may notice that your log lines are missing from the driver’s output. That’s because in Spark Streaming, for example, that single thread is used to read streaming data from a source, and the driver wouldn’t have any threads left to print out the results of your program. If you want the output printed to your log file, be sure to specify at least two threads (local[2]) when running spark streaming in local mode.