New posts in apache-spark

Setting textinputformat.record.delimiter in spark

scala hadoop mapreduce apache-spark

Converting mysql table to spark dataset is very slow compared to same from csv file

java mysql apache-spark jdbc amazon-s3

Why does starting a streaming query lead to "ExitCodeException exitCode=-1073741515"?

windows apache-spark spark-structured-streaming

Access Array column in Spark

arrays scala apache-spark apache-spark-sql classcastexception

reading json file in pyspark

apache-spark pyspark spark-streaming

Spark textFile vs wholeTextFiles

scala apache-spark file-io

Retain keys with null values while writing JSON in spark

java json apache-spark apache-spark-sql

How to upgrade Spark to newer version?

apache-spark

Reduce a key-value pair into a key-list pair with Apache Spark

python apache-spark mapreduce pyspark rdd

How to deal with executor memory and driver memory in Spark?

memory-management apache-spark

Spark sql top n per group

apache-spark group-by apache-spark-sql top-n

How to reduce the verbosity of Spark's runtime output?

scala apache-spark

Spark iterate HDFS directory

hadoop hdfs apache-spark

update query in Spark SQL

apache-spark apache-spark-sql

collect() or toPandas() on a large DataFrame in pyspark/EMR

pandas apache-spark pyspark emr amazon-emr

Spark specify multiple column conditions for dataframe join

apache-spark apache-spark-sql rdd

How to export data from Spark SQL to CSV

hadoop apache-spark export-to-csv hiveql apache-spark-sql

spark-shell error on Windows - can it be ignored if not using hadoop?

apache-spark

How to assign unique contiguous numbers to elements in a Spark RDD

apache-spark apache-spark-mllib

How to transpose an RDD in Spark

scala apache-spark rdd