New posts in apache-spark-sql

How to perform union on two DataFrames with different amounts of columns in spark?

python apache-spark pyspark apache-spark-sql pyspark-dataframes

Pyspark: Split multiple array columns into rows

python apache-spark dataframe pyspark apache-spark-sql

Select a column value with at least two records with a condition (PYSPARK)

dataframe pyspark apache-spark-sql apache-spark

Better process or tools to deploy large number of Hive tables

apache-spark hive apache-spark-sql impala hcatalog

How to define schema for custom type in Spark SQL?

scala apache-spark apache-spark-sql case-class

How to control partition size in Spark SQL

apache-spark hive apache-spark-sql partitioning

Filter Pyspark dataframe column with None value

python apache-spark dataframe pyspark apache-spark-sql

How to create SparkSession with Hive support (fails with "Hive classes are not found")?

java apache-spark hive apache-spark-sql

How do I detect if a Spark DataFrame has a column

scala apache-spark dataframe apache-spark-sql

Spark SQL window function with complex condition

sql apache-spark pyspark apache-spark-sql window-functions

Spark Dataframe distinguish columns with duplicated name

python apache-spark dataframe pyspark apache-spark-sql

Spark Window Functions - rangeBetween dates

sql apache-spark pyspark apache-spark-sql window-functions

How do I add a new column to a Spark DataFrame (using PySpark)?

python apache-spark dataframe pyspark apache-spark-sql

Partitioning in spark while reading from RDBMS via JDBC

apache-spark jdbc apache-spark-sql partitioning

How can I change column types in Spark SQL's DataFrame?

scala apache-spark apache-spark-sql

Write a window function Spark

dataframe scala apache-spark apache-spark-sql window-functions

Multiple Aggregate operations on the same column of a spark dataframe

apache-spark dataframe apache-spark-sql

Encoder error while trying to map dataframe row to updated row

scala apache-spark apache-spark-sql apache-spark-dataset apache-spark-encoders

Load CSV file with Spark

python csv apache-spark pyspark apache-spark-sql

While writing to hdfs path getting error java.io.IOException: Failed to rename

apache-spark hadoop apache-spark-sql hdfs hadoop2