drop columns delta table

Anthony Taylor answered on April 19, 2022 Popularity 5/10 Helpfulness 3/10

answer drop columns delta table

drop columns delta table

Comment

schema='<schema>'
table='<table>'

columnstoDrop = ["<column or columns to drop>"]
display(spark.sql(f"describe table {schema}.{table}"))
df = spark.sql(f"Select * from {schema}.{table}")

df1 = df.drop(*columnstoDrop)

spark.sql(f"DROP TABLE if exists {schema}.{table}")

df1.write \
  .format(write_format) \
  .mode('overwrite') \
  .option("overwriteSchema", "true") \
  .save(f"{save_path}{table}")

spark.sql(f"CREATE  TABLE  {schema}.{table}  USING DELTA LOCATION '{save_path}{table}'")

display(spark.sql(f"describe table {schema}.{table}"))

Popularity 5/10 Helpfulness 3/10 Language python

Source: stackoverflow.com

Tags: delta drop python

Link to this answer
Share Copy Link

Contributed on Apr 19 2022

Anthony Taylor

0 Answers Avg Quality 2/10

drop columns delta table

Contents

More Related Answers

drop columns delta table

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.