Breaking News: Grepper is joining You.com. Read the official announcement!

python bigquery example

Add Answer

CompSciGeek answered on April 17, 2022 Popularity 9/10 Helpfulness 1/10

answer python bigquery example

related python install bigquery

related bigquery data using python

python bigquery example

Comment

-1

# Here is a sample code from https://cloud.google.com/bigquery/docs/samples/bigquery-add-column-load-append#bigquery_add_column_load_append-python 

# from google.cloud import bigquery
# client = bigquery.Client()
# project = client.project
# dataset_ref = bigquery.DatasetReference(project, 'my_dataset')
# filepath = 'path/to/your_file.csv'

# Retrieves the destination table and checks the length of the schema
table_id = "my_table"
table_ref = dataset_ref.table(table_id)
table = client.get_table(table_ref)
print("Table {} contains {} columns.".format(table_id, len(table.schema)))

# Configures the load job to append the data to the destination table,
# allowing field addition
job_config = bigquery.LoadJobConfig()
job_config.write_disposition = bigquery.WriteDisposition.WRITE_APPEND
job_config.schema_update_options = [
    bigquery.SchemaUpdateOption.ALLOW_FIELD_ADDITION
]
# In this example, the existing table contains only the 'full_name' column.
# 'REQUIRED' fields cannot be added to an existing schema, so the
# additional column must be 'NULLABLE'.
job_config.schema = [
    bigquery.SchemaField("full_name", "STRING", mode="REQUIRED"),
    bigquery.SchemaField("age", "INTEGER", mode="NULLABLE"),
]
job_config.source_format = bigquery.SourceFormat.CSV
job_config.skip_leading_rows = 1

with open(filepath, "rb") as source_file:
    job = client.load_table_from_file(
        source_file,
        table_ref,
        location="US",  # Must match the destination dataset location.
        job_config=job_config,
    )  # API request

job.result()  # Waits for table load to complete.
print(
    "Loaded {} rows into {}:{}.".format(
        job.output_rows, dataset_id, table_ref.table_id
    )
)

# Checks the updated length of the schema
table = client.get_table(table)
print("Table {} now contains {} columns.".format(table_id, len(table.schema)))

Popularity 9/10 Helpfulness 1/10 Language python

Source: Grepper

Tags: python python-bigquery

Link to this answer
Share Copy Link

Contributed on Apr 17 2022

CompSciGeek

0 Answers Avg Quality 2/10

Closely Related Answers

python install bigquery

Comment

pip install google-cloud-bigquery

Popularity 9/10 Helpfulness 8/10 Language python

Source: pypi.org

Tags: python py

Link to this answer
Share Copy Link

Contributed on May 19 2022

TELLI Hichem

0 Answers Avg Quality 2/10

bigquery data using python

Comment

from google.cloud import bigquery

# Construct a BigQuery client object.
client = bigquery.Client()

query = """
    SELECT name, SUM(number) as total_people
    FROM `bigquery-public-data.usa_names.usa_1910_2013`
    WHERE state = 'TX'
    GROUP BY name, state
    ORDER BY total_people DESC
    LIMIT 20"""

query_job = client.query(query)  # Make an API request.

df = query_job.to_dataframe(max_results = 1000) # max_results - num of rows to get
print(df.head())

Popularity 9/10 Helpfulness 5/10 Language python

Source: Grepper

Tags: python py

Link to this answer
Share Copy Link

Contributed on Oct 11 2022

Rishabh Kesarwani

0 Answers Avg Quality 2/10

python bigquery example

Contents

More Related Answers

python bigquery example

Closely Related Answers

python install bigquery

bigquery data using python

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.