Breaking News: Grepper is joining You.com. Read the official announcement!

get data from s3 bucket python

Breakable Badger answered on December 1, 2021 Popularity 1/10 Helpfulness 1/10

answer get data from s3 bucket python

get data from s3 bucket python

Comment

Get data from s3 bucket python:

def s3_read(source, profile_name=None):
    """
    Read a file from an S3 source.

    Parameters
    ----------
    source : str
        Path starting with s3://, e.g. 's3://bucket-name/key/foo.bar'
    profile_name : str, optional
        AWS profile

    Returns
    -------
    content : bytes

    botocore.exceptions.NoCredentialsError
        Botocore is not able to find your credentials. Either specify
        profile_name or add the environment variables AWS_ACCESS_KEY_ID,
        AWS_SECRET_ACCESS_KEY and AWS_SESSION_TOKEN.
        See https://boto3.readthedocs.io/en/latest/guide/configuration.html
    """
    session = boto3.Session(profile_name=profile_name)
    s3 = session.client('s3')
    bucket_name, key = mpu.aws._s3_path_split(source)
    s3_object = s3.get_object(Bucket=bucket_name, Key=key)
    body = s3_object['Body']
    return body.read()

Popularity 1/10 Helpfulness 1/10 Language python

Source: Grepper

Tags: get python s3-bucket

Link to this answer
Share Copy Link

Contributed on Dec 01 2021

Breakable Badger

0 Answers Avg Quality 2/10

Closely Related Answers

read data from s3 bucket python

Comment

# read data from s3 bucket python
s3 = boto3.resource('s3')
bucket = s3.Bucket('test-bucket')
for object in bucket.objects.all():
    key = object.key
    body = object.get()['Body'].read()

Popularity 9/10 Helpfulness 4/10 Language python

Source: Grepper

Tags: s3-bucket python read-data

Link to this answer
Share Copy Link

Contributed on Feb 21 2022

visualscrapper

0 Answers Avg Quality 2/10

get data from s3 bucket python

Contents

More Related Answers

get data from s3 bucket python

Closely Related Answers

read data from s3 bucket python

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.