Breaking News: Grepper is joining You.com. Read the official announcement!

python outlier dataframe

Ty Wang answered on August 18, 2022 Popularity 9/10 Helpfulness 8/10

answer python outlier dataframe

related df outlier

python outlier dataframe

Comment

def remove_outlier(df_in, col_name):
    q1 = df_in[col_name].quantile(0.25)
    q3 = df_in[col_name].quantile(0.75)
    iqr = q3-q1 #Interquartile range
    fence_low  = q1-1.5*iqr
    fence_high = q3+1.5*iqr
    df_out = df_in.loc[(df_in[col_name] > fence_low) & (df_in[col_name] < fence_high)]
    return df_out

Popularity 9/10 Helpfulness 8/10 Language python

Source: Grepper

Tags: dataframe python

Link to this answer
Share Copy Link

Contributed on Aug 28 2022

Ty Wang

0 Answers Avg Quality 2/10

Closely Related Answers

df outlier

Comment

# generate base summary df using pd describe() function.
summary_df = Df.describe() # www.athulmathew.com

# dict intitialisation.
myu_sigma_dict = dict()
myupsigma_dict = dict()
outlier_dict = dict()
outlier_pct_dict = dict()

# index column defenition.
myu_sigma_dict["index"] = "µ-3σ"
myupsigma_dict["index"] = "µ+3σ"
outlier_dict["index"] = "outlier count"
outlier_pct_dict["index"] = "outlier(%)"
for col in summary_df.columns:
    myu = summary_df[col]["mean"]
    sigma = summary_df[col]["std"]
    myu_sigma_dict[col] = (myu - 3*sigma)
    myupsigma_dict[col] = (myu + 3*sigma)
    outlier_dict[col] = Df[(Df[col] < (myu - 3*sigma)) | (Df[col] > (myu + 3*sigma))].shape[0]
    outlier_pct_dict[col] = outlier_dict[col]*100/summary_df[col]["count"]

    # replace outlier with (myu - 3*sigma) and (myu + 3*sigma).
    Df.loc[Df[col] < (myu - 3*sigma), col] = (myu - 3*sigma)
    Df.loc[Df[col] > (myu + 3*sigma), col] = (myu + 3*sigma)

# add the newly created metrics to summary df.
summary_df = summary_df.reset_index()
summary_df = summary_df.append( myu_sigma_dict , ignore_index=True)
summary_df = summary_df.append( myupsigma_dict , ignore_index=True)
summary_df = summary_df.append( outlier_dict, ignore_index=True)
summary_df = summary_df.append( outlier_pct_dict, ignore_index=True)

display(summary_df)

Popularity 7/10 Helpfulness 2/10 Language python

Source: Grepper

Tags: python

Link to this answer
Share Copy Link

Contributed on Aug 18 2022

Athul Mathew

0 Answers Avg Quality 2/10

python outlier dataframe

Contents

More Related Answers

python outlier dataframe

Closely Related Answers

df outlier

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.