Tokenize String

Vinay Rawal answered on April 2, 2023 Popularity 4/10 Helpfulness 1/10

answer Tokenize String

Comment

When we split the string, it breaks down into smaller pieces and these smaller pieces are called tokens.

my_string = “Audi,BMW,Ferrari”
tokens = my_string.split(‘,’))
print(“String tokens are: “, tokens

Popularity 4/10 Helpfulness 1/10 Language python

Source: Grepper

Tags: python string tokenize

Link to this answer
Share Copy Link

Contributed on Apr 02 2023

Vinay Rawal

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

Oops, You will need to install Grepper and log-in to perform this action.