Breaking News: Grepper is joining You.com. Read the official announcement!

python multiprocessing logging

Thankful Thrush answered on August 1, 2021 Popularity 9/10 Helpfulness 3/10

answer python multiprocessing logging

python multiprocessing logging

Comment

The only way to deal with this non-intrusively is to:

Spawn each worker process such that its log goes to a different file descriptor (to disk or to pipe.) Ideally, all log entries should be timestamped.
Your controller process can then do one of the following:
If using disk files: Coalesce the log files at the end of the run, sorted by timestamp
If using pipes (recommended): Coalesce log entries on-the-fly from all pipes, into a central log file. (E.g., Periodically select from the pipes' file descriptors, perform merge-sort on the available log entries, and flush to centralized log. Repeat.)

Popularity 9/10 Helpfulness 3/10 Language whatever

Source: Grepper

Tags: logging python-multiprocessing whatever

Link to this answer
Share Copy Link

Contributed on Aug 01 2021

Thankful Thrush

0 Answers Avg Quality 2/10

python multiprocessing logging

Contents

More Related Answers

python multiprocessing logging

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.