(Just tidying up some loose ends.)<\/p>\n
I once complained about Python Logging<\/a> and its performance for real-time systems. <\/p>\n It was suggested in the comments by the owner of the Python Logging module that I make a custom version for my needs. I protested that I didn’t think I was that special, and it should be available to everyone.<\/p>\n Nothing happened for a few weeks, until I got bitten by my inaction<\/a> and I decided I should try to make a solution for everyone. In that same post, I laid out the design for a solution that should work for everyone.<\/p>\n The next day, I pointed out a difficult problem with Python shutdown<\/a> which sounded like it should be a lot easier than it was.<\/p>\n One of the OddThinking regulars, configurator, pointed out<\/a> that I was being too thread-averse. Being willing to create threads more frequently gave me a simple solution. Performance tests showed I need not be that worried about the cost of threads in the typical case. Thanks, configurator. I proceeded with the implementation.<\/p>\n I have shared that solution with others, and it has earned a few raised eyebrows. However, configurator’s suggestion seems to be the only one that gives correct behaviour, which counts for an awful lot. It also, in the typical case, is quite performant.<\/p>\n The concern is that it may perform badly in the case of a run-away thread emitting log messages in an infinite loop. Without the plain logging solution, this would be I\/O bound, sending emails as quickly as it could, while the rest of the system kept performing normally. Under my implementation, I would expect the number of threads to explode. I assume this would have a heavy toll on other threads and processes in the operating system.<\/p>\n So I am still open to less thread-intensive implementations, I just don’t know what they are. Please revisit the discussion<\/a> if you have any ideas.<\/p>\n Anyway, I completed the implementation called the Nonblocking Log Handler, made it available in PyPI<\/a>, talked it up at a Python User’s Group, and I have been using it in anger for 2-3 months.<\/p>\n