Python logging library not importing in metaflow pipeline

[aarthi-subramanian]

Context-

• Hi! For logging, usually python's standard library import logging and then can run logging.info('Pipeline starting!') etc.
• This ^ works in .py files . But if I try this ^ in metaflow steps, it doesnt work
• Also couldnt find a metaflow built-in logging function

Issues-

• Why doesnt python's logging library work with metaflow steps?
• What is the best, cleanest logging framework to use with metaflow? (I would really really like to avoid print statements 🙏 )

[savingoyal]

how are you configuring your logger? do you have something of the order of

logging.basicConfig(level=logging.INFO, stream=sys.stdout)

after you have imported logging?

[aarthi-subramanian]

how are you configuring your logger? do you have something of the order of

logging.basicConfig(level=logging.INFO, stream=sys.stdout)

after you have imported logging?

hi! like this in a utils.py file-->

import logging

def set_up_logging(level='INFO'):
    logging.basicConfig(
        level=getattr(logging, level),
        format="%(asctime)s %(levelname)s %(name)s: %(message)s"
    )

and then i point to it in my main flow.py and try to do-

import logging

@step
def start(self):        
        # Set up logging framework for pipeline
        set_up_logging()

        print("Hello world- print!") # works!
        logging.info("Hello world- logger!") # doesnt work!
        
        self.next(self.merge)

[savingoyal]

what happens if you pull set_up_logging to right after the import?