Where shall I put my (Condor) log files?

As always, the correct answer is: It depends.

You can put your log files in your home, e.g. assuming your user name is MYUSER that would be /home/MYUSER. This has the benefit that all nodes can see your log files (if they need to) and these log files are automatically put into backup (on Atlas). However, this approach can slow down the Condor daemons on the submit host as they have to have access to the log files very often and doing this via NFS is a relatively slow way.

One solution is putting the log files under /local/user/MYUSER which mitigates the NFS issue, but this might be problematic if your compute jobs need to access these files (still possible but you have to take care to use the correct paths).

Our suggestion here to use the following path (assuming you are on submit machine atlasX): Put your log files under /atlas/user/atlasX/MYUSER as this is guaranteed to be the same path on any node, every node can access this area via NFS and on the submit host atlasX this gets automatically converted into a local mount, i.e. you get around the NFS overhead.

DocumentationForm edit

Title Where shall I put my (Condor) log files?
Description Placing Condor log files in the right location may speed up the execution of them
Tags condor log file path
Category User
Topic revision: r3 - 10 Feb 2012, ArthurVarkentin
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Foswiki? Send feedback