Re: [HTCondor-users] cgroups in RHEL 7

[Todd Tannenbaum <tannenba@xxxxxxxxxxx>]

Just FYI, I created two tickets as a result of this discussion in hopes 
of making life easier for future HTCondor+cgroup+RHEL7/systemd users:

Documentation for using cgroups on RHEL7 insufficient
https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=4979

Possible missing packaging dependency for cgroups
https://htcondor-wiki.cs.wisc.edu/index.cgi/tktview?tn=4980

regards,
Todd



On 4/3/2015 10:04 AM, Brian Bockelman wrote:
> Hi Andrew,
>
> I forget the details of how Garhan set this up locally.  However, I think you want the base cgroup to be the same cgroup that systemd automatically creates.  Should be something like:
>
> BASE_CGROUP=/system.slice/condor.service
>
> (look at /proc/`pidof condor_master`/cgroup to see where things are.)
>
> It's also possible that newer versions of systemd are mounting the cgroup filesystem tree as read-only (but I think that's only the latest fedoras?).
>
> Brian
>
> > On Apr 3, 2015, at 9:49 AM, <andrew.lahiff@xxxxxxxxxx> <andrew.lahiff@xxxxxxxxxx> wrote:
> >
> > Hi,
> >
> > Is the cgroup support in HTCondor expected to work in RHEL 7/SL7? I've done a test using the standard way of enabling cgroups, i.e. I installed libcgroup-tools, added to /etc/cgconfig.conf:
> >
> > group htcondor {
> >         cpu {}
> >         cpuacct {}
> >         memory {}
> >         freezer {}
> >         blkio {}
> > }
> >
> > started cgconfig and added to the condor config:
> >
> > BASE_CGROUP = htcondor
> > CGROUP_MEMORY_LIMIT_POLICY = soft
> >
> > Directories such as /sys/fs/cgroup/memory/htcondor and /sys/fs/cgroup/cpu/htcondor were created as expected (including contents). However, when trying to run jobs, messages like this appeared in ProcLog:
> >
> > 03/29/15 08:48:07 : Setting cgroup to htcondor/condor_pool_condor_slot1_2@xxxxxxxxxxxxx for ProcFamily 28946.
> > 03/29/15 08:48:07 : Unable to create cgroup htcondor/condor_pool_condor_slot1_2@xxxxxxxxxxxxxx  Cgroup functionality will not work: Cgroup, operation not allowed
> >
> > The RHEL 7 documentation recommends not using libcgroup as it has been deprecated. Do we need to wait for HTCondor to support cgroups in a systemd compatible way, or is there a known way of getting it to work using libcgroup?
> >
> > For the record I'm using HTCondor 8.3.4 on SL7.
> >
> > Thanks,
> > Andrew.
> >
> >
> > _______________________________________________
> > HTCondor-users mailing list
> > To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> > subject: Unsubscribe
> > You can also unsubscribe by visiting
> > https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
> >
> > The archives can be found at:
> > https://lists.cs.wisc.edu/archive/htcondor-users/
>
>
> _______________________________________________
> HTCondor-users mailing list
> To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
> subject: Unsubscribe
> You can also unsubscribe by visiting
> https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users
>
> The archives can be found at:
> https://lists.cs.wisc.edu/archive/htcondor-users/


--
Todd Tannenbaum <tannenba@xxxxxxxxxxx> University of Wisconsin-Madison
Center for High Throughput Computing   Department of Computer Sciences
HTCondor Technical Lead                1210 W. Dayton St. Rm #4257
Phone: (608) 263-7132                  Madison, WI 53706-1685