[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Submission to remote slurm cluster is Failing consistently



I am not really sure how to do that. I will explore how to run a job directly to slurm and will get back to you with the output.


Meanwhile, if you know any relevant documentation, kindly share. 

thanks 

regards
Hasan

On Feb 2, 2021, at 1:53 PM, Jaime Frey <jfrey@xxxxxxxxxxx> wrote:

BOSCO and HTCondor donât use the -q/--qos command-line option when submitting a job to Slurm. There is a way to have them set the -p/--partition option, but the bosco_cluster tool doesnât use it when testing a new setup.

Can you try submitting a job directly to Slurm on the cluster login node without using the -p or -q options of sbatch?

 - Jaime

On Feb 2, 2021, at 12:43 PM, hasanbaigg@xxxxxxxxx wrote:

Thanks for your concerns,

I will look into the qos documentation. Meanwhile, would expect any SLURM expert to chip in.

regards
Hasan

On Feb 2, 2021, at 1:32 PM, christoph.beyer@xxxxxxx wrote:

Uh,

hopefully someone with slurm experience can jump in here (I better stick to my alternative HTC facts) :D :D :D

As far as I know the partition you use is defined with a list of possible qos (default,debug) for ex. in the submit you can request the qos with the '-q' option.

scontrol show part <partname>

It looks like your job coming from the HTC side of things is requesting a qos that is not defined for the partition you want to use. 

Unfortunately that is even thinner ice for me than usualy on this list :(

Also I did not fully get the concept of slurm at the time and started using condor instead ;)

But you seem to be on the right track, and should check the documentation about qos and how to define them for partiions and users alike:


Best
christoph




--
Christoph Beyer
DESY Hamburg
IT-Department

Notkestr. 85
Building 02b, Room 009
22607 Hamburg

phone:+49-(0)40-8998-2317
mail: christoph.beyer@xxxxxxx


Von: hasanbaigg@xxxxxxxxx
An: "htcondor-users" <htcondor-users@xxxxxxxxxxx>
CC: "bosco-discuss" <bosco-discuss@xxxxxxxxxxxxxxxxxxx>
Gesendet: Dienstag, 2. Februar 2021 18:53:07
Betreff: Re: [HTCondor-users] Submission to remote slurm cluster is Failing consistently

Hi,

Now I ran it on the server (where bosco node is hosted) and it shows me the following output 
     User   Def Acct     Admin    Cluster    Account  Partition     Share MaxJobs MaxNodes  MaxCPUs MaxSubmit     MaxWall  MaxCPUMins                  QOS   Def QOS 
---------- ---------- --------- ---------- ---------- ---------- --------- ------- -------- -------- --------- ----------- ----------- -------------------- --------- 
     hbaig  pi-mendes      None     xanadu  pi-mendes                    1                                                             general,himem,speci+           
-bash-4.2$ 


Could you please tell me if it tells something meaningful which needs to be fixed.

regards
Hasan

On Feb 2, 2021, at 12:37 PM, christoph.beyer@xxxxxxx wrote:

acctmgr show user <user> withassoc 


_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/
_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/