[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [HTCondor-users] Help: How to use VM Universe? Thank you




Hi, thank you very much for your reply . And Also thank Brian Candler very much.
I create a raw disk file, and then modify the submit file as :  vm_disk=/data/kvm.raw:sda2:w    or     vm_disk=/data/kvm.raw:sda2:w:raw
However ,the result has not been changed. There are still VMGAHP_ERR_JOBCLASSAD_KVM_INVALID_DISK_PARAM error.
I try to add error=vm.err into the submit file. But the result is that :
 
Submitting job(s)
ERROR: You cannot use input, ouput, and error parameters in the submit description file for vm universe
 
In fact , There are two real server in the condor pool. such as A and B, both of them are using Centos OS, and also have been installed KVM, I am sure that the value of  parameter HasVM is True.
Now, I have download the  OS dvd file ,the file path is /data/linux_OS_ISO/CentOS-6.4-x86_64-bin-DVD1.iso .  It is stored on server A.
I want to use HTCondor to  create an vm Universe job ,that is to say ,I get a  virtual machine under KVM, and it should be stored in the file /data/kvm.raw
Since now, I guess that there is something wrong with my submittion file. The whole content of it is as follows:
 
universe                     = vm
executable                   = kvm_sample_job
log                          = sample.vm.log
# error                      = vm.err
vm_type                      = kvm
vm_memory                    = 2048
# should_transfer_files = YES
when_to_transfer_output = ON_EXIT
transfer_input_files = /data/linux_OS_ISO/CentOS-6.4-x86_64-bin-DVD1.iso,/data/kvm.raw
# /data/kvmswap.img
# vm_cdrom_files=/data/linux_OS_ISO/CentOS-6.4-x86_64-bin-DVD1.iso
# vm_should_transfer_cdrom_files=True
vm_checkpoint=True
vm_disk=/data/kvm.raw:sda2:w
# kvm_cdrom_device=/media/cdrom
queue
 
 
Can you help me to check this file ?Thank you very much.
I also want to know how to make the vm get a static IP address with Bridge style ?
Thanks again.
Best regards.

btdan
 
Date: 2013-05-15 21:54
Subject: Re: [HTCondor-users] Help: How to use VM Universe? Thank you
inline below...


From: "btdan" <btdan@xxxxxxx>
To: "Brian Candler" <B.Candler@xxxxxxxxx>
Cc: "HTCondor-Users Mail List" <htcondor-users@xxxxxxxxxxx>
Sent: Wednesday, May 15, 2013 7:41:19 AM
Subject: Re: [HTCondor-users] Help: How to use VM Universe? Thank you

Thank you for your reply.
I have already modified the BIOS setup of the server in order to support the virtualization. And now I make sure the kvm is running now.
And I also modified the condor_config file to support the vm, and the HasVM parameter is True .
The submit file is as follows:
universe                     = vm
executable                   = kvm_sample_job
log                          = sample.vm.log
vm_type                      = kvm
vm_memory                    = 2048
# should_transfer_files = YES
# when_to_transfer_output = ON_EXIT
# transfer_input_files = /data/linux_OS_ISO/CentOS-6.4-x86_64-bin-DVD1.iso
# /data/kvmswap.img
# vm_cdrom_files=/data/linux_OS_ISO/CentOS-6.4-x86_64-bin-DVD1.iso
# vm_should_transfer_cdrom_files=True
vm_checkpoint=True
vm_disk=/data/kvmswap.img:sda2:w:ext4

It's likely falling over on *this line ^^ 
ext4 is not an image format.  e.g. raw, qcow, qcow2 are image formats.  In general, it's usually not needed unless it's raw.


# kvm_cdrom_device=/media/cdrom
queue
After I condor_submit this file. The result of condor_q -better-analyze id  of this job is:
The Requirements _expression_ for your job reduces to these conditions:
         Slots
Step    Matched  Condition
-----  --------  ---------
[1]          48  TARGET.HasVM
[3]          48  TARGET.VM_Type == "kvm"
[5]          48  TARGET.VM_AvailNum > 0
[11]         48  TARGET.FileSystemDomain == MY.FileSystemDomain
[15]         48  TARGET.VM_Memory >= 2048
Suggestions:
    Condition                         Machines Matched    Suggestion
    ---------                         ----------------    ----------
1   ( TARGET.HasVM )                  48
2   ( TARGET.VM_Type == "kvm" )       48
3   ( TARGET.VM_AvailNum > 0 )        48
4   ( TARGET.FileSystemDomain == "xxxx.com" )48
5   ( TARGET.VM_Memory >= 2048 )      48
6   ( TARGET.Arch == "X86_64" )       56
7   ( TARGET.Disk >= 0 )              56
8   ( TARGET.HasFileTransfer )        56
9   ( TARGET.TotalMemory >= 2048 )    56
10  ( ( MY.CkptArch == target.Arch ) || ( MY.CkptArch is undefined ) )
                                      56
11  ( ( MY.VM_CkptMac is undefined ) || ( TARGET.VM_All_Guest_Macs is undefined ) || ( stringListIMember(MY.VM_CkptMac,TARGET.VM_All_Guest_Macs,",") == false ) )
                                      56
However ,I get the message from /var/log/condor/ShadowLog  as follows:
05/15/13 20:05:47 Using config source: /etc/condor/condor_config
05/15/13 20:05:47 Using local config sources:
05/15/13 20:05:47    /etc/condor/condor_config.local
05/15/13 20:05:47 DaemonCore: command socket at <111.111.11.220:47405?noUDP>
05/15/13 20:05:47 DaemonCore: private command socket at <111.111.11.220:47405>
05/15/13 20:05:47 Setting maximum accepts per cycle 8.
05/15/13 20:05:47 Initializing a VM shadow for job 21.0
05/15/13 20:05:47 (21.0) (5521): Request to run on slot1@xxxxxxxxxxxxxxx <111.111.11.206:53684> was ACCEPTED
05/15/13 20:05:47 (21.0) (5521): File transfer completed successfully.
05/15/13 20:06:07 (21.0) (5521): Job 21.0 going into Hold state (code 6,0): Error from slot1@xxxxxxxxxxxx: VMGAHP_ERR_JOBCLASSAD_KVM_INVALID_DISK_PARAM
05/15/13 20:06:07 (21.0) (5521): **** condor_shadow (condor_SHADOW) pid 5521 EXITING WITH STATUS 112
I google the keyword VMGAHP_ERR_JOBCLASSAD_KVM_INVALID_DISK_PARAM, but I get nothing useful.
The parameter of vm_disk in the submiting file is /data/kvmswap.img, it is created with the following command:
  dd if=/dev/zero of=kvm_swap.img count=1000000
  mkfs.ext4 kvm_swap.img
Can somebody tell me how to solve this problem ?
Or give me an sampe submit file ?
Thanks a lot.

btdan
Date: 2013-05-14 22:18
Subject: Re: Re: Re: [HTCondor-users] Help: How to use VM Universe? Thank you
On Tue, May 14, 2013 at 09:42:36PM +0800, btdan wrote:
>         56 are rejected by your job's requirements
...
>        Condition                         Machines Matched    Suggestion
>        ---------                         ----------------    ----------
>    1   ( TARGET.HasVM )                  0                   MODIFY TO
>    false
>    2   ( TARGET.VM_Type == "kvm" )       0                   REMOVE
>    3   ( TARGET.VM_AvailNum > 0 )        0                   REMOVE
>    4   ( TARGET.Disk >= 75000000 )       0                   MODIFY TO
>    1727434
>    5   ( TARGET.VM_Memory >= 2048 )      0                   REMOVE
There in black-and-white is why your job isn't running.
* You asked it to run only on machines which are advertising HasVM = True.
  None of them match this condition.
* You asked it to run only on machines which have VM_Type == "kvm". None do.
* You asked it to run only on machines where VM_AvailNum > 0. None do.
* You asked it to run on machines with >=75GB of disk space. None do.
  It hints that only 1.7GB is actually free.
* You asked it to run only on machines with VM_Memory >= 2048. None do.
You clearly need to make config changes on your *execution* nodes to give
them the capability to run VMs, and to announce this capability in their
MachineAd.
>    It seems that the kvm is not running?
Of course not. Condor hasn't found any machine in your cluster which is
suitable to run this job, so it hasn't started anywhere.
So let's go back to your original mail:
"I want to use VM Universe. And follwing the instruction."
Which instruction exactly are you follwing?  Give the URL.  I suspect you
have missed out a huge chunk.
Regards,
Brian.

_______________________________________________
HTCondor-users mailing list
To unsubscribe, send a message to htcondor-users-request@xxxxxxxxxxx with a
subject: Unsubscribe
You can also unsubscribe by visiting
https://lists.cs.wisc.edu/mailman/listinfo/htcondor-users

The archives can be found at:
https://lists.cs.wisc.edu/archive/htcondor-users/