RE: [Xen-users] nvidia drivers do not seem to work on xen kernels

["Chulmin Kim" <cmkim@xxxxxxxxxxxxxxxx>]

I'm also searching the solution of what you've asked here. 

I tried two kinds of xen environment 

1. Xen 4.0.2 + 2.6.32 pvops dom0 kernel
 -> all apps failed.
 -> error message (dmesg), NVRM: PAT Configuration unsupported + NVRM: 
RmInitAdapter failed! (0x27:0x38:1047)
 -> app error message, /dev/nvidia0 io failed

2. Xen 3.2 + 2.6.18 (centos 5.5) dom0 kernel
 -> device query is possible, while bandwidth test failed
 -> error message (dmesg), NVRM: bad caching on address 0xffff8805b62cd000: 
actual 0x77 != expected 0x73
 -> app error message, cudasafecall runtime api error : all CUDA-available 
device is busy or unavailable



Do we need special kernel options for it? (especially related with PCI such as 
Passthrough or VPCI ..)

I also spent the whole week... 

I'm ready to do anything from formatting the disk to meeting the devil.. 

Please, help me out! 



>-----Original Message-----
>From: xen-users-bounces@xxxxxxxxxxxxxxxxxxx [mailto:xen-users-
>bounces@xxxxxxxxxxxxxxxxxxx] On Behalf Of Jorg Lotze
>Sent: Saturday, May 07, 2011 12:07 AM
>To: xen-users@xxxxxxxxxxxxxxxxxxx
>Subject: [Xen-users] nvidia drivers do not seem to work on xen kernels
>
>Hi guys,
>
>I spent the whole week trying to setup a Ubuntu 10.04 64-bit machine for
>Xen virtualization (Xen 4.1) for GPGPU tests on several virtual machines
>(using Xen's GPU passthrough capability). My problem is that I just can't
>get the nvidia development driver to work on the xen kernel (works
>perfectly fine with the standard kernel).
>
>For compiling the kernel, I followed the instructions from
>http://www.zeroaccess.org/2011/04/xen-4-1-on-ubuntu-10-04-64bit/ (but built
>the kernel the debian way (make-kpkg) to get a nice .deb package).
>It boots fine, I modified grub to set the kernel options, etc. All the Xen
>setup seems to be working as it should.
>
>I can't get the NVIDIA driver working on the host (Dom0) though. I used the
>driver with CUDA 3.2, and also the 4.0 RC2 driver (for a GTX 590 card).
>When the system tries to start X11, the screen turns blank and the system
>gets very slow. Booting the system into text mode works fine.
>I can load the nvidia driver manually (modprobe nvidia), and create the
>device nodes in /dev using mknode (so I have the /dev/nvidia0, /dev/nvidia1,
>/dev/nvidiactl - with major number 195, and minors 0, 1, 255, respectively).
>When I try to build anything using OpenCL, it just reports that no
>platforms have been found. With CUDA, I get the error: "cudaSafeCall()
>Runtime API error : invalid device ordinal." Both work completely fine when
>I boot the system into a standard kernel (linux-image-generic, default with
>ubuntu 10.04).
>
>The X11 log just says that it failed to load the NVIDIA module. Syslog
>gives messages like "NVRM: RmInitAdapter failed!" .
>
>I tried various suggestions for installing the the driver found on the web
>(e.g., http://wiki.xensource.com/xenwiki/NvidiaGPU?highlight=%
>28nvidia%29 ) but with no success.
>
>Did any of you get NVIDIA and Xen work together?? How? Any help is
>appreciated!
>
>Jorg



_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-users