英伟达
直播中

廖丽霞

7年用户 149经验值
私信 关注
[问答]

GRID K1卡MMIO内存不足

我在PowerEdge R730中使用了单个GRID K1卡,该卡在我升级BIOS和其他固件之前一直运行良好。
现在,我在启动时收到一条警告:“由于MMIO内存不足,无法为一个或多个PCIe设备分配MMIO资源”。
我可以启用高于4 GB的MMIO设置并且错误消失,但VMware ESXi不支持此设置。
我已将其禁用,点击F1以绕过消息,GRID卡仍然出现(它也是唯一的PCI设备)。
我的问题是,我是否应该担心稳定性,因为警告声称该卡试图将内存映射到4 GB以上的限制?
如果禁用该设置,GRID卡是否仍会尝试将内存映射到4 GB以上的屏障?
我担心的是,GRID卡最初使用低于4 GB屏障的内存,最终可能通过它导致PSOD或其他来宾虚拟机或主机崩溃。
我之前遇到过GRID K1和PowerEdge R720(长线程:https://communities.vmware.com/thread/488038)的稳定性问题,并希望确保第13代PowerEdge设备的这种设置稳定。

以上来自于谷歌翻译


以下为原文

I'm using a single GRID K1 card in a PowerEdge R730 that was working great until I upgraded the BIOS and some other firmware.  Now, I get a warning on boot that says "Unable to allocate MMIO resources for one of more PCIe devices because of insufficient MMIO memory".  I can enable the MMIO above 4 GB setting and the error goes away, but VMware ESXi doesn't support this setting.  I've left it disabled, hit F1 to bypass the message, and the GRID card still appears (it's the only PCI device too).  My question is, should I be worried about stability since the warning claims that the card is trying to map memory above the 4 GB limit?  With the setting disabled, will the GRID card still attempt to map memory above the 4 GB barrier?  My concern is that the GRID card initially uses memory below the 4 GB barrier and eventually could pass it resulting in a PSOD or some other guest VM or host crash.  I've had previous stability issues with a GRID K1 and a PowerEdge R720 (long thread here: https://communities.vmware.com/thread/488038) and want to make sure that this setup on 13th gen PowerEdge equipment is stable.

回帖(7)

郑雅颖

2018-10-8 14:13:59
约翰,
我不是当前的ESXi用户,但据我所知,限制是基于底层虚拟机管理程序无法支持32位以上的XenServer版本的内存映射(因此在XenServer 6.5之前)。
如果ESXi基于64位操作系统,除非另有说明,否则您应该可以使用> 4 GB内存映射。
如果不是,则需要保持低于4 GB的边界。
您是否查看了NVIDIA文档以了解其安装设置建议是什么?
它是否表明ESXi不支持更高内存映射设置?
你必须拥有相当数量的设备才能触发甚至需要更高的内存映射 - 至少我从未在XenServer 6.2(32位)中看到这一点。
最重要的是,作为lomg工作并且稳定,应该没问题,但VMware和NVIDIA应该有特定的文档说明设置应该是什么。
如果仍有问题,您可能需要打开支持案例。

以上来自于谷歌翻译


以下为原文

John,
I'm not a current ESXi user, but as I understand it, the limitation was based on the underlying hypervisor not being able to support memory mapping above 4 GB for the XenServer versions that were 32-bit (so prior to XenServer 6.5). If ESXi is based on a 64-bit OS, you should be fine with the >4 GB memory mapping unless stated otehrwise. If not, you need to stay below the 4 GB boundary. Did you check the NVIDIA documentation to see what its installation setting recommendations are? WHere does it state that ESXi doesn't support the higher memory mapping setting? You must have a fair number of devices in there to trigger even needing the higher memory mapping -- I never saw this with XenServer 6.2 (32-bit), at least.
The bottom line is that as lomg as it works and is stable ot should be OK, but there should be specific documentation from both VMware and NVIDIA that state what the settings should be. If there is still an issue, you might need to open a support case.
举报

罗莹

2018-10-8 14:29:42
我和Dell和VMware一起打开了一些案例。
戴尔建议启用此设置,而VMware表示完全相反,并且此处有一个KB:http://kb.vmware.com/selfservice/microsites/search.do?language = en_US& cmd = displayKC& externalId = 2050443。
我相信NVIDIA建议启用该设置。
奇怪的是,我能够让两个PCI-e设备在最初禁用的设置下工作。
升级BIOS后,即使我禁用除GRID卡所在的插槽6之外的所有PCI-e插槽,我也会在启动时收到警告消息。
我不确定为什么在硬件配置没有改变时会出现错误。

以上来自于谷歌翻译


以下为原文

I opened cases a little while back with both Dell and VMware.  Dell recommends that the setting be enabled while VMware says the exact opposite and has a KB here: http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=2050443.  I believe NVIDIA recommends that the setting be enabled.  The strange thing is that I was able to get both PCI-e devices to work with the setting disabled initially.  After I upgraded the BIOS, I get the warning message on boot, even if I disable all PCI-e slots except for Slot 6 where the GRID card is.  I'm not sure why the error would appear when the hardware configuration has not changed.
举报

王艳

2018-10-8 14:37:57
嗨,约翰:这两个供应商互相矛盾的事实让我觉得这可能是一个错误。
任何64位操作系统都应该能够支持4 GB以上的标记,前提是BIOS不是限制因素。
您是否在服务器上运行最新的BIOS级别?

以上来自于谷歌翻译


以下为原文

Hi, John: The fact that the two vendors contradict each other makes me also think it may be a bug. Any 64-bit OS should be able to support above the 4 GB mark providing the BIOS isn't a limiting factor. Are you running the latest BIOS level on your server?
举报

蓝孝增

2018-10-8 14:55:58
在ESXi中,您必须将MMIO设置为低于4G。
VMware文章是正确的。
尽管ESXi是64位虚拟机管理程序,但它仍然具有此限制。
如果主机中只有一个GRID卡,并且当设置了低于4G的MMIO时ESXi无法启动,那么服务器就会出现问题。
确保您已为性能配置了所有其他设置。

以上来自于谷歌翻译


以下为原文

In ESXi you have to have MMIO set to below 4G. The VMware article is correct. Although ESXi is a 64bit hypervisor it still has this restriction.

If there is only a single GRID card in the host and ESXi is failing to boot when MMIO below 4G is set, then there is an issue with the server somewhere. Ensure you've got all other settings configured for performance.
举报

更多回帖

发帖
×
20
完善资料,
赚取积分