[SPDK] spdk exits with failure if hugemem is very large

Lance Hartmann ORACLE lance.hartmann at oracle.com
Wed Oct 24 13:53:26 PDT 2018


> On Oct 16, 2018, at 4:28 AM, wuzhouhui <wuzhouhui14 at mails.ucas.ac.cn> wrote:
> 
> 
>> -----Original Messages-----
>> From: wuzhouhui <wuzhouhui14 at mails.ucas.ac.cn>
>> Sent Time: 2018-10-16 17:18:47 (Tuesday)
>> To: "storage performance development kit" <spdk at lists.01.org>
>> Cc: 
>> Subject: [CASS SPAM]Re: [SPDK] [CASS SPAM]Re: [CASS SPAM]Re: spdk exits with failure if hugemem is very large
>> 
>>> -----Original Messages-----
>>> From: wuzhouhui <wuzhouhui14 at mails.ucas.ac.cn>
>>> Sent Time: 2018-10-16 09:32:09 (Tuesday)
>>> To: "storage performance development kit" <spdk at lists.01.org>
>>> Cc: 
>>> Subject: [CASS SPAM]Re: [SPDK] [CASS SPAM]Re: spdk exits with failure if hugemem is very large
>>> 
>>>> -----原始邮件-----
>>>> 发件人: "Stojaczyk, Dariusz" <dariusz.stojaczyk at intel.com>
>>>> 发送时间: 2018-10-15 21:18:40 (星期一)
>>>> 收件人: "Storage Performance Development Kit" <spdk at lists.01.org>
>>>> 抄送: 
>>>> 主题: [CASS SPAM]Re: [SPDK] spdk exits with failure if hugemem is very large
>>>> 
>>>> I could guess you're hitting a max virtual memory limit. 
>> The manual of mmap() says:
>> 
>> ENOMEM  The  process's  maximum number of mappings would have been exceeded. 
>>        This error can also occur for munmap(), when unmapping a region in 
>>        the middle of an existing mapping, since this results in two smaller  
>>        mappings  on either side of the region being unmapped.
>> 
>> I also write a demo to mmap() 69632 files, each file is 8-bytes long. The demo
>> report error when mmap() 65515th file. So it is the limit of number of mappings
>> that kernel enforced, although I haven't check kernel code.
> Ok, I find it. The /proc/sys/vm/max_map_count controls this limit. The default
> value is 65535.


I had run into this problem on a system with a lot of memory as well.   Increasing vm.max_map_count to a larger number resolved the problem for us.

--
Lance Hartmann
lance.hartmann at oracle.com





More information about the SPDK mailing list