Thank you for your donation!


Cloudsmith graciously provides open-source package management and distribution for our project.


Official moOde 7.1.0 support thread
Since I've updated to 7.1.0 I've been getting page allocation failure messages. The system remains stable after boot for a good number of hours and then goes unresponsive (no access via ssh or through the web interface, but it can still be pinged and respond to port scans from the LAN. After a period of time (not quite sure how long) it then starts responding again, but I find dmesg contains kernel errors (sample pasted below). The hardware has previously been good and has run moode v6.x very stably for long periods (it's a Pi 3b+, integrated wifi and BT are off though I do have a bluetooth dongle attached via USB) and I've had no trouble with the microSD card. Power is supplied from a good brand PSU (Mean Well) adjusted to provide just over 5.1V to the 40 pin header voltage pins.

Is this likely to be a sign of possible hardware failure, or possibly a problem with moode itself ? Happy to carry out anything that might help resolve the issue if you think it goes beyond my specific hardware.

Code:
[81589.720601]   node 0: slabs: 92, objs: 1416, free: 0
[81589.727049] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[81589.727054]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[81589.727058]   node 0: slabs: 92, objs: 1416, free: 0
[81589.752495] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[81589.752500]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[81589.752504]   node 0: slabs: 92, objs: 1416, free: 0
[81589.758492] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[81589.758497]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[81589.758501]   node 0: slabs: 92, objs: 1416, free: 0
[81589.764495] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[81589.764499]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[81589.764503]   node 0: slabs: 92, objs: 1416, free: 0
[81589.770950] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[81589.770955]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[81589.770958]   node 0: slabs: 92, objs: 1416, free: 0
[81589.935765] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[81589.935771]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[81589.935777]   node 0: slabs: 92, objs: 1416, free: 0
[82980.299635] warn_alloc: 10 callbacks suppressed
[82980.299652] kworker/0:0H: page allocation failure: order:0, mode:0x40800(GFP_NOWAIT|__GFP_COMP), nodemask=(null),cpuset=/,mems_allowed=0
[82980.299677] CPU: 0 PID: 6141 Comm: kworker/0:0H Tainted: G         C        5.4.77-v7+ #1371
[82980.299681] Hardware name: BCM2835
[82980.299698] Workqueue: kblockd blk_mq_run_work_fn
[82980.299704] Backtrace:
[82980.299722] [<8010dfa4>] (dump_backtrace) from [<8010e324>] (show_stack+0x20/0x24)
[82980.299733]  r7:ffffffff r6:00000000 r5:60000093 r4:80e97f70
[82980.299748] [<8010e304>] (show_stack) from [<80900d54>] (dump_stack+0xd8/0x11c)
[82980.299763] [<80900c7c>] (dump_stack) from [<802d7aa0>] (warn_alloc+0xd4/0x168)
[82980.299774]  r10:00000000 r9:80e04f88 r8:ffffe000 r7:80bbf8a4 r6:00000000 r5:00000000
[82980.299781]  r4:80e04f88 r3:e51a8c20
[82980.299793] [<802d79cc>] (warn_alloc) from [<802d8ccc>] (__alloc_pages_nodemask+0x1198/0x1270)
[82980.299799]  r3:00000000 r2:80bbf8a4
[82980.299809]  r8:00000000 r7:00040800 r6:80e04f88 r5:00000201 r4:00000200
[82980.299822] [<802d7b34>] (__alloc_pages_nodemask) from [<802e97c8>] (new_slab+0x2a8/0xbe4)
[82980.299834]  r10:00000008 r9:00040800 r8:b6401a00 r7:00000000 r6:80e04f88 r5:b6401a00
[82980.299838]  r4:00000000
[82980.299851] [<802e9520>] (new_slab) from [<802ec620>] (___slab_alloc.constprop.29+0x33c/0x53c)
[82980.299862]  r10:b6b2f2b0 r9:8060494c r8:b6401a00 r7:00000000 r6:00000900 r5:b6400ec0
[82980.299867]  r4:00000000
[82980.299880] [<802ec2e4>] (___slab_alloc.constprop.29) from [<802ec864>] (__slab_alloc.constprop.28+0x44/0x90)
[82980.299891]  r10:000d0418 r9:8060494c r8:b6b2f2b0 r7:8060494c r6:00000900 r5:b6401a00
[82980.299896]  r4:60000013
[82980.299908] [<802ec820>] (__slab_alloc.constprop.28) from [<802ecb90>] (__kmalloc+0x2e0/0x2e8)
[82980.299919]  r9:8060494c r8:00000900 r7:0000014c r6:b6401a00 r5:00000000 r4:b6401a00
[82980.299935] [<802ec8b0>] (__kmalloc) from [<8060494c>] (bcm2835_dma_create_cb_chain+0x64/0x34c)
[82980.299946]  r10:000d0418 r9:00000000 r8:7e202040 r7:00000002 r6:00000020 r5:b672c240
[82980.299951]  r4:b672c240
[82980.299965] [<806048e8>] (bcm2835_dma_create_cb_chain) from [<80605158>] (bcm2835_dma_prep_slave_sg+0x140/0x310)
[82980.299976]  r10:40000000 r9:00000000 r8:b5f3d800 r7:00000002 r6:00000020 r5:00000000
[82980.299981]  r4:b672c240
[82980.299998] [<80605018>] (bcm2835_dma_prep_slave_sg) from [<80766d7c>] (bcm2835_sdhost_request+0x4ac/0x754)
[82980.300009]  r10:b672c240 r9:b5f26790 r8:b644bb40 r7:80f56c94 r6:80e04f88 r5:b5f266b0
[82980.300014]  r4:b644b800
[82980.300030] [<807668d0>] (bcm2835_sdhost_request) from [<80746b34>] (__mmc_start_request+0x88/0x18c)
[82980.300041]  r10:b5f26600 r9:b5e6d684 r8:b644b800 r7:00000000 r6:b5f266b0 r5:b5f266b0
[82980.300046]  r4:b644b800
[82980.300060] [<80746aac>] (__mmc_start_request) from [<80746ccc>] (mmc_start_request+0x94/0xbc)
[82980.300069]  r7:00000000 r6:00000000 r5:b5f266b0 r4:b644b800
[82980.300083] [<80746c38>] (mmc_start_request) from [<8075a550>] (mmc_blk_mq_issue_rq+0x354/0x8e0)
[82980.300092]  r7:00000000 r6:b5e6d608 r5:b5f266b0 r4:80e04f88
[82980.300104] [<8075a1fc>] (mmc_blk_mq_issue_rq) from [<8075afb4>] (mmc_mq_queue_rq+0x150/0x27c)
[82980.300115]  r10:00000002 r9:b5e6d684 r8:b644b800 r7:b644c000 r6:b5e6d610 r5:b5f26600
[82980.300120]  r4:b5e6d608
[82980.300133] [<8075ae64>] (mmc_mq_queue_rq) from [<8057e900>] (blk_mq_dispatch_rq_list+0xd0/0x650)
[82980.300145]  r10:00000000 r9:b5f48000 r8:b5f26600 r7:00000000 r6:b5e71c00 r5:b0c0fe64
[82980.300150]  r4:b5f26630
[82980.300165] [<8057e830>] (blk_mq_dispatch_rq_list) from [<8058404c>] (blk_mq_do_dispatch_ctx+0xd8/0x130)
[82980.300177]  r10:00000000 r9:ff7c4f40 r8:b5e71c00 r7:80e04f88 r6:b5f48000 r5:b5e71c8c
[82980.300181]  r4:b0c0fe64
[82980.300196] [<80583f74>] (blk_mq_do_dispatch_ctx) from [<80584680>] (blk_mq_sched_dispatch_requests+0x158/0x1a4)
[82980.300207]  r9:b5f48000 r8:b5e71c04 r7:b0c0fe9c r6:80e04f88 r5:00000000 r4:b5e71c00
[82980.300220] [<80584528>] (blk_mq_sched_dispatch_requests) from [<8057c2a4>] (__blk_mq_run_hw_queue+0x100/0x1b4)
[82980.300232]  r9:00000020 r8:00000000 r7:b6b31300 r6:00000000 r5:b5e71d48 r4:b5e71c00
[82980.300243] [<8057c1a4>] (__blk_mq_run_hw_queue) from [<8057c380>] (blk_mq_run_work_fn+0x28/0x2c)
[82980.300252]  r7:b6b31300 r6:b6b2c4c0 r5:9f3f1d00 r4:b5e71c40
[82980.300266] [<8057c358>] (blk_mq_run_work_fn) from [<8013c98c>] (process_one_work+0x250/0x570)
[82980.300279] [<8013c73c>] (process_one_work) from [<8013cfa8>] (worker_thread+0x2fc/0x5d0)
[82980.300290]  r10:b6b2c4c0 r9:80e03d00 r8:b6b2c4d8 r7:00000008 r6:b6b2c4c0 r5:9f3f1d14
[82980.300295]  r4:9f3f1d00
[82980.300308] [<8013ccac>] (worker_thread) from [<801440d8>] (kthread+0x170/0x174)
[82980.300319]  r10:b15a5e74 r9:8013ccac r8:9f3f1d00 r7:b0c0e000 r6:00000000 r5:b1496600
[82980.300324]  r4:b179e600
[82980.300336] [<80143f68>] (kthread) from [<801010ac>] (ret_from_fork+0x14/0x28)
[82980.300342] Exception stack(0xb0c0ffb0 to 0xb0c0fff8)
[82980.300350] ffa0:                                     00000000 00000000 00000000 00000000
[82980.300360] ffc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[82980.300369] ffe0: 00000000 00000000 00000000 00000000 00000013 00000000
[82980.300380]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:80143f68
[82980.300385]  r4:b1496600
[82980.300389] Mem-Info:
[82980.300407] active_anon:196693 inactive_anon:10173 isolated_anon:0
               active_file:410 inactive_file:2410 isolated_file:0
               unevictable:8 dirty:1 writeback:0 unstable:0
               slab_reclaimable:2674 slab_unreclaimable:4655
               mapped:6337 shmem:10401 pagetables:2619 bounce:0
               free:13552 free_pcp:448 free_cma:9637
[82980.300421] Node 0 active_anon:786772kB inactive_anon:40692kB active_file:1640kB inactive_file:9640kB unevictable:32kB isolated(anon):0kB isolated(file):0kB mapped:25348kB dirty:4kB writeback:0kB shmem:41604kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[82980.300441] Normal free:54208kB min:16384kB low:20480kB high:24576kB active_anon:786772kB inactive_anon:40692kB active_file:1368kB inactive_file:9896kB unevictable:32kB writepending:4kB present:970752kB managed:947036kB mlocked:32kB kernel_stack:2120kB pagetables:10476kB bounce:0kB free_pcp:1792kB local_pcp:248kB free_cma:38548kB
[82980.300444] lowmem_reserve[]: 0 0
[82980.300452] Normal: 263*4kB (UEC) 522*8kB (UE) 359*16kB (UEC) 186*32kB (UEC) 85*64kB (UEC) 39*128kB (UEC) 15*256kB (UC) 9*512kB (C) 2*1024kB (C) 2*2048kB (C) 3*4096kB (C) = 54236kB
[82980.300499] 13275 total pagecache pages
[82980.300505] 0 pages in swap cache
[82980.300510] Swap cache stats: add 0, delete 0, find 0/0
[82980.300514] Free swap  = 0kB
[82980.300518] Total swap = 0kB
[82980.300522] 242688 pages RAM
[82980.300525] 0 pages HighMem/MovableOnly
[82980.300529] 5929 pages reserved
[82980.300533] 16384 pages cma reserved
[82980.300540] slab_out_of_memory: 1 callbacks suppressed
[82980.300546] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[82980.300553]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[82980.300560]   node 0: slabs: 104, objs: 1592, free: 0
[82980.359499] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[82980.359510]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[82980.359516]   node 0: slabs: 104, objs: 1592, free: 0
[82980.375278] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[82980.375289]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[82980.375296]   node 0: slabs: 104, objs: 1592, free: 0
[82980.382784] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[82980.382794]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[82980.382801]   node 0: slabs: 104, objs: 1592, free: 0
[82980.400378] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[82980.400389]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[82980.400394]   node 0: slabs: 104, objs: 1592, free: 0
[83125.555093] warn_alloc: 4 callbacks suppressed
[83125.555109] kworker/2:1H: page allocation failure: order:0, mode:0x40800(GFP_NOWAIT|__GFP_COMP), nodemask=(null),cpuset=/,mems_allowed=0
[83125.555133] CPU: 2 PID: 89 Comm: kworker/2:1H Tainted: G         C        5.4.77-v7+ #1371
[83125.555138] Hardware name: BCM2835
[83125.555155] Workqueue: kblockd blk_mq_run_work_fn
[83125.555161] Backtrace:
[83125.555179] [<8010dfa4>] (dump_backtrace) from [<8010e324>] (show_stack+0x20/0x24)
[83125.555189]  r7:ffffffff r6:00000000 r5:60000193 r4:80e97f70
[83125.555204] [<8010e304>] (show_stack) from [<80900d54>] (dump_stack+0xd8/0x11c)
[83125.555219] [<80900c7c>] (dump_stack) from [<802d7aa0>] (warn_alloc+0xd4/0x168)
[83125.555231]  r10:00000000 r9:80e04f88 r8:ffffe000 r7:80bbf8a4 r6:00000000 r5:00000000
[83125.555237]  r4:80e04f88 r3:e51a8c20
[83125.555249] [<802d79cc>] (warn_alloc) from [<802d8ccc>] (__alloc_pages_nodemask+0x1198/0x1270)
[83125.555256]  r3:00000000 r2:80bbf8a4
[83125.555266]  r8:00000000 r7:00040800 r6:80e04f88 r5:00000201 r4:00000200
[83125.555279] [<802d7b34>] (__alloc_pages_nodemask) from [<802e97c8>] (new_slab+0x2a8/0xbe4)
[83125.555290]  r10:00000008 r9:00040800 r8:b6401a00 r7:00000000 r6:80e04f88 r5:b6401a00
[83125.555295]  r4:00000000
[83125.555307] [<802e9520>] (new_slab) from [<802ec620>] (___slab_alloc.constprop.29+0x33c/0x53c)
[83125.555319]  r10:b6b572b0 r9:8060494c r8:b6401a00 r7:00000000 r6:00000900 r5:b6400ec0
[83125.555324]  r4:00000000
[83125.555336] [<802ec2e4>] (___slab_alloc.constprop.29) from [<802ec864>] (__slab_alloc.constprop.28+0x44/0x90)
[83125.555348]  r10:000d0418 r9:8060494c r8:b6b572b0 r7:8060494c r6:00000900 r5:b6401a00
[83125.555353]  r4:60000113
[83125.555365] [<802ec820>] (__slab_alloc.constprop.28) from [<802ecb90>] (__kmalloc+0x2e0/0x2e8)
[83125.555376]  r9:8060494c r8:00000900 r7:0000014c r6:b6401a00 r5:00000000 r4:b6401a00
[83125.555392] [<802ec8b0>] (__kmalloc) from [<8060494c>] (bcm2835_dma_create_cb_chain+0x64/0x34c)
[83125.555403]  r10:000d0418 r9:00000000 r8:7e202040 r7:00000002 r6:00000020 r5:b672c240
[83125.555408]  r4:b672c240
[83125.555422] [<806048e8>] (bcm2835_dma_create_cb_chain) from [<80605158>] (bcm2835_dma_prep_slave_sg+0x140/0x310)
[83125.555433]  r10:40000000 r9:00000000 r8:b5f37800 r7:00000002 r6:00000020 r5:00000000
[83125.555438]  r4:b672c240
[83125.555455] [<80605018>] (bcm2835_dma_prep_slave_sg) from [<80766d7c>] (bcm2835_sdhost_request+0x4ac/0x754)
[83125.555466]  r10:b672c240 r9:b5f24f90 r8:b644bb40 r7:80f56c94 r6:80e04f88 r5:b5f24eb0
[83125.555471]  r4:b644b800
[83125.555487] [<807668d0>] (bcm2835_sdhost_request) from [<80746b34>] (__mmc_start_request+0x88/0x18c)
[83125.555498]  r10:b5f24e00 r9:b5e6d684 r8:b644b800 r7:00000000 r6:b5f24eb0 r5:b5f24eb0
[83125.555503]  r4:b644b800
[83125.555517] [<80746aac>] (__mmc_start_request) from [<80746ccc>] (mmc_start_request+0x94/0xbc)
[83125.555526]  r7:00000000 r6:00000000 r5:b5f24eb0 r4:b644b800
[83125.555540] [<80746c38>] (mmc_start_request) from [<8075a550>] (mmc_blk_mq_issue_rq+0x354/0x8e0)
[83125.555549]  r7:00000000 r6:b5e6d608 r5:b5f24eb0 r4:80e04f88
[83125.555561] [<8075a1fc>] (mmc_blk_mq_issue_rq) from [<8075afb4>] (mmc_mq_queue_rq+0x150/0x27c)
[83125.555572]  r10:00000002 r9:b5e6d684 r8:b644b800 r7:b644c000 r6:b5e6d610 r5:b5f24e00
[83125.555577]  r4:b5e6d608
[83125.555590] [<8075ae64>] (mmc_mq_queue_rq) from [<8057e900>] (blk_mq_dispatch_rq_list+0xd0/0x650)
[83125.555602]  r10:00000001 r9:b5f48000 r8:b5f24e00 r7:00000000 r6:b5e71c00 r5:b443de9c
[83125.555607]  r4:b5f24e30
[83125.555621] [<8057e830>] (blk_mq_dispatch_rq_list) from [<80584634>] (blk_mq_sched_dispatch_requests+0x10c/0x1a4)
[83125.555632]  r10:00000000 r9:b5f48000 r8:b5e71c04 r7:b443de9c r6:80e04f88 r5:00000000
[83125.555637]  r4:b5e71c00
[83125.555650] [<80584528>] (blk_mq_sched_dispatch_requests) from [<8057c2a4>] (__blk_mq_run_hw_queue+0x100/0x1b4)
[83125.555662]  r9:000000a0 r8:00000000 r7:b6b59300 r6:00000000 r5:b5e71d48 r4:b5e71c00
[83125.555673] [<8057c1a4>] (__blk_mq_run_hw_queue) from [<8057c380>] (blk_mq_run_work_fn+0x28/0x2c)
[83125.555682]  r7:b6b59300 r6:b6b544c0 r5:b5e26f00 r4:b5e71c40
[83125.555696] [<8057c358>] (blk_mq_run_work_fn) from [<8013c98c>] (process_one_work+0x250/0x570)
[83125.555708] [<8013c73c>] (process_one_work) from [<8013cd0c>] (worker_thread+0x60/0x5d0)
[83125.555720]  r10:b6b544c0 r9:80e03d00 r8:b6b544d8 r7:00000008 r6:b6b544c0 r5:b5e26f14
[83125.555725]  r4:b5e26f00
[83125.555738] [<8013ccac>] (worker_thread) from [<801440d8>] (kthread+0x170/0x174)
[83125.555749]  r10:b6569e74 r9:8013ccac r8:b5e26f00 r7:b443c000 r6:00000000 r5:b5f11400
[83125.555754]  r4:b54152c0
[83125.555765] [<80143f68>] (kthread) from [<801010ac>] (ret_from_fork+0x14/0x28)
[83125.555772] Exception stack(0xb443dfb0 to 0xb443dff8)
[83125.555780] dfa0:                                     00000000 00000000 00000000 00000000
[83125.555790] dfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[83125.555799] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000
[83125.555809]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:80143f68
[83125.555814]  r4:b5f11400
[83125.555818] Mem-Info:
[83125.555836] active_anon:196771 inactive_anon:10175 isolated_anon:0
               active_file:284 inactive_file:2339 isolated_file:0
               unevictable:8 dirty:0 writeback:0 unstable:0
               slab_reclaimable:2680 slab_unreclaimable:4668
               mapped:6119 shmem:10403 pagetables:2632 bounce:0
               free:13579 free_pcp:444 free_cma:9847
[83125.555850] Node 0 active_anon:787084kB inactive_anon:40700kB active_file:1136kB inactive_file:9356kB unevictable:32kB isolated(anon):0kB isolated(file):0kB mapped:24476kB dirty:0kB writeback:0kB shmem:41612kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[83125.555869] Normal free:54316kB min:16384kB low:20480kB high:24576kB active_anon:787084kB inactive_anon:40700kB active_file:1224kB inactive_file:9376kB unevictable:32kB writepending:0kB present:970752kB managed:947036kB mlocked:32kB kernel_stack:2152kB pagetables:10528kB bounce:0kB free_pcp:1776kB local_pcp:348kB free_cma:39388kB
[83125.555872] lowmem_reserve[]: 0 0
[83125.555881] Normal: 171*4kB (UEC) 562*8kB (UEC) 373*16kB (UEC) 183*32kB (UEC) 85*64kB (UEC) 39*128kB (UEC) 15*256kB (UC) 9*512kB (C) 2*1024kB (C) 2*2048kB (C) 3*4096kB (C) = 54316kB
[83125.555928] 13099 total pagecache pages
[83125.555934] 0 pages in swap cache
[83125.555939] Swap cache stats: add 0, delete 0, find 0/0
[83125.555943] Free swap  = 0kB
[83125.555947] Total swap = 0kB
[83125.555951] 242688 pages RAM
[83125.555955] 0 pages HighMem/MovableOnly
[83125.555959] 5929 pages reserved
[83125.555962] 16384 pages cma reserved
[83125.555971] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83125.555978]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83125.555985]   node 0: slabs: 106, objs: 1624, free: 0
[83125.563382] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83125.563392]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83125.563398]   node 0: slabs: 106, objs: 1624, free: 0
[83125.570552] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83125.570561]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83125.570567]   node 0: slabs: 106, objs: 1624, free: 0
[83125.615449] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83125.615461]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83125.615468]   node 0: slabs: 106, objs: 1624, free: 0
[83125.631716] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83125.631730]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83125.631737]   node 0: slabs: 106, objs: 1624, free: 0
[83201.000435] warn_alloc: 4 callbacks suppressed
[83201.000447] kworker/0:0H: page allocation failure: order:0, mode:0x40800(GFP_NOWAIT|__GFP_COMP), nodemask=(null),cpuset=/,mems_allowed=0
[83201.000464] CPU: 0 PID: 6141 Comm: kworker/0:0H Tainted: G         C        5.4.77-v7+ #1371
[83201.000467] Hardware name: BCM2835
[83201.000479] Workqueue: kblockd blk_mq_run_work_fn
[83201.000483] Backtrace:
[83201.000495] [<8010dfa4>] (dump_backtrace) from [<8010e324>] (show_stack+0x20/0x24)
[83201.000501]  r7:ffffffff r6:00000000 r5:60000093 r4:80e97f70
[83201.000511] [<8010e304>] (show_stack) from [<80900d54>] (dump_stack+0xd8/0x11c)
[83201.000520] [<80900c7c>] (dump_stack) from [<802d7aa0>] (warn_alloc+0xd4/0x168)
[83201.000527]  r10:00000000 r9:80e04f88 r8:ffffe000 r7:80bbf8a4 r6:00000000 r5:00000000
[83201.000530]  r4:80e04f88 r3:e51a8c20
[83201.000538] [<802d79cc>] (warn_alloc) from [<802d8ccc>] (__alloc_pages_nodemask+0x1198/0x1270)
[83201.000542]  r3:00000000 r2:80bbf8a4
[83201.000547]  r8:00000000 r7:00040800 r6:80e04f88 r5:00000201 r4:00000200
[83201.000555] [<802d7b34>] (__alloc_pages_nodemask) from [<802e97c8>] (new_slab+0x2a8/0xbe4)
[83201.000562]  r10:00000008 r9:00040800 r8:b6401a00 r7:00000000 r6:80e04f88 r5:b6401a00
[83201.000565]  r4:00000000
[83201.000572] [<802e9520>] (new_slab) from [<802ec620>] (___slab_alloc.constprop.29+0x33c/0x53c)
[83201.000579]  r10:b6b2f2b0 r9:8060494c r8:b6401a00 r7:00000000 r6:00000900 r5:b6400ec0
[83201.000582]  r4:00000000
[83201.000589] [<802ec2e4>] (___slab_alloc.constprop.29) from [<802ec864>] (__slab_alloc.constprop.28+0x44/0x90)
[83201.000596]  r10:000d0418 r9:8060494c r8:b6b2f2b0 r7:8060494c r6:00000900 r5:b6401a00
[83201.000599]  r4:60000013
[83201.000606] [<802ec820>] (__slab_alloc.constprop.28) from [<802ecb90>] (__kmalloc+0x2e0/0x2e8)
[83201.000613]  r9:8060494c r8:00000900 r7:00000144 r6:b6401a00 r5:00000000 r4:b6401a00
[83201.000622] [<802ec8b0>] (__kmalloc) from [<8060494c>] (bcm2835_dma_create_cb_chain+0x64/0x34c)
[83201.000629]  r10:000d0418 r9:00000000 r8:7e202040 r7:00000002 r6:0000001f r5:b672c240
[83201.000632]  r4:b672c240
[83201.000640] [<806048e8>] (bcm2835_dma_create_cb_chain) from [<80605158>] (bcm2835_dma_prep_slave_sg+0x140/0x310)
[83201.000647]  r10:40000000 r9:00000000 r8:b5f1c800 r7:00000002 r6:0000001f r5:00000000
[83201.000649]  r4:b672c240
[83201.000660] [<80605018>] (bcm2835_dma_prep_slave_sg) from [<80766d7c>] (bcm2835_sdhost_request+0x4ac/0x754)
[83201.000667]  r10:b672c240 r9:b5f22390 r8:b644bb40 r7:80f56c94 r6:80e04f88 r5:b5f222b0
[83201.000670]  r4:b644b800
[83201.000680] [<807668d0>] (bcm2835_sdhost_request) from [<80746b34>] (__mmc_start_request+0x88/0x18c)
[83201.000687]  r10:b5f22200 r9:b5e6d684 r8:b644b800 r7:00000000 r6:b5f222b0 r5:b5f222b0
[83201.000689]  r4:b644b800
[83201.000698] [<80746aac>] (__mmc_start_request) from [<80746ccc>] (mmc_start_request+0x94/0xbc)
[83201.000703]  r7:00000000 r6:00000000 r5:b5f222b0 r4:b644b800
[83201.000711] [<80746c38>] (mmc_start_request) from [<8075a550>] (mmc_blk_mq_issue_rq+0x354/0x8e0)
[83201.000716]  r7:00000000 r6:b5e6d608 r5:b5f222b0 r4:80e04f88
[83201.000723] [<8075a1fc>] (mmc_blk_mq_issue_rq) from [<8075afb4>] (mmc_mq_queue_rq+0x150/0x27c)
[83201.000730]  r10:00000002 r9:b5e6d684 r8:b644b800 r7:b644c000 r6:b5e6d610 r5:b5f22200
[83201.000733]  r4:b5e6d608
[83201.000740] [<8075ae64>] (mmc_mq_queue_rq) from [<8057e900>] (blk_mq_dispatch_rq_list+0xd0/0x650)
[83201.000747]  r10:00000000 r9:b5f48000 r8:b5f22200 r7:00000000 r6:b5e71c00 r5:b0c0fe64
[83201.000750]  r4:b5f22230
[83201.000758] [<8057e830>] (blk_mq_dispatch_rq_list) from [<8058404c>] (blk_mq_do_dispatch_ctx+0xd8/0x130)
[83201.000765]  r10:00000000 r9:ff7c4f40 r8:b5e71c00 r7:80e04f88 r6:b5f48000 r5:b5e71c8c
[83201.000768]  r4:b0c0fe64
[83201.000776] [<80583f74>] (blk_mq_do_dispatch_ctx) from [<80584680>] (blk_mq_sched_dispatch_requests+0x158/0x1a4)
[83201.000783]  r9:b5f48000 r8:b5e71c04 r7:b0c0fe9c r6:80e04f88 r5:00000000 r4:b5e71c00
[83201.000791] [<80584528>] (blk_mq_sched_dispatch_requests) from [<8057c2a4>] (__blk_mq_run_hw_queue+0x100/0x1b4)
[83201.000798]  r9:00000020 r8:00000000 r7:b6b31300 r6:00000000 r5:b5e71d48 r4:b5e71c00
[83201.000804] [<8057c1a4>] (__blk_mq_run_hw_queue) from [<8057c380>] (blk_mq_run_work_fn+0x28/0x2c)
[83201.000810]  r7:b6b31300 r6:b6b2c4c0 r5:9f3f1d00 r4:b5e71c40
[83201.000819] [<8057c358>] (blk_mq_run_work_fn) from [<8013c98c>] (process_one_work+0x250/0x570)
[83201.000826] [<8013c73c>] (process_one_work) from [<8013cfa8>] (worker_thread+0x2fc/0x5d0)
[83201.000833]  r10:b6b2c4c0 r9:80e03d00 r8:b6b2c4d8 r7:00000008 r6:b6b2c4c0 r5:9f3f1d14
[83201.000836]  r4:9f3f1d00
[83201.000843] [<8013ccac>] (worker_thread) from [<801440d8>] (kthread+0x170/0x174)
[83201.000850]  r10:b15a5e74 r9:8013ccac r8:9f3f1d00 r7:b0c0e000 r6:00000000 r5:b1496600
[83201.000853]  r4:b179e600
[83201.000860] [<80143f68>] (kthread) from [<801010ac>] (ret_from_fork+0x14/0x28)
[83201.000864] Exception stack(0xb0c0ffb0 to 0xb0c0fff8)
[83201.000869] ffa0:                                     00000000 00000000 00000000 00000000
[83201.000875] ffc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[83201.000880] ffe0: 00000000 00000000 00000000 00000000 00000013 00000000
[83201.000886]  r10:00000000 r9:00000000 r8:00000000 r7:00000000 r6:00000000 r5:80143f68
[83201.000889]  r4:b1496600
[83201.000892] Mem-Info:
[83201.000902] active_anon:196745 inactive_anon:10174 isolated_anon:0
               active_file:362 inactive_file:1006 isolated_file:0
               unevictable:8 dirty:0 writeback:0 unstable:0
               slab_reclaimable:2677 slab_unreclaimable:4670
               mapped:5307 shmem:10402 pagetables:2622 bounce:0
               free:14960 free_pcp:417 free_cma:11146
[83201.000911] Node 0 active_anon:786980kB inactive_anon:40696kB active_file:1448kB inactive_file:4024kB unevictable:32kB isolated(anon):0kB isolated(file):0kB mapped:21228kB dirty:0kB writeback:0kB shmem:41608kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
[83201.000922] Normal free:59840kB min:16384kB low:20480kB high:24576kB active_anon:786980kB inactive_anon:40696kB active_file:1448kB inactive_file:4024kB unevictable:32kB writepending:0kB present:970752kB managed:947036kB mlocked:32kB kernel_stack:2136kB pagetables:10488kB bounce:0kB free_pcp:1668kB local_pcp:216kB free_cma:44584kB
[83201.000924] lowmem_reserve[]: 0 0
[83201.000929] Normal: 736*4kB (UEC) 974*8kB (UEC) 373*16kB (UEC) 182*32kB (UEC) 85*64kB (UEC) 39*128kB (UEC) 15*256kB (UC) 9*512kB (C) 2*1024kB (C) 2*2048kB (C) 3*4096kB (C) = 59840kB
[83201.000956] 11789 total pagecache pages
[83201.000960] 0 pages in swap cache
[83201.000964] Swap cache stats: add 0, delete 0, find 0/0
[83201.000966] Free swap  = 0kB
[83201.000968] Total swap = 0kB
[83201.000970] 242688 pages RAM
[83201.000973] 0 pages HighMem/MovableOnly
[83201.000975] 5929 pages reserved
[83201.000977] 16384 pages cma reserved
[83201.000984] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.000988]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.000992]   node 0: slabs: 107, objs: 1640, free: 0
[83201.006847] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.006853]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.006857]   node 0: slabs: 107, objs: 1640, free: 0
[83201.014911] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.014916]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.014920]   node 0: slabs: 107, objs: 1640, free: 0
[83201.020933] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.020937]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.020941]   node 0: slabs: 107, objs: 1640, free: 0
[83201.026656] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.026660]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.026664]   node 0: slabs: 107, objs: 1640, free: 0
[83201.032790] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.032795]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.032799]   node 0: slabs: 107, objs: 1640, free: 0
[83201.038793] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.038798]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.038801]   node 0: slabs: 107, objs: 1640, free: 0
[83201.061431] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.061436]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.061440]   node 0: slabs: 107, objs: 1640, free: 0
[83201.067543] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.067548]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.067551]   node 0: slabs: 107, objs: 1640, free: 0
[83201.076456] SLUB: Unable to allocate memory on node -1, gfp=0x900(GFP_NOWAIT|__GFP_ZERO)
[83201.076460]   cache: kmalloc-512, object size: 512, buffer size: 512, default order: 1, min order: 0
[83201.076464]   node 0: slabs: 107, objs: 1640, free: 0
Reply
@aknaggbaugh

I've never seen SLUB or SLAB errors in any Linux system and certainly not in moOde but, who knows, maybe I just wasn't looking in the right place at the right time. 

My customary search of the InterWeb™ for the SLUB error message results in a real mixed bag of hits. Deep in one (regarding ZFS in a virtual machine running under heavy load) is an interesting comment "this isn't a bug just a kernel warning that memory was very tight" which I think might apply in your case because of your observation "after a period of time...it begins responding again." 

In another thread you said you have moved /var/cache to RAM. That would pressure memory. In yet another thread, you've posted about local display. That also pressures memory.

Try making changes one at a time to see if the SLUB error recurs. You might even try enabling swap to give the system a pressure relief valve.

Regards,
Kent

PS - giving us the output from moodeutl -s or moodeutl -l (this latter preferably after a reboot) is always a good first step in establishing the context of an issue.
Reply
Thanks. I put /var/cache back on the SD card and it has been stable ever since, I haven't had to turn off the local display. 1GB RAM isn't enough for such tweaks I suppose.
Reply
I see that Moode 7.2.0 has been released. Will an upgrade from 7.1.0 be possible, or does it require a fresh install?
Reply
The repo has been updated but there has not been a release yet.
Enjoy the Music!
moodeaudio.org | Mastodon Feed | GitHub
Reply
(04-28-2021, 05:31 PM)Tim Curtis Wrote: The repo has been updated but there has not been a release yet.

Sorry, I stand corrected. Looking forward to the release!
Reply
There is an option in library settings to ignore or not cue files.
Reply
Hi, I am trying to update from 7.1.0 to 7.2.0 and I get the following message: Update cannot proceed without at least 500M space. I have expanded the filesystem. I have also, cleared Browser Cache, Playback History, System Logs, but the problem remains. I have RPi 3 and  the MoodeAudio is installed on a 8GB usb stick. I didn't have issues with updating before.
Reply
Post the output from the commands below.

Code:
df -h

moodeutl -l
Enjoy the Music!
moodeaudio.org | Mastodon Feed | GitHub
Reply
(07-19-2021, 10:39 AM)Tim Curtis Wrote: Post the output from the commands below.

Code:
df -h

moodeutl -l


Code:
Filesystem      Size  Used Avail Use% Mounted on
/dev/root       3.4G  2.8G  418M  88% /
devtmpfs        430M     0  430M   0% /dev
tmpfs           463M     0  463M   0% /dev/shm
tmpfs           463M   13M  450M   3% /run
tmpfs           5.0M  4.0K  5.0M   1% /run/lock
tmpfs           463M     0  463M   0% /sys/fs/cgroup
/dev/sdb1       253M   55M  198M  22% /boot
/dev/sda1       116G   48G   69G  41% /media/3BDB939D013EE5BB
tmpfs            93M     0   93M   0% /run/user/1000

Code:
20210719 114212 worker: -- Start
20210719 114212 worker: Successfully daemonized
20210719 114212 worker: Integrity check (passed)
20210719 114213 worker: File check (OK)
20210719 114318 worker: Session vacuumed
20210719 114318 worker: Session loaded
20210719 114318 worker: Debug logging (OFF)
20210719 114319 worker: -- Device
20210719 114319 worker: ALSA cards: (0:sndrpihifiberry | 1:empty | 2:empty | 3:empty
20210719 114319 worker: MPD config: (0:HiFiBerry DAC+ Pro | mixer:(Digital) | card:0)
20210719 114319 worker: ALSA mixer actual (Digital)
20210719 114319 worker: ALSA Digital volume set to (0%)
20210719 114319 worker: -- System
20210719 114321 worker: Host     (moode)
20210719 114321 worker: moOde    (7.1.0 2021-03-15)
20210719 114321 worker: RaspiOS  (10.6)
20210719 114321 worker: Kernel   (5.4.77-v7+ #1371)
20210719 114321 worker: Platform (Pi-3B+ 1.3 1GB)
20210719 114321 worker: ARM arch (armv7l, 32-bit kernel)
20210719 114321 worker: MPD ver  (0.22.6_p0x3)
20210719 114321 worker: CPU gov  (ondemand)
20210719 114322 worker: USB boot enabled
20210719 114323 worker: File system expanded
20210719 114323 worker: HDMI port on
20210719 114323 worker: -- Network
20210719 114323 worker: eth0 exists
20210719 114323 worker: IP addr (192.168.1.5)
20210719 114323 worker: Netmask (255.255.255.0)
20210719 114323 worker: Gateway (192.168.1.1)
20210719 114323 worker: Pri DNS (fe80::1%eth0)
20210719 114323 worker: Domain  (192.168.1.1)
20210719 114323 worker: wlan0 exists
20210719 114323 worker: Pi integrated wlan0 power save disabled
20210719 114323 worker: wifi country (GR)
20210719 114323 worker: wlan0 SSID is blank
20210719 114323 worker: eth0 addr exists, AP mode not started
20210719 114323 worker: wlan0 address not assigned
20210719 114323 worker: -- Audio
20210719 114328 worker: MPD conf updated
20210719 114328 worker: ALSA card number (0)
20210719 114328 worker: MPD audio output (HiFiBerry DAC+ Pro)
20210719 114328 worker: Audio formats (S16_LE, S24_LE, S32_LE)
20210719 114328 worker: ALSA mixer name (Digital)
20210719 114328 worker: MPD volume control (software)
20210719 114328 worker: Hdwr volume controller exists
20210719 114328 worker: Max ALSA volume (100%)
20210719 114328 worker: Reset renderer active flags
20210719 114328 worker: CamillaDSP (off)
20210719 114328 worker: -- MPD
20210719 114328 worker: MPD started
20210719 114330 worker: MPD accepting connections
20210719 114330 worker: MPD output 1 ALSA Default (on)
20210719 114330 worker: MPD output 2 ALSA Crossfeed (off)
20210719 114330 worker: MPD output 3 ALSA Parametric EQ (off)
20210719 114330 worker: MPD output 4 ALSA Graphic EQ (off)
20210719 114330 worker: MPD output 5 ALSA Polarity Inv (off)
20210719 114330 worker: MPD output 6 ALSA CamillaDSP (off)
20210719 114330 worker: MPD output 7 ALSA Bluetooth (off)
20210719 114330 worker: MPD output 8 HTTP Server (off)
20210719 114330 worker: MPD crossfade (off)
20210719 114330 worker: MPD ignore CUE files (yes)
20210719 114330 worker: -- Feature availability
20210719 114330 worker: Source select (available)
20210719 114330 worker: Source select (source: MPD)
20210719 114330 worker: Source select (output: HiFiBerry DAC+ Pro)
20210719 114330 worker: Bluetooth (available)
20210719 114330 worker: Airplay renderer (available)
20210719 114330 worker: Spotify renderer (available)
20210719 114330 worker: Squeezelite (available)
20210719 114330 worker: RoonBridge renderer (not installed)
20210719 114330 worker: UPnP renderer (available)
20210719 114330 worker: DLNA server (available)
20210719 114330 worker: UPnP browser (available)
20210719 114330 worker: GPIO button handler (available)
20210719 114330 worker: Stream recorder (n/a)
20210719 114330 worker: -- Music sources
20210719 114330 worker: USB source (3BDB939D013EE5BB)
20210719 114330 worker: NAS and UPnP sources (none configured)
20210719 114330 worker: -- Miscellaneous
20210719 114330 worker: USB volume knob (Off)
20210719 114330 worker: USB auto-mounter (udisks-glue)
20210719 114330 worker: LED0 (On)
20210719 114330 worker: LED1 (On)
20210719 114330 worker: Saved MPD vol level (0)
20210719 114330 worker: Preamp volume level (0)
20210719 114330 worker: MPD volume level (99) restored
20210719 114330 worker: ALSA Digital volume (100%)
20210719 114330 worker: Auto-play (Off)
20210719 114330 worker: Maintenance interval (3 hrs)
20210719 114330 worker: Screen saver activation (Never)
20210719 114330 worker: Session permissions (OK)
20210719 114331 worker: Watchdog started
20210719 114331 worker: Ready
20210719 120457 worker: Job compactdb
20210719 144359 Maintenance: Free disk space < 512M required for in-place updates
Reply


Forum Jump: