Playdate Hard Crash - Not While Playing Game?

Unreal · September 11, 2022, 10:45pm

Howdy - we have been developing a new game over the last few weeks and recently my device is having weird issues.

Its never while I am playing the game we are developing, its always a few minutes after I close the game and go back to the main menu.

Here is my crash log from the most recent time it happened:

--- crash at 2022/09/11 22:29:50---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:a0000000    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a66   psr: 81000000
 cfsr:00000082  hfsr:00000000  mmfar:00000017  bfar: 00000017
rcccsr:00000000
heap allocated: 890976
Lua totalbytes=127824125 GCdebt=-127575304 GCestimate=248437 stacksize=42

--- crash at 2022/09/11 22:33:19---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200384d4    r1:10000000     r2:10000000    r3: 00000000
  r12:0000000a    lr:080b2825     pc:080b2640   psr: 01000000
 cfsr:00000082  hfsr:00000000  mmfar:0100004e  bfar: 0100004e
rcccsr:00000000
heap allocated: 891552
Lua totalbytes=127824065 GCdebt=-127571894 GCestimate=248356 stacksize=84

I am trying to make sure nothing in our game is causing this - just because it does seem to happen after playing our game for a bit. Again its NOT WHILE the game is playing, its a few moments to a minute or so after returning to the home menu after playing the game.

matt · September 11, 2022, 11:08pm

This is odd because the whole system is rebooted/restarted when exiting a game to the launcher. I'll tag Dave

Unreal · September 11, 2022, 11:10pm

Thanks Matt - I am worried its some kind of memory leak thing. When I have some time I will hook it up to the profiler.

Unreal · September 12, 2022, 1:03am

Coming back here to report that it is doing this a lot now lol. And randomly - I haven't touched the thing in a little over an hour and it just randomly hard crashed and recycled.

Unreal · September 12, 2022, 1:34am

--- crash at 2022/09/11 23:37:22---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:080b2704    r1:200022cc     r2:20002313    r3: 00000006
  r12:0000000a    lr:080b1d71     pc:080b2700   psr: 81000000
 cfsr:00000082  hfsr:00000000  mmfar:61000dc7  bfar: 61000dc7
rcccsr:00000000
heap allocated: 7827008
Lua totalbytes=127985535 GCdebt=-127574984 GCestimate=410247 stacksize=40

--- crash at 2022/09/12 01:01:29---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:00045400    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a62   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:30000007  bfar: 30000007
rcccsr:00000000
heap allocated: 891712
Lua totalbytes=127823644 GCdebt=-127575288 GCestimate=248356 stacksize=42

Unreal · September 12, 2022, 6:59pm

--- crash at 2022/09/11 22:29:50---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:a0000000    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a66   psr: 81000000
 cfsr:00000082  hfsr:00000000  mmfar:00000017  bfar: 00000017
rcccsr:00000000
heap allocated: 890976
Lua totalbytes=127824125 GCdebt=-127575304 GCestimate=248437 stacksize=42

--- crash at 2022/09/11 22:33:19---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200384d4    r1:10000000     r2:10000000    r3: 00000000
  r12:0000000a    lr:080b2825     pc:080b2640   psr: 01000000
 cfsr:00000082  hfsr:00000000  mmfar:0100004e  bfar: 0100004e
rcccsr:00000000
heap allocated: 891552
Lua totalbytes=127824065 GCdebt=-127571894 GCestimate=248356 stacksize=84

--- crash at 2022/09/11 23:37:22---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:080b2704    r1:200022cc     r2:20002313    r3: 00000006
  r12:0000000a    lr:080b1d71     pc:080b2700   psr: 81000000
 cfsr:00000082  hfsr:00000000  mmfar:61000dc7  bfar: 61000dc7
rcccsr:00000000
heap allocated: 7827008
Lua totalbytes=127985535 GCdebt=-127574984 GCestimate=410247 stacksize=40

--- crash at 2022/09/12 01:01:29---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:00045400    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a62   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:30000007  bfar: 30000007
rcccsr:00000000
heap allocated: 891712
Lua totalbytes=127823644 GCdebt=-127575288 GCestimate=248356 stacksize=42

--- crash at 2022/09/12 01:54:50---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:a0000000    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a66   psr: 81000000
 cfsr:00000082  hfsr:00000000  mmfar:00000018  bfar: 00000018
rcccsr:00000000
heap allocated: 890976
Lua totalbytes=127823676 GCdebt=-127575288 GCestimate=248388 stacksize=42

--- crash at 2022/09/12 02:35:06---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:00045400    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a62   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:0000010c  bfar: 0000010c
rcccsr:00000000
heap allocated: 897984
Lua totalbytes=127824473 GCdebt=-127573207 GCestimate=248388 stacksize=84

--- crash at 2022/09/12 15:26:56---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:20031244    r1:00000000     r2:00001000    r3: 00000400
  r12:00000009    lr:0803980b     pc:0803a6cc   psr: 81000200
 cfsr:00000082  hfsr:00000000  mmfar:7051553b  bfar: 7051553b
rcccsr:00000000
heap allocated: 1032928
Lua totalbytes=127826633 GCdebt=-127575280 GCestimate=250864 stacksize=42

--- crash at 2022/09/12 15:47:03---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200320bc    r1:00000000     r2:00001000    r3: 00000400
  r12:00003fe0    lr:0803980b     pc:0803a6b0   psr: 81000200
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 864384
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 16:07:37---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:a0000000    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a66   psr: 81000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 16:28:11---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c95    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 16:34:36---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:00045400    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a62   psr: 21000000
 cfsr:00000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=357400 GCdebt=-95166 GCestimate=178777 stacksize=22

--- crash at 2022/09/12 17:03:18---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:a0000000    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a66   psr: 81000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 524896
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 17:23:51---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:00045400    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a62   psr: 21000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 17:44:25---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b44    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 18:04:59---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:a0000000    r3: 40012c00
  r12:00003fe0    lr:08030aa3     pc:08030a66   psr: 81000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 18:25:33---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:0801048c    r1:00000006     r2:200026ca    r3: 0000000c
  r12:00003fe0    lr:0801e791     pc:0803ae9c   psr: 21000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 18:46:07---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200332c8    r1:08046925     r2:20010220    r3: 00000000
  r12:0000000a    lr:08046925     pc:0803b5be   psr: 81000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/12 18:52:41---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000100     r2:00000000    r3: ffffffff
  r12:00003fe0    lr:0803aaf9     pc:0803aaf8   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:dff1fe07  bfar: dff1fe07
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=357400 GCdebt=-95051 GCestimate=178777 stacksize=42

--- crash at 2022/09/12 18:57:22---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:2003118b    r1:2003118b     r2:00000020    r3: 00000043
  r12:2003116b    lr:08042de3     pc:08042eda   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:8061091e  bfar: 8061091e
rcccsr:00000000
heap allocated: 8909568
Lua totalbytes=128216074 GCdebt=-127560198 GCestimate=470511 stacksize=168

Unreal · September 22, 2022, 1:50am

Just wanted to report back - these are starting to happen more frequently and I am starting to think my device might be faulty. As you can see, it happens multiple times a day now:

--- crash at 2022/09/14 11:10:04---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00000000    r3: 40012c14
  r12:006d3000    lr:08037c43     pc:080307e2   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 11:30:38---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b8c    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 11:51:12---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000003    r1:00000002     r2:e000ed00    r3: 00000340
  r12:006d3000    lr:08030911     pc:0801484c   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 12:11:46---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030bd5    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030504   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 12:32:20---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030ccd    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 12:52:54---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030bfd    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 13:13:28---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b15    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 13:34:02---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b8d    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 13:54:36---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b60    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 14:15:10---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c8a    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 14:35:44---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:080e58d5    r1:00000000     r2:20002313    r3: 0000000a
  r12:0000000a    lr:080b1d71     pc:080b27f4   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 14:56:18---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b86    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 15:16:52---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000003    r1:ffffffff     r2:e000ed00    r3: 000000c0
  r12:006d3000    lr:08030911     pc:0801484c   psr: 81000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 15:37:26---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b8a    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 15:58:00---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030ace    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030508   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 16:18:34---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030d10    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030504   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 16:39:08---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:2000246c    r1:00000000     r2:000000ff    r3: 0000003f
  r12:2003123a    lr:08042ef9     pc:0803a6d0   psr: 81000200
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 16:59:42---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c71    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 17:20:16---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030adc    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 17:40:50---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:2a86c000    r1:00000016     r2:08a15436    r3: 40026458
  r12:006d3000    lr:ffffffed     pc:08030046   psr: 0100004b
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 18:01:24---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:20003cd8    r1:00000000     r2:00000001    r3: 20010290
  r12:006d3000    lr:08046231     pc:08047dde   psr: 81000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 18:21:58---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c62    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 18:42:32---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b07    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 19:03:06---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200023d0    r1:080106bc     r2:00000020    r3: 200023dc
  r12:2c000000    lr:080b1b61     pc:080b18be   psr: 81000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 19:23:40---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030ab8    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 19:44:14---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b46    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 20:04:48---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c0c    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030542   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 20:25:22---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000384     r2:0000a8c0    r3: 00000000
  r12:0000083a    lr:08039fe3     pc:0803a57e   psr: 81000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 20:45:56---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:40012c00    r1:00001f40     r2:06422bfd    r3: 00082800
  r12:006d3000    lr:08037ddd     pc:08037c06   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 21:06:30---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030cec    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 21:27:04---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200336c0    r1:20026098     r2:00000000    r3: 00000002
  r12:00000000    lr:080426ef     pc:08041dd6   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 21:47:38---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c59    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030508   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 22:08:12---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000002    r1:200310e0     r2:00000001    r3: 00000000
  r12:006d3000    lr:0803012b     pc:0803012e   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 22:28:46---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:20003cd8    r1:0803984f     r2:20010220    r3: 20024c00
  r12:006d3000    lr:0803c5bd     pc:0803936c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/14 22:49:20---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030ca9    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/15 02:22:45---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030d03    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:51554458  bfar: 51554458
rcccsr:00000000
heap allocated: 891712
Lua totalbytes=127824403 GCdebt=-127575080 GCestimate=248452 stacksize=42

--- crash at 2022/09/15 02:35:41---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000002    r1:40012c80     r2:00000016    r3: 0fc00000
  r12:006d3000    lr:08030803     pc:0802fcec   psr: 01000000
 cfsr:00000082  hfsr:00000000  mmfar:0008000c  bfar: 0008000c
rcccsr:00000000
heap allocated: 836896
Lua totalbytes=127828357 GCdebt=-127575280 GCestimate=252497 stacksize=42

--- crash at 2022/09/15 02:39:51---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030a3d    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030504   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:64056440  bfar: 64056440
rcccsr:00000000
heap allocated: 432864
Lua totalbytes=127822397 GCdebt=-127574663 GCestimate=246940 stacksize=42

--- crash at 2022/09/15 03:00:26---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c9d    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 432864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/15 03:20:39---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c9c    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 432864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/15 04:40:35---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030ae5    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030508   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 512224
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/15 13:31:02---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:200330e0     r2:200026ca    r3: 00000000
  r12:006d3000    lr:08030917     pc:08043d78   psr: 61005200
 cfsr:00000082  hfsr:00000000  mmfar:30303037  bfar: 30303037
rcccsr:00000000
heap allocated: 432864
Lua totalbytes=127823394 GCdebt=-127575288 GCestimate=246898 stacksize=42

--- crash at 2022/09/15 14:37:52---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:40012c00    r1:00001f40     r2:06422c00    r3: 00000800
  r12:006d3000    lr:0803807d     pc:08037c0c   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 432864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/15 15:51:17---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b44    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 601376
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/15 17:03:08---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c4e    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 787840
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/15 23:39:53---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030cfb    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:00001850  bfar: 00001850
rcccsr:00000000
heap allocated: 890976
Lua totalbytes=127823985 GCdebt=-127575280 GCestimate=248420 stacksize=42

--- crash at 2022/09/16 00:00:26---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b86    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00008600  hfsr:40000000  mmfar:d55d4778  bfar: d55d4778
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/16 00:21:00---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030d3b    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/16 00:41:34---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000005    r1:08030917     r2:20010220    r3: 00000000
  r12:006d3000    lr:08030917     pc:080394c6   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2022/09/16 00:53:27---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:000007dc    r1:2000263c     r2:00000064    r3: 00000000
  r12:00000009    lr:0803a07f     pc:08039fae   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:00100004  bfar: 00100004
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=357400 GCdebt=-619339 GCestimate=178777 stacksize=42

--- crash at 2022/09/16 01:01:27---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b14    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:70054c9d  bfar: 70054c9d
rcccsr:00000000
heap allocated: 890944
Lua totalbytes=127824133 GCdebt=-127574547 GCestimate=248356 stacksize=42

--- crash at 2022/09/16 03:26:12---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000003    r1:00000000     r2:e000ed00    r3: 00000100
  r12:006d3000    lr:08030911     pc:0801484c   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:64139578  bfar: 64139578
rcccsr:00000000
heap allocated: 898112
Lua totalbytes=127824273 GCdebt=-127575280 GCestimate=248324 stacksize=42

--- crash at 2000/01/01 13:30:16---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b72    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 965472
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 13:50:49---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030bd5    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 14:11:23---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000004    r1:08030917     r2:e000ed00    r3: 00000050
  r12:006d3000    lr:080244d9     pc:08039490   psr: 21000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 14:31:57---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200384d4    r1:200022d0     r2:00000000    r3: 00000001
  r12:0000000a    lr:080b2825     pc:080b260e   psr: 01000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 14:52:31---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030afa    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 15:13:05---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030cf9    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 15:33:39---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000002    r1:ffffffff     r2:00000001    r3: 00000000
  r12:006d3000    lr:0804683f     pc:0804684e   psr: 61000000
 cfsr:01000000  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 360864
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 16:00:59---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c58    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:71000d67  bfar: 71000d67
rcccsr:00000000
heap allocated: 890816
Lua totalbytes=127824409 GCdebt=-127575280 GCestimate=248324 stacksize=42

--- crash at 2000/01/01 17:53:11---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000003    r1:00000001     r2:e000ed00    r3: 00000300
  r12:006d3000    lr:0803085b     pc:080148a8   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:645597b7  bfar: 645597b7
rcccsr:00000000
heap allocated: 890848
Lua totalbytes=127824221 GCdebt=-127575280 GCestimate=248452 stacksize=42

--- crash at 2000/01/02 00:54:02---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:00000001     r2:00000400    r3: 40012c00
  r12:006d3000    lr:080307eb     pc:08030510   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:655157f8  bfar: 655157f8
rcccsr:00000000
heap allocated: 898816
Lua totalbytes=496600 GCdebt=-248059 GCestimate=248324 stacksize=42

--- crash at 2000/01/02 20:51:33---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:200313a8    r1:00000000     r2:00001000    r3: 00000400
  r12:00000000    lr:0803980b     pc:0803a6cc   psr: 81000200
 cfsr:00000082  hfsr:00000000  mmfar:6402b998  bfar: 6402b998
rcccsr:00000000
heap allocated: 891680
Lua totalbytes=127824313 GCdebt=-127575288 GCestimate=248356 stacksize=42

--- crash at 2000/01/02 22:33:36---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:40012c00    r1:00001f40     r2:06422c35    r3: 00000800
  r12:006d3000    lr:0803807d     pc:08037c12   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:44471718  bfar: 44471718
rcccsr:00000000
heap allocated: 890848
Lua totalbytes=127823761 GCdebt=-127574612 GCestimate=248324 stacksize=84

--- crash at 2000/01/02 22:47:14---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000001     r2:20024b0c    r3: 00000057
  r12:006d3000    lr:080307eb     pc:08030810   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:ffffd806  bfar: ffffd806
rcccsr:00000000
heap allocated: 890848
Lua totalbytes=127823612 GCdebt=-127575288 GCestimate=248324 stacksize=42

--- crash at 2000/01/03 00:10:36---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b06    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:0e020710  bfar: 0e020710
rcccsr:00000000
heap allocated: 890976
Lua totalbytes=127824089 GCdebt=-127574192 GCestimate=248388 stacksize=84

--- crash at 2000/01/03 01:47:13---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:20026098    r1:200310e0     r2:0000000d    r3: 20031110
  r12:006d3000    lr:08042a75     pc:08042a84   psr: 01000000
 cfsr:00000400  hfsr:40000000  mmfar:00000000  bfar: 00000000
rcccsr:00000000
heap allocated: 891680
Lua totalbytes=0 GCdebt=0 GCestimate=0 stacksize=0

--- crash at 2000/01/01 21:34:53---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b4e    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:45450518  bfar: 45450518
rcccsr:00000000
heap allocated: 898688
Lua totalbytes=127823644 GCdebt=-127575288 GCestimate=248356 stacksize=42

--- crash at 2000/01/01 22:48:43---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b1b    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:401151c7  bfar: 401151c7
rcccsr:00000000
heap allocated: 890848
Lua totalbytes=127824473 GCdebt=-127573552 GCestimate=248388 stacksize=84

--- crash at 2000/01/01 22:59:46---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c61    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:00100008  bfar: 00100008
rcccsr:00000000
heap allocated: 945504
Lua totalbytes=127828339 GCdebt=-127574604 GCestimate=252526 stacksize=84

--- crash at 2000/01/01 23:08:11---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030d0b    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803050a   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:610035a7  bfar: 610035a7
rcccsr:00000000
heap allocated: 890848
Lua totalbytes=127826330 GCdebt=-127574439 GCestimate=248437 stacksize=84

--- crash at 2000/01/01 23:21:53---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:40012c00    r1:00001f40     r2:06422c14    r3: 00000800
  r12:006d3000    lr:0803807d     pc:08037c0c   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:0400001c  bfar: 0400001c
rcccsr:00000000
heap allocated: 898080
Lua totalbytes=127823761 GCdebt=-127572543 GCestimate=248405 stacksize=84

--- crash at 2000/01/01 23:36:12---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030c41    r3: 00000000
  r12:006d3000    lr:080307eb     pc:08030540   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:0000014d  bfar: 0000014d
rcccsr:00000000
heap allocated: 937280
Lua totalbytes=503400 GCdebt=-248711 GCestimate=251703 stacksize=84

--- crash at 2022/09/22 01:15:25---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:00000000     r2:00030b7a    r3: 00000000
  r12:006d3000    lr:080307eb     pc:0803053c   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:00000017  bfar: 00000017
rcccsr:00000000
heap allocated: 903744
Lua totalbytes=127824097 GCdebt=-127575221 GCestimate=248388 stacksize=42

--- crash at 2022/09/22 01:22:40---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000001    r1:08046925     r2:20010220    r3: 00000000
  r12:0000000a    lr:08046925     pc:0803c5a8   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:6e000007  bfar: 6e000007
rcccsr:00000000
heap allocated: 504800
Lua totalbytes=127822190 GCdebt=-127574612 GCestimate=246693 stacksize=84

--- crash at 2022/09/22 01:31:40---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:00000000    r1:08046925     r2:20010220    r3: 00000000
  r12:006d3000    lr:08046925     pc:080393fe   psr: 61000000
 cfsr:00000082  hfsr:00000000  mmfar:01000007  bfar: 01000007
rcccsr:00000000
heap allocated: 1381248
Lua totalbytes=128259096 GCdebt=-127570735 GCestimate=683744 stacksize=172

--- crash at 2022/09/22 01:45:19---
build:59185ded27c7-1.12.3-release.140884-buildbot
   r0:20025bf0    r1:40012c80     r2:0000007f    r3: 00000080
  r12:006d3000    lr:08030803     pc:0802fc7e   psr: 21000000
 cfsr:00000082  hfsr:00000000  mmfar:73600365  bfar: 73600365
rcccsr:00000000
heap allocated: 1392128
Lua totalbytes=128244212 GCdebt=-127574576 GCestimate=668456 stacksize=42

Unreal · September 22, 2022, 1:51am

Its actually happening so often that I cant paste the complete crashlog.

Unreal · September 22, 2022, 1:52am

I also just noticed that the date on playdate is now mysteriously 2000/01/01, so that's new lol. Yeah something is 100% wrong with the device.

dave · September 22, 2022, 2:16am

I tried to look up those addresses to see if there was any pattern but it didn't look like I was using the right build--but I just remembered where to find the actual build so I'll take another look at that now and see if I spot any patterns. Still, it definitely looks like flaky hardware.

One thing to try if you haven't already: Do a hard reset by poking the hidden button behind the hole inside the crank pocket. That's the only way (short of letting the battery completely drain or opening the case and pulling the battery connector) of doing a full power cycle.

And sorry for the late reply! I was out last week and I've had a lot to catch up on.

dave · September 22, 2022, 1:39pm

oh, and to arrange a replacement, please email support@play.date!

Unreal · October 9, 2022, 9:56pm

Hey @dave so we did end up launching the game we were working on, along with a companion app that runs in Windows.

We have had a few (5 so far) folks report similar issues to what I described above as part of using these games. I aggregated their crash logs (because no error logs were generated from the apps) and I am attaching them here:
Hardware Failures - SGSBGN.zip (89.3 KB)

Any thoughts on this? We have been unable to help these folks launch our games after running into this issue even after hard resets and multiple uninstall/reinstall cycles.

dave · October 10, 2022, 9:15pm

Okay, I think I found the problem. There's a bug that slipped into 1.12.0 that we didn't catch until last week where the 10-second runloop hang check is crashing instead of showing the error. I checked Memfault, the online crash logger tool we're using, and see lots of that on those devices. Oh nice.. they have memory dumps and it looks like I can find the error message it should have shown, so I can tell you where the Lua code was hanging. I'll dig through the data and DM you the traces.

kieranpenrice · March 31, 2023, 7:32pm

Sorry but I'm having the same problem and I'm on the latest firmware.

I was just getting ready to do the final test of the demo of my game before release and it crashed, then the menu crashed, now it crashes constantly even when just on the clock, just as Unreal Hunter described.

I've tried recovering the firmware using the a+b+menu+lock combo, but that crashes too. Whatever this is, it isn't fixed on the latest firmware. Luckily I haven't given out my demo yet, because if this is tanking playdates then a free demo would probably take out a lot of systems.

take a look for yourself, I've attached my crashlog.
crashlog.zip (3.6 KB)

dave · April 1, 2023, 3:44am

Not the same bug exactly, I don't think. The previous was a timeout where the system stalls for 10 seconds then the watchdog timer triggers a crash because it sees that something is stuck; In your case it looks like it's crashing immediately but at somewhat random locations, mostly in the code that talks to flash storage. I'll see if Marc has any ideas, he's been doing work in that area lately.

One thing that sometimes helps is to do a hard reset by pressing the button hidden inside the crank pocket. Find a pokey tool like an unbent paperclip, pull the crank out, and look for a little hole inside the recess where the crank handle goes. Poke inside there and you should feel it click. Hold it for a few seconds, let go, and the device will reboot--possibly with whatever bad state is causing the crashes cleared out.

kieranpenrice · April 1, 2023, 6:47am

Hi Dave thanks for responding.

Unfortunately I have already tried the reset button several times.

I have also tried:

Switching to data disk mode and removing the copy of my game zipped in the tmp directory.

Removing all games and data from the data disk.

Pressing the reset button for like a minute before releasing it.

Using the recovery mode to restore the recovery firmware.

All of these have made no difference. The system is now at the point where it crashes on the clock (every ten minutes or so, then resets back to the clock), if I open the menu then shut it, if I select an app, anything. I struggle to get the system to even open data disk or recovery mode. When the system restarts it sometimes goes back to the menu, but mostly it goes all the way back to the intro and I have to reconnect to my wi-fi again.

Other things of note:

when I open the menu the system acts like I am in a game, giving me the option of 'home' rather than 'settings'. Home, of course, crashes the system.
Mirror cannot see the system at all. It just shows a black screen.
the simulator does detect the system, but when it does it generally crashes the simulator. If I manage to get to select an option such as to control the simulator using the playdate the simulator crashes or nothing happens.

I put in a support request Wednesday morning UK time but I guess it is a bit early to have heard anything back.

I don't know if any of these are relevant but here are the last few things I did on my game that may have been triggers:

I implemented Noble Engine's gamedata system, with my system saving aspects of the game state to a file. The game is a visual novel, so some aspects would be saved every time a dialogue box opened, which means sometimes the same data gets saved several times in quick succession.

I edited my games pdxinfo file, putting the game's full name with 'demo' on the end in each field, which may have proven too long when I put com.kieranpenrice.tricklegreenweedmermaidatlawinchristmascatastrophedemo

I edited my sound system to increase the buffer size on sound effects and mp3 music to prevent buffer underruns.

Sorry for the info dump, but I figure when trying to find a bug it is always useful to have as much information as possible.

kieranpenrice · April 5, 2023, 6:44am

For the record I have just tried today's firmware update and it doesn't help.

dave · April 12, 2023, 3:43pm

Would you mind sending me the demo and I'll see if I can reproduce the problem? (And sorry, I should have asked you that a week ago. Too much going on to keep track of these days..)

kieranpenrice · April 13, 2023, 7:51am

Trickle_greenweed_demo_DO_NOT_USE_ON_CONSOLE_ONLY_SIMULATOR.pdx.zip (1.3 MB)

Enjoy!

dave · April 14, 2023, 3:21am

No luck, the game is working fine for me. The only thing I can think to try is Factory Reset in Settings (under the System menu) if you haven't already. If that doesn't work it looks like we'll need to swap you for a new unit and I can poke at yours and try to figure out what went wrong. We do get the occasional flaky device but I don't think I've heard of one that was working fine then suddenly started having fits.