Face Detection in CameraWebServer Example Not Working in 1.0.2

[xgarb]

Faces aren't detected in the CameraWebServer example in 1.0.2. I tested with an Ai-Thinker and an ESP-EYE and there is nothing in the serial monitor or in the stream.

Works great when I rolled back to 1.0.1 with the previous example.

[crackpot1977]

Hi.
Not your solution, but:
I have the same problem :-(

[sconwayaus]

I was able to repeat the OP issue.

Hardware: AI-Thinker ESP32-CAM
Built the CameraWebServer example in the Ardunio IDE using 1.0.2 and 1.0.1.
1.0.2, face detection was not working.
1.0.1, face detection working

[me-no-dev]

Hey, can you please install 1.0.3-rc1 from the development package manager link and give it a try?

[crackpot1977]

Hi.
Unfortunately no solution for me.
1.0.1 => working
1.0.2 & 1.0.3-rc1 => not working

[eggnot]

1.0.1 - working
1.0.2 - not working

[MohamadBay]

ESP-eye Face detection and recognition is not working
1.0.1 not working
1.0.2 not working
a other member has the same Problem : #2817

any idea??

[rikki78]

Same here. I have an AI thinker board. Is it possible to use that with the previous release 1.0.1 somehow? I'm using platformIO.

[rikki78]

I've got it to work by switching to Arduino IDE 1.0.1. The AI thinker board is not supported, but the ESP32 Wrover module also works

[andytion]

hey,guts,i think i figure out how to fix this.
in the old version mtmn_config init code is something like

mtmn_config.min_face = 80; mtmn_config.pyramid = 0.8; mtmn_config.p_threshold.score = 0.1; mtmn_config.p_threshold.nms = 0.9; mtmn_config.r_threshold.candidate_number = 10; mtmn_config.r_threshold.score = 0.2; mtmn_config.r_threshold.nms = 0.8; mtmn_config.r_threshold.candidate_number = 5; mtmn_config.o_threshold.score = 0.3; mtmn_config.o_threshold.nms = 0.7; mtmn_config.o_threshold.candidate_number = 3;

and in the new version.there is some new values had been add in the struct mtmn_config_t.
and a new function.
mtmn_init_config()

and i use this function to init my mtmn_config. face_detect() work finaly.

[omathurin]

I confirm andytion's solution worked for me: I'm on 1.0.2 and I just added a call to mtmn_init_config() to initialize the mtmn_config variable in the file app_httpd.cpp:
mtmn_config = mtmn_init_config()

And I managed to see faces detected in the stream (green rectangle around the face) - as expected.

[privet971]

Thanks to andytion and omathurin..... face detection is ok even in 1.0.3rc1

But ......It's not lasting very long, after a few seconds, he made a reset :

MJPG: 6472B 39ms (25.6fps), AVG: 39ms (25.6fps), 0+0+0+0=0 0
MJPG: 6536B 37ms (27.0fps), AVG: 39ms (25.6fps), 0+0+0+0=0 0
MJPG: 6440B 40ms (25.0fps), AVG: 39ms (25.6fps), 0+0+0+0=0 0
MJPG: 6464B 512ms (2.0fps), AVG: 62ms (16.1fps), 141+322+0+0=464 0
CORRUPT HEAP: Bad tail at 0x3f91a883. Expected 0xbaad5678 got 0xbaad5600
assertion "head != NULL" failed: file "/Users/ficeto/Desktop/ESP32/ESP32/esp-idf-public/components/heap/multi_heap_poisoning.c", line 214, function: multi_heap_free
abort() was called at PC 0x400dd32b on core 1

Backtrace: 0x40091648:0x3ffdcb00 0x40091879:0x3ffdcb20 0x400dd32b:0x3ffdcb40 0x400912bd:0x3ffdcb70 0x40087e7a:0x3ffdcb90 0x40089485:0x3ffdcbb0 0x4000bec7:0x3ffdcbd0 0x400e9195:0x3ffdcbf0 0x400e4c77:0x3ffdcc10 0x400e55e6:0x3ffdcc90 0x400d31ee:0x3ffdccf0 0x4012e3ad:0x3ffdcea0 0x4012d601:0x3ffdced0 0x4012d6dd:0x3ffdcf60 0x4012dae8:0x3ffdcf80 0x4012cbf2:0x3ffdcfa0 0x4012cc44:0x3ffdcfe0 0x4008d5e5:0x3ffdd000

Rebooting...

Any ideas to fix that ?

[rvdbreemen]

First big thanks, that fix by andytion works for me too.

But then after flashing and running the software, the face recoginition at least is happening. Then just like privet971, the same thing happens here, after a few frame it just died with a corrupt heap error.

Logs:
..
WiFi connected
Starting web server on port: '80'
Starting stream server on port: '81'
Camera Ready! Use 'http://192.168.88.35' to connect
MJPG: 9291B 305ms (3.3fps), AVG: 305ms (3.3fps), 136+91+0+0=228 0
MJPG: 9316B 244ms (4.1fps), AVG: 274ms (3.6fps), 136+88+0+0=224 0
MJPG: 9333B 250ms (4.0fps), AVG: 266ms (3.8fps), 139+89+0+0=229 0
MJPG: 9323B 285ms (3.5fps), AVG: 271ms (3.7fps), 138+129+0+0=268 0
MJPG: 9298B 297ms (3.4fps), AVG: 276ms (3.6fps), 139+129+0+0=269 0
CORRUPT HEAP: Bad head at 0x3ffded74. Expected 0xabba1234 got 0x00000000
assertion "head != NULL" failed: file "/Users/ficeto/Desktop/ESP32/ESP32/esp-idf-public/components/heap/multi_heap_poisoning.c", line 214, function: multi_heap_free
abort() was called at PC 0x400dd6cb on core 1

Backtrace: 0x40091b44:0x3ffdc8d0 0x40091d75:0x3ffdc8f0 0x400dd6cb:0x3ffdc910 0x400917b9:0x3ffdc940 0x4008840a:0x3ffdc960 0x400899b5:0x3ffdc980 0x4000bec7:0x3ffdc9a0 0x400e9bb1:0x3ffdc9c0 0x400d2f96:0x3ffdc9e0 0x4012b445:0x3ffdcb90 0x4012a699:0x3ffdcbc0 0x4012a775:0x3ffdcc50 0x4012ab80:0x3ffdcc70 0x40129cb6:0x3ffdcc90 0x40129d08:0x3ffdccd0 0x4008dae1:0x3ffdccf0

Rebooting...

But it just rebooted, and then it toke samples again and it started working. There must be something going on, it happened after I tried to add my first face (myself) and then it .

Now it's been running for a few minutes without any issue. Just noticed that the ESP is getting quite hot, maybe running it on 3.3V is better, but it initially would not work at that voltage, so I switched to 5V.

Anyway, just wanted to let you all know!

[rvdbreemen]

And there it is again:
CORRUPT HEAP: Bad tail at 0x3ffdfcc4. Expected 0xbaad5678 got 0x00000000
assertion "head != NULL" failed: file "/Users/ficeto/Desktop/ESP32/ESP32/esp-idf-public/components/heap/multi_heap_poisoning.c", line 214, function: multi_heap_free
abort() was called at PC 0x400dd6cb on core 0

Backtrace: 0x40091b44:0x3ffd41d0 0x40091d75:0x3ffd41f0 0x400dd6cb:0x3ffd4210 0x400917b9:0x3ffd4240 0x4008840a:0x3ffd4260 0x400899b5:0x3ffd4280 0x4000bec7:0x3ffd42a0 0x4008e96b:0x3ffd42c0 0x4010dcb5:0x3ffd42e0 0x4010f499:0x3ffd4300 0x4010fec3:0x3ffd4330 0x400fd379:0x3ffd4350 0x4008dae1:0x3ffd4380

Rebooting...

So the code still has bugs that needs killing ;-)

[andytion]

That happened to me,too. First of all, i suspect is something wrong in my code? But after i debug and test around for a while. I doubt that is there something wrong in the official code? And i try the lastest master branch. After that the annouying multi_heap_free abort() gone finaly.You guys can give it a try~~;-P

[pfeerick]

Both face detection and face recognition work fine for me with the provided CameraWebServer example using 1.0.4 of this core on both the Arduino IDE and PlatformIO... so perhaps this has now actually been fixed?

I'm using an AI-Thinker ESP32-CAM, so my configuration was as follows:

In the main sketch, set my WiFI SSID and Password, comment out //#define CAMERA_MODEL_WROVER_KIT and uncomment #define CAMERA_MODEL_AI_THINKER

On the Arduino IDE, I have the board configured as an ESP32 Wrover Module with a HUGE APP (3MB NO OTA/1MB SPIFFs) partition scheme. Everything else at defaults. On PlatformIO, I used the esp32-cam board type which worked as-is.

Unless faults can be reproduced against the 1.0.4 core, with the stock example (with configuration changes only), hopefully this and the related #2817 can be closed now.