Skip to content

Portenta H7: Trying to add the Camera/GC2145 support #78

New issue
New issue
Open
Open
Portenta H7: Trying to add the Camera/GC2145 support#78
Assignees
iabdalkader
@KurtE

Description

@KurtE
KurtE
opened on Feb 25, 2025

For the fun of it, I thought I would try to add the Camera support that was added to the GIGA to the Portenta H7.

I now have it building and the camera makes it through the begin call, but the camera soon errors out:

In case anyone wishes to play along:

Here are my overlay and config file.

arduino_portenta_h7_m7.zip

I also needed to edit the fixups.c to allow the Portenta to work.
Changed the line that had GIGA and added portenta:

#if (defined(CONFIG_BOARD_ARDUINO_GIGA_R1) || defined(CONFIG_BOARD_ARDUINO_PORTENTA_H7)) && defined(CONFIG_VIDEO)

The error code shown in monitor window:
[00:00:14.808,000] <wrn> video_stm32_dcmi: HAL_DCMI_ErrorCallback(41)
Note: I edited the file to add the error code, which is error DMA overrun I believe.

Now back to playing

Activity

KurtE

KurtE commented on Feb 25, 2025

@KurtE
KurtE
on Feb 25, 2025 · edited by KurtE
Author

Quick update:
Looking at where this message is generated: [00:00:14.808,000] video_stm32_dcmi: HAL_DCMI_ErrorCallback(41)
It is in the zephyr/drivers/video/vides_stm32_dcmi.c

void HAL_DCMI_ErrorCallback(DCMI_HandleTypeDef *hdcmi)
{
	LOG_WRN("%s(%x)", __func__, hdcmi->ErrorCode);
}

Which is called from: the modules\hal\stm32\stm32cure\stm32h7xx\drivers\src\stm32h7xx_hal_dma.c
from the function:
HAL_StatusTypeDef HAL_DMA_Abort_IT(DMA_HandleTypeDef *hdma)
which was called by the (same directory) stm32h7xx_hal_dcmi.c
from: void HAL_DCMI_IRQHandler(DCMI_HandleTypeDef *hdcmi)
Where it sets the error callback to the HAL_DCMI_ErrorCallback.

So my read of this is, that in this case we receive that one message, and the DMA stream is stopped, we probably
need to call something to restart it?

Something like: HAL_DCMI_Start_DMA ?

@pillo79 and/or @facchinm - Does this make sense?

KurtE

KurtE commented on Mar 3, 2025

@KurtE
KurtE
on Mar 3, 2025
Author

For the fun (or pain) of it, I thought it might be interesting to try adapting to a different camera that zephyr supports, such as the
OV2640 and OV5640. So today I (actually both of us) have tried to setup for the OV5640. I have a couple of them that the two of us
a while ago, were experimenting with, in adapting and extending the camera library to work on the Teensy 4.x boards.

So far it is not working yet. Some of the issues we have run into include:

a) Reset/power down pins - The name of the power down pin is different: powerdown-gpios versus pwdn-gpios
Also the Adafruit OV5640 and maybe others, the camera is powered down when the pin has a high signal, not low.

b) the port { area - looks like they use remote-endpoint-label instead of remote-endpoint and they have different
data associated with them.

c) the current OV5640 object does not currently support the size 320x240 size of image.
Actually, only support (1280x720) and 640x480). The camera reference shows that they support several other resolutions as well,
like 2592x1944, 1920x1080, 1280x960. And can support several others by setting up windows within...

So far I have not gotten past the camera initializing, but will try some more tomorrow. Will also try the OV2640 as well.

mjs513

mjs513 commented on Mar 3, 2025

@mjs513
mjs513
on Mar 3, 2025

Theres a lot more that @KurtE didn't mentioned that we noticed. As mentioned for the OV5640 camera failed to start until we releasized about reset and powerdown pin states via a LA trace that Kurte did.

  1. DCMI DMA ERRORS:
    Once started noticed a error messages on Serial1:
[00:00:10.008,000] <err> video_stm32_dcmi: Failed to start DCMI DMA
[00:00:15.017,000] <err> video_stm32_dcmi: Failed to start DCMI DMA
[00:00:20.026,000] <err> video_stm32_dcmi: Failed to dequeue a DCMI buffer.
[00:00:25.036,000] <err> video_stm32_dcmi: Failed to dequeue a DCMI buffer.

Digging a bit deeper noticed in driver that we are currently using in the core it is starting the stream with IO as mipi vs dvp? Think we are using DVP for the GC2145. The above errors are coming from video_stm32_dcmi.c

static int ov5640_stream_start(const struct device *dev)
{
	const struct ov5640_config *cfg = dev->config;
	/* Power up MIPI PHY HS Tx & LP Rx in 2 data lanes mode */
	int ret = ov5640_write_reg(&cfg->i2c, IO_MIPI_CTRL00_REG, 0x45);

	if (ret) {
		LOG_ERR("Unable to power up MIPI PHY");
		return ret;
	}
	return ov5640_write_reg(&cfg->i2c, SYS_CTRL0_REG, SYS_CTRL0_SW_PWUP);
}

Though I am not seeing an error for unable to power up MIPI. The latest driver for the OV5640 actually provides support for both: https://github.com/zephyrproject-rtos/zephyr/blob/main/drivers/video/ov5640.c

  1. @KurtE mention about available resolutions. There is an open issue on zephyr about that: video: ov5640 support for vga , qvga and qqvga not there zephyrproject-rtos/zephyr#86519, that @KurtE found yesterday. Kurt mentioned that we played with this camera on the Teensy 4 so I modified the ov5640_reg low_res_params to support the lower resoutions but hard to test.

  2. While @KurtE was testing the OV2640 I tried the OV7670 and again managed to get camera started but received the same DCMI errors:

[00:00:10.008,000] <err> video_stm32_dcmi: Failed to start DCMI DMA
[00:00:15.017,000] <err> video_stm32_dcmi: Failed to start DCMI DMA
[00:00:20.026,000] <err> video_stm32_dcmi: Failed to dequeue a DCMI buffer.
[00:00:25.036,000] <err> video_stm32_dcmi: Failed to dequeue a DCMI buffer.
KurtE

KurtE commented on Mar 3, 2025

@KurtE
KurtE
on Mar 3, 2025
Author

Thanks @mjs513 for filling in a lot of the gaps, Will try 2640 next as it looks like there may be more complete information in the driver.

One thing that I keep wondering about, is once more of Arduino integration with zephyr is completed. How do you expect it
will work. That is the MBED version I believe supported 4 cameras. It was reasonably easy to switch between them.
With this current version on Zephyr, there may be Several more cameras. How can different sketches choose which one to use?
Will the Overlay(s) allow multiple cameras to be included. How then to choose?

The chosen{zephyr,camera = &dcmi; Sort of maybe allows you choose to use the hardware camera subsystem, but currently
not necessarily which actual camera, the DCMI should be configured for.

I am assuming that once the real basics of the camera are working, that a lot more of the functionality of the MBED camera library will be added.

But now back to trying some of the basics.

KurtE

KurtE commented on Mar 3, 2025

@KurtE
KurtE
on Mar 3, 2025
Author

Quick update: currently the OV2640 shows more promise than the OV5640.

Note: I changed all of the 5640 to 2640 in overlay and config file. Also noted that it has a different I2C address of 0x30, so
changed that in two places.

Build first failed as POWERDOWN pin is not defined in their yaml file... so commented out that line.

Images are not good yet, Sort of like I am seeing from GC2145.

Image
Note: the ceiling in my office does not look like that ;)

The images of the GC2145 are similar. I am not getting the same error on the OV2640...
And runs for long time. I do get the: could not get buffer a few times, but...

mjs513

mjs513 commented on Mar 4, 2025

@mjs513
mjs513
on Mar 4, 2025

@KurtE
I hacked up the existing ov5640.c file to take the initialization arrays and a couple of things from the 5640.c that looks like will be in release 4.1 as a quick and dirty test and did get a totally out of synch image and lot of errors on serial1 about dma buffers.

Image

So don;t think I am going to do anything else on the 5640 until I see if the incoporarte the driver changes. Otherwise I will rewriting it completely

KurtE

KurtE commented on Mar 4, 2025

@KurtE
KurtE
on Mar 4, 2025
Author

Quick update: OV2640.
I added debug code to the ov2640.c to printk all of the registers that are set by the code. Plus when I know them their name.
Code extracted/modified from our Teensy code. Note: the processing image still looks like the one I posted yesterday:

*** Booting Zephyr OS build v3.7.0-8126-g33bc8a018ecc ***
Camera::begin(320 240 0 0)
        Choosen: 0x808080c
        Requested caps: w:320 h:240 fmt:50424752
        0: w:160 h:120 fmt:50424752
        1: w:176 h:144 fmt:50424752
        2: w:240 h:160 fmt:50424752
        3: w:240 h:240 fmt:50424752
        4: w:320 h:240 fmt:50424752
[00:00:02.038,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 0)
[00:00:02.047,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (da, 8)-  IMAGE_MODE
[00:00:02.087,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 0)
[00:00:02.096,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (5, 1)-  R_BYPASS
[00:00:02.105,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (5a, 50)-  ZMOW
[00:00:02.115,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (5b, 3c)-  ZMOH
[00:00:02.125,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (5c, 0)-  ZMHH
[00:00:02.134,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 1)
[00:00:02.143,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (11, 87)-  CLKRC
[00:00:02.153,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 1)
[00:00:02.161,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (12, 0)-  COM7
[00:00:02.171,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (3, f)-  COM1
[00:00:02.180,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (32, 36)-  REG32
[00:00:02.190,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (17, 11)-  HREFST
[00:00:02.200,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (18, 75)-  HREFEND
[00:00:02.210,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (19, 1)-  VSTRT
[00:00:02.219,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (1a, 97)-  VEND
[00:00:02.229,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (3d, 34)
[00:00:02.238,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (35, 88)
[00:00:02.247,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (22, a)
[00:00:02.255,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (37, 40)
[00:00:02.264,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (34, a0)-  ARCOM2
[00:00:02.274,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (6, 2)
[00:00:02.283,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (d, b7)-  COM4
[00:00:02.292,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (e, 1)
[00:00:02.301,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (42, 83)
[00:00:02.310,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 0)
[00:00:02.319,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (5, 1)-  R_BYPASS
[00:00:02.329,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (e0, 4)-  RESET
[00:00:02.338,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (c0, c8)-  HSIZE8
[00:00:02.348,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (c1, 96)-  VSIZE8
[00:00:02.358,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (8c, 0)-  SIZEL
[00:00:02.367,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (53, 0)-  XOFFL
[00:00:02.377,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (54, 0)-  YOFFL
[00:00:02.387,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (51, 90)-  HSIZE
[00:00:02.396,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (52, 2c)-  VSIZE
[00:00:02.406,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (55, 88)-  VHYX
[00:00:02.415,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (57, 0)-  TEST
[00:00:02.425,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (86, 3d)-  CTRL2
[00:00:02.435,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (50, 80)-  CTRLI
[00:00:02.444,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (d3, 84)-  R_DVP_SP
[00:00:02.454,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (5, 0)-  R_BYPASS
[00:00:02.464,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (e0, 0)-  RESET
[00:00:02.473,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (0, 0)-  R_BYPASS_DSP_EN
[00:00:02.484,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 0)
[00:00:02.493,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (5, 0)-  R_BYPASS
[00:00:02.532,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 1)
[00:00:02.542,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (4, 28)-  REG04
[00:00:02.551,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (ff, 1)
[00:00:02.560,000] <dbg> video_ov2640: DBG_OV2640WriteReg: (4, 28)-  REG04
uart:~$

As a comparison, here is the debug output I just ran on a Teensy Micromod using OV2640 and displayed on an ILI9341 display:
Note: in this output, the code shows each of them as they are set, and then later prints a summary of the current setting for
each of the registers we touched:

Start Display CS:5 DC:4 RST:2
hm0360 Camera Test
FLEXIO_CUSTOM_LIKE_8_BIT
------------------
Using Micromod ATP Adapter
  VS=33, HR=32, PC=10 XC=29
  RST=31(-2), PWDN=30(-1)
  _dpins(0)=40
  _dpins(1)=41
  _dpins(2)=42
  _dpins(3)=43
  _dpins(4)=44
  _dpins(5)=45
  _dpins(6)=6
  _dpins(7)=9
MAP Pin 29(0x401f8090)
Warning pin: 29 is not a known CSI pin
** beginXCLK PWM **
getModelID: return: 2642
getModelID: return: 2642
Calling ov7670_configure
Cam Name: 3, Format: 2, Resolution: 2, Clock: 12
Frame rate: 8
hardware_configure - try CSI
MAP Pin 33(0x401f8030)
Warning pin: 33 is not a known CSI pin
	failed try FLEXIO
Custom - Flexio is 8 bit mode

@@@ SetVSYNC ISR priority: 102 camera Input:1
cameraWriteRegister(ff, 0)
cameraWriteRegister(2c, ff)
cameraWriteRegister(2e, df)
cameraWriteRegister(ff, 1)
cameraWriteRegister(3c, 32)
cameraWriteRegister(11, 82) -  CLKRC
cameraWriteRegister(9, 2) -  COM2
cameraWriteRegister(4, f8) -  REG04
cameraWriteRegister(13, e5) -  COM8
cameraWriteRegister(14, 48) -  COM9
cameraWriteRegister(2c, c)
cameraWriteRegister(33, 78)
cameraWriteRegister(3a, 33)
cameraWriteRegister(3b, fb)
cameraWriteRegister(3e, 0)
cameraWriteRegister(43, 11)
cameraWriteRegister(16, 10)
cameraWriteRegister(39, 2)
cameraWriteRegister(35, 88)
cameraWriteRegister(22, a)
cameraWriteRegister(37, 40)
cameraWriteRegister(23, 0)
cameraWriteRegister(34, a0) -  ARCOM2
cameraWriteRegister(6, 2)
cameraWriteRegister(6, 88)
cameraWriteRegister(7, c0)
cameraWriteRegister(d, b7) -  COM4
cameraWriteRegister(e, 1)
cameraWriteRegister(4c, 0)
cameraWriteRegister(4a, 81)
cameraWriteRegister(21, 99)
cameraWriteRegister(24, 40) -  AEW
cameraWriteRegister(25, 38) -  AEB
cameraWriteRegister(26, 82) -  VV
cameraWriteRegister(5c, 0)
cameraWriteRegister(63, 0)
cameraWriteRegister(46, 22) -  FLL
cameraWriteRegister(c, 3a) -  COM3
cameraWriteRegister(5d, 55) -  REG5D
cameraWriteRegister(5e, 7d) -  REG5E
cameraWriteRegister(5f, 7d) -  REG5F
cameraWriteRegister(60, 55) -  REG60
cameraWriteRegister(61, 70) -  HISTO_LOW
cameraWriteRegister(62, 80) -  HISTO_HIGH
cameraWriteRegister(7c, 5)
cameraWriteRegister(20, 80) -  COM8_BNDF_EN
cameraWriteRegister(28, 30)
cameraWriteRegister(6c, 0)
cameraWriteRegister(6d, 80)
cameraWriteRegister(6e, 0)
cameraWriteRegister(70, 2)
cameraWriteRegister(71, 94)
cameraWriteRegister(73, c1)
cameraWriteRegister(3d, 34)
cameraWriteRegister(12, 4) -  COM7
cameraWriteRegister(5a, 57)
cameraWriteRegister(4e, 0) -  COM25
cameraWriteRegister(4f, bb) -  BD50
cameraWriteRegister(50, 9c) -  BD60
cameraWriteRegister(ff, 0)
cameraWriteRegister(e5, 7f)
cameraWriteRegister(f9, c0) -  MC_BIST
cameraWriteRegister(41, 24)
cameraWriteRegister(e0, 14) -  RESET
cameraWriteRegister(76, ff)
cameraWriteRegister(33, a0)
cameraWriteRegister(42, 20)
cameraWriteRegister(43, 18)
cameraWriteRegister(4c, 0)
cameraWriteRegister(87, d0) -  CTRL3
cameraWriteRegister(88, 3f)
cameraWriteRegister(d7, 3)
cameraWriteRegister(d9, 10)
cameraWriteRegister(d3, 82) -  R_DVP_SP
cameraWriteRegister(c8, 8)
cameraWriteRegister(c9, 80)
cameraWriteRegister(7c, 0) -  BPADDR
cameraWriteRegister(7d, 0) -  BPDATA
cameraWriteRegister(7c, 3) -  BPADDR
cameraWriteRegister(7d, 48) -  BPDATA
cameraWriteRegister(7d, 48) -  BPDATA
cameraWriteRegister(7c, 8) -  BPADDR
cameraWriteRegister(7d, 20) -  BPDATA
cameraWriteRegister(7d, 10) -  BPDATA
cameraWriteRegister(7d, e) -  BPDATA
cameraWriteRegister(90, 0)
cameraWriteRegister(91, e)
cameraWriteRegister(91, 1a)
cameraWriteRegister(91, 31)
cameraWriteRegister(91, 5a)
cameraWriteRegister(91, 69)
cameraWriteRegister(91, 75)
cameraWriteRegister(91, 7e)
cameraWriteRegister(91, 88)
cameraWriteRegister(91, 8f)
cameraWriteRegister(91, 96)
cameraWriteRegister(91, a3)
cameraWriteRegister(91, af)
cameraWriteRegister(91, c4)
cameraWriteRegister(91, d7)
cameraWriteRegister(91, e8)
cameraWriteRegister(91, 20)
cameraWriteRegister(92, 0)
cameraWriteRegister(93, 6)
cameraWriteRegister(93, e3)
cameraWriteRegister(93, 3)
cameraWriteRegister(93, 3)
cameraWriteRegister(93, 0)
cameraWriteRegister(93, 2)
cameraWriteRegister(93, 0)
cameraWriteRegister(93, 0)
cameraWriteRegister(93, 0)
cameraWriteRegister(93, 0)
cameraWriteRegister(93, 0)
cameraWriteRegister(93, 0)
cameraWriteRegister(93, 0)
cameraWriteRegister(96, 0)
cameraWriteRegister(97, 8)
cameraWriteRegister(97, 19)
cameraWriteRegister(97, 2)
cameraWriteRegister(97, c)
cameraWriteRegister(97, 24)
cameraWriteRegister(97, 30)
cameraWriteRegister(97, 28)
cameraWriteRegister(97, 26)
cameraWriteRegister(97, 2)
cameraWriteRegister(97, 98)
cameraWriteRegister(97, 80)
cameraWriteRegister(97, 0)
cameraWriteRegister(97, 0)
cameraWriteRegister(a4, 0)
cameraWriteRegister(a8, 0)
cameraWriteRegister(c5, 11)
cameraWriteRegister(c6, 51)
cameraWriteRegister(bf, 80)
cameraWriteRegister(c7, 10)
cameraWriteRegister(b6, 66)
cameraWriteRegister(b8, a5)
cameraWriteRegister(b7, 64)
cameraWriteRegister(b9, 7c)
cameraWriteRegister(b3, af)
cameraWriteRegister(b4, 97)
cameraWriteRegister(b5, ff)
cameraWriteRegister(b0, c5)
cameraWriteRegister(b1, 94)
cameraWriteRegister(b2, f)
cameraWriteRegister(c4, 5c)
cameraWriteRegister(a6, 0)
cameraWriteRegister(a7, 20)
cameraWriteRegister(a7, d8)
cameraWriteRegister(a7, 1b)
cameraWriteRegister(a7, 31)
cameraWriteRegister(a7, 0)
cameraWriteRegister(a7, 18)
cameraWriteRegister(a7, 20)
cameraWriteRegister(a7, d8)
cameraWriteRegister(a7, 19)
cameraWriteRegister(a7, 31)
cameraWriteRegister(a7, 0)
cameraWriteRegister(a7, 18)
cameraWriteRegister(a7, 20)
cameraWriteRegister(a7, d8)
cameraWriteRegister(a7, 19)
cameraWriteRegister(a7, 31)
cameraWriteRegister(a7, 0)
cameraWriteRegister(a7, 18)
cameraWriteRegister(7f, 0)
cameraWriteRegister(e5, 1f)
cameraWriteRegister(e1, 77)
cameraWriteRegister(dd, 7f)
cameraWriteRegister(c2, e) -  CTRL0
cameraWriteRegister(ff, 1)
cameraWriteRegister(f, 4b)
cameraWriteRegister(3, 8f) -  COM1
cameraWriteRegister(ff, 0)
cameraWriteRegister(5, 0) -  R_BYPASS
cameraWriteRegister(da, 9) -  IMAGE_MODE
cameraWriteRegister(d7, 3)
cameraWriteRegister(e0, 0) -  RESET
cameraWriteRegister(5, 0) -  R_BYPASS
UXGA Width: 1600, Height: 1200
Width: 320, Height: 240
cameraWriteRegister(ff, 1)
cameraWriteRegister(12, 40) -  COM7
cameraWriteRegister(3, 8a) -  COM1
cameraWriteRegister(17, 11) -  HREFST
cameraWriteRegister(18, 43) -  HREFEND
cameraWriteRegister(19, 1) -  VSTRT
cameraWriteRegister(1a, 97) -  VEND
cameraWriteRegister(32, 9) -  REG32
cameraWriteRegister(ff, 0)
cameraWriteRegister(e0, 4) -  RESET
cameraWriteRegister(8c, 0) -  SIZEL
cameraWriteRegister(c0, 64) -  HSIZE8
cameraWriteRegister(c1, 4b) -  VSIZE8
cameraWriteRegister(86, 3d) -  CTRL2
Sensor w,h: 800 - 600
sensor_w / w: 2, sensor_h / h: 2
temp_div: 2, log_div: 0, div: 1
w_mul: 640, h_mul: 480
x_off: 80, y_off: 60
cameraWriteRegister(50, 89) -  CTRLI
cameraWriteRegister(51, a0) -  HSIZE
cameraWriteRegister(52, 78) -  VSIZE
cameraWriteRegister(53, 50) -  XOFFL
cameraWriteRegister(54, 3c) -  YOFFL
cameraWriteRegister(55, 0) -  VHYX
cameraWriteRegister(57, 0) -  TEST
cameraWriteRegister(5a, 50) -  ZMOW
cameraWriteRegister(5b, 3c) -  ZMOH
cameraWriteRegister(5c, 0) -  ZMHH
cameraWriteRegister(d3, 2) -  R_DVP_SP
cameraWriteRegister(e0, 0) -  RESET
Set PLL: clk_2x: 1, clk_div: 3, pclk_auto: 1, pclk_div: 8
c.clk value: 131
c.pclk value: 136
cameraWriteRegister(ff, 1)
cameraWriteRegister(11, 83) -  CLKRC
cameraWriteRegister(ff, 0)
cameraWriteRegister(d3, 88) -  R_DVP_SP
cameraWriteRegister(ff, 0)
cameraWriteRegister(5, 0) -  R_BYPASS
Begin status: 1
cameraWriteRegister(ff, 1)
cameraWriteRegister(4, 78) -  REG04
cameraWriteRegister(ff, 1)
cameraWriteRegister(4, 28) -  REG04
cameraWriteRegister(ff, 0)
cameraWriteRegister(c7, 40)
Camera settings:
	width = 320
	height = 240

TFT Width = 320 Height = 240

ImageSize (w,h): 320, 240
cameraWriteRegister(ff, 1)
cameraWriteRegister(12, 40) -  COM7

*** Camera Registers ***
cameraWriteRegister(ff, 0)
(0)  QS(44): 12(c)
(0)  HSIZE(51): 160(a0)
(0)  VSIZE(52): 120(78)
(0)  XOFFL(53): 80(50)
(0)  YOFFL(54): 60(3c)
(0)  VHYX(55): 0(0)
(0)  DPRP(56): 0(0)
(0)  TEST(57): 0(0)
(0)  ZMOW(5a): 80(50)
(0)  ZMOH(5b): 60(3c)
(0)  ZMHH(5c): 0(0)
(0)  BPADDR(7c): 11(b)
(0)  BPDATA(7d): 0(0)
(0)  SIZEL(8c): 0(0)
(0)  HSIZE8(c0): 100(64)
(0)  VSIZE8(c1): 75(4b)
(0)  CTRL1(c3): 255(ff)
(0)  MS_SP(f0): 4(4)
(0)  SS_ID(f7): 96(60)
(0)  SS_CTRL(f7): 96(60)
(0)  MC_AL(fa): 0(0)
(0)  MC_AH(fb): 0(0)
(0)  MC_D(fc): 0(0)
(0)  P_CMD(fd): 0(0)
(0)  P_STATUS(fe): 60(3c)
(0)  CTRLI(50): 137(89)
(0)  CTRLI_LP_DP(80): 0(0)
(0)  CTRLI_ROUND(40): 51(33)
(0)  CTRL0(c2): 14(e)
(0)  CTRL2(86): 61(3d)
(0)  CTRL3(87): 208(d0)
(0)  R_DVP_SP(d3): 136(88)
(0)  R_DVP_SP_AUTO_MODE(80): 0(0)
(0)  R_BYPASS(5): 0(0)
(0)  R_BYPASS_DSP_EN(0): 0(0)
(0)  R_BYPASS_DSP_BYPAS(1): 0(0)
(0)  IMAGE_MODE(da): 9(9)
(0)  RESET(e0): 0(0)
(0)  MC_BIST(f9): 192(c0)
(0)  BANK_SEL(ff): 0(0)
(0)  BANK_SEL_DSP(0): 0(0)
(0)  BANK_SEL_SENSOR(1): 0(0)
cameraWriteRegister(ff, 1)
(1)  GAIN(0): 0(0)
(1)  COM1(3): 138(8a)
(1)  REG_PID(a): 38(26)
(1)  REG_VER(b): 66(42)
(1)  COM4(d): 183(b7)
(1)  AEC(10): 178(b2)
(1)  CLKRC(11): 131(83)
(1)  CLKRC_DOUBLE(82): 0(0)
(1)  CLKRC_DIVIDER_MASK(3f): 1(1)
(1)  COM10(15): 0(0)
(1)  HREFST(17): 17(11)
(1)  HREFEND(18): 67(43)
(1)  VSTRT(19): 1(1)
(1)  VEND(1a): 151(97)
(1)  MIDH(1c): 127(7f)
(1)  MIDL(1d): 162(a2)
(1)  AEW(24): 64(40)
(1)  AEB(25): 56(38)
(1)  REG2A(2a): 0(0)
(1)  FRARL(2b): 0(0)
(1)  ADDVSL(2d): 0(0)
(1)  ADDVSH(2e): 0(0)
(1)  YAVG(2f): 79(4f)
(1)  HSDY(30): 8(8)
(1)  HEDY(31): 48(30)
(1)  REG32(32): 9(9)
(1)  ARCOM2(34): 160(a0)
(1)  REG45(45): 1(1)
(1)  FLL(46): 34(22)
(1)  FLH(47): 0(0)
(1)  COM19(48): 0(0)
(1)  ZOOMS(49): 0(0)
(1)  COM22(4b): 32(20)
(1)  COM25(4e): 0(0)
(1)  BD50(4f): 187(bb)
(1)  BD60(50): 156(9c)
(1)  REG5D(5d): 85(55)
(1)  REG5E(5e): 125(7d)
(1)  REG5F(5f): 125(7d)
(1)  REG60(60): 85(55)
(1)  HISTO_LOW(61): 112(70)
(1)  HISTO_HIGH(62): 128(80)
(1)  REG04(4): 43(2b)
(1)  REG08(8): 64(40)
(1)  COM2(9): 2(2)
(1)  COM2_STDBY(10): 55(37)
(1)  COM3(c): 58(3a)
(1)  COM7(12): 64(40)
(1)  COM8(13): 229(e5)
(1)  COM8_DEFAULT(c0): 0(0)
(1)  COM8_BNDF_EN(20): 128(80)
(1)  COM8_AGC_EN(4): 43(2b)
(1)  COM8_AEC_EN(1): 0(0)
(1)  COM9(14): 72(48)
(1)  CTRL1_AWB(8): 64(40)
(1)  VV(26): 130(82)
(1)  REG32(32): 9(9)
Window Hor: (137 - 537) = 400 * 2 = 800 Vert: (6 - 606) = 600 * 2 = 1200
cameraWriteRegister(ff, 0)
device	Size H: 160 * 4 = 640 V: 120 * 4 = 480
	 offset H: 80 V: 60

Image of setup:

Image

mjs513

mjs513 commented on Mar 5, 2025

@mjs513
mjs513
on Mar 5, 2025

Did manage to get an image out of the ov7670

Image

Still dies after a while with the errors you see with DCMI failed callback.

to get it working to this point

  1. Changed pixel clock to 12 mhz (not sure if 10 may work better).
  2. changed hsynch and vsynch to active high in ov7670.c
	/* configure the output timing */
	/* Free running PCLK, default VSYNC, HSYNC and PCLK */
	{OV7670_COM10, 0x03}, /* COM10 */
	{OV7670_COM12, 0x00}, /* COM12,No HREF when VSYNC is low */

after reading this:
zephyrproject-rtos/zephyr#84229

however doesn't look like that change made it into 4.1-rc2

mjs513

mjs513 commented on Mar 5, 2025

@mjs513
mjs513
on Mar 5, 2025

Just as a quick update I switched to using portenta mid-carrier with the ov7670 and image quality improved drastically but still hit the error message when it stops noted in previous posts:

Image

Do have to hit reset a couple of times to get more that a single image to display. Then I will get may 10-12 then it errors out.

Did verify that you have to update to {OV7670_COM10, 0x03}, /* COM10 */ otherwise will get no images.

KurtE

KurtE commented on Mar 5, 2025

@KurtE
KurtE
on Mar 5, 2025
Author

Will have to try it in the morning. Looks a lot better

facchinm
assigned
iabdalkader
on Mar 5, 2025
mjs513

mjs513 commented on Mar 8, 2025

@mjs513
mjs513
on Mar 8, 2025

See this issue as well: #81

mjs513
mentioned this on Mar 8, 2025
iabdalkader

iabdalkader commented on Mar 8, 2025

@iabdalkader
iabdalkader
on Mar 8, 2025

I've sent a fix for the pixel format array: zephyrproject-rtos/zephyr#86810

Only the GC2145 has been tested and known to work well enough with the Giga. The rest of the sensors all have issues, bad regs, bad config, buggy drivers etc... I don't know the state of the H7 support and whether it can use the cameras or not.

Note if the colors look wrong, try passing True in the last argument: cam.begin(DISPLAY_W, DISPLAY_H, CAMERA_RGB565, true)

mjs513

mjs513 commented on Mar 8, 2025

@mjs513
mjs513
on Mar 8, 2025

@iabdalkader

I have been having issues with the GC2145 on the GIGA and H7 but going to try and sort it out. Basically on Giga looks like its running if I watch the Serial1 spew and on the H7 will see 1 frame in the visualizer. In both cases get this message and then it halts:

 **_<wrn> video_stm32_dcmi: HAL_DCMI_ErrorCallback_**

Again using the H7:

  1. The 5640 looks like the driver has major issues with reg settings etc. Did try and hack it to use settings from other sources including openmv. DId get that messed up image in Portenta H7: Trying to add the Camera/GC2145 support #78 (comment) then said forget since it looks like they redid the driver in a later release.

  2. On the other hand had alot better luck with the OV7670 by making one change in the driver:

	/* configure the output timing */
	/* Free running PCLK, default VSYNC, HSYNC and PCLK */
	{OV7670_COM10, 0x03}, /* COM10 */
	{OV7670_COM12, 0x00}, /* COM12,No HREF when VSYNC is low */

also set clock to 12Mhz and using FIFO_FULL then will run for a couple of minutes but will eventually get the:

[00:00:24.443,000] <dbg> video_stm32_dcmi: HAL_DCMI_FrameEventCallback: Failed to get buffer from fifo
[00:00:24.571,000] <dbg> video_stm32_dcmi: HAL_DCMI_FrameEventCallback: Failed to get buffer from fifo
[00:01:40.769,000] <wrn> video_stm32_dcmi: HAL_DCMI_ErrorCallback

Image

17 remaining items

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

    Development

    No branches or pull requests

      Participants

      @KurtE@iabdalkader@mjs513

      Issue actions
        Portenta H7: Trying to add the Camera/GC2145 support · Issue #78 · arduino/ArduinoCore-zephyr