Wanna Use Synchronized Dual Camera for Raspberry Pi 4 or Stereo Camera HAT for Pi 3B+/3? Arducam Makes Them All Come True
Standard Raspberry Pi, like the Pi 4, only offers a single CSI camera connector, but people would love multiple cameras for 3D applications. Arducam has figured out a way to connect the sync two cameras at the same time in 2019, and the following blog tells you all about it.
A year later in Oct. 2020, we have updated this Synchronized Stereo Camera HAT to make it even more universal and powerful. We will keep the products described in this blog but will replace the old HAT with a new one. This old HAT will phase out. You can read about the upgraded solution below.
Raspberry Pi Camera Module 3: An In-Depth Look
Raspberry Pi’s new camera module v3 is finally out. It’s got a fairly competent sensor, the long-awaited autofocus, and also comes at pretty unbeatable prices, just like its predecessors. However, is it as perfect as Read more…
Introducing Camarray: Arducam’s New Solution to Multiple Cameras on Embedded Systems and Edge Devices
Preface As one of the leading companies that pioneers in multiple cameras for popular embedded systems, Arducam now releases the new multi-camera solutions – named Camarray – which allows you to connect and sync up Read more…
Update 2021: The Arudcam stereoscopic camera V2 can leverage Raspberry Pi’s official ISP tuning algorithms, stereo vision on an RPi has come to a new era!
- Two camera Solutions on pi 4, 3B+ and 3 – What you need to know about the background
- New Stereoscopic Camera Breakout Board – Arducam’s Big Step Forward
- Panoramic (3D) photos and videos with Raspberry Pi 4
- Feature and Specification
- Real-time depth mapping – A Typical application in which this stereo solution can be used
- Product Info
Two camera Solutions on pi 4, 3B+ and 3 – What you need to know about the background
When we talk about a new two-camera solution on RPi, we have to mention the background of the stereo Pi camera on this popular open-source hardware platform. For a long time, advanced users of the Raspberry Pi community want to take video or images from multiple cameras simultaneously for 3D vids & pics, face/object detection, stereo robotic vision or advanced surveillance and live-streaming applications, so they want a real stereo camera for raspberry pi 3, 4, and other standard Pi boards. It was an unresolved problem limited by the RPi’s hardware design because the standard Raspberry pi models only have one camera port. Although Arducam has multi-camera adapter boards that let you connect up to 4 cameras to a single pi board, it only actives one camera at a time, and you have to switch between them.
The other alternative is to use network-based synchronization, but you still have to use one Raspberry pi board for each camera setup, and the capture process is still not at the exact same time which will introduce the movement or artifacts between multiple images.
New Stereoscopic Camera Breakout Board – Arducam’s Big Step Forward
Now Arducam released a stereo camera HAT for Raspberry Pi which allows you to connect two 5MP OV5647 or two 8MP IMX219 Pi cameras to a single standard Pi board and takes images or video at the same time. More importantly, this binocular solution makes both cameras fully synchronized. The highlight of this stereo camera HAT is that it incorporates the Arducam proprietary ArduChip solution and extends the usage of the single pi camera port, and it cheats the Raspberry pi as if only one camera connected. It supports and is fully compatible with Raspistill commands for preview, and Raspivid command for video capture/processing with RPi’s default camera driver for its 5MP and 8MP cameras.
Panoramic (3D) photos and videos with Raspberry Pi 4
With the latest Pi 4’s hardware, Arducam makes more camera applications possible for Raspberry Pi 4. This new HAT also supports other Arducam Raspberry Pi cameras and proprietary camera driver that works up to two 16MP, and as the Pi 4 is much more powerful, you can not only shoot two pictures at the same time. With the shared oscillator and I2C broadcasting, the two cameras are fully synchronized in the nanosecond level. These features are excellent for a lot of applications, such as 3D Vision for IoT or panoramics photos and videos. Combined with a nice fisheye camera from Arducam and some image processing software, you can stitch a wonderful panorama with higher resolution and better accuracy.
Feature and Specification
- Support all series Raspberry Pi boards, Pi HAT board style
- Two MIPI camera input and one MIPI camera output
- Support 1, 2 and 4lane MIPI cameras up-to 800Mbps/lane
- Support Raspistill (preview) and Raspivid (processing) commands for 5MP/8MP pi cameras with half-resolution combine
- Support Arducam RPI cameras up to 16MP with proprietary camera driver with full resolution combine
- Support camera side-by-side combine (split – right left), channel 0 and channel 1 software switching on the fly
- Support digital pan in half resolution combine, programmable pan speed control
- Oscillator sharing requires extra cables, soldering skill needed or please use Arducam bundle kit
- Typical Applications in Stereo Vision, 360 Camera, and Advance Surveillance Camera
- Contact us for other platform support
Real-time depth mapping – A Typical application in which this stereo solution can be used
So what is the point of two cameras? The short answer is you will get different information from each camera, and if it’s fully synchronized, it is real-time. The information difference then could be used in applications like distance and depth mapping. To put it simply, this is also a bionic solution because that’s like how eyes work. If you are a user of Google’s camera app, you might have used the “Len Blur” feature in it, which requires you to lift up the camera to take pictures, and that is also image information difference. In this feature, it calculates the distance to decide which object is in the front to stay clear and what else should be blurred in the background, so you can have a picture that seems like it’s from a DSLR lens. However, that is only a simple application used in our daily life, and you can have much more fancy projects like 3d modeling and AR/VR Cameras for Raspberry Pi 4.
That being said, it would be much easier to see what the stereo camera HAT is capable of with a demo. We’ve done a depth mapping demo with this camera HAT and our stereo camera board. Read more from this product’s documents page below if you are interested in this application.
Depth Mapping on Arducam Stereo Camera HAT with OpenCV
Introduction The Arducam Stereo Camera HAT is a revolutionary product that enables you to use two synchronized Pi camera modules on a single standard Raspberry Pi model. The stereo camera setup could be used in Read more…
Aside from this hat’s document page, you can also read more about it on the product page below. You can contact us at [email protected] if you want to purchase this item.
kchen0128 · October 25, 2019 at 1:10 am
To confirm, this would not be compatible with the [B0163] Arducam IMX135 MIPI 13MP Color Camera Module for Raspberry Pi?
arducam19 · October 25, 2019 at 5:52 am
We’ve been working on it.
Carl · November 16, 2019 at 1:27 pm
Whats the timelines looking like for the first hats? And can will I be able to order individual ones before bulk ordering?
Lee Jackson · December 16, 2019 at 5:29 pm
You sure can order a sample to run tests before making a bulk orders. About the timelines, please refer to the documentation.
mohamed Fakhry · November 18, 2019 at 8:52 pm
what is the price of this camera ?
Lee Jackson · December 16, 2019 at 5:25 pm
You may find the price here
atorresani · November 20, 2019 at 2:48 pm
Is this compatible with [B0165] Arducam 1MP OV9281 Mono Global Shutter MIPI Camera Module?
Lee Jackson · December 16, 2019 at 5:43 pm
Yes, you can.
WenLiang Gao · April 14, 2022 at 2:12 pm
Is this compatible with [B0381] Arducam 2MP OV2311 Mono Global Shutter MIPI Camera Module (I don not need ISP, just 8bit Raw data from image sensor)?
Simon Kirkman · November 21, 2019 at 9:33 am
Would I be able to use this to connect a pi and a pi noir to a jeston nano? Or is there a better solution for this?
Lee Jackson · December 16, 2019 at 5:46 pm
If you want to connect two pi NOIRs plus this board to the Nvidia Jetson Nano, yes.
sandary · November 25, 2019 at 3:38 pm
Would it already be possible to receive a prototype to run a test with? Or do you have any estimated time when they’ll be available for ordering?
Lee Jackson · December 16, 2019 at 5:47 pm
It’s available here.
MisterMagoo · December 6, 2019 at 6:59 am
It’s a shame, I can’t seem to find any of these in stock anywhere. :V
Lee Jackson · December 16, 2019 at 5:52 pm
FYI, the 5MP version and the 8MP version.
sf · December 19, 2019 at 10:31 pm
Do you know if both version you posted work with the Nvidia Jeston Nano?
Lee Jackson · February 27, 2020 at 5:51 pm
Yes, both of them can be used with Nano.
Marv · December 9, 2019 at 1:34 pm
Is this stereo HAT compatible with Picamera API?
Lee Jackson · February 27, 2020 at 6:04 pm
Split screening/resolution with two official V2 camera modules or our imx219/OV5647 modules, yes.
If you need full resolution, no.
Charles Adams · December 17, 2019 at 9:26 pm
Will these be sold as just the HATS? or if you are only going to sell them in KITS will there be a combo of some of your cameras that support full resolution split screening?
I’m interested in the potential to have a single Pi run multiple cameras in a 3D printer enclosure and live stream it to YouTube. I need camera modules that can be separated and not tied together.
Lee Jackson · February 27, 2020 at 5:55 pm
You can get the bundle, or just the HAT and pick any two RPI cameras, solder them up and you are good to go.
[email protected] · January 1, 2020 at 4:29 pm
Where can I find documentation for the board?
Lee Jackson · January 18, 2020 at 12:13 am
There you go.
David · January 8, 2020 at 1:37 pm
Is there a timeline on getting these for the Jetson Nano?
Lee Jackson · January 18, 2020 at 12:08 am
We have done it.
Aazim · February 3, 2020 at 3:06 am
Do you sell this board as a standalone not as a bundle?
Lee Jackson · February 27, 2020 at 5:39 pm
Wilhelm · February 21, 2020 at 1:56 am
Can we use opencv to control the cameras with this setup?
Lee Jackson · February 27, 2020 at 5:24 pm
Wei Tuck Cho · February 23, 2020 at 8:55 pm
I bought two OV5647 fisheye 175 degree camera with 22pin. Does it able to connect using 15pin to 22pin FPC cable? Does all cameras need to go through rework instruction with those jumping wires?
Lee Jackson · February 27, 2020 at 5:23 pm
Yes. Instructions can be found here
Cristian Oancea · March 5, 2020 at 12:36 pm
Hello, can I use use this hat on raspberry pi 4 and have two cameras sending video stream to two displays? I want to have one camera on one display and the second camera on the second display in fullscreen.
Lee Jackson · March 23, 2020 at 5:35 pm
You sure can.
Gianluca · March 26, 2020 at 2:30 am
Hi there, I was wondering if the modification documented for 8MP V2 Pi Camera (https://www.arducam.com/docs/cameras-for-raspberry-pi/synchronized-stereo-camera-hat/sync-stereo-camera-hat-user-manual/), consisting in removing resistors and wiring the two cameras is a suggestion to improve the signal or is it mandatory?
Will it work if I don’t modify anything in the two camera sensors? Thanks
Gabriel · April 24, 2020 at 1:10 am
Hello, how far can be each of the camera from each other? I would need them to be at about 3 meters of distance.
Can be done?
Ricardo · May 31, 2020 at 6:17 pm
In the case that I use this hat on raspberry pi 4 and have the two cameras sending video stream to the two displays, I need two HDMI cables coming out of the raspberry pi 4, one for each display?
Lee Jackson · June 1, 2020 at 12:21 am
If you need to use two displays showing different contents on the Pi, then you will be needing two HDMI cables, regardless of what HAT you are using.
Michael · June 7, 2020 at 9:21 pm
Is this compatible with the new Raspberry Pi HQ Camera?
Lee Jackson · June 8, 2020 at 6:58 am
We’ve made it for dual sync cam with Pi HQ camera, and please check this video here: https://youtu.be/WtfhN2yPW4A
Daniel · June 30, 2020 at 10:56 pm
@Lee: is it possible to use 4 cameras synchronized? I’m about to build a “bird-eye-view”, and it needs 4 simultaneous cameras, with literally 0 latency, and with very good framerate above 20fps, but the resolution can be reduced (4 cameras shall be FHD altogether).
[email protected] · July 1, 2020 at 12:09 am
We’ve finished the prototyping and in the middle of the product launch. The HAT to sync 4 cameras will be named Arducam camarray HAT, and you can see from our Pinterest to get an idea of what the product will be like: https://www.pinterest.com/pin/805018502130169305/
rolinster · July 2, 2020 at 3:08 am
I have a need for a 4 camera system where each camera needs to be aimed in a different direction. Can each camera be placed on a separate board to facilitate this setup?
[email protected] · July 2, 2020 at 10:08 pm
Theoretically, the cameras could be placed on separate boards, but that should require the camera board to be customized.
Kisira · July 11, 2020 at 11:51 pm
When will these be back in stock, I cannot seem to find them from any seller worldwide or in the US.
[email protected] · July 12, 2020 at 5:43 pm
We have been distributing the synchronized stereo camera hat in 5MP and 8MP bundles, and distributors like UCTRONICS have these bundles in stock.
Kisira · July 15, 2020 at 12:03 am
Yes you have for the stereo camera but the b hat with synchronized camera is not. My use case is similar to the one shown in the video. The ability to see forward and backwards at the same time.
Madhavi Gambhire · August 5, 2020 at 3:26 am
I wish to use 2 synchronized cameras to pi 3B, 1 camera with enough high resolution to capture number plate of a car and second camera must be thermal or Noir camera which can detect heat coming out of exhaust pipe of a car. Can this possible from this module?
[email protected] · August 5, 2020 at 6:07 pm
The Arducam Synchronized Stereo Camera HAT is designed for synchronizing two cameras with the same model.
Amos · August 13, 2020 at 1:21 pm
Hello – would this be suitable for a remote call setup that points one camera at the participant’s face and the other at their hands / table top, and sends the video for both via separate jitsi meet webcalls? Is it possible to get the cameras about 30 cm apart? Thanks in advance.
Pierpaolo · August 17, 2020 at 6:00 am
Hi, where can i find the scheme to connect the two imx477 cameras like in the video you have already shared (https://youtu.be/WtfhN2yPW4A)? I need to use the two stereo cameras synced in order to have a side by side with at least 30fps, very low latency and at the higher resolution possible. Thanks
Jefrey Hipp · August 28, 2020 at 4:37 pm
Hacen envios a la ciudad de Guaetemala?
Amato · September 6, 2020 at 9:17 am
Do raspi4b, arducam synchronized stereo hat and imx477 cameras work together or do I need special software. ? Thanks
Pascal · September 17, 2020 at 2:53 am
Hello, Can we use this on standard V4L2 and OpenCV video capture ?
[email protected] · September 17, 2020 at 6:02 pm
You can refer to this demo of Depth Mapping on Arducam Stereo Camera HAT with OpenCV.
Marko Mandaric · November 29, 2020 at 1:17 am
I see the stand-alone HAT has been discontinued.
Is it still possible to purchase the available HAT + stereo camera bundle and use the new HQ camera (Sony IMX477R) instead? I’m interested in a 360* setup.
Ashely · November 29, 2020 at 5:53 pm
Yes, contact us now: https://www.arducam.com/contact-arducam/
We will respond to you shortly after submitting.
Mike · July 9, 2022 at 11:04 pm
@Can the new 64MP cameras be used with this HAT?
csmeutah · October 12, 2022 at 7:03 am
How far apart are the lenses on the 8MP IMX219 stereo camera board?