topic Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens in Camera Software

Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

michaelpedrosa — Wed, 30 Mar 2022 20:43:21 GMT

Hello,

I'm wondering if there are any solutions to live stream content with R5 and 5.2mm L Dual fisheye Lens. If so, what does that workflow look like? I understand using the canon software to create VR content, but I'm specifically looking to stream a live event in real time using an R5 or R5c using the 5.2mm L Dual fisheye Lens. Thanks for the help!

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

shadowsports — Thu, 31 Mar 2022 04:02:50 GMT

You can use the Canon Mobile App or EOS Utility for Live View. Streaming might be a different story. I'm no sure, but I don't think what you capture will like right until you put it through the VR utility in post.

Here's more from Canon about the lens:

Shoot VR with Canon’s New RF5.2mm F2.8 L Dual Fisheye Lens - YouTube

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

Tronhard — Fri, 01 Apr 2022 01:49:02 GMT

That's my understanding too. I never thought that a lens with such exotic optics would be used for live streaming - the downloading and processing of what is essentially two lenses at once is asking a lot from any camera.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

WillSteeleNYC — Wed, 04 May 2022 18:11:05 GMT

Most VR Video creators actually prefer to post process the raw footage/stream from the camera anyway. So the main question is what are the viable ways to get an 8K live feed from the r5 r5c? I'd use the 8K HDMI output, but there aren't any 8K HDMI capture cards yet. I believe the cameras support some kind of feature to be recognized as an 8K webcam, but I doubt that works with 8K. So many camera manufacturers support RTMP, but RTMP always introduces unacceptable latency for me. NDI or SRT would be great, but at the moment I'll take what I can get.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

rs-eos — Wed, 04 May 2022 19:30:14 GMT

I have to ask why you need 8K for a webcam?

As for capturing 8K RAW output, Canon mentions that (as of Jan 2022), only the Atomos Ninja V+ is capable of that.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

WillSteeleNYC — Wed, 04 May 2022 21:32:34 GMT

It's not about needing "8K for a webcam", not that the why should really matter, it's about not having a single way to capture/stream 8K video in Realtime. With the dual stereo fisheye lens 8K is really a requirement. It's great that the camera can output 8K HDMI, but as I mentioned, there isn't an 8K HDMI capture card in existence yet and even the Atomos V+ Ninja with AtomX Cast only streams and outputs in 1080P. It's amazing that the R5 can output at 8K over HDMI, but since nothing really exists to take advantage of that it's mostly useless until we have an 8K HDMI 2.1 capable capture card. If there was some way to access a live 8K feed, like through USB (which wouldn't be an engineering marvel), I'd buy this in a heartbeat.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

exploretv — Fri, 29 Jul 2022 01:39:06 GMT

You have a few hurdles to jump. First, you need an app that unwarps your image. It laos means that you couldn't shoot RAW because RAW needs to be adjusted first. Second, and this is the BIG one, YouTube has put major restrictions on who can live stream VR180. Your account has to be whitelisted in order to do it. And lastly, the issue of who can watch it and the constant bitrate of 60 Mbps to 1Gbps speeds to stream! What device can watch it? Right now livestreaming is not a viable option.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

WillSteeleNYC — Tue, 09 Aug 2022 17:04:07 GMT

Early adopters like myself aren't worried about all that. The only thing we are missing is a way to capture that 8K stream in real-time, but unfortunately there isn't an 8K HDMI 2.1 capture card in existence yet. That's the only barrier at the moment for me anyway.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

exploretv — Wed, 10 Aug 2022 05:31:44 GMT

Well you have several obstacles. First of all where are you live streaming too? You have to be whitelisted and approved to be able to stream vr180 on YouTube. Second you need some kind of processing to take the two fisheye images and unwarp them. Unfortunately that software does not yet exist.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

Delrious — Sat, 13 Aug 2022 06:56:26 GMT

It would be amazing if Canon and Meta could get together and at least make live preview happen (which could lead to livestreaming) via a USB tether between Quest 2 and the R5. The most difficult thing with VR is framing a shot. Camera placement with VR is a huge deal if you are trying to make something cinematic. Right now, it's at least the next day before we can see how our shot looks in VR. A director needs to at be able to see what a shot looks like on set...I'm sure quest 2 has the horsepower to do equirectangular projection. Doesn't need to be 29.97...even just previewing with stills would be a huge improvement. Right now it's like we're shooting with an old school camera onto glass plates and you don't even have a viewfinder.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

WillSteeleNYC — Sun, 18 Dec 2022 16:51:47 GMT

Since you don't know what my intent is, you don't know what my hurdles are. The assumed hurdles you mention are irrelevant for for me. And for me there is only one sigular hurdle and that is getting the live unprocessed output of the camera in real time in 8K. I have everything else already figured out. Thanks!

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

exploretv — Sun, 18 Dec 2022 23:55:49 GMT

The problem is not the live streaming per se. That part is very simple HDMI out into a converter and into your PC and use obs. The problem is that the vr180 is not on warped and so you're going to get 2 big fish eyes. Plus where do you want a live stream to? YouTube no longer allows everyone to livestream vr180, you have to be whitelisted by them in order to do it.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

Waddizzle — Mon, 19 Dec 2022 08:46:31 GMT

We know what your intent is. The combo is not designed for live streaming. The images must be post processed, which cannot be done at real time.

BTW, your internet etiquette is atrocious. Not only havey have totally hijacked someone’s thread, but you have ignited a flame war in the process.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

exploretv — Mon, 19 Dec 2022 08:42:48 GMT

Good for you! I wish you all the best!

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

WillSteeleNYC — Sat, 14 Jan 2023 23:12:38 GMT

Internet etiquette? Flame war? That's awefully dramatic. I don't think anyone who's responded has a clue as to what my intent is for wanting to livestream. All I've received is arguments why it is unfeasable or unecessarry. The responses are way too common from people offering unhelpful advice to up their message board cred instead of actually answering questions. I work in computer vision and XR so I know what's possible. The only limitations here are technical one's driven by market demand, not technical hurdles due to processing power. If I had a way to access a 8K realtime dualfisheye feed I can guarantee that I have more than enough processing power in a single gpu to process the image in realtime as required for my purposes. 3D stitching is far from rocket science and with two side by side images landing on a single sensor the overhead for live stitching is even less. I'd rather get no answers at all instead usless responses from people who don't really understand what they are talking about. I'm not intending to be rude here, just matter of fact. That said, I've found a much better solution for my purposes using a 10+ year old 3D lens and a non-canon camera all costing me less than $1,000. So on the bright side I made out not getting any useful reponses to my questions. This is one of the few times I can happily say thanks for nothing 😄

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

exploretv — Sat, 14 Jan 2023 23:55:43 GMT

https://youtu.be/XcRwDUJTctY My method works with both the quest and the PICO 4. Although it does seem to be better with the full color pass through of the Pico. Plus with the Pico you can disable the guardian and the tap through pass through still works. With the quest 2 you have to keep the guardian on otherwise the pass-through doesn't work. So it can be done and it works great.

Re: Live Streaming Content with R5 and 5.2mm L Dual fisheye Lens

WillSteeleNYC — Sun, 15 Jan 2023 00:26:17 GMT

Good hack for monitoring your shoots. I was looking for a way to get a quality livestream, but I've since gone another route with a non-canon camera and 3D lens. A fisheye lense setup is overkill for my use case anyway...
https://www.youtube.com/watch?v=4zn9xXVM7e8