Forum Navigation
Please or Register to create posts and topics.

Mixed realilty VR

Hi
I was wondering, has anybody any experience with Mixed Realiy VR headsets like the Meta Quest 3 or .. better.. varjo xr 4?
I do see youtube video's with fighterplanes and VR mixed reality headsets... but very few with airliners .
It seems to me this is the future of flightsim!!

Roel,

My Lear45 is packed in boxes until I have proper location to restart the project, meanwhile I put together secondary sim and fly VR exclusively using Pimax Crystal.

Previously I used Quest 2 then HP reverb G2. Among all 3, Pimax Crystal is without doubt, the best. I’m working on setting up OBS to record some short flights. I usually choose TBM 930 or recently TBM 850 but have a versatile set up that is ready for pretty much anything including helicopters.

I discovered recently that CRJ jets have similar panels to Learjet. This opens an opportunity for me to learn about procedures that I can later use flying Learjet. Somehow I don’t have interest in large airliners. VR presents some challenges with operating large amount of switches. I don’t use VR controllers at all, any button can be operated with mouse, you just need to know where to reach out to find it. Muscle memory is critical in VR.

VR is very very hardware hungry. I don’t think it will ever replace real sim like the one we work on but once you put VR headset on, there is no going back to using monitor. I have 49” UWide monitor 2 feet from my face and still prefer VR.

Hi Roel and everyone else,

I have been using VR since the Oculus Rift S first came out in 2019. I have only just upgraded to the Quest 3 in the last month.

I have a VR flying group which we fly together every 2 weeks on a Monday morning. Maciej (Hunka) is a member and the timing fits with him as it is a late Sunday afternoon/ evening where he lives.

Without a doubt he has the best hardware setup and is the guru for most questions.

A few points to consider.

1/ Quest 3 is very good for the price. Pimax anything here in Australia, is just too $$, to stay married, .

2/ I have a modest hardware setup AMD 3900x and GTX3800. With Virtual Desktop ( an alternative to Oculus default software ) I can get 60-90 FPS in MSFS. With High settings !

3/ I have almost never had any feelings of nausea in VR. Rarely, when flying along and the hardware, for whatever reason, pauses for a second or three, your brain's reaction to a 'perceived' change in Vestibular proprioception will temporarily have you confused. Momentary if anyone is concerned. Others experiences may vary.

4/ Anyone who has not given VR a fair go is seriously missing out on the most wonderful experience possible. I almost cannot fly now using the monitor. It is a colour vs black and white thing. The only thing missing is the 'forces' that you would experience flying a real plane. If your pockets are deep, my real pilot and Learjet sim pilot, Mark C. has a 3DoF Motion simulation seat to go with his VR. I can tell you that whilst flying a Trojan and undertaking a steep bank, I nearly fell out of his seat. Indescribable is the immersion you experience.

5/ The Learjet sim vs VR. No comparison. We love both and are very privileged to go from one to the other. Sitting with your mates ( or dog) and going flying in the sim is the best. VR however, allows us to immerse ourselves in the closest possible to reality in any plane that you have available. At the moment the sim is in P3D v5.4 ( am not convinced from reading posts about V6, the jump is worth it till 6.1, at least). If you invest in the addons, P3D it is still visually stunning. VR however, can be, in my case P3D or in MSFS, ( I do not have X plane). So still plenty of choice when flying different planes.

6/ As Hunka alluded to, the only problem with VR is detailed cockpits that would require lots of pushing buttons and turning encoders. If you have a hardware bank that is programmed for the most common flying tasks then as Hunka said regarding muscle memory, you'll be able to reach forward to access that physical hardware without lifting the headset.

7/ Lastly. The more you read online, the more confused you will get. All of the VR headsets work, it is just a matter of expectations. If your hardware is not 'beefy'enough there is only so much performance you can expect. Some people have just gotten a headset, cracked it because it did not work or was not clear enough and have sent it back. If that were the case why have many many more thousands of users happily kept theirs ?

Summary.

Have a good try before you buy if possible. Purchase within your means as you may( or may not) need to up your computer hardware as well. You get what you pay forfor example, Pimax cost as against Quest 3.

We fly mainly default or free 3rd party aircraft in MSFS. We don't worry about ATC, in fact turned it off.We just marvel at looking out the window. If you think a plane needs all the latest avionics and hardware to fly, then go get in a Tiger Moth for a reality check.

Cheers

Mark S.

 

So the original post by Roel was asking about mixed VR.  While pure VR is incredible, mixed reality VR for flight simulation is where you would be able to actually see your physical cockpit and manipulate all of the tactical controls, but when you look 'out the window' you would see the FS generated world.

Take a look at this video to see how this would work:




I do agree that there is nothing like flight sim in VR. My ideal situation is that you have the L45 cockpit with 180+deg visuals, and save the VR for flying fighter planes or helos in FS2020.

Jason Hite FlightDeckSoft

Yes i only see fighter sims with VR , so i was wondering if anybody in here has ever tried mixed reality in a Lear sim.
It should be an option to create "portals" where the windshields are, so you see the outside in these  portals.
But no idea how this looks.

Would be great though...

The link you added Jason was also what i referred to...wow.. this would be awesome.. 🙂

The original question was has anyone had any experience with Mixed reality headsets specifically Q3 and the Varjo.

Yes I have tried it with MSFS and it was terrible. Admittedly I turned it on using the menu system for Virtual desktop. When first starting the Q3 you need to setup your safety space. If you are within your space you see nothing of the reality in the room. but if you move out of that space everything becomes visible, ie is hands, joystick, throttle, monitor etc. that is fine if you contort yourself to make it visible when needed. However, once in MSFS, as the colour black is default, it shows up your back ground in my case the twin screens on the monitor, wherever black is. Not great when your top 1/4 of the instrument panel is another picture !

There is a configuration setting to change the chromakey as well as other settings but I was not inclined to persist. Fail, unless you wanted to spend ages setting it up with no guarantees.

Now trying not to dampen anyone's enthusiasm. P3D for Augmented Reality which is what you are after I believe is only for Professional Plus version.

https://www.prepar3d.com/SDKv5/prepar3d/virtual_reality/virtual_reality.html

The idea is right and is probably pretty close but not quite there yet. Portals are the go to chromakey your background screens to project P3D scenery onto. Don't know how you'd go with monitors though instead of a projector screen ?

So can anyone with the sim test it out ? If I read the P3D SDK documents correctly, not likely as probably no-one I know will have the Professional Plus version at US $2750.

Ask again next year. lol  Funny enough though, my sim to me is 3D so I really don't need to use my Quest 3 in it.

Mark S.

 

Hey guys,

I will admit, I didn't know exactly what "Mixed Reality VR" is until I watched the video Jason posted up.  My idea was something like what Maciej is doing.  (Maciej, I hope you don't mind me sharing a few photos)

His hardware coupled with his Pimax Crystal VR headset is a pretty powerful way to go flying a wide variety of aircraft while on standby waiting for the ability to get back to work on the full scale Lear45 project.  (But with the headset on, everything is virtual reality, not mixed)  Still super cool!

In my case, I only have an Xbox S and a gaming controller to fly FS2020.  It's cool but doesn't compare to what Maciej has put together, let alone the Mixed Reality VR we are talking about.  It's just enough to keep me motivated and focused on the end goal while at the same time not getting sidetracked.

I agree with Mark and Jason, our full scale sims with a wrap around visual system is the goal.  Our sims are three denominational, the only difference is we don't have to wear a headset.  And like Mark said, the setup and alignment issues with something like this could be a nightmare.

And what if we want to bring along a copilot?  That's another Mixed Reality VR headset.  No fun for the guest watching from behind I wouldn't think.

No doubt Mixed Reality VR technology is amazing and I am blown away from what I saw in that fighter jet video.  But I think this is where that technology is going to strive, with single seat aircraft, helicopters and any other open view/air single seat vehicle for that matter.

The thing we have going for us when it comes to the Lear45 and most other mid size to larger aircraft is the outside view is limited......... when compared to an F16 as an example.  We only have to worry about a narrow cylindrical slice of visuals no more than 220 degrees from left to right.  This is solved with the use of a couple (up to three) projectors and some warping software.

I love to see new technology because stuff like this will somehow benefit us in the future.

Last point, I have a Quest 2 VR headset but don't dare to use it with flight sim.  I am afraid I would not get anything done!  It's a "gateway device" to something like what Maciej has put together.  LOL

Fully agree with mark.
Since i also use P3d and did read about options in P3d with VR, but did not realize it needs the professional edition!  I do think MSFS will be better in the end for VR.

This guy: Russ Barlow which i follow on youtube, posted a video which gave me the trigger to investigate the whole VR concept.




It doesn't look great and he does not have a cockpit shell, but it does show where the sim world is going.
But you are right Mark, maybe in a year!

But again building a fighter sim was always my first choice but the poor reality with projectors or screens made me decide not to go that way, and airliners are more realistic.
But with mixed reality these sims do become an option.