Jump to content

Leadwerks Software to Assist NASA Building VR Applications


Josh

8,996 views

 Share

TLDR: I made a long-term bet on VR and it's paying off. I haven't been able to talk much about the details until now.

Here's what happened:

Leadwerks 3.0 was released during GDC 2013. I gave a talk on graphics optimization and also had a booth at the expo. Something else significant happened that week.  After the expo closed I walked over to the Oculus booth and they let me try out the first Rift prototype.

This was a pivotal time both for us and for the entire game industry. Mobile was on the downswing but there were new technologies emerging that I wanted to take advantage of. Our Kickstarter campaign for Linux support was very successful, reaching over 200% of its goal. This coincided with a successful Greenlight campaign to bring Leadwerks Game Engine to Steam in the newly-launched software section. The following month Valve announced the development of SteamOS, a Linux-based operating system for the Steam Machine game consoles. Because of our work in Linux and our placement in Steam, I was fortunate enough to be in close contact with much of the staff at Valve Software.

The Early Days of VR

It was during one of my visits to Valve HQ that I was able to try out a prototype of the technology that would go on to become the HTC Vive. In September of 2014 I bought an Oculus Rift DK2 and first started working with VR in Leadwerks. So VR has been something I have worked on in the background for a long time, but I was looking for the right opportunity to really put it to work. In 2016 I felt it was time for a technology refresh, so I wrote a blog about the general direction I wanted to take Leadwerks in. A lot of it centered around VR and performance. I didn't really know exactly how things would work out, but I knew I wanted to do a lot of work with VR.

A month later I received a message on this forum that went something like this (as I recall):

Quote

Hey man!!! I love Leadwerks, and I think you are really cool! I work for NASA, want to come and build spaceships with me?

I thought "Okay, some stupid teenager, where is my ban button?", but when I started getting emails with nasa.gov return addresses I took notice.

Now, Leadwerks Software has a long history of use in the defense and simulation industries, with orders for software from Northrop Grumman, Lockheed Martin, the British Royal Navy, and probably some others I don't know about. So NASA making an inquiry about software isn't too strange. What was strange was that they were very interested in meeting in person.

Mr. Josh Goes to Washington

I took my first trip to Goddard Space Center in January 2017 where I got a tour of the facility. I saw robots, giant satellites, rockets, and some crazy laser rooms that looked like a Half-Life level. It was my eleven year old self's dream come true. I was also shown some of the virtual reality work they are using Leadwerks Game Engine for. Basically, they were taking high-poly engineering models from CAD software and putting them into a real-time visualization in VR. There are some good reasons for this. VR gives you a stereoscopic view of objects that is far superior to a flat 2D screen. This makes a huge difference when you are viewing complex mechanical objects and planning robotic movements. You just can't see things on a flat screen the same way you can see them in VR. It's like the difference between looking at a photograph of an object versus holding it in your hands.

Mars-2020-rover.thumb.jpg.6dd183781f8afe8504f7466551bb6b0f.jpg
What is even going on here???

CAD models are procedural, meaning they have a precise mathematical formula that describes their shape. In order to render them in real-time, they have to be converted to polygonal models, but these objects can be tens of millions of polygons, with details down to threading on individual screws, and they were trying to view them in VR at 90 frames per second! Now with virtual reality, if there is a discrepancy between what your visual system and your vestibular system perceives, you will get sick to your stomach. That's why it's critical to maintain a steady 90 Hz frame rate. The engineers at NASA told me they first tried to use Unity3D but it was too slow, which is why they came to me. Leadwerks was giving them better performance, but it still was not fast enough for what they wanted to do next. I thought "these guys are crazy, it cannot be done".

Then I remembered something else people said could never be done.

000f18d5-800.jpg.990e1a219313c9100d0d81c1f9309928.jpg

So I started to think "if it were possible, how would I do it?" They had also expressed interest in an inverse kinematics simulation, so I put together this robotic arm control demo in a few days, just to show what could be easily be done with our physics system.

 

A New Game Engine is Born

With the extreme performance demands of VR and my experience writing optimized rendering systems, I saw an opportunity to focus our development on something people can't live without: speed. I started building a new renderer designed specifically around the way modern PC hardware works. At first I expected to see performance increases of 2-3x. Instead what we are seeing are 10-40x performance increases under heavy loads. During this time I stayed in contact with people at NASA and kept them up to date on the capabilities of the new technology.

At this point there was still nothing concrete to show for my efforts. NASA purchased some licenses for the Enterprise edition of Leadwerks Game Engine, but the demos I made were free of charge and I was paying my own travel expenses. The cost of plane tickets and hotels adds up quickly, and there was no guarantee any of this would work out. I did not want to talk about what I was doing on this site because it would be embarrassing if I made a lot of big plans and nothing came of it. But I saw a need for the technology I created and I figured something would work out, so I kept working away at it.

Call to Duty

Today I am pleased to announce I have signed a contract to put our virtual reality expertise to work for NASA. As we speak, I am preparing to travel to Washington D.C. to begin the project. In the future I plan to provide support for aerospace, defense, manufacturing, and serious games, using our new technology to help users deliver VR simulations with performance and realism beyond anything that has been possible until now.

My software company and relationship with my customers (you) is unaffected. Development of the new engine will continue, with a strong emphasis on hyper-realism and performance. I think this is a direction everyone here will be happy with. I am going to continue to invest in the development of groundbreaking new features that will help in the aerospace and defense industries (now you understand why I have been talking about 64-bit worlds) and I think a great many people will be happy to come along for the ride in this direction.

Leadwerks is still a game company, but our core focus is on enabling and creating hyper-realistic VR simulations. Thank you for your support and all the suggestions and ideas you have provided over the years that have helped me create great software for you. Things are about to get very interesting. I can't wait to see what you all create with the new technology we are building.

 

  • Like 15
  • Upvote 2
 Share

18 Comments


Recommended Comments

05.gif
I wish you the best of luck in the project, and don't forget the users of LE 4, we are always waiting for an update or two. :)

  • Like 1
Link to comment
4 hours ago, Josh said:

Let’s plan on doing a Google Hangout this Saturday so I can answer any questions you have.

I'd be up for that.  Depends on time in the land of AUS of course :P

Link to comment

Ground control to Major Josh
Ground control to Major Josh
Get ready to program
Laptop on.

Ground control to Major Josh
Commencing countdown
Leadwerks on
Check ignition
And may Turbo be with you!

  • Like 2
Link to comment

Very cool. Glad you're back in the States. Although Turbo is still the priority, I hope this NASA contact benefits LE4 while Turbo is being worked on. Would be nice to see bugs fixed and more VR options soon.

Also hopefully this means you're not tied to that Gigabyte box so I also hope to see AMD and Linux support with the new engine. (And continued support for LE4.)

Congratulations, and continue making cool stuff!

  • Like 1
Link to comment

Congratulations Josh! That's some exciting news, I hope this finally puts Leadwerks/Turbo on the map in a big way. I can't wait to see the first AAA media production (game or otherwise) that's powered in Turbo.

Considering your affiliation with NASA perhaps rename Turbo to the ''ROCKET ENGINE'" ? It encapsulates visions of speed, power, performance and the ability to take you to new worlds :)

I wish I would've got my tournament posters signed now...

 

the-space-force-construction-already-underway.thumb.jpg.45bea21467b2fdc8ff9dc9fb1acada94.jpg

Link to comment

Congrats Josh. As stated before in your blogs: unlike the mobile direction, VR is actually bringing back the power to the engine. So leadwerks 5 will contain the Turbo changes, minus the new editor. 

Do you think you will expand your team, now that you have a contract?

Link to comment
8 minutes ago, AggrorJorn said:

Congrats Josh. As stated before in your blogs: unlike the mobile direction, VR is actually bringing back the power to the engine. So that plan is still unchanged right? So leadwerks 5 will contain the Turbo changes, minus the editor. 

Do you think you will expend your team, now that you have a contract?

I don't think Leadwerks 5 like I was suggesting might happen will happen. We will jump straight to Turbo and use the Leadwerks 4 editor until the new editor is available.

Yes, this gives me more predictable cash flow and this is how I plan to add new hires.

  • Like 4
  • Thanks 1
  • Confused 1
  • Upvote 1
Link to comment

 Really proud of you Josh, you have quite literally moved mountains to get where you are. You skipped the low steps on the ladder and went straight to the top. 

gsfc

  • Like 1
Link to comment
Guest
Add a comment...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...