NVIDIA is working with the livestreaming application OBS to integrate RTX Greenscreen. "With it, livestreamers will be able to remove their background environment or instantly teleport themselves anywhere -- in this world or in virtual ones," the company said. NVIDIA will show off the feature at Twitchcon 2019, and it'll be available from OBS in a few months.
The RTX AR SDK, meanwhile, can detect your face from a webcam and track features like your eyes and mouth. It can then overlay your expressions and speaking onto a 3D character, à la Apple's memoji feature. You could also overlay 3D content like a mesh or tracking dots onto your face. Finally, there's an SDK called RTX Style Filters, which can transform your webcam feed to look like anime or whatever style of art or image you prefer.
From what NVIDIA showed off in a Twitchcon sizzle reel, the RTX Greenscreen effect is pretty effective, even if you have a relatively cluttered background. Decent subject lighting is probably a must for best results, though. The RTX AR SDK could also be pretty cool, but the RTX Style features look a bit cheesy.
All of the features are available via SDK, so it could take awhile for them to show up in apps, but NVIDIA said that Streamlabs and XSplit are working on implementations, too. NVIDIA also revealed that its NVIDIA RTX Encoder, introduced earlier, will work on Twitch Studio, Discord Go-Live chat and to Elgato 4K60 Pro Mk II HEVC devices. That should speed up frame rates and image quality for games while streaming, the company said.