Learn extra at:
Ray tracing is usually seen as a trade-off between visuals and efficiency – enhancing lighting realism at the price of FPS. Nonetheless, there is a second commerce off that’s talked about much less: noise.
I not too long ago devoted a video to discuss just this as a result of there are video games that do not use a excessive sufficient decision for his or her results, others with noticeable floor grain, heavy denoising that ends in floor boiling, or video games the place ray tracing hurts texture high quality to the extremes of inflicting noticeable responsiveness points with lighting.
All of those issues find yourself hurting what is meant to be a expertise that improves visible high quality.
What’s Ray Reconstruction?
Partly acknowledging this, Nvidia launched DLSS Ray Reconstruction again in 2023 to handle many of those points. As an AI-based denoiser for ray-traced video games, it did supply some enhancements in sharpening sure results, however points with noise and lack of element remained in frequent eventualities.
Nvidia has now up to date Ray Reconstruction as a part of its DLSS 4 expertise suite. The DLSS 4 model replaces the outdated convolutional neural community (CNN) with a brand new transformer model.
Primarily, this can be a bigger, higher-quality AI mannequin with additional tuning to enhance denoising high quality. Does this up to date model deal with lots of my complaints about ray tracing noise? Properly, it is time to discover out.
The excellent news about DLSS 4 Ray Reconstruction is that it is out there on all Nvidia RTX GPUs, in contrast to Multi Frame Generation, which is unique to the GeForce 50 series. Whereas the brand new transformer AI mannequin is bigger and extra performance-taxing relying on the GPU structure, it does not require any particular architectural part – simply Tensor cores – so compatibility stays the identical as DLSS 3-era Ray Reconstruction.
As you may see later, the efficiency hit is not the identical throughout each GPU era, however at the least it really works all the best way again to the GeForce 20 series.
Like different DLSS 4 applied sciences, there are two methods to entry DLSS 4 Ray Reconstruction. Both it is built-in into the sport itself, as seen in titles like Cyberpunk 2077 and Hogwarts Legacy, or you possibly can override a DLSS 3 Ray Reconstruction recreation to make use of the DLSS 4 model as an alternative through Nvidia’s driver override characteristic.
Both means, a recreation should already help Ray Reconstruction, however this enables most Ray Reconstruction-enabled video games to be immediately upgraded to the most recent model. Exterior of this, third-party instruments like DLSS Swapper and DLSS Updater can improve DLSS 3 video games to DLSS 4.
For the picture high quality evaluation on this article (watch the video), I will be instantly evaluating DLSS 3 vs. DLSS 4 Ray Reconstruction throughout a number of examples. To do that, I’ve taken DLSS 4 video games and manually downgraded them to DLSS 3.7.20 Ray Reconstruction – the latest model previous to DLSS 4 – whereas holding every part else the identical. This enables us to isolate the influence of Ray Reconstruction enhancements.
In some video games, it is attainable to modify between the transformer and CNN fashions for Ray Reconstruction with out swapping the DLLs, however this often impacts each the ray reconstruction and upscaling elements on the identical time.
I wished to maintain the Tremendous Decision mannequin on the DLSS 4 stage whereas altering solely Ray Reconstruction, which is why I used a downgrade methodology for comparability. The examples on this video have been captured at 4K utilizing a GeForce RTX 5090.
DLSS 4 Ray Reconstruction Picture High quality
Let’s begin with the good things. DLSS 4 Ray Reconstruction is a big enchancment in stability. Specifically, many surfaces are much less liable to boiling with the brand new model, eliminating one of many ugly negative effects of weak denoising.
In Star Wars Outlaws, for instance, a recreation liable to boiling with DLSS 3 Ray Reconstruction – the brand new DLSS 4 model reveals big enhancements in floor stability. On the left, DLSS 3 causes a very stationary floor to bubble when it should not, whereas on the appropriate, DLSS 4 is way cleaner. It is not 100% freed from this artifact however is considerably decreased. Actually, in different areas of the picture, stability improves to near-perfect ranges.
For a greater illustration of picture high quality comparisons, take a look at the HUB video under:
In different examples, like Cyberpunk 2077, this enchancment is most noticeable in movement. There’s much less effervescent as denoised ray-traced results transfer, giving them larger stability and consistency from body to border. That is particularly noticeable on some globally illuminated surfaces, the place DLSS 4 Ray Reconstruction brings a big enchancment.
The brand new model is cleaner in movement and resolves a good stage of element extra shortly. In some instances, the distinction in high quality is evening and day – a lot in order that DLSS 3 can seem like the sport is operating at a decrease decision. And have in mind, that is denoising, not upscaling, which stays the identical in each examples. Adjustments in publicity are additionally a lot much less prone to trigger temporary boiling, indicating that the brand new transformer mannequin handles lighting changes higher.
At occasions, this improve in stability combines with higher denoising to supply higher-resolution reflections. Within the Alan Wake II instance, metallic reflections present boiling with DLSS 3, however switching to DLSS 4 Ray Reconstruction reduces it, making the reflection seem greater decision since edges are extra outlined and constant in movement.
There’s additionally the basic fan instance that Nvidia used to exhibit DLSS 4, and we will verify that this can be a actual profit in video games. Because the fan spins, revealing the roof behind every blade, DLSS 4 is far more steady, lowering each boiling and ghosting.
Once more, that is ghosting attributable to denoising, not upscaling. Rippling water surfaces additionally profit from DLSS 4 Ray Reconstruction – usually a supply of noise – however the brand new model does a greater job of smoothing these particulars with out introducing further points.
One of many main points with the original Ray Reconstruction technology was its incapability to resolve texture element on surfaces that additionally required denoising. In these instances, Ray Reconstruction prioritized smoothing noise over preserving textures, resulting in blurry, muddy surfaces. In lots of cases, DLSS 4 is a significant enchancment on this space.
For instance, in Cyberpunk 2077, when taking a look at some shiny tiles, DLSS 3 Ray Reconstruction removes a lot of the marbling and floor element, whereas DLSS 4 retains texture element. This is applicable to each stationary and transferring scenes, and in each instances, DLSS 4 is a transparent improve in texture high quality. Actually, the movement instance seems horrible and intensely blurry with DLSS 3, whereas with DLSS 4, it seems far more like a 4K picture.
This enchancment extends to different video games like Star Wars Outlaws, the place the mixture of decreased boiling and higher texture preservation ends in considerably higher-quality surfaces throughout the sport world. Within the Alan Wake II elevator door instance, DLSS 3 fully hides the truth that the floor is brushed metallic, however DLSS 4 Ray Reconstruction restores this element together with different advantages.
This is one other instance in Cyberpunk 2077, the place the roof of the automotive retains clearer textures in movement with DLSS 4 Ray Reconstruction in comparison with earlier variations. Related advantages will be seen on varied surfaces all through the sport.
It is spectacular how a lot DLSS 4 Ray Reconstruction improves floor stability, decision, and element – and the way dangerous prior variations of denoising can look compared. Denoising that blurs textures and causes boiling is just not an actual resolution – efficient denoising ought to protect element as effectively, and we’re getting a lot nearer to that with DLSS 4.
The Downsides of Ray Reconstruction
DLSS 4 Ray Reconstruction is not good although. Some areas have not improved a lot over DLSS 3 Ray Reconstruction, and in sure instances, there are literally regressions, which is not nice. For instance, within the three predominant video games we examined – all of which have native DLSS 4 integrations – we observed that DLSS 4 might sometimes introduce unusual floor artifacts.
In Star Wars Outlaws, stationary ray-traced results generally show a grid sample. We have zoomed in for readability, however it’s additionally seen at a standard viewing distance on a 32-inch 4K panel. An analogous situation seems in Cyberpunk 2077, although much less often, often in globally illuminated areas.
We additionally observed some instances the place DLSS 4 Ray Reconstruction decreased texture high quality, separate from the earlier situation. About 80% of the time, texture high quality is noticeably higher, however within the remaining 20%, textures can turn into blurrier or extra smoothed out. For instance, in Alan Wake II, the scene under reveals improved textures in a single space however worse textures in a darker part.
Happily, typically, this regression is not sufficient to harm total picture high quality in comparison with DLSS 3, as nearly all of the picture sees enhancements – particularly by way of boiling and floor artifacts. Nonetheless, some tweaks to the mannequin are obligatory to make sure texture high quality is constantly preserved together with denoising.
Ray Reconstruction additionally nonetheless suffers from a noticeable distinction in readability between stationary photographs and movement – the place standing nonetheless at all times ends in a higher-quality picture than when transferring.
That is, in fact, attributable to how denoising works: if there aren’t any adjustments between frames, denoising can temporally accumulate and resolve the next stage of element. However when there are adjustments, attaining comparable element ranges turns into a lot more durable. Nonetheless, we might have favored to see extra enhancements on this space.
The truth is that while you cease transferring, after a second or two, Ray Reconstruction seems to slowly “load in” higher-quality surfaces. It is not really loading something – it is simply the temporal system benefiting increasingly from the dearth of movement throughout that point.
However when really gaming, this may be noticeable, particularly as a result of in some cases, as quickly as you are taking a step or transfer the digicam, the general render high quality decreases. Now, DLSS 4 Ray Reconstruction in movement is definitely superior to DLSS 3, however on this space, it appears to work in mainly the identical means.
Since there’s nonetheless fairly a little bit of temporal accumulation taking place, there have not been main enhancements to the responsiveness of the denoiser. It nonetheless takes a couple of frames to completely reply to lighting adjustments, which may create a floaty feeling when transferring round and taking a look at reflections or illumination on surfaces.
The standard of every step within the accumulation and determination course of is improved, however the variety of temporal samples getting used for denoising appears fairly just like earlier iterations. This nonetheless causes points in video games that do not use a very excessive ray rely for ray tracing. So this pet peeve now we have with the responsiveness of ray-traced lighting persists even with DLSS 4 Ray Reconstruction.
Efficiency Testing
As for efficiency, DLSS 4 Ray Reconstruction is extra taxing than DLSS 3 Ray Reconstruction. We examined 4 totally different graphics playing cards utilizing the most recent model in comparison with DLSS 3, focusing solely on the influence of Ray Reconstruction, not upscaling. For every GPU, we adjusted the settings to one thing realistically playable whereas sustaining the same output body price.
GeForce RTX 5090
Beginning with the GeForce RTX 5090, we examined at 4K with DLSS High quality enabled, usually utilizing the very best in-game settings. This ends in round 60 FPS in Alan Wake II and Cyberpunk 2077, or the next 90 FPS in Star Wars Outlaws.
Utilizing DLSS 4 Ray Reconstruction induced a 4% hit in Alan Wake II, a 5% hit in Cyberpunk 2077, and a 7% hit in Outlaws. So, not an insignificant influence, however fairly worthwhile given the picture high quality is mostly significantly better.
GeForce RTX 4070 Tremendous
The RTX 4070 Super is much less highly effective and makes use of the previous-generation Ada Lovelace structure. To run these video games at round 60 FPS, we needed to drop to 1440p with DLSS High quality and barely decrease the presets as effectively.
However regardless of these adjustments, the influence from DLSS 4 Ray Reconstruction is sort of just like the RTX 5090: a 4% hit in Alan Wake II, a 6% hit in Cyberpunk 2077, and a 6% hit in Outlaws. Based mostly on this, it is protected to say the Tensor cores in Blackwell and Ada are adequate to run the brand new transformer mannequin at a suitable efficiency price.
GeForce RTX 3090
The RTX 3090 is roughly equal to an RTX 4070 Tremendous in ray tracing efficiency, so we used the very same settings for each GPUs. The principle distinction right here is the structure. What was fascinating to notice is that the 3090 suffers from a larger hit when utilizing DLSS 4 Ray Reconstruction: an 18% loss to FPS in each Alan Wake II and Cyberpunk 2077.
Curiously, there isn’t any efficiency influence in Star Wars Outlaws, however it is because it looks as if the sport forces the usage of the CNN mannequin on generations previous to the 40 sequence. Not like the opposite two video games, there isn’t any possibility to modify between fashions – the sport does it for you. On this occasion, it chooses Transformer for the 40 and 50 sequence and CNN for the 30 and 20 sequence, therefore no influence between DLSS 3 and 4 in Outlaws on the RTX 3090.
The most probably clarification for the efficiency distinction between Ampere and Ada Lovelace is the distinction in Tensor core structure, with Ada supporting a wider vary of precisions which can be doubtlessly being utilized right here.
GeForce RTX 2080 Ti
As for Turing with the RTX 2080 Ti, this GPU is de facto solely appropriate for low-quality ray tracing at this time. We needed to dial again the settings to 1080p with DLSS High quality and the bottom high quality settings. In Alan Wake II, we noticed a 27% FPS discount utilizing DLSS 4 Ray Reconstruction vs. DLSS 3, and a 32% discount in Cyberpunk 2077.
This makes it laborious to suggest the usage of the newer mannequin on older 20 sequence GPUs, although it is unclear how a lot it issues given the general ray tracing efficiency of those playing cards.
What We Discovered
General, we have been fairly impressed testing DLSS 4 Ray Reconstruction – definitely far more impressed than when testing Multi-Frame Generation. The brand new transformer mannequin usually ends in a big improve in visible high quality. There are main enhancements to stability, floor boiling, texture preservation, and total element, which assist ship higher ray-traced surfaces.
Utilizing this expertise makes ray tracing really feel like much less of a downgrade intimately, minimizing the “visible price” of attaining higher lighting high quality and accuracy. Lots of these floor and element points have been clear issues with DLSS 3 Ray Reconstruction and different denoising strategies utilized in at this time’s ray-traced video games. It is good to get ray-traced lighting, however the noise will be fairly distracting in some video games, giving the presentation a soupy, low-resolution look, particularly in movement.
DLSS 4 is an enormous step in the appropriate path towards bettering how ray-traced video games look, and in all of the video games we examined, we have been a lot happier with the DLSS 4 output.
Whereas it’s fairly a powerful enchancment that must be immediately noticeable in video games, I would not say it is “mounted” all of my ray tracing noise complaints. DLSS 4 Ray Reconstruction nonetheless has some floor boiling in worst case eventualities, there’s nonetheless a noticeable distinction intimately between standing nonetheless and movement, and it nonetheless struggles to be responsive and top quality when ray counts are low. There’s additionally a couple of regressions in comparison with DLSS 3, just like the occasional bizarre artifact and a few reductions to texture high quality.
However for probably the most half, it is value utilizing – particularly on RTX 50 and RTX 40 sequence GPUs, the place the efficiency influence relative to DLSS 3 appears to be round 5%. It struggles extra on Ampere-based RTX 30 GPUs however might nonetheless be value utilizing, whereas on RTX 20 sequence playing cards, you possibly can mainly overlook about it attributable to each the efficiency price and the dearth of ray tracing efficiency in fashionable video games. It is nice to see Nvidia delivering this type of replace with out locking it to a selected GPU era, permitting as many individuals as attainable to learn.
We do have a few suggestions for recreation builders primarily based on this testing. First, when you’re growing a ray-traced recreation, contemplate integrating DLSS 4 Ray Reconstruction. There are another good denoising options in video games, however usually they’re fairly lackluster and create a foul output. The standard from DLSS 4 is nice, and there are far fewer downsides in comparison with DLSS 3 Ray Reconstruction.
Second, we suggest permitting players to decide on the mannequin used for upscaling and ray reconstruction individually. In Cyberpunk 2077 and Alan Wake II, you possibly can select between the CNN and Transformer fashions, however this is applicable to each upscaling and denoising collectively. Separating these choices would permit for extra efficiency fine-tuning, particularly on older GPUs like Ampere, the place ray reconstruction will be taxing.
Nvidia additionally must preserve engaged on this expertise as a result of there’s room for enchancment with extra coaching and tweaks. The bizarre artifacts want fixing, and a stronger concentrate on responsiveness could be good to scale back that hole in high quality between standing nonetheless and movement.
Purchasing Shortcuts:
The improvements brought by NVIDIA DLSS 4 and ray reconstruction are revolutionizing the way ray tracing noise is handled, ensuring smoother and more detailed graphics. This breakthrough allows for better visual quality while maintaining performance.