Quantcast Dark Scenes Unnatural, Surfaces Producing a Rippling Effect ? - digitalFAQ.com Forums [Archives]
  #1  
06-14-2004, 11:48 PM
J-Wo J-Wo is offline
Free Member
 
Join Date: Nov 2002
Location: Toronto, Canada
Posts: 454
Thanks: 0
Thanked 0 Times in 0 Posts
There is a thread in the Optimal Scripts forum dealing with "unnatural" surfaces producing a rippling effect using the old MA script. Dialhot made some suggestions about using the "new" Deen 1.0 beta (which has actually been around since August 03 and linked on http://www.avisynth.org/warpenterprises/). I PM'd him about a script using this new deen for AVI sources and here's what he sent me:

Code:
AviSource("yourfile.avi",false)

BlindPP(cpu=4)

GripCrop(544, 480, overscan=3, source_anamorphic=false)
GripSize(resizer="LanczosResize")

Blockbuster(method="noise",detail_min=1,detail_max=3,variance=0.1,seed=1)
Deen()
Undot()
DCTFilter(1,1,1,1,1,1,0.5,0) 

GripBorders()
I tried this out on an hdtv capture I have in xvid format, and there are some major problems during dark scenes. For example, where there should be a clear black night sky there is instead dancing dark blue bloches. I then went out to test the other AVI optimal scripts and found that v3 and v4 were just as bad. Only v1 and v2 handled these dark scenes better, but at the sacrifice of less compression and (I think) some detail loss.

Here is a short clip of the scene in question. I invite you all to test them out for yourself and if someone can come up with a good alternative script PLEASE let me know!!! Thanks!

http://qlink.queensu.ca/~7jw6/chunk_1.avi
Reply With Quote
Someday, 12:01 PM
admin's Avatar
Site Staff / Ad Manager
 
Join Date: Dec 2002
Posts: 42
Thanks: ∞
Thanked 42 Times in 42 Posts
  #2  
06-15-2004, 03:45 AM
Dialhot Dialhot is offline
Free Member
 
Join Date: May 2003
Posts: 10,463
Thanks: 0
Thanked 0 Times in 0 Posts
Quote:
Originally Posted by J-Wo
the "new" Deen 1.0 beta (which has actually been around since August 03 and linked on http://www.avisynth.org/warpenterprises/).
The site is currently done so I can't check but are your SURE that this site link to the NEW deen qnd not the one from 2002 ?

Quote:
Only v1 and v2 handled these dark scenes better, but at the sacrifice of less compression and (I think) some detail loss.
Did you try to add the second blockbuster line like in the V4 script ?
Reply With Quote
  #3  
06-15-2004, 07:45 AM
J-Wo J-Wo is offline
Free Member
 
Join Date: Nov 2002
Location: Toronto, Canada
Posts: 454
Thanks: 0
Thanked 0 Times in 0 Posts
Hi Dialhot. Yes I know the site was down but I accessed a cached version while doing a google search and the link for deen was dated 8-03. I did add the second blockbuster line to v3 and v4 but i still think v1 handles these dark scenes better (it already includes two blockbuster lines). but as I said there is some detail lost.

On another note, I gave Mencode-ME a try using the predefined AVI filtering and it did an amazing job in these dark scenes. I find there is always blockiness no matter what incarnation of your avi optimal script I try, but with mencoder there is a general "spray" of pixelation. Not too sure how to describe it... but the problem with mencoder is there is a definite loss in sharpness and detail. Perhaps you could give it a try on the sample I included and see for yourself what I mean?

Hoping you might be able to help... thanks!
Reply With Quote
  #4  
06-15-2004, 09:50 AM
Dialhot Dialhot is offline
Free Member
 
Join Date: May 2003
Posts: 10,463
Thanks: 0
Thanked 0 Times in 0 Posts
Quote:
Originally Posted by J-Wo
but with mencoder there is a general "spray" of pixelation.
Check all my post where I used the word "grainy" and you will see that what you find interesting there is for me a big default in all mencoder output. But you have the right to like pictures shouted in a sand storm

Quote:
Perhaps you could give it a try on the sample I included and see for yourself what I mean?
Under mencoder ? non way ! But I will try to find what can explained that V1 is better that V4 on this problem. I'll tell you.
Reply With Quote
  #5  
06-15-2004, 01:18 PM
muhali3 muhali3 is offline
Free Member
 
Join Date: Sep 2003
Posts: 134
Thanks: 0
Thanked 0 Times in 0 Posts
J-Wo: I saw the sample clip that you put on. There doesn't appear to be any "dancing dark blue blotches" as you mentioned, but there is definetly a "graininess" to your video. Other than that i can't see anything wrong with it.
Reply With Quote
  #6  
06-15-2004, 02:00 PM
J-Wo J-Wo is offline
Free Member
 
Join Date: Nov 2002
Location: Toronto, Canada
Posts: 454
Thanks: 0
Thanked 0 Times in 0 Posts
The sample clip is the offending dark scene from the ORIGINAL avi file. So what you need to do is try v3 or v4 script to see the "dancing blue blotches". I used CCE for encoding at Q=15, min/max bitrate = 64/4500, quantizer charactistic = 17. I am encoding for KDVD, so I compiled using DVD-Lab Pro beta 4. Here is an example of the v4 script I used:

Code:
AviSource("E:\Movies\chunk_1.avi",false)

BlindPP(cpu=4)
Blockbuster(method="noise",detail_min=1,detail_max=3,variance=0.1,seed=1)
Convolution3D(1, 6, 12, 6, 8, 2.8, 0) 

GripCrop(544, 480, overscan=3, source_anamorphic=false)
GripSize(resizer="LanczosResize")

Undot()
TemporalSoften(2,7,7,3,2)
DCTFilter(1,1,1,1,1,1,0.5,0) 

GripBorders()
Reply With Quote
  #7  
06-15-2004, 09:25 PM
Uruk-hai Uruk-hai is offline
Free Member
 
Join Date: Apr 2004
Location: Middle Earth
Posts: 30
Thanks: 0
Thanked 0 Times in 0 Posts
I am using DIKO which essentially is using the Dialhotv4 avs script.
I have similar "wet-paint" problem when converting a thriller movie AVI clip. The moive was converted in CCE using Max Bitrate= 7000 bps, QC=25 and Q Factor=1. The AVI was an xvid with bitrate=900kps. The output KDVD Video stream was 2.5GB for 80 mins.

The movie has a lot of dark and misty scenes and the result is that all the details and texture of hairs and actors' faces become wet-paint. I think it is a consequence of over-filtering. I thought Deen() was a solution but from this thread it seems not.

Will removing the temporal dimension totally solve this wet-paint problem?

Could anyone suggest filters/scripts that can deal better with low bitrate and dark scenes. Or parameters in CCE that can improve the encoding.
Reply With Quote
  #8  
06-16-2004, 04:01 AM
Dialhot Dialhot is offline
Free Member
 
Join Date: May 2003
Posts: 10,463
Thanks: 0
Thanked 0 Times in 0 Posts
Quote:
Originally Posted by Uruk-hai
Will removing the temporal dimension totally solve this wet-paint problem?
It should at least reduce it.
As told in private to J-Who you can also try with temporalcleaner insteed of temporalsoften. I didn't have tilme to do some tests on his current problem yet.

Quote:
Could anyone suggest filters/scripts that can deal better with low bitrate and dark scenes. Or parameters in CCE that can improve the encoding.
If you are using full DVD reso from an avi source, just forget.
Reply With Quote
  #9  
06-16-2004, 04:25 AM
Boulder Boulder is offline
Free Member
 
Join Date: Sep 2002
Location: Lahti, Finland
Posts: 1,652
Thanks: 0
Thanked 0 Times in 0 Posts
I've been using a script like this for AVI sources and have had no problems:

Code:
AviSource("path\clip.avi") 
Crop() # if needed
Blockbuster(method="noise",detail_min=1,detail_max=3,variance=0.1,seed=1)
Deen("c2d",2,4,6,4,6,0.5,9,"")
UnFilter(60,60) # if needed
UnDot()
BicubicResize() # appropriate values here
Blockbuster(method="noise",detail_min=1,detail_max=10,variance=0.3,seed=2)
AddBorders() # appropriate values here
ConverttoYUY2()
Limiter()
I try to avoid temporal filtering with AVI sources if possible. The sources are usually without any extensive grain so only light filtering is needed. I also prefer codec postprocessing since I trust it does a better job than MarcFD's BlindPP. The codec gets the quantizers directly from the clip whereas BlindPP only guesstimates.
Reply With Quote
  #10  
06-16-2004, 04:47 AM
J-Wo J-Wo is offline
Free Member
 
Join Date: Nov 2002
Location: Toronto, Canada
Posts: 454
Thanks: 0
Thanked 0 Times in 0 Posts
thanks for the suggestions boulder, i'll give them a try. could you tell me a bit more about codec postprocessing? I'm pretty sure I had all mine turned off. Which ones do you enable and at what settings please? Thanks!
Reply With Quote
  #11  
06-16-2004, 05:13 AM
Uruk-hai Uruk-hai is offline
Free Member
 
Join Date: Apr 2004
Location: Middle Earth
Posts: 30
Thanks: 0
Thanked 0 Times in 0 Posts
Thank U Dialhot,

I just found the following in CCE manaul which may help to reduce the wet-paint effect:
Quote:
Quantization characteristics This parameter changes the balance
of characteristics at quantization. The range is 0 to 64.
As the value becomes closer to 0, a higher bit amount is allocated
to complicated images areas. As the value becomes closer to 64, a
higher bit amount is allocated to flat image areas. When the value is
close to 0, the mosquito noise at the edges (noise causing hazy part
along the edges, looking like flying mosquitoes) is less outstanding,
but the contouring noise (noise which looks like contour line patterns,
which appear in flat and wide areas, such as a dark background) is
more outstanding. The opposite occurs when the value is closer to
64.
According to the manual, for dark scenes CCE's QC should be set to higher value to reduce the contouring noise. Will give it a try
Reply With Quote
  #12  
06-16-2004, 05:31 AM
Boulder Boulder is offline
Free Member
 
Join Date: Sep 2002
Location: Lahti, Finland
Posts: 1,652
Thanks: 0
Thanked 0 Times in 0 Posts
J-Wo,

I set the postprocessing in DivX at max deblocking, no deringing. Automatic post-proc adjust, both disabled. Film effect disabled. In quality settings, YUV extended mode and Disable logo ticked, others unticked. The DivX team released an updated version with some bugfixes in the decoder some time ago but they didn't change the version number. I think the latest one is v5.1.1 build 1031.

In XviD (Koepi's v1.0.1) I have deblocking for Y and UV ticked and output colorspace set as YV12. All the others are not ticked.

In CCE I've got 28 as the quantizer characteristics.
Reply With Quote
  #13  
06-16-2004, 08:48 AM
J-Wo J-Wo is offline
Free Member
 
Join Date: Nov 2002
Location: Toronto, Canada
Posts: 454
Thanks: 0
Thanked 0 Times in 0 Posts
great suggestions boulder, I'll give them a try!

In your script, I was wondering if the last two lines are needed. For some reason I have never needed a converttoyuy2() or converttoyv12() at the end of my script using CCE, I have no idea why! If I can avoid colorspace conversions, I should if at all possible right? And finally is the limiter() line necessary? I've stopped using that one a long time ago based on some previous suggestions. Just wondering why you include it. Thanks!
Reply With Quote
  #14  
06-16-2004, 08:53 AM
Dialhot Dialhot is offline
Free Member
 
Join Date: May 2003
Posts: 10,463
Thanks: 0
Thanked 0 Times in 0 Posts
Quote:
Originally Posted by J-Wo
converttoyuy2() or converttoyv12() at the end of my script using CCE, I have no idea why!!
CCE 2.50 can't work in other thing than YUY2 and need this line.
With CCE 2.6 and above, the line is no more necessary.
Reply With Quote
  #15  
06-16-2004, 09:06 AM
Boulder Boulder is offline
Free Member
 
Join Date: Sep 2002
Location: Lahti, Finland
Posts: 1,652
Thanks: 0
Thanked 0 Times in 0 Posts
I've found out that CCE still needs YUY2 data, it's just that some codec does the YV12->YUY2 conversion - most likely XviD. I don't trust that so I do the conversion in the script. You can check the registry to find out which codec does the conversion, it can be found at HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Drivers32 . See if there's a string vidc.yv12 and what the value is, I've got xvidvfw.dll. On a side note, I also edited vidc.yuy2 and placed huffyuv.dll there as from what I know, msyuv.dll is a bit buggy.

What comes to Limiter(), I've never had any problems.
Reply With Quote
  #16  
06-16-2004, 12:46 PM
J-Wo J-Wo is offline
Free Member
 
Join Date: Nov 2002
Location: Toronto, Canada
Posts: 454
Thanks: 0
Thanked 0 Times in 0 Posts
Okay, I did a bit of testing and found that I actually get the best results with the v2 script (I previously might have mentioned v1 but I think I was wrong). Surfaces such as skies, fog, walls etc appear grainy and pixelated, which I find actually GOOD. With v2 the graininess is somewhat stable which is another good thing. With all other incarnations of avi scripts, instead of a grainy/pixelated surface I see largish blocks of colour or a rippling effect that dances around a bit, distracting the eye. I also don't like to enable post-processing in divx/xvid codec, I find the result is a little "overprocessed" and these flat surfaces don't look as good.

I'm trying to do a QC test in CCE to find that qc value is the best. To be honest I could tell a whole lot of difference from qc=10 to qc=28, except that the higher qc goes the more compression you get. Anyone got some suggestions?

here's the v2 script I'm using right now
Code:
AviSource("E:\Movies\test.avi",false)

Undot()
Blockbuster(method="noise",detail_min=1,detail_max=8,variance=0.3,seed=5823)
ATC(2,3,5,0.5,false)
TemporalSoften(2,7,7,3,2) 

GripCrop(544, 480, overscan=3, source_anamorphic=false)
GripSize(resizer="LanczosResize")

DCTFilter(1,1,1,1,1,1,0.5,0)
Blockbuster(method="noise",detail_min=1,detail_max=10,variance=0.5,seed=5623) 

GripBorders()
Reply With Quote
  #17  
06-16-2004, 11:10 PM
Uruk-hai Uruk-hai is offline
Free Member
 
Join Date: Apr 2004
Location: Middle Earth
Posts: 30
Thanks: 0
Thanked 0 Times in 0 Posts
Hi J-wo
I am also working hard to eliminate the wet-paint effect. I did some search and found that contouring noise & DCT occurs when the encoder compresses too much or the area has too few details.

One rescue is to add noise to the scene to increase the details. This coincides with your findings that V1 & V2 work better because in their scripts the BLOCKBUSTER line has max_detail=8, which add noises more generally to the frame. The V4 version has max_detail=3, making less areas are subjected to BLOCKBUSTER.

You can also add dithered noise in CCE as there is a "dither quantization" parameter.

Maybe Dialhot can advise whether adding
Quote:
Blockbuster( method="dither")
or
Quote:
asharp()
to the script is a good idea to increase the details.

BTW I did some experience this morining and was much puzzled by the result. I used a script which essentially contained only resize up (GRIPFIT and GRIPCROP) and viewed the avs in VDub, prominent wet-paint effect was already very visible. The wet-paint was not there when I put the original avi in VDub. The only difference was resize. I knew that my clip was of low bitrate (around 900kps xvid) but this result was not expected as I assumed that the wet-paint was coming from other filters. Now it wasn't the case
Can someone confirm resize up will always introduce contouring noise? Will different resize methods matter?
Reply With Quote
  #18  
06-17-2004, 03:39 AM
Dialhot Dialhot is offline
Free Member
 
Join Date: May 2003
Posts: 10,463
Thanks: 0
Thanked 0 Times in 0 Posts
Quote:
Originally Posted by Uruk-hai
One rescue is to add noise to the scene to increase the details. This coincides with your findings that V1 & V2 work better because in their scripts the BLOCKBUSTER line has max_detail=8, which add noises more generally to the frame. The V4 version has max_detail=3, making less areas are subjected to BLOCKBUSTER.
And you didn't asked yourself why there is a second (optional) blockbuster line in my V3 and V4 script ? You just agree with what was I found in my tests some months ago The second line as a max_detail set to 10.

Quote:
asharp()
No way. This filter gives nothing but crap. I never used it, I'll never do.

Quote:
Will different resize methods matter?
Why don't you do the test and give us the result ?
What resizer did you use in your test when you see that this is the possible source of the painting effect ?
Reply With Quote
  #19  
06-17-2004, 08:55 AM
J-Wo J-Wo is offline
Free Member
 
Join Date: Nov 2002
Location: Toronto, Canada
Posts: 454
Thanks: 0
Thanked 0 Times in 0 Posts
Quote:
Originally Posted by Dialhot
And you didn't asked yourself why there is a second (optional) blockbuster line in my V3 and V4 script ? You just agree with what was I found in my tests some months ago The second line as a max_detail set to 10.
From my own testing, these dark scenes are handled better by the v2 script than either v3 or v4 with both BB lines. It's hard to describe, but v2 makes surfaces like walls appear less blocky, has less dancing squares, it just looks "better" in my opinion. But the downside is edges are much softer and there is a lacking of detail on objects.

I'm hoping that thru my feedback you might be able to provide some suggestions to help tweak v2 a little bit, or perhaps make some updates to your v4 script. Thanks!
Reply With Quote
  #20  
06-17-2004, 09:35 AM
Dialhot Dialhot is offline
Free Member
 
Join Date: May 2003
Posts: 10,463
Thanks: 0
Thanked 0 Times in 0 Posts
Quote:
Originally Posted by J-Wo
It's hard to describe, but v2 makes surfaces like walls appear less blocky, has less dancing squares, it just looks "better" in my opinion. But the downside is edges are much softer and there is a lacking of detail on objects.
The purpose of V3 and more over V4 is that it should give the same results on the flat area than V2 but with less loss in the details. But you probably found a tricky source

Can you test this "old" V2 but with "Deen()" insteed of the ATC line ?
(I'm still talking about the new deen, the one from august 2003).
Reply With Quote
Reply




Similar Threads
Thread Thread Starter Forum Replies Last Post
Avisynth: Unnatural Looking Surfaces? Jellygoose Avisynth Scripting 64 06-08-2004 12:41 PM
Avisynth: About Unnatural Looking Surfaces... Jellygoose Avisynth Scripting 1 03-30-2004 05:54 AM
KVCD: lot of VERY dark scenes? Paul0889 Video Encoding and Conversion 3 12-30-2002 01:19 AM
KVCD: Dark scenes problem! ARAGORN Video Encoding and Conversion 3 10-21-2002 11:20 AM
Blocks in dark scenes? syk2c11 Video Encoding and Conversion 5 07-02-2002 08:49 PM

Thread Tools



 
All times are GMT -5. The time now is 05:01 PM  —  vBulletin Jelsoft Enterprises Ltd