digitalFAQ.com Forum

digitalFAQ.com Forum (https://www.digitalfaq.com/forum/)
-   Restore, Filter, Improve Quality (https://www.digitalfaq.com/forum/video-restore/)
-   -   Different types of noise removal for video? (https://www.digitalfaq.com/forum/video-restore/8785-different-types-noise.html)

yukukuhi 06-17-2018 11:30 AM

Different types of noise removal for video?
 
4 Attachment(s)
Hey there folks of digitalFAQ :D
I want to remove or reduce these 2 types of noises from the video samples that i'm attaching below. The first 2 videos contains noises to be present in dark areas & the other 2 videos contains noises in bright areas or the entire video to be exact. They are h264 .m2ts & mpeg2 .ts files. Please help.

sanlyn 06-18-2018 04:21 AM

The noise in your m2ts files are similar to the spots and scratches in your Chinvar videos. use the same filters:

Code:

aud=NicMPG123Source("Drive:\path\to\HDPVR60_20180325_1425 PID 642 L2 2ch 48 256 DELAY 0ms.mp2")
vid=AVCSource("Drive:\path\to\HDPVR60_20180325_1425.dga")
AudioDub(vid,aud)
Source1=last
a=source1.SelectEvery(3,0).RemoveDirtMC(50,false).RemoveSpotsMC2()
b=source1.SelectEvery(3,1).RemoveDirtMC(50,false).RemoveSpotsMC2()
c=source1.SelectEvery(3,2).RemoveDirtMC(50,false).RemoveSpotsMC2()
Interleave(a,b,c)
LimitedSharpenFaster()
AddGrainC(1.5,1.5)
AssumeFPS("Film",sync_audio=true)
return last

The movie in the two .ts samples is permanently ruined. The disturbance you see isn't "noise". It is damaged to the point where there is no usable video data to work with. Playing with the color is about all you can do.

BTW, none of those videos are BluRay compliant. 1920x1080 progressive video @25fps is not valid for authored BluRay, which at that frame size and frame rate must be encoded as interlaced. The script above changes the frame rate to the original 24fps film speed, which is valid for 1920x1080p BluRay and which doesn't look and sound ridiculous as it does when speeded up to 25fps.

yukukuhi 07-02-2018 12:00 PM

2 Attachment(s)
The noises present in the video i'm attaching other than the dirts, scratches & spots, there is some compression noises in the dark areas kinda like macro blocks (coz they are not exactly block shaped). Is there a filter to remove or reduce that types of noises?

themaster1 07-02-2018 06:12 PM

2 Attachment(s)
I've seen worse blocking but try this filter maybe it'll give you satisfaction: https://forum.doom9.org/showthread.php?t=174433

hdpvr60 original frame 211:
http://www.digitalfaq.com/forum/error.gif

yukukuhi 07-04-2018 11:23 AM

Hey sanlyn your thoughts on these types of noises removal.

yukukuhi 08-04-2018 09:57 AM

Hey sanlyn what is the best deblock filter to use?

sanlyn 08-06-2018 04:51 AM

Quote:

Originally Posted by yukukuhi (Post 55364)
Hey sanlyn what is the best deblock filter to use?

There is no "best" deblocker. DeBlock is among the strongest but is also more destructive. DeBlock_QED uses DeBlock internally but has more specific parameters. The dither 16-bit plugin package has additional tweaks that people add to deblock operations that help prevent posterizing effects after removing macroblocks, such as GradFun3 and filters that add fine film grain effects.

I didn't see any macroblocks in the samples posted in this thread.

yukukuhi 08-06-2018 07:36 AM

Well they aren't exactly deblock noises but they look like some kind of a foggy noise that exist even after running RemoveDirtMC. Please help.

sanlyn 08-06-2018 08:53 AM

which sample or samples do you refer to?

yukukuhi 08-31-2018 09:02 AM

Hey sanlyn could you please upload the required support plugins for running Deblock_Qed if you seem to be having them coz some of them have been removed.

And I'm working on the precise video samples having the noises that I had mentioned earlier. :)

sanlyn 09-03-2018 03:52 AM

DeBlock_QED requires the following:

1. DeBlock_QED_MT2Mod.avsi is the latest version. Internally the filter is still called "DeBlocK_QED", so there is no change in the way the filter appears in a script. It is fully compatible with older scripts that used the earlier "DeBlock_QED.avsi". http://avisynth.nl/index.php/Deblock_QED

2. DeBlock.dll version 1.3, which appears in downloads as DeBlock13.zip or as Avisynth_DeBlock.zip. The html documentation page is at http://avisynth.nl/index.php/DeBlock. The new zip download page is linked there as https://github.com/mysteryx93/Avisynth-Deblock/releases.

3. MaskTools2.dll. If you have QTGMC, you already have MaskTools2. The latest version is 2.2.17, whose documentation and download page is at http://avisynth.nl/index.php/MaskTools2.

yukukuhi 10-11-2018 12:18 PM

Hey sanlyn i tried running DeBlock_QED filter and it gives this error message:

Avisynth open failure:
Cache: Filter returned invalid response to
CACHE_GETCHILD_CACHE_MODE, 139339872
(Deblock_QED_MT2Mod.avsi, line 46)
(C:\Users\SGK\Desktop\chinnavar Movie Comedya1.avs, line 11)

Here's my script:
Code:


Import("C:\Program Files (x86)\AviSynth\plugins\MDG2.avs")
Import("C:\Program Files (x86)\AviSynth\plugins\RemoveDirtMC.avs")

aud=NicMPG123Source("C:\Users\SGK\Desktop\Adithya TV Comedy Collection\"
  \+ "Chinnvar Movie Comedya PID 125 L2 2ch 48 256 DELAY 5ms.mp2",
  \normalize=false)

vid=MPEG2Source("C:\Users\SGK\Desktop\Adithya TV Comedy Collection\Chinnvar Movie Comedya.d2v")
AudioDub(vid,aud)

deblock_qed(quant1=28, quant2=32)

Source1=vid
a=source1.SelectEvery(3,0)RemoveSpotsMC2()MDG2()
b=source1.SelectEvery(3,1)RemoveSpotsMC2()MDG2()
c=source1.SelectEvery(3,2)RemoveSpotsMC2()MDG2()
Interleave(a,b,c)

Please help.

sanlyn 10-11-2018 03:23 PM

I haven't made Deblock_QED_MT2Mod.avsi myself. I'm tired of all the MT2mods coming down the pike these days, they seem to work only for their designers. I'd just use the original DeBlock_QED.

lordsmurf 10-12-2018 06:58 AM

Quote:

Originally Posted by sanlyn (Post 56727)
I'm tired of all the [mods] coming down the pike these days, they seem to work only for their designers.

I've seen a lot of that myself. Glad it's not just me. :unsure:

yukukuhi 10-12-2018 10:34 AM

I can't find the original DeBlock_QED! Please help.

lordsmurf 10-12-2018 10:47 AM

This is the text of the .avsi

Code:

# Changes 2008-08-18: (Didée)
# - Replaced the ugly stackXXX cascade with mt_LutSpa() (requires MaskTools v2.0a35)
# - Changed Quant and Offset defaults to 24,28,2,4,4,8

# Changes 2010-05-25:
# - Explicitly specified parameters of mt_LutSpa()
#  (required due to position of new 'biased' parameter, starting from MaskTools 2.0a43)
# - Non mod 16 input is now padded with borders internally

# Changes 2010-08-18:
# - Replaced AddBorders with PointResize
# - Changed Quant and Offset defaults to 18,19,3,4,1,1 to reduce blurring

# Changes 2010-10-16:
# - Replaced 'relative' with the new 'mode' parameter in mt_LutSpa(), starting from MaskTools 2.0a45
# - Changed Quant and Offset defaults to 24,26,1,1,2,2 to increase effectiveness, but still within sensible limits.
#  (see for details: http://forum.doom9.org/showthread.php?p=810932#post810932)

function Deblock_QED ( clip clp, int "quant1", int "quant2",
 \                    int "aOff1", int "bOff1", int "aOff2", int "bOff2", int "uv" )
{

quant1 = default( quant1, 24 ) # Strength of block edge deblocking
quant2 = default( quant2, 26 ) # Strength of block internal deblocking

aOff1 = default( aOff1, 1 ) # halfway "sensitivity" and halfway a strength modifier for borders
aOff2 = default( aOff2, 1 ) # halfway "sensitivity" and halfway a strength modifier for block interiors
bOff1 = default( bOff1, 2 ) # "sensitivity to detect blocking" for borders
bOff2 = default( bOff2, 2 ) # "sensitivity to detect blocking" for block interiors

uv    = default( uv, 3 )    # u=3 -> use proposed method for chroma deblocking
                            # u=2 -> no chroma deblocking at all (fastest method)
                            # u=1|-1 -> directly use chroma debl. from the normal|strong deblock()

# add borders if clp is not mod 8
padX = clp.width%8 == 0 ? 0 : (8 - clp.width%8)
padY = clp.height%8 == 0 ? 0 : (8 - clp.height%8)
clp=clp.pointresize(clp.width+padX, clp.height+padY, 0, 0, clp.width+padX, clp.height+padY)

# block
block = clp.mt_LutSpa(mode="absolute",expr="x 1 + 8 % 1 < x 8 % 1 < y 1 + 8 % 1 < y 8 % 1 < | | | 255 0 ?",U=3,V=3)

# create normal deblocking (for block borders) and strong deblocking (for block interiour)
normal = clp.deblock(quant=quant1,aOffset=aOff1,bOffset=bOff1)
strong = clp.deblock(quant=quant2,aOffset=aOff2,bOffset=bOff2)

# build difference maps of both
normalD = mt_makediff(clp,normal,chroma=uv>2?"process":"ignore")
strongD = mt_makediff(clp,strong,chroma=uv>2?"process":"ignore")

# separate border values of the difference maps, and set the interiours to '128'
normalD2 = mt_lutxy(normalD,block,expr="y 255 == x 128 ?",U=uv,V=uv)
strongD2 = mt_lutxy(StrongD,block,expr="y 255 == x 128 ?",U=uv,V=uv)

# interpolate the border values over the whole block: DCTFilter can do it. (Kiss to Tom Barry!)
# (Note: this is not fully accurate, but a reasonable approximation.)
# add borders if clp is not mod 16
sw=strongD2.width sh=strongD2.height
remX = sw%16 == 0 ? 0 : (16 - sw%16)
remY = sh%16 == 0 ? 0 : (16 - sh%16)
strongD3 = strongD2.pointresize(sw+remX, sh+remY, 0, 0, sw+remX, sh+remY).mt_lut(expr="x 128 - 1.01 * 128 +",U=uv,V=uv)\
                        .dctfilter(1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0).crop(0,0,-remX,-remY)

# apply compensation from "normal" deblocking to the borders of
# the full-block-compensations calculated from "strong" deblocking ...
strongD4 = mt_lutxy(strongD3,normalD2,expr="y 128 == x y ?",U=uv,V=uv)

# ... and apply it.
deblocked= mt_makediff(clp,strongD4,chroma=uv>2?"process":"ignore")

# simple decisions how to treat chroma
deblocked = (uv<0) ? deblocked.mergechroma(strong) : uv<2 ? deblocked.mergechroma(normal) : deblocked

deblocked.crop(0,0,-padX,-padY) # remove mod 8 borders
}

from https://forum.doom9.org/showthread.p...77#post1402777

Few other versions in later replies.

sanlyn 10-12-2018 11:02 AM

The official version from the older Avisynth Wiki was attached in digitalfaq at this link: http://www.digitalfaq.com/forum/atta...deblock_qedzip.

yukukuhi 10-13-2018 11:18 AM

The same error message occurs. Please help.

sanlyn 10-13-2018 02:04 PM

Are you using plain vanilla Avisynth 2.6, or another version of Avisynth?
Are you using the 64-bit version of any plugins ? (they must all be 32-bit)
Are you using Windows 10?

yukukuhi 10-15-2018 12:47 PM

I'm using plain vanilla Avisynth 2.6. 32-bit plugins only. Windows XP.

Now the earlier error has been fixed after a PC restart, but there is a new error message:

Code:

Avisynth open failure:
Script error: there is no function named 'dctfilter'
(Deblock_QED.avsi, line 44)
(C:\Users\SGK\Desktop\chinnavar Movie Comedya1.avs, line 11)



All times are GMT -5. The time now is 07:56 AM

Site design, images and content © 2002-2024 The Digital FAQ, www.digitalFAQ.com
Forum Software by vBulletin · Copyright © 2024 Jelsoft Enterprises Ltd.