Quantcast Different types of noise removal for video? - digitalFAQ Forum
Go Back    Forum > Digital Video > Video Project Help > Restore, Filter, Improve Quality

Reply
 
LinkBack Thread Tools
  #1  
06-17-2018, 11:30 AM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
Hey there folks of digitalFAQ
I want to remove or reduce these 2 types of noises from the video samples that i'm attaching below. The first 2 videos contains noises to be present in dark areas & the other 2 videos contains noises in bright areas or the entire video to be exact. They are h264 .m2ts & mpeg2 .ts files. Please help.


Attached Files
File Type: rar HDPVR60_20180325_1425.rar (87.73 MB, 23 downloads)
File Type: rar HDPVR60_20180423_1834 .rar (37.74 MB, 7 downloads)
File Type: rar HDPVR60_20180427_1414.rar (19.93 MB, 7 downloads)
File Type: rar Nallavanukku Nallavan.rar (5.22 MB, 6 downloads)
Reply With Quote
Someday, 12:01 PM
admin's Avatar
Ads / Sponsors
 
Join Date: ∞
Posts: 42
Thanks: ∞
Thanked 42 Times in 42 Posts
  #2  
06-18-2018, 04:21 AM
sanlyn sanlyn is offline
Premium Member
 
Join Date: Aug 2009
Location: N. Carolina and NY, USA
Posts: 3,382
Thanked 1,058 Times in 883 Posts
The noise in your m2ts files are similar to the spots and scratches in your Chinvar videos. use the same filters:

Code:
aud=NicMPG123Source("Drive:\path\to\HDPVR60_20180325_1425 PID 642 L2 2ch 48 256 DELAY 0ms.mp2")
vid=AVCSource("Drive:\path\to\HDPVR60_20180325_1425.dga") 
AudioDub(vid,aud) 
Source1=last 
a=source1.SelectEvery(3,0).RemoveDirtMC(50,false).RemoveSpotsMC2()
b=source1.SelectEvery(3,1).RemoveDirtMC(50,false).RemoveSpotsMC2()
c=source1.SelectEvery(3,2).RemoveDirtMC(50,false).RemoveSpotsMC2()
Interleave(a,b,c) 
LimitedSharpenFaster() 
AddGrainC(1.5,1.5)
AssumeFPS("Film",sync_audio=true) 
return last
The movie in the two .ts samples is permanently ruined. The disturbance you see isn't "noise". It is damaged to the point where there is no usable video data to work with. Playing with the color is about all you can do.

BTW, none of those videos are BluRay compliant. 1920x1080 progressive video @25fps is not valid for authored BluRay, which at that frame size and frame rate must be encoded as interlaced. The script above changes the frame rate to the original 24fps film speed, which is valid for 1920x1080p BluRay and which doesn't look and sound ridiculous as it does when speeded up to 25fps.
Reply With Quote
  #3  
07-02-2018, 12:00 PM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
The noises present in the video i'm attaching other than the dirts, scratches & spots, there is some compression noises in the dark areas kinda like macro blocks (coz they are not exactly block shaped). Is there a filter to remove or reduce that types of noises?


Attached Files
File Type: rar PVR_REC_TV2 (02).rar (37.95 MB, 3 downloads)
File Type: rar HDPVR60_20180423_1834 .rar (37.74 MB, 5 downloads)
Reply With Quote
  #4  
07-02-2018, 06:12 PM
themaster1 themaster1 is offline
Free Member
 
Join Date: Feb 2011
Posts: 180
Thanked 30 Times in 26 Posts
I've seen worse blocking but try this filter maybe it'll give you satisfaction: https://forum.doom9.org/showthread.php?t=174433

hdpvr60 original frame 211:


Attached Images
File Type: jpg 1530573088-hdpvr.jpg (79.1 KB, 10 downloads)
Attached Files
File Type: zip 1530573088-hdpvr.zip (1.25 MB, 2 downloads)
Reply With Quote
  #5  
07-04-2018, 11:23 AM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
Hey sanlyn your thoughts on these types of noises removal.
Reply With Quote
  #6  
08-04-2018, 09:57 AM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
Hey sanlyn what is the best deblock filter to use?
Reply With Quote
  #7  
08-06-2018, 04:51 AM
sanlyn sanlyn is offline
Premium Member
 
Join Date: Aug 2009
Location: N. Carolina and NY, USA
Posts: 3,382
Thanked 1,058 Times in 883 Posts
Quote:
Originally Posted by yukukuhi View Post
Hey sanlyn what is the best deblock filter to use?
There is no "best" deblocker. DeBlock is among the strongest but is also more destructive. DeBlock_QED uses DeBlock internally but has more specific parameters. The dither 16-bit plugin package has additional tweaks that people add to deblock operations that help prevent posterizing effects after removing macroblocks, such as GradFun3 and filters that add fine film grain effects.

I didn't see any macroblocks in the samples posted in this thread.
Reply With Quote
  #8  
08-06-2018, 07:36 AM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
Well they aren't exactly deblock noises but they look like some kind of a foggy noise that exist even after running RemoveDirtMC. Please help.
Reply With Quote
  #9  
08-06-2018, 08:53 AM
sanlyn sanlyn is offline
Premium Member
 
Join Date: Aug 2009
Location: N. Carolina and NY, USA
Posts: 3,382
Thanked 1,058 Times in 883 Posts
which sample or samples do you refer to?
Reply With Quote
  #10  
08-31-2018, 09:02 AM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
Hey sanlyn could you please upload the required support plugins for running Deblock_Qed if you seem to be having them coz some of them have been removed.

And I'm working on the precise video samples having the noises that I had mentioned earlier.
Reply With Quote
  #11  
09-03-2018, 03:52 AM
sanlyn sanlyn is offline
Premium Member
 
Join Date: Aug 2009
Location: N. Carolina and NY, USA
Posts: 3,382
Thanked 1,058 Times in 883 Posts
DeBlock_QED requires the following:

1. DeBlock_QED_MT2Mod.avsi is the latest version. Internally the filter is still called "DeBlocK_QED", so there is no change in the way the filter appears in a script. It is fully compatible with older scripts that used the earlier "DeBlock_QED.avsi". http://avisynth.nl/index.php/Deblock_QED

2. DeBlock.dll version 1.3, which appears in downloads as DeBlock13.zip or as Avisynth_DeBlock.zip. The html documentation page is at http://avisynth.nl/index.php/DeBlock. The new zip download page is linked there as https://github.com/mysteryx93/Avisynth-Deblock/releases.

3. MaskTools2.dll. If you have QTGMC, you already have MaskTools2. The latest version is 2.2.17, whose documentation and download page is at http://avisynth.nl/index.php/MaskTools2.
Reply With Quote
  #12  
10-11-2018, 12:18 PM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
Hey sanlyn i tried running DeBlock_QED filter and it gives this error message:

Avisynth open failure:
Cache: Filter returned invalid response to
CACHE_GETCHILD_CACHE_MODE, 139339872
(Deblock_QED_MT2Mod.avsi, line 46)
(C:\Users\SGK\Desktop\chinnavar Movie Comedya1.avs, line 11)

Here's my script:
Code:
Import("C:\Program Files (x86)\AviSynth\plugins\MDG2.avs") 
Import("C:\Program Files (x86)\AviSynth\plugins\RemoveDirtMC.avs") 

aud=NicMPG123Source("C:\Users\SGK\Desktop\Adithya TV Comedy Collection\"
   \+ "Chinnvar Movie Comedya PID 125 L2 2ch 48 256 DELAY 5ms.mp2", 
   \normalize=false) 

vid=MPEG2Source("C:\Users\SGK\Desktop\Adithya TV Comedy Collection\Chinnvar Movie Comedya.d2v") 
AudioDub(vid,aud) 

deblock_qed(quant1=28, quant2=32)

Source1=vid
a=source1.SelectEvery(3,0)RemoveSpotsMC2()MDG2() 
b=source1.SelectEvery(3,1)RemoveSpotsMC2()MDG2() 
c=source1.SelectEvery(3,2)RemoveSpotsMC2()MDG2() 
Interleave(a,b,c)
Please help.
Reply With Quote
  #13  
10-11-2018, 03:23 PM
sanlyn sanlyn is offline
Premium Member
 
Join Date: Aug 2009
Location: N. Carolina and NY, USA
Posts: 3,382
Thanked 1,058 Times in 883 Posts
I haven't made Deblock_QED_MT2Mod.avsi myself. I'm tired of all the MT2mods coming down the pike these days, they seem to work only for their designers. I'd just use the original DeBlock_QED.
Reply With Quote
  #14  
10-12-2018, 06:58 AM
lordsmurf's Avatar
lordsmurf lordsmurf is offline
Site Staff | Video
 
Join Date: Dec 2002
Posts: 8,212
Thanked 1,350 Times in 1,192 Posts
Quote:
Originally Posted by sanlyn View Post
I'm tired of all the [mods] coming down the pike these days, they seem to work only for their designers.
I've seen a lot of that myself. Glad it's not just me.

- Did my advice help you? Then become a Premium Member and support this site.
- Find television shows, cartoons, DVDs and Blu-ray releases at the TVPast forums.
Reply With Quote
  #15  
10-12-2018, 10:34 AM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
I can't find the original DeBlock_QED! Please help.
Reply With Quote
  #16  
10-12-2018, 10:47 AM
lordsmurf's Avatar
lordsmurf lordsmurf is offline
Site Staff | Video
 
Join Date: Dec 2002
Posts: 8,212
Thanked 1,350 Times in 1,192 Posts
This is the text of the .avsi

Code:
# Changes 2008-08-18: (Didée)
# - Replaced the ugly stackXXX cascade with mt_LutSpa() (requires MaskTools v2.0a35)
# - Changed Quant and Offset defaults to 24,28,2,4,4,8

# Changes 2010-05-25:
# - Explicitly specified parameters of mt_LutSpa()
#   (required due to position of new 'biased' parameter, starting from MaskTools 2.0a43)
# - Non mod 16 input is now padded with borders internally

# Changes 2010-08-18:
# - Replaced AddBorders with PointResize
# - Changed Quant and Offset defaults to 18,19,3,4,1,1 to reduce blurring

# Changes 2010-10-16:
# - Replaced 'relative' with the new 'mode' parameter in mt_LutSpa(), starting from MaskTools 2.0a45
# - Changed Quant and Offset defaults to 24,26,1,1,2,2 to increase effectiveness, but still within sensible limits.
#   (see for details: http://forum.doom9.org/showthread.php?p=810932#post810932)

function Deblock_QED ( clip clp, int "quant1", int "quant2", 
 \                     int "aOff1", int "bOff1", int "aOff2", int "bOff2", int "uv" )
{

quant1 = default( quant1, 24 ) # Strength of block edge deblocking
quant2 = default( quant2, 26 ) # Strength of block internal deblocking

aOff1 = default( aOff1, 1 ) # halfway "sensitivity" and halfway a strength modifier for borders
aOff2 = default( aOff2, 1 ) # halfway "sensitivity" and halfway a strength modifier for block interiors
bOff1 = default( bOff1, 2 ) # "sensitivity to detect blocking" for borders
bOff2 = default( bOff2, 2 ) # "sensitivity to detect blocking" for block interiors

uv    = default( uv, 3 )    # u=3 -> use proposed method for chroma deblocking
                            # u=2 -> no chroma deblocking at all (fastest method)
                            # u=1|-1 -> directly use chroma debl. from the normal|strong deblock()

# add borders if clp is not mod 8
padX = clp.width%8 == 0 ? 0 : (8 - clp.width%8)
padY = clp.height%8 == 0 ? 0 : (8 - clp.height%8)
clp=clp.pointresize(clp.width+padX, clp.height+padY, 0, 0, clp.width+padX, clp.height+padY)

# block
block = clp.mt_LutSpa(mode="absolute",expr="x 1 + 8 % 1 < x 8 % 1 < y 1 + 8 % 1 < y 8 % 1 < | | | 255 0 ?",U=3,V=3)

# create normal deblocking (for block borders) and strong deblocking (for block interiour)
normal = clp.deblock(quant=quant1,aOffset=aOff1,bOffset=bOff1)
strong = clp.deblock(quant=quant2,aOffset=aOff2,bOffset=bOff2)

# build difference maps of both
normalD = mt_makediff(clp,normal,chroma=uv>2?"process":"ignore") 
strongD = mt_makediff(clp,strong,chroma=uv>2?"process":"ignore") 

# separate border values of the difference maps, and set the interiours to '128'
normalD2 = mt_lutxy(normalD,block,expr="y 255 == x 128 ?",U=uv,V=uv)
strongD2 = mt_lutxy(StrongD,block,expr="y 255 == x 128 ?",U=uv,V=uv)

# interpolate the border values over the whole block: DCTFilter can do it. (Kiss to Tom Barry!)
# (Note: this is not fully accurate, but a reasonable approximation.)
# add borders if clp is not mod 16
sw=strongD2.width sh=strongD2.height
remX = sw%16 == 0 ? 0 : (16 - sw%16)
remY = sh%16 == 0 ? 0 : (16 - sh%16)
strongD3 = strongD2.pointresize(sw+remX, sh+remY, 0, 0, sw+remX, sh+remY).mt_lut(expr="x 128 - 1.01 * 128 +",U=uv,V=uv)\
                        .dctfilter(1.0,1.0,0.0,0.0,0.0,0.0,0.0,0.0).crop(0,0,-remX,-remY)

# apply compensation from "normal" deblocking to the borders of
# the full-block-compensations calculated from "strong" deblocking ... 
strongD4 = mt_lutxy(strongD3,normalD2,expr="y 128 == x y ?",U=uv,V=uv)

# ... and apply it.
deblocked= mt_makediff(clp,strongD4,chroma=uv>2?"process":"ignore") 

# simple decisions how to treat chroma
deblocked = (uv<0) ? deblocked.mergechroma(strong) : uv<2 ? deblocked.mergechroma(normal) : deblocked

deblocked.crop(0,0,-padX,-padY) # remove mod 8 borders
}
from https://forum.doom9.org/showthread.p...77#post1402777

Few other versions in later replies.

- Did my advice help you? Then become a Premium Member and support this site.
- Find television shows, cartoons, DVDs and Blu-ray releases at the TVPast forums.
Reply With Quote
  #17  
10-12-2018, 11:02 AM
sanlyn sanlyn is offline
Premium Member
 
Join Date: Aug 2009
Location: N. Carolina and NY, USA
Posts: 3,382
Thanked 1,058 Times in 883 Posts
The official version from the older Avisynth Wiki was attached in digitalfaq at this link: http://www.digitalfaq.com/forum/atta...deblock_qedzip.
Reply With Quote
  #18  
10-13-2018, 11:18 AM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
The same error message occurs. Please help.
Reply With Quote
  #19  
10-13-2018, 02:04 PM
sanlyn sanlyn is offline
Premium Member
 
Join Date: Aug 2009
Location: N. Carolina and NY, USA
Posts: 3,382
Thanked 1,058 Times in 883 Posts
Are you using plain vanilla Avisynth 2.6, or another version of Avisynth?
Are you using the 64-bit version of any plugins ? (they must all be 32-bit)
Are you using Windows 10?
Reply With Quote
  #20  
10-15-2018, 12:47 PM
yukukuhi yukukuhi is offline
Free Member
 
Join Date: Apr 2018
Posts: 68
Thanked 0 Times in 0 Posts
I'm using plain vanilla Avisynth 2.6. 32-bit plugins only. Windows XP.

Now the earlier error has been fixed after a PC restart, but there is a new error message:

Code:
Avisynth open failure:
Script error: there is no function named 'dctfilter'
(Deblock_QED.avsi, line 44)
(C:\Users\SGK\Desktop\chinnavar Movie Comedya1.avs, line 11)
Reply With Quote
Reply




Similar Threads
Thread Thread Starter Forum Replies Last Post
Diagonal line noise on VHS video? Luma noise? bilditup1 Capture, Record, Transfer 66 10-17-2015 01:03 AM
Cartoon restoration project - film grain noise removal? via Email or PM Restore, Filter, Improve Quality 1 07-26-2014 11:39 AM
Pre-processing audio in SoundForge for noise removal in Goldwave [GUIDE] admin Restore, Filter, Improve Quality 0 05-12-2009 10:03 PM
Video censor (blur) removal stoogedog Edit Video, Audio 6 07-20-2006 02:47 AM
Types of Copyprotection Tom_n_Jonna Restore, Filter, Improve Quality 2 01-19-2006 08:23 AM

Thread Tools



 
All times are GMT -5. The time now is 10:44 PM