digitalFAQ.com Forums [Archives]

digitalFAQ.com Forums [Archives] (http://www.digitalfaq.com/archives/)
-   Avisynth Scripting (http://www.digitalfaq.com/archives/avisynth/)
-   -   Experimental Revised prediction! (http://www.digitalfaq.com/archives/avisynth/4139-experimental-revised-prediction.html)

Krassi 06-24-2003 10:52 AM

Quote:

Originally Posted by audioslave
@kwag
Where can I download the older versions of ToK?

Here:
http://www.kvcd.net/hedix/ToK_0.0.5.2.zip

audioslave 06-24-2003 10:55 AM

Thanks Krassi! :wink:

J-Wo 06-24-2003 11:24 AM

Just to clarify, if I go back to ToK v.0.0.5.2, what should I set my Factor for Prediction?

kwag 06-24-2003 11:27 AM

Quote:

Originally Posted by J-Wo
Just to clarify, if I go back to ToK v.0.0.5.2, what should I set my Factor for Prediction?

You should run a couple of prediction samples at 1.0, and check your results. I'm trying that out right now :)

-kwag

kwag 06-24-2003 11:56 AM

ToK 0.0.5.2 is working like a charm with Sampler() :)
Just ran "K-Pax" prediction, and gave me a CQ of 62.914. With manual Sampler prediction, I had calculated a CQ of 65.32 and my file size was over for~2.5%.
The same for "The Boondock Saints". My calculated CQ was 63.2. Now with ToK 0.0.5.2, I got 63.146 ( extremely close:!: )
These tests were with the "video.en1" that uses "Motion Estimation" for search precision, and "Scene Change" detection turned on.
Using factor of 1.0 for both tests and using Tenra's "Faster prediction" method.

-kwag

audi2honda 06-24-2003 12:02 PM

let us know how the final encode works out. I'm running one right now

jorel 06-24-2003 12:10 PM

please,
where is the "Scene Change" detection to turn on in ToK :?:

Krassi 06-24-2003 12:12 PM

Quote:

Originally Posted by jorel
please,
where is the "Scene Change" detection to turn on in ToK :?:

Hey Jorel, nice to "see" you.
It's in the video.en1-file in ToK's opt folder. Kwags new video.en1-file already has this option activated 8) .

jorel 06-24-2003 12:15 PM

thanks,nice to see you too Krassi!

believe me..i'm blind,i edit the file and don't find this (line) option!
8O
not found in 0052 and 0053.....i'm blind?
8O

kwag 06-24-2003 12:24 PM

Quote:

Originally Posted by audi2honda
let us know how the final encode works out. I'm running one right now

I'm not going to encode K-Pax again, because I know the result :)
Specially on that movie, which was over size. With the new CQ calculated by ToK, I'm pretty sure it will be <1% because it's almost three CQ points lower :cool:
Now I'm going for a long encode of "K-19", which is a long movie ( Total Time : 02:18:06 )
Just finished predicting with a CQ of 57.207 for 528x480.
Here's the short 10% sample: www.kvcd.net/k-19-short-adaptive.mpg
Starting to encode now ... Estimated time ~5 hours, 20 minutes.


-kwag

kwag 06-24-2003 12:27 PM

Quote:

Originally Posted by jorel
thanks,nice to see you too Krassi!

believe me..i'm blind,i edit the file and don't find this (line) option!
8O
not found in 0052 and 0053.....i'm blind?
8O

Hi jorel,

The line should read: Video.AutoForceIPict = True
Normally, it's set to False :)

-kwag

J-Wo 06-24-2003 12:35 PM

Quote:

Originally Posted by kwag
Starting to encode now ... Estimated time ~5 hours, 20 minutes.

A little off topic but....
I just upgaded my system the other week to an AMD 2500+ Barton with 512mb DDR400 ram. I have the system overclocked to 2.2ghz, which is roughly equivalent to a 3200+ (or so I'm told!). Anyway I can't believe what a difference my encode speeds have become. What would take me 7-9 hrs before, I now encode in REAL TIME! So right now I'm doing a two part xvid encode of Chicago at CQ 56.766 (prediction factor 1.0). I'll let you know how it went in ~2 hrs! :lol:

jorel 06-24-2003 12:42 PM

Quote:

Originally Posted by kwag
Quote:

Originally Posted by jorel
thanks,nice to see you too Krassi!

believe me..i'm blind,i edit the file and don't find this (line) option!
8O
not found in 0052 and 0053.....i'm blind?
8O

Hi jorel,

The line should read: Video.AutoForceIPict = True
Normally, it's set to False :)

-kwag

i'm thankfull Kwag cos you never forget that:
:imstupid:
thank you..i found!

if the things aren't too clear,i can't see nothing.

thanks. :oops:

jorel 06-24-2003 12:46 PM

Quote:

Originally Posted by J-Wo
Quote:

Originally Posted by kwag
Starting to encode now ... Estimated time ~5 hours, 20 minutes.

A little off topic but....
I just upgaded my system the other week to an AMD 2500+ Barton with 512mb DDR400 ram. I have the system overclocked to 2.2ghz, which is roughly equivalent to a 3200+ (or so I'm told!). Anyway I can't believe what a difference my encode speeds have become. What would take me 7-9 hrs before, I now encode in REAL TIME! So right now I'm doing a two part xvid encode of Chicago at CQ 56.766 (prediction factor 1.0). I'll let you know how it went in ~2 hrs! :lol:

J-Wo,
real time?
8O
cool ...
hey,another proove that:
:imstupid:
i forgot to send to you a picture for more than a month. 8O
excuse me J-Wo my friend.
i send to you today.
:D

audi2honda 06-24-2003 12:56 PM

real time?? with the filters in the MA optimal script?

I have a P4 2.8 and get about 4 hours with the MA scrpit depending on movie length. Currently doing a 150 minute movie and target is 4 hours 20 minutes

J-Wo 06-24-2003 12:57 PM

Oh ya, it's incredible! Yesterday I was doing a 90min video which took 95 minutes to encode. Today I'm doing a 110min movie and it looks like it's going to take 120min. I really was looking to upgrade primarily to speed up my encode times (don't play much games) and let's just say I absolutely got my money's worth! No more celeron 1.2 for me. :D

kwag 06-24-2003 12:59 PM

Quote:

Originally Posted by J-Wo
I now encode in REAL TIME!

:stickouttongue:

-kwag

J-Wo 06-24-2003 01:08 PM

Quote:

Originally Posted by audi2honda
real time?? with the filters in the MA optimal script?

I have a P4 2.8 and get about 4 hours with the MA scrpit depending on movie length. Currently doing a 150 minute movie and target is 4 hours 20 minutes

Yup, I'm using the latest MA optimal script. Which P4 2.8 do you have? Do you have the normal 533fsb or the new P4 2.8c 800fsb? Also how much/fast is your memory? I'm totally new to the AMD world but I'm told that with my Barton 2500+ overclocked to about a 3200+, that's "equivalent" to a P4 3.2. However with a P4 I'm told you should be able to get faster encoding times because TMPGEnc supports SSEII. You do have that turned on, don't you?

90 mins left... 8)

audi2honda 06-24-2003 01:16 PM

yea i have sse turned on. I have the old 533mhz fsb version. Wow I didn't think the AMD would cook that fast. The barton has more L2 Cache, but I didn't think that mattered for video encoding/rendering.

Actually this is a spare computer at my office I use to encode :-) When I finally upgrade my home machine I'm gonna go AMD. real time...that's nutz :!:

J-Wo 06-24-2003 01:41 PM

yeah, I don't think a higher L2 cache makes much of a difference, but I'm told memory does. Right now with my fsb at 220mhz, the ddr400 memory is runnint at ddr440 speeds. And I was able to set aggressive latency timing on it so it runs at CL2.5 (and this is only on normal, basic infinion ram). Later on when I save up a bit more and memory prices drop, I plan on buying a second 512mb dimm. Sticking that into my ABIT NF7-S motherboard gives me something called dualDDR. Don't know much about it, but maybe soon I'll be able to encode FASTER than realtime!

So honda, again, what is your memory for your current system?

audi2honda 06-24-2003 01:58 PM

I'm pretty sure it is DDR266 :cry:

Krassi 06-24-2003 03:29 PM

Quote:

Originally Posted by kwag
I'm not going to encode K-Pax again, because I know the result :)
Specially on that movie, which was over size. With the new CQ calculated by ToK, I'm pretty sure it will be <1% because it's almost three CQ points lower :cool:
Now I'm going for a long encode of "K-19", which is a long movie ( Total Time : 02:18:06 )
Just finished predicting with a CQ of 57.207 for 528x480.
Here's the short 10% sample: www.kvcd.net/k-19-short-adaptive.mpg
Starting to encode now ... Estimated time ~5 hours, 20 minutes.


-kwag

Using Sampler() seems to bring back the old PAL-Prediction Problem. I've done some short tests with a short movie and the the final size is way off wanted size :? . I've already tried with a sampler length of 24 and 25. The 24-length gives a higher CQ, but still too low.
I've been using ToK 0.0.5.2 with the new video-en1-file and ToK's faster prediction method.
Code:

Required Video Size: 330.369.920
Sampler length= 25, GOP 25: Final Encoded Size: 304.146.843
Sampler length= 24, GOP 25: Final Encoded Size: 318.831.766

Any idea :?:

kwag 06-24-2003 03:35 PM

I see that a smaller length size is more accurate on PAL :!:
Have you tried "Sampler length= 15, GOP 25" :?:
If that does target a closer final size for PAL, is it consistent with different movies :?:

-kwag

Krassi 06-24-2003 03:38 PM

Quote:

Originally Posted by kwag
I see that a smaller length size is more accurate on PAL :!:
Have you tried "Sampler length= 15, GOP 25" :?:
If that does target a closer final size for PAL, is it consistent with different movies :?:

-kwag

Not Yet. I've just tried a Sampler length of 30 and it was smaller...

EDIT: With Sampler length=15 the CQ is a bit higher. I'll go for a complete encoding. Results in ~ 1hour (if i'm still awake :D )

kwag 06-24-2003 03:43 PM

Quote:

Originally Posted by Krassi
Quote:

Originally Posted by kwag
I see that a smaller length size is more accurate on PAL :!:
Have you tried "Sampler length= 15, GOP 25" :?:
If that does target a closer final size for PAL, is it consistent with different movies :?:

-kwag

Not Yet. I've just tried a Sampler length of 30 and it was smaller...

Could it be that there's a "sweet spot" for sampler length :idea:
How about doing a sampler from say 12 to 30, in steps of 1, and see if at a point you get a "peak" optimal value :?:

-kwag

Krassi 06-24-2003 03:48 PM

I think we really need a batch for encoding... :roll: That would simplify alot 8) .

kwag 06-24-2003 03:51 PM

Quote:

Originally Posted by Krassi
I think we really need a batch for encoding... :roll: That would simplify alot 8) .

Yes I know :!: It's a real pain doing this stuff manually over and over again :twisted:

Krassi 06-24-2003 04:52 PM

:ole:
The Prediction with Sampler length=15 was good :!:
Can any PAL user try this:
Code:

1. Use ToK 0.0.5.2
2. Overwrite file video.en1 in ToK's opt folder with Kwags newest one
3. Set a factor of 1.0 in ToK and Length of Sample to 15. Samples/Minute to 4 or above.
4. Precision to 0.5 or 1%

My results:
Code:

Required Video Size: 330.369.920
Final Encoded Size: 324.024.428

I'll test some other lengths of Samplers tomorrow...
Good night,

Krassi

kwag 06-24-2003 05:05 PM

Thanks Krassi,

This might also be a solution for higher accuracy on NTSC material :idea:

-kwag

jorel 06-24-2003 05:14 PM

:!:
if the source is 29,97 ntsc,

TMPGEnc don't want to work if the line in video.en1 has:
Job.MPEG.Video.VideoEncodeMode = MPEGVideoEncoder_VideoEncodeMode_Progressive_32Pul ldown

only if i use:
Job.MPEG.Video.VideoEncodeMode=MPEGVideoEncoder_Vi deoEncodeMode_Interlace

what to do?
some hints please!

kwag 06-24-2003 05:21 PM

Hi jorel,

That line applies only to MPEG-2 at 23.976. Not to MPEG-1. If you are encoding MPEG-2 at 29.97fps, then change the line to Job.MPEG.Video.VideoEncodeMode=MPEGVideoEncoder_Vi deoEncodeMode_Interlace.

-kwag

jorel 06-24-2003 05:27 PM

thanks Kwag,
i did it and see my results in mpeg2,29,97,ntsc:
with ToK 0053:
Final CQ: 56,467

with ToK 0052 (with new video.en1 and "Interlace" in the line):
Final CQ: 55,958

the CQ decrease and in my case i need to encrease!
using this values i can put more 150mb in one cdr 80 minutes.
this will be too short.

seems that only i got less size,
everybody got huge files!
:?

audi2honda 06-24-2003 06:10 PM

Quote:

Originally Posted by Krassi
:ole:
Code:

3. Set a factor of 1.0 in ToK and Length of Sample to 15. Samples/Minute to 4 or above.
Krassi

length of 15 with samples/minute of 4 or more is painfully slow even on fast prediction. The first pass on my 1.8ghz machine was over 20 minutes 8O

kwag 06-24-2003 06:11 PM

No jorel, you're not the only one :!:
Me too :!: I'm getting smaller file sizes too :cry: :cry:
I just finished "K19", and it should have been ~699,875KB, but the final encoded size is 639,574KB :cry: :cry: :cry:
That's about -8.5% under :cry:
It's a sad prediction day :( :(
Now I'm completely lost :!:
This was with "Fast" prediction, using Tenra's 100/10 prediction. The only thing I'm left to try is full prediction instead of 100/10. If I get the same predicted CQ with normal prediction, then it's over, and this just doesn't work. If I do get a higher CQ without the 100/10, then I have to do the same with K-Pax and "The Boondock Saints" to see if the problem was the 100/10 prediction. So I guess I have one more prediction shot now , unchecking "New faster Prediction".

-kwag

kwag 06-24-2003 07:07 PM

And here we go :!:
After unchecking "New Faster Prediction", and using "Full" prediction, my new "K19" movie CQ is now 62.783 instead of 57.21 :!:
No wonder I was over 60MB under :!:
Now I have to encode "K19" again :x, K-Pax again :x and "The Boondock Saints :x again :!:
Until I get all these three completely different movies down to <2% I won't be happy :twisted:

Here's my ToK screenshot, with the parameters set for a full prediction sampler:

http://www.digitalfaq.com/archives/i.../2003/06/7.jpg

-kwag

audi2honda 06-24-2003 07:24 PM

I tried this and still came in about 60MB under on the movie I've been testing 'The Firm'

But I notice you have 1st group of passes at .5% and the second group of passes unchecked.

These aren't the default settings. Why did you choose these?

kwag 06-24-2003 07:28 PM

Quote:

Originally Posted by audi2honda

These aren't the default settings. Why did you choose these?

Because this way you run a full prediction sampler every time, with a .5% accuracy. It takes longer, but in the end, it should prove more accurate.
What settings did you use :?:

-kwag

vhelp 06-24-2003 07:40 PM

Hi Kwag..

Can I get a little help here, please.. ??

There's just too many confusing things going on around here, and I'm
afraid that I don't have everything that i need for a successful testing
in aiding you (if I can offer any help, using my time) :)

K, first let me ask ya..

* which script are you using for all these tests ??
I want to make sure I use the exact one you are using, k ?

* Then, what template in TMPG are you using.
I want to use it also (below movie test...)

* ToK.. Main/Tab.. what are the settings ??
...can you enclude some screen shots of ToK for all the Tabs settings ??


I need to get an idea of what I'm using is correct, for the most part,
when using ToK.

My Movie test:
I want to give my Movie, "Dogma" another shot, since the last time, it
bombed out w/ bad results. But, to add, in aid for you, results I would
get w/ the predict issues. Help me, to help you :)

See if this chef's list is correct so far..

CHEF'S "PREDICTION" LIST
---------------------------------

* Any Files ie, .DLL's
-- .
-- .
-- .
* AVIsynth v2.52
-- .
-- .
-- .
* MA script (which one)
-- .
-- .
-- .
* ToK (and latest files and things)
-- .
-- .
-- .
* TMPG (I'm using v2.53, if that helps or not)
-- .
-- .
-- .


The "--." respresent any files or settings I may be missing from this list.
Please feel free to add, change, or re-order anything in this chef's list.

Thank you for your time.
-vhelp

kwag 06-24-2003 07:53 PM

Quote:

Originally Posted by vhelp

* which script are you using for all these tests ??
I want to make sure I use the exact one you are using, k ?

The one posted on the Optimal Script thread.
Quote:


* Then, what template in TMPG are you using.
I want to use it also (below movie test...)
No template ;)
Just select in ToK 528x480, MIN=300, MAX=2,500. Initial CQ=80. Audio set to 112Kbps. Look at the screenshot I posted here for the other settings.
Quote:


* ToK.. Main/Tab.. what are the settings ??
...can you enclude some screen shots of ToK for all the Tabs settings ??
Just as described above.

-kwag

vhelp 06-24-2003 08:01 PM

@ Kwag..

Quote:

Just select in ToK 528x480, MIN=300, MAX=2,500. Initial CQ=80. Audio set to 112Kbps. Look at the screenshot I posted here for the other settings.
That's just it. There's no resolution settings. Also, I remember seeing
someone's post showing their results, and their resolution was set at
* 704x480 ...(this is what I want to use in my future encodes)
.
.
...and, I was hoping to continue using the same res, but when I gave a
few shots at ToK, I got 720x480, and I never set nothing for res 8O

Another thing...
I also notice that ToK dumps a bunch of other files in my WORK folder.
Should I be deleting them fater every encode, or project or anything I'm
finished ?? Example:
* video.en1.txt
* video.avs
* video.tpr
* ToK log file

Is it ok to change anything in any of these files, that ToK will be able to
use, if I want to change thing (like you guys seem to be doing)

Thanks again.
-vhelp


All times are GMT -5. The time now is 01:30 PM  —  vBulletin © Jelsoft Enterprises Ltd

Site design, images and content © 2002-2026 The Digital FAQ, www.digitalFAQ.com
Forum Software by vBulletin · Copyright © 2026 Jelsoft Enterprises Ltd.