Bitrates: Same CQ Value Tested More than one Time, Waste of Time ?

Dialhot · #1 08-09-2003, 07:18 AM

I'm currently making a CQ prediction with CQMatic 1.1.06. I'm very suprised about one thing : the same values are tested twice !

Kwag, can't you just memorize the results in an array and avoid to check same value twice ?

See my log. Value 79 is used on attempt #1 and #4, and 81.75 on attempt #5 and #8.

Quote:

Executing Prediction Phase...
Process started at 12:55:52
On 08/09/2003
Setting up initial sampling.
Using CQ of 79.00
Prediction cycle #1
Encoder started...
Process time: 9.18 minutes.
Encoder end.
File size difference = 1.332512
Low fence: 79.000000
High fence: 90.000000
Last CQ = 79.00
Current CQ = 90.00
CQ difference = 11.000000
Using CQ of 90.00
Prediction cycle #2
Encoder started...
Process time: 9.67 minutes.
Encoder end.
File size difference = 0.661043
Low fence: 79.000000
High fence: 90.000000
Last CQ = 90.00
Current CQ = 84.50
CQ difference = 5.500000
Using CQ of 84.50
Prediction cycle #3
Encoder started...
Process time: 8.93 minutes.
Encoder end.
File size difference = 0.906230
Low fence: 79.000000
High fence: 84.500000
Last CQ = 84.50
Current CQ = 79.00
CQ difference = 5.500000
Using CQ of 79.00
Prediction cycle #4
Encoder started...
Process time: 8.83 minutes.
Encoder end.
File size difference = 1.332512
Low fence: 79.000000
High fence: 84.500000
Last CQ = 79.00
Current CQ = 81.75
CQ difference = 2.750000
Using CQ of 81.75
Prediction cycle #5
Encoder started...
Process time: 11.20 minutes.
Encoder end.
File size difference = 1.007026
Low fence: 81.750000
High fence: 84.500000
Last CQ = 81.75
Current CQ = 82.32
CQ difference = 0.574409
Using CQ of 82.32
Prediction cycle #6
Encoder started...
Process time: 9.95 minutes.
Encoder end.
File size difference = 0.980629
Low fence: 81.750000
High fence: 82.324409
Last CQ = 82.32
Current CQ = 82.04
CQ difference = 0.287209
Using CQ of 82.04
Prediction cycle #7
Encoder started...
Process time: 9.08 minutes.
Encoder end.
File size difference = 0.992444
Low fence: 81.750000
High fence: 82.037201
Last CQ = 82.04
Current CQ = 81.75
CQ difference = 0.287201
Using CQ of 81.75
Prediction cycle #8
Encoder started...

kwag · #2 08-09-2003, 11:22 AM

That shouldn't happen

But yes, you're right, and I just saw it on one of my logs too.
It's probably a math rounding error, as it should always close in and never repeat a value. I'll take a look into this today.

Thanks Phil

-kwag

kwag · #3 08-09-2003, 05:14 PM

Here's the update. Thanks for pointing that out Phil

( Stupid math error on my part

)
http://www.kvcd.net/CQMatic-1.1.07.exe

Results are the same as in 1.1.06.
Except that now, it's even faster zeroing in on final CQ

Here's my log of 1.1.06 on IceAge:

Code:

http://www.kvcd.net
CQMatic Version 1.1.06
Copyright Softronex Corporation, 2003.
All rights reserved.
Time: 23:36:35 Date: 08/08/2003
Ready!
Project: K:\iceage.tpr

Creating: CQMatic.tpr

f:\temp\iceage.m1v
Project resolution: 352x480
Execute.
Movie Time: 81
Average Bitrate: 1240
Full Encode mode
Executing Prediction Phase...
Process started at 23:57:28
On 08/08/2003
Setting up initial sampling.
Using CQ of 85.00
Prediction cycle #1
Encoder started...
Process time: 6.17 minutes.
Encoder end.
File size difference  = 0.888898
Low fence: 2.000000
High fence: 85.000000
Last CQ = 85.00
Current CQ = 75.56
CQ difference = 9.443687
Using CQ of 75.56
Prediction cycle #2
Encoder started...
Process time: 6.07 minutes.
Encoder end.
File size difference  = 1.387644
Low fence: 75.556313
High fence: 85.000000
Last CQ = 75.56
Current CQ = 80.28
CQ difference = 4.721840
Using CQ of 80.28
Prediction cycle #3
Encoder started...
Process time: 6.63 minutes.
Encoder end.
File size difference  = 1.102644
Low fence: 80.278152
High fence: 85.000000
Last CQ = 80.28
Current CQ = 85.00
CQ difference = 4.721848
Using CQ of 85.00
Prediction cycle #4
Encoder started...
Process time: 6.58 minutes.
Encoder end.
File size difference  = 0.888898
Low fence: 80.278152
High fence: 85.000000
Last CQ = 85.00
Current CQ = 82.64
CQ difference = 2.360924
Using CQ of 82.64
Prediction cycle #5
Encoder started...
Process time: 6.77 minutes.
Encoder end.
File size difference  = 0.943718
Low fence: 80.278152
High fence: 82.639076
Last CQ = 82.64
Current CQ = 80.28
CQ difference = 2.360924
Using CQ of 80.28
Prediction cycle #6
Encoder started...
Process time: 6.88 minutes.
Encoder end.
File size difference  = 1.102644
Low fence: 80.278152
High fence: 82.639076
Last CQ = 80.28
Current CQ = 81.46
CQ difference = 1.180466
Using CQ of 81.46
Prediction cycle #7
Encoder started...
Process time: 6.75 minutes.
Encoder end.
Encoding set to Full encode.
Full encode start...
CQMatic complete!
Total minutes of process: 45.85
Process ended at 00:43:19
On 08/09/2003

And here's the same, processed with 1.1.07

Code:

http://www.kvcd.net
CQMatic Version 1.1.07
Copyright Softronex Corporation, 2003.
All rights reserved.
Time: 17:41:29 Date: 08/09/2003
Ready!
Project: K:\iceage.tpr

Creating: CQMatic.tpr

f:\temp\iceage.m1v
Project resolution: 352x480
Execute.
Movie Time: 81
Average Bitrate: 1240
Full Encode mode
Executing Prediction Phase...
Process started at 17:41:39
On 08/09/2003
Setting up initial sampling.
Using CQ of 85.0000
Prediction cycle #1
Encoder started...
Process time: 6.55 minutes.
Encoder end.
File size difference  = 0.888898
Low fence: 2.000000
High fence: 85.000000
Last CQ = 85.0000
Current CQ = 75.5563
CQ difference = 9.443687
Using CQ of 75.5563
Prediction cycle #2
Encoder started...
Process time: 6.10 minutes.
Encoder end.
File size difference  = 1.387658
Low fence: 75.556313
High fence: 85.000000
Last CQ = 75.5563
Current CQ = 80.2782
CQ difference = 4.721840
Using CQ of 80.2782
Prediction cycle #3
Encoder started...
Process time: 5.87 minutes.
Encoder end.
File size difference  = 1.101980
Low fence: 80.278152
High fence: 85.000000
Last CQ = 80.2782
Current CQ = 82.6391
CQ difference = 2.360924
Using CQ of 82.6391
Prediction cycle #4
Encoder started...
Process time: 5.77 minutes.
Encoder end.
File size difference  = 0.943849
Low fence: 80.278152
High fence: 82.639076
Last CQ = 82.6391
Current CQ = 81.4586
CQ difference = 1.180458
Using CQ of 81.4586
Prediction cycle #5
Encoder started...
Process time: 5.90 minutes.
Encoder end.
Encoding set to Full encode.
Full encode start...
CQMatic complete!
Total minutes of process: 30.18
Process ended at 18:11:50
On 08/09/2003

-kwag

Dialhot · #4 08-09-2003, 07:17 PM

Just the time to go buy a new 120Go HD and a new CQMatic version is delivered

. Faster than Fedex

jorel · #5 08-09-2003, 07:27 PM

Quote:

Originally Posted by Dialhot

Just the time to go buy a new 120Go HD and a new CQMatic version is delivered

. Faster than Fedex

true my dear friend!

see the results with 1106 here only to check:
CQ63,54
Total minutes of process: 45.32
http://www.kvcd.net/forum/viewtopic.php?t=5522

now the full log using 1107:

http://www.kvcd.net
CQMatic Version 1.1.07
Copyright Softronex Corporation, 2003.
All rights reserved.
Time: 20:44:33 Date: 08/09/2003
Ready!
Project: C:\CQMatic\1106.tpr

Creating: CQMatic.tpr

D:\La Luna\ToK\2\VIDEOPhil1807pred2.m2v
Project resolution: 480x480
Execute.
Movie Time: 31
Average Bitrate: 1074
Prediction Only mode
Executing Prediction Phase...
Process started at 20:44:48
On 08/09/2003
CQ set for prediction
Setting up initial sampling.
Using CQ of 60.0000
Prediction cycle #1
Encoder started...
Process time: 6.30 minutes.
Encoder end.
File size difference = 1.078564
Low fence: 60.000000
High fence: 90.000000
Last CQ = 60.0000
Current CQ = 64.7139
CQ difference = 4.713860
Using CQ of 64.7139
Prediction cycle #2
Encoder started...
Process time: 5.93 minutes.
Encoder end.
File size difference = 0.965295
Low fence: 60.000000
High fence: 64.713860
Last CQ = 64.7139
Current CQ = 62.3569
CQ difference = 2.356930
Using CQ of 62.3569
Prediction cycle #3
Encoder started...
Process time: 5.98 minutes.
Encoder end.
File size difference = 1.076412
Low fence: 62.356930
High fence: 64.713860
Last CQ = 62.3569
Current CQ = 63.5354
CQ difference = 1.178463
Using CQ of 63.5354
Prediction cycle #4
Encoder started...
Process time: 6.18 minutes.
Encoder end.
File size difference = 0.990945
Low fence: 62.356930
High fence: 63.535393
Last CQ = 63.5354
Current CQ = 62.9462
CQ difference = 0.589233
Using CQ of 62.9462
Prediction cycle #5
Encoder started...
Process time: 6.17 minutes.
Encoder end.
File size difference = 1.029791
Low fence: 62.946159
High fence: 63.535393
Last CQ = 62.9462
Current CQ = 63.2408
CQ difference = 0.294617
Using CQ of 63.2408
Prediction cycle #6
Encoder started...
Process time: 6.02 minutes.
Encoder end.
File size difference = 1.008729
Low fence: 63.240776
High fence: 63.535393
Last CQ = 63.2408
Current CQ = 63.3881
CQ difference = 0.147308
CQMatic complete!
Total minutes of process: 36.58
Process ended at 21:21:23
On 08/09/2003

CQ63,2408

Total minutes of process: 36.58
just the same and faster!