Building Encoding Cluster
Hi,
Anyone tried using Avisynth/CCESPT with wine for KDVD/KVCD's? Linux purists, please excuse me! :) I am planning to build an OpenMosix cluster with three P4/2.8GHz/512MB-DDR400 nodes and use it to encode KDVD/KVCD as an experiment. I want to use TMPGEnc or CCESPT for encoding with Avisynth frame server. Am I wasting time trying to use Avisynth/CCE-SPT with wine? |
In my opinion there is two ways to do it, debain based (knoppix) or gentoo based. If you chose to debain based I would recommend using clusterknoppix at http://bofh.be/clusterknoppix/ it is a live cd and comes all complied for you. You can also use gentoo which would be my choice, and get a fully custom OS with what you want, since you making a video encoder cluster you most likely want to use gnome for a desktop environment since it uses less resources (there is only few versions of knoppix that use gnome and clusterknoppix is not one), but beware gentoo is one of the hardest distributor to install, since it fully custom. Either way your most likely going to install it on the hard drive, since live cd is probably a crappy idea for a cluster since cd-roms take lost of time to spin up and down making each node that connect to the main server slow down the system. Its more of the question of time if you want to learn Linux and how hard it is then choose gentoo which will give you better results since you OS will be custom, if you don't have much time or just don't want to go though a kernel panic fix, then choose clusterknoppix.
P.S. Avisynth doesn't work and don't use tmpgenc or windoz based encoders mencoder is replacing that, and here http://www.kvcd.net/forum/viewtopic.php?t=9074 is the forum on all the info you need on mencoder, and here shows why you might not need avisyth http://www.kvcd.net/forum/viewtopic.php?t=10242 |
Quote:
Quote:
People on Doom9 tell Avisythn, CCESPT work with wine. I have successfully installed Avisynth, VirtualDubMod and CCESPT, but could not get to load the avs script. I have never tried Mencoder. Will give it a try. I was trying to use a mix of Big3 and MA script for backing up my DVD's with the menu structure intact. I am not sure whether Mencoder will meet my all needs. |
Quote:
Quote:
Quote:
Quote:
|
I have been consulting Linux and Open Source technologies. Have few Linux boxes with oodles of power at home which can be used for cluster. A dual Xeon 2.8GHz is on the way ;)
Quote:
Quote:
|
Quote:
I put ~4 movies on each DVD, using KDVD. Average of ~8 hours, at 704x480 (wide screen material) :!: At ~6 hours per DVD using KDVD, you really can't tell the difference from the original DVDs ;) Now with MEncoder, we'll raise that bar even further. Look what I just did using MEncoder. http://www.kvcd.net/payback.mpg.cut.8.mpg That's 704x480 MPEG-2, audio 112Kbps(44.1KHz) DS2 No filters used :!: The complete movie (101 minutes) muxed is 795,419KB :cool: -kwag |
Quote:
I have been able to put 2 hours onto one single disk. In fact, the zeal to retain the menu structure forced me to consider using windows tools with wine as reauthoring would be easy. The clip looks very very good even when you zoom 300%. I will forget about original menu and start encoding with Mencoder. I should be able to churn out lot's of KDVD's quickly as I have oodles of power on my Linux box(s). Thanks for making me see the light :) |
Let us know about your encoding adventures with your Linux farm (rub it in, eh!) :lol:
-kwag |
Quote:
BTW, I have no experience with mencoder. I will be coming back to the forum for more help. |
Quote:
Quote:
-kwag |
To anwser kwags question with a quote from venkatk.
Quote:
|
Quote:
|
I forgot to tell one more reason why I was considering wine.
Wine will spawn a new process for each windows thread. So, You can distribute the Avisynth process to one node and encoder to one or two nodes depending on how many threads the encoder is using internally. Edit: Checking out whether I can use one mencoder instance for pre-processing and other for encoding? |
Consider Cluster Knoppix, and also consider XFS when creating the partitions. To me, XFS is probably the best file system in existence.
EXT3 is good, until you fill up a partition, and then your system will crash :!: (reported to my by a friend, who uses Linux on DNS/FTP servers at the corporate level ) I also have been playing with Linux since ~1992, but I use FreeBSD professionally (Since 1997) for all my customers ;) Although, I have my eyes focused on Linux kernel 2.6, which seems to match (or exceed!) FreeBSD's performance. I still have to run some tests, though. -kwag |
Quote:
I have used FreeBSD and OpenBSD professionally to a limited extent. Over here Linux is very popular and It pays to be a Linux consultant ;) |
Quote:
Here too ;) http://www.thelinuxreview.com/ldp/se...onsult_id=3252 -kwag |
venkatk wrote:
Quote:
Kwag wrote: Quote:
|
Quote:
XFS is Silicon Graphics file system, which has been used in production for over 10 years in their IRIX Operating System. Silicon Graphics produces high end machines, used for heavy duty graphics/animation/movie productions. So it's a proven filesystem, and ReiserFS is still relatively new, so I wouldn't put my client's data on it yet ;) -kwag |
Quote:
To be frank Reiser has never been a problem. I am very conservative when it comes using new technologies in production. I still use Redhat 7.3 or my own distro forked from RHEL 2.1AS sources :( |
It seems mencoder does't support SMP :(. So, cluster will not help.
I am exploring other options. BTW, the motherboards I had ordered for building cluster were damaged in transit and I have to wait for another day. Meanwhile, have a look at this http://www.linuxjournal.com/article.php?sid=7126 Also this http://www.cs.wisc.edu/condor/ |
Site design, images and content © 2002-2024 The Digital FAQ, www.digitalFAQ.com
Forum Software by vBulletin · Copyright © 2024 Jelsoft Enterprises Ltd.