HOWTO reduce time of build ?

[Philip M. Gollucci]

On 9/15/2010 6:15 PM, Dominic Fandrey wrote:
>>>>>>> I have installed Tinderbox 3.3.
>>>>>>> How can i reduce time for building packages ? I own a quad core
>>>>>>> CPU. I must use more BUILDS ( jail + ports ) in parallel or exist
>>>>>>> something like make -j ? Thanks for a great tool.

tinderd -jobs is not the same as MAKE_JOBS_NUMBER which translates to
make -jX during the make do-build phase. The previous is tinderbox
specific and does not work and like jmc said, it was disabled but the
option left in for I guess back compat.

By far the best thing you can do to speed up builds are:

1)
$ sudo mkdir -p $mdroot
$ sudo mdmfs -s 12g -m $md_id -S -o async -o noatime md$md_id $mdroot

2) set FORCE_MAKE_JOBS=yes and up the default MAKE_JOBS_NUMBER quite
   a bit.  ncpu(cores)*2+3 might be a good start.

3) Get and SSD and but /ccache on it or if you have the RAM leftover
after #1, put it on a different or the same md device.

4) Finally, you can split into several Tinderbox builds and run them in
parallell (this will only help with cpu load).  I can only use 25% of my
single quad without doing this
even with step 1-3 above (unless the port involves C++ which just sinks
the ram and cpu usage).

Given the above, I average about 150-200 packages / hour with a machine
with the following specs.  Unless I'm mistaken the amd64 pointyhat
cluster was at ~350 packages per hour but its hurting at the moment it
has to build kde/gnome/x/open office/java which I try not to touch.

6GB RAM
12GB Swap
1 SSD (60GB)
1 SAS 250 3 GB/s [not used]
Intel(R) Core(TM)2 Quad  CPU   Q8200  @ 2.33GHz (2327.55-MHz K8-class CPU)

A very good test is how fast can you build lang/perl5.10.  You should
seem something in the 3.5 - 4min range.














-- 
------------------------------------------------------------------------
1024D/DB9B8C1C B90B FBC3 A3A1 C71A 8E70  3F8C 75B8 8FFB DB9B 8C1C
Philip M. Gollucci (pgollucci at p6m7g8.com) c: 703.336.9354
VP Apache Infrastructure; Member, Apache Software Foundation
Committer,                        FreeBSD Foundation
Consultant,                       P6M7G8 Inc.
Sr. System Admin,                 Ridecharge Inc.

Work like you don't need the money,
love like you'll never get hurt,
and dance like nobody's watching.