87 replies to this topic

[WanWizard]

See my earlier posts. NodeJS is definitely one of the heavy hitters, if you have more CPU's than memory ( count roughly 2-3GB per core, so a 12 core machine should have at least 24 GB memory if you don't limit parallel builds ).

[el bandido]

I make an openpli-enigma2-feed.bbappend and put it in /openpli-oe-core/meta-local/recipes-local/images

Things like nodejs and other items I don't need are removed from the build which makes things easier and faster. I usually build the image, then build the feed. Seems like an easier way of doing things for me.
 

This is what my openpli-enigma2-feed.bbappend file looks like:

RDEPENDS:${PN}:remove = " \
    zerotier \
    channelsettings-enigma2-meta \
    kodi-addons-meta \
    enigma2-plugin-extensions-kodi \
    enigma2-plugin-extensions-hbbtv-qt \
    enigma2-plugin-extensions-stalker-qt \
    enigma2-plugin-extensions-webkithbbtv \
    enigma2-plugin-extensions-hbbtv-webkit \
    enigma2-plugin-extensions-hbbtv-gb \
    enigma2-plugin-extensions-openhbbtvbrowser \
    enigma2-plugin-extensions-chromium \
    enigma2-plugin-extensions-libvupldemo \
    enigma2-plugin-extensions-stalkerclient \
    enigma2-plugin-extensions-jedimakerxtream \
    enigma2-plugin-systemplugins-cablescan \
    enigma2-plugin-systemplugins-fastscan \
    ${@bb.utils.contains('TARGET_FPU', 'soft', '', 'nodejs', d)} \
     ${@bb.utils.contains('OPENPLI_FEATURES', 'kodi', 'enigma2-plugin-extensions-kodi kodi-addons-meta', '', d)} \
    ${@bb.utils.contains('MACHINE_FEATURES', 'kodi', 'enigma2-plugin-extensions-kodi kodi-addons-meta', '', d)} \
    ${@bb.utils.contains('OPENPLI_FEATURES', 'qtplugins', 'enigma2-plugin-extensions-qthbbtv enigma2-plugin-extensions-qtstalker', '', d)} \
    ${@bb.utils.contains("MACHINE_FEATURES", "webkithbbtv", "enigma2-plugin-extensions-webkithbbtv", "", d)} \
    ${@bb.utils.contains("MACHINE_FEATURES", "chromiumos", "enigma2-plugin-extensions-chromium", "", d)} \
    ${@bb.utils.contains('OPENPLI_FEATURES', 'openhbbtvbrowser', 'enigma2-plugin-extensions-openhbbtvbrowser', '', d)} \
    ${@bb.utils.contains("DEFAULTTUNE", "sh4", "" , "nodejs", d)} \
    ${@bb.utils.contains('TARGET_FPU', 'soft', '', 'nodejs', d)} \
    "

Attached Files

•  openpli-enigma2-feed.zip   638bytes   4 downloads

[WanWizard]

If you can live with a stripped image, that works too...

 

In general, these things are not a big deal, they get built once, and since OE recipes hardly ever change, once built bitbake will not try to build them again.

 

The downside is that because of that, you miss things like missing repo's, as these aren't checked if they aren't build.

[levi45@]

Thanks @WanWizard now i have finished building image and the feed  for the vuplus. But still having memory issue with qtwebkit and qtwebengine. Maybe you can give me correct setting parallel building for 4 core pc

Attached Files

•  log.txt   206.92KB   1 downloads

[WanWizard]

Add something like

PARALLEL_MAKE:pn-qtwebkit = " -j 2"
PARALLEL_MAKE:pn-qtwebengine = " -j 2"

to your local.conf. It will limit make to 2 cores.

 

Won't help much though, if your 4-core PC only has 1GB of memory...

[levi45@]

Add something like

PARALLEL_MAKE:pn-qtwebkit = " -j 2"
PARALLEL_MAKE:pn-qtwebengine = " -j 2"

to your local.conf. It will limit make to 2 cores.

 

Won't help much though, if your 4-core PC only has 1GB of memory...

Hi no didn't help , still getting same error.  My system is  4core cpu , 6 gb ram and 600 gb memory. 

[WanWizard]

Are the settings found and used? Check when the compile is running with "top" and "ps" what exactly is running.

[levi45@]

Are the settings found and used? Check when the compile is running with "top" and "ps" what exactly is running.

Hope i done correctly
top

 

   PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
    104 root      20   0       0      0      0 R  93.9   0.0  46:23.42 kswapd0
 924204 mypc    20   0  278884 181124    220 R  35.4   3.0   0:03.75 enigma2+
 920842 mypc    20   0 2291532   2.1g      0 R  28.6  35.9   1:13.94 cc1plus
 921548 mypc    20   0 2174936   2.0g     52 R  27.0  33.7   0:56.82 cc1plus
 913721 mypc    20   0  691056 517228     32 D  25.4   8.5   0:54.37 Cooker
 835416 root      20   0  176196 168224      0 D  19.0   2.8 291:54.37 stats.pl
 913719 mypc    20   0  120052  22024     12 S   6.1   0.4   0:04.10 KnottyUI
 915056 mypc    20   0  278852 180848      0 S   3.5   3.0   0:04.58 Worker
 885685 mypc    20   0   17472   2696      0 S   2.9   0.0   0:01.26 sshd
 913742 root      20   0   13076    756      0 R   1.6   0.0   0:00.59 top
 885464 root      20   0       0      0      0 I   1.3   0.0   0:00.37 kworker+
 915108 mypc    20   0  279136 180968      0 S   1.3   3.0   0:03.17 Worker +
 885755 root      20   0       0      0      0 I   1.0   0.0   0:00.33 kworker+
 910809 root      20   0       0      0      0 I   1.0   0.0   0:00.16 kworker+
    495 mysql     20   0 1271788  59544      0 S   0.6   1.0   3:29.36 mariadbd
    660 root      20   0   47076  28308      0 S   0.6   0.5   4:29.92 miniser+
 893325 root      20   0       0      0      0 I   0.6   0.0   0:00.26 kworker+

 

 

 

ps

 

    PID TTY          TIME CMD
 922308 pts/2    00:00:00 bash
 924227 pts/2    00:00:00 ps

 

Edited by levi45@, 14 September 2024 - 19:09.

[WanWizard]

A bit difficult to see without details, but that top shows 2 compile threads (so that limit seems to work), each grabbing more than 2Gb of memory.

 

Which doesn't leave much space for other things, and I can see this is not a buildserver, but used for all sorts (I see a mariadb instance for example, also requiring lots of memory, and I even see an "enigma2" running (on a linux machine you build on?)

 

6Gb is simply not enough memory, especially not with all other stuff active. Our oldest buildserver runs with 16Gb, and even then we need to limit parallelism to avoid running out of memory. Our newer buildservers all have 32Gb memory.

[levi45@]

A bit difficult to see without details, but that top shows 2 compile threads (so that limit seems to work), each grabbing more than 2Gb of memory.

 

Which doesn't leave much space for other things, and I can see this is not a buildserver, but used for all sorts (I see a mariadb instance for example, also requiring lots of memory, and I even see an "enigma2" running (on a linux machine you build on?)

 

6Gb is simply not enough memory, especially not with all other stuff active. Our oldest buildserver runs with 16Gb, and even then we need to limit parallelism to avoid running out of memory. Our newer buildservers all have 32Gb memory.

Im not sure why mariadb and enigma2 showing up , it could be that vps server is shared . 

[WanWizard]

EIther way, I think you can forget using that for building, also because a VPS only gives you virtual CPU's,. so compiling can take ages (on my own Core i7 7700K build machine, compiling kodi already takes over 45 minutes, and that is dedicated to building OpenPLi).

[levi45@]

Thank you very much for your help and support  

[levi45@]

EIther way, I think you can forget using that for building, also because a VPS only gives you virtual CPU's,. so compiling can take ages (on my own Core i7 7700K build machine, compiling kodi already takes over 45 minutes, and that is dedicated to building OpenPLi).

Please can you adapted building with Ubuntu 24.04.1 LTS many thanks.

[WanWizard]

Ubuntu is a nightmare for building, as it lacks long term compatibility.  If you adapt for one version, you can't build other versions anymore.

 

What adaptations do you exactly need?

[levi45@]

Ubuntu is a nightmare for building, as it lacks long term compatibility.  If you adapt for one version, you can't build other versions anymore.

 

What adaptations do you exactly need?

when i try to Install prerequisite packages i get this error so i think the stop using the python3-distutils.
sudo apt-get install sed wget cvs subversion git-core git-lfs \
  coreutils unzip texi2html texinfo docbook-utils \
  gawk python3-distutils diffstat help2man make gcc build-essential g++ \
  desktop-file-utils chrpath default-jre gettext zip libssl-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'git' instead of 'git-core'
Package python3-distutils is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

E: Package 'python3-distutils' has no installation candidate

 

[WanWizard]

That is one of the typical examples where Ubuntu upgrades are a nightmare.

 

Distutils is used all over OE, it is not limited to OpenPLi. But is is deprecated in Python 3.12, which is why it is missing from 24.04.

 

You could try

sudo apt install python3-setuptools

or you might want to start building from the Scarthgap branch (which will become OpenPLi 10), it uses a more recent OE and Pythlon 3.12, so it doesn't need distutils.

[levi45@]

That is one of the typical examples where Ubuntu upgrades are a nightmare.

 

Distutils is used all over OE, it is not limited to OpenPLi. But is is deprecated in Python 3.12, which is why it is missing from 24.04.

 

You could try

sudo apt install python3-setuptools

or you might want to start building from the Scarthgap branch (which will become OpenPLi 10), it uses a more recent OE and Pythlon 3.12, so it doesn't need distutils.

i have switch to the  Scarthgap but im getting this error now .

 

 

Traceback (most recent call last):
  File "/home/mypc/openpli-oe-core/bitbake/bin/bitbake", line 24, in <module>
    from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
  File "/home/mypc/openpli-oe-core/bitbake/lib/bb/main.py", line 24, in <module>
    from bb import cooker
  File "/home/mypc/openpli-oe-core/bitbake/lib/bb/cooker.py", line 26, in <module>
    import pyinotify
  File "/home/mypc/openpli-oe-core/bitbake/lib/pyinotify.py", line 55, in <module>
    import asyncore
ModuleNotFoundError: No module named 'asyncore'
make: *** [Makefile:131: image] Error 1

 

[levi45@]

Please ignore my post above   .

[levi45@]

Im getting this error now

 

ERROR: update-rc.d-0.8-r0 do_package: Fatal errors occurred in subprocesses:
Command '['/home/mypc/openpli-oe-core/build/tmp/work/all-oe-linux/update-rc.d/0.8-r0/recipe-sysroot-native/usr/lib/rpm/rpmdeps', '--alldeps', '--define', '__font_provides %{nil}', '/home/mypc/openpli-oe-core/build/tmp/work/all-oe-linux/update-rc.d/0.8-r0/packages-split/update-rc.d/usr/sbin/update-rc.d']' returned non-zero exit status 1.
Subprocess output:error: No file attributes configured

[WanWizard]

Why is it building rpm stuff?