See my earlier posts. NodeJS is definitely one of the heavy hitters, if you have more CPU's than memory ( count roughly 2-3GB per core, so a 12 core machine should have at least 24 GB memory if you don't limit parallel builds ).
Build issues
Re: Build issues #21
Posted 11 September 2024 - 12:03
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #22
Posted 11 September 2024 - 14:54
I make an openpli-enigma2-feed.bbappend and put it in /openpli-oe-core/meta-local/recipes-local/images
Things like nodejs and other items I don't need are removed from the build which makes things easier and faster. I usually build the image, then build the feed. Seems like an easier way of doing things for me.
This is what my openpli-enigma2-feed.bbappend file looks like:
RDEPENDS:${PN}:remove = " \
zerotier \
channelsettings-enigma2-meta \
kodi-addons-meta \
enigma2-plugin-extensions-kodi \
enigma2-plugin-extensions-hbbtv-qt \
enigma2-plugin-extensions-stalker-qt \
enigma2-plugin-extensions-webkithbbtv \
enigma2-plugin-extensions-hbbtv-webkit \
enigma2-plugin-extensions-hbbtv-gb \
enigma2-plugin-extensions-openhbbtvbrowser \
enigma2-plugin-extensions-chromium \
enigma2-plugin-extensions-libvupldemo \
enigma2-plugin-extensions-stalkerclient \
enigma2-plugin-extensions-jedimakerxtream \
enigma2-plugin-systemplugins-cablescan \
enigma2-plugin-systemplugins-fastscan \
${@bb.utils.contains('TARGET_FPU', 'soft', '', 'nodejs', d)} \
${@bb.utils.contains('OPENPLI_FEATURES', 'kodi', 'enigma2-plugin-extensions-kodi kodi-addons-meta', '', d)} \
${@bb.utils.contains('MACHINE_FEATURES', 'kodi', 'enigma2-plugin-extensions-kodi kodi-addons-meta', '', d)} \
${@bb.utils.contains('OPENPLI_FEATURES', 'qtplugins', 'enigma2-plugin-extensions-qthbbtv enigma2-plugin-extensions-qtstalker', '', d)} \
${@bb.utils.contains("MACHINE_FEATURES", "webkithbbtv", "enigma2-plugin-extensions-webkithbbtv", "", d)} \
${@bb.utils.contains("MACHINE_FEATURES", "chromiumos", "enigma2-plugin-extensions-chromium", "", d)} \
${@bb.utils.contains('OPENPLI_FEATURES', 'openhbbtvbrowser', 'enigma2-plugin-extensions-openhbbtvbrowser', '', d)} \
${@bb.utils.contains("DEFAULTTUNE", "sh4", "" , "nodejs", d)} \
${@bb.utils.contains('TARGET_FPU', 'soft', '', 'nodejs', d)} \
"
Attached Files
Re: Build issues #23
Posted 11 September 2024 - 18:01
If you can live with a stripped image, that works too...
In general, these things are not a big deal, they get built once, and since OE recipes hardly ever change, once built bitbake will not try to build them again.
The downside is that because of that, you miss things like missing repo's, as these aren't checked if they aren't build.
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #24
Re: Build issues #25
Posted 12 September 2024 - 17:31
Add something like
PARALLEL_MAKE:pn-qtwebkit = " -j 2" PARALLEL_MAKE:pn-qtwebengine = " -j 2"
to your local.conf. It will limit make to 2 cores.
Won't help much though, if your 4-core PC only has 1GB of memory...
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #26
Posted 14 September 2024 - 08:47
Add something like
PARALLEL_MAKE:pn-qtwebkit = " -j 2" PARALLEL_MAKE:pn-qtwebengine = " -j 2"to your local.conf. It will limit make to 2 cores.
Won't help much though, if your 4-core PC only has 1GB of memory...
Hi no didn't help , still getting same error. My system is 4core cpu , 6 gb ram and 600 gb memory.
Re: Build issues #27
Posted 14 September 2024 - 11:33
Are the settings found and used? Check when the compile is running with "top" and "ps" what exactly is running.
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #28
Posted 14 September 2024 - 19:08
Are the settings found and used? Check when the compile is running with "top" and "ps" what exactly is running.
Hope i done correctly
top
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
104 root 20 0 0 0 0 R 93.9 0.0 46:23.42 kswapd0
924204 mypc 20 0 278884 181124 220 R 35.4 3.0 0:03.75 enigma2+
920842 mypc 20 0 2291532 2.1g 0 R 28.6 35.9 1:13.94 cc1plus
921548 mypc 20 0 2174936 2.0g 52 R 27.0 33.7 0:56.82 cc1plus
913721 mypc 20 0 691056 517228 32 D 25.4 8.5 0:54.37 Cooker
835416 root 20 0 176196 168224 0 D 19.0 2.8 291:54.37 stats.pl
913719 mypc 20 0 120052 22024 12 S 6.1 0.4 0:04.10 KnottyUI
915056 mypc 20 0 278852 180848 0 S 3.5 3.0 0:04.58 Worker
885685 mypc 20 0 17472 2696 0 S 2.9 0.0 0:01.26 sshd
913742 root 20 0 13076 756 0 R 1.6 0.0 0:00.59 top
885464 root 20 0 0 0 0 I 1.3 0.0 0:00.37 kworker+
915108 mypc 20 0 279136 180968 0 S 1.3 3.0 0:03.17 Worker +
885755 root 20 0 0 0 0 I 1.0 0.0 0:00.33 kworker+
910809 root 20 0 0 0 0 I 1.0 0.0 0:00.16 kworker+
495 mysql 20 0 1271788 59544 0 S 0.6 1.0 3:29.36 mariadbd
660 root 20 0 47076 28308 0 S 0.6 0.5 4:29.92 miniser+
893325 root 20 0 0 0 0 I 0.6 0.0 0:00.26 kworker+
ps
PID TTY TIME CMD
922308 pts/2 00:00:00 bash
924227 pts/2 00:00:00 ps
Edited by levi45@, 14 September 2024 - 19:09.
Re: Build issues #29
Posted 14 September 2024 - 19:37
A bit difficult to see without details, but that top shows 2 compile threads (so that limit seems to work), each grabbing more than 2Gb of memory.
Which doesn't leave much space for other things, and I can see this is not a buildserver, but used for all sorts (I see a mariadb instance for example, also requiring lots of memory, and I even see an "enigma2" running (on a linux machine you build on?)
6Gb is simply not enough memory, especially not with all other stuff active. Our oldest buildserver runs with 16Gb, and even then we need to limit parallelism to avoid running out of memory. Our newer buildservers all have 32Gb memory.
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #30
Posted 14 September 2024 - 19:46
A bit difficult to see without details, but that top shows 2 compile threads (so that limit seems to work), each grabbing more than 2Gb of memory.
Which doesn't leave much space for other things, and I can see this is not a buildserver, but used for all sorts (I see a mariadb instance for example, also requiring lots of memory, and I even see an "enigma2" running (on a linux machine you build on?)
6Gb is simply not enough memory, especially not with all other stuff active. Our oldest buildserver runs with 16Gb, and even then we need to limit parallelism to avoid running out of memory. Our newer buildservers all have 32Gb memory.
Im not sure why mariadb and enigma2 showing up , it could be that vps server is shared .
Re: Build issues #31
Posted 14 September 2024 - 19:48
EIther way, I think you can forget using that for building, also because a VPS only gives you virtual CPU's,. so compiling can take ages (on my own Core i7 7700K build machine, compiling kodi already takes over 45 minutes, and that is dedicated to building OpenPLi).
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #32
Re: Build issues #33
Posted 16 September 2024 - 17:11
EIther way, I think you can forget using that for building, also because a VPS only gives you virtual CPU's,. so compiling can take ages (on my own Core i7 7700K build machine, compiling kodi already takes over 45 minutes, and that is dedicated to building OpenPLi).
Please can you adapted building with Ubuntu 24.04.1 LTS many thanks.
Re: Build issues #34
Posted 16 September 2024 - 18:26
Ubuntu is a nightmare for building, as it lacks long term compatibility. If you adapt for one version, you can't build other versions anymore.
What adaptations do you exactly need?
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #35
Posted 16 September 2024 - 19:00
Ubuntu is a nightmare for building, as it lacks long term compatibility. If you adapt for one version, you can't build other versions anymore.
What adaptations do you exactly need?
when i try to Install prerequisite packages i get this error so i think the stop using the python3-distutils.
sudo apt-get install sed wget cvs subversion git-core git-lfs \
coreutils unzip texi2html texinfo docbook-utils \
gawk python3-distutils diffstat help2man make gcc build-essential g++ \
desktop-file-utils chrpath default-jre gettext zip libssl-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'git' instead of 'git-core'
Package python3-distutils is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source
E: Package 'python3-distutils' has no installation candidate
Re: Build issues #36
Posted 16 September 2024 - 19:31
That is one of the typical examples where Ubuntu upgrades are a nightmare.
Distutils is used all over OE, it is not limited to OpenPLi. But is is deprecated in Python 3.12, which is why it is missing from 24.04.
You could try
sudo apt install python3-setuptools
or you might want to start building from the Scarthgap branch (which will become OpenPLi 10), it uses a more recent OE and Pythlon 3.12, so it doesn't need distutils.
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
Re: Build issues #37
Posted 16 September 2024 - 21:42
That is one of the typical examples where Ubuntu upgrades are a nightmare.
Distutils is used all over OE, it is not limited to OpenPLi. But is is deprecated in Python 3.12, which is why it is missing from 24.04.
You could try
sudo apt install python3-setuptoolsor you might want to start building from the Scarthgap branch (which will become OpenPLi 10), it uses a more recent OE and Pythlon 3.12, so it doesn't need distutils.
i have switch to the Scarthgap but im getting this error now .
Traceback (most recent call last):
File "/home/mypc/openpli-oe-core/bitbake/bin/bitbake", line 24, in <module>
from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
File "/home/mypc/openpli-oe-core/bitbake/lib/bb/main.py", line 24, in <module>
from bb import cooker
File "/home/mypc/openpli-oe-core/bitbake/lib/bb/cooker.py", line 26, in <module>
import pyinotify
File "/home/mypc/openpli-oe-core/bitbake/lib/pyinotify.py", line 55, in <module>
import asyncore
ModuleNotFoundError: No module named 'asyncore'
make: *** [Makefile:131: image] Error 1
Re: Build issues #38
Re: Build issues #39
Posted 16 September 2024 - 22:42
Im getting this error now
ERROR: update-rc.d-0.8-r0 do_package: Fatal errors occurred in subprocesses:
Command '['/home/mypc/openpli-oe-core/build/tmp/work/all-oe-linux/update-rc.d/0.8-r0/recipe-sysroot-native/usr/lib/rpm/rpmdeps', '--alldeps', '--define', '__font_provides %{nil}', '/home/mypc/openpli-oe-core/build/tmp/work/all-oe-linux/update-rc.d/0.8-r0/packages-split/update-rc.d/usr/sbin/update-rc.d']' returned non-zero exit status 1.
Subprocess output:error: No file attributes configured
Re: Build issues #40
Posted 17 September 2024 - 10:38
Why is it building rpm stuff?
Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)
Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.
Many answers to your question can be found in our new and improved wiki.
10 user(s) are reading this topic
0 members, 10 guests, 0 anonymous users