Jump to content


Photo

Build issues


  • Please log in to reply
78 replies to this topic

Re: Build issues #21 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 11 September 2024 - 12:03

See my earlier posts. NodeJS is definitely one of the heavy hitters, if you have more CPU's than memory ( count roughly 2-3GB per core, so a 12 core machine should have at least 24 GB memory if you don't limit parallel builds ).


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #22 el bandido

  • Senior Member
  • 392 posts

+15
Neutral

Posted 11 September 2024 - 14:54

I make an openpli-enigma2-feed.bbappend and put it in /openpli-oe-core/meta-local/recipes-local/images

Things like nodejs and other items I don't need are removed from the build which makes things easier and faster. I usually build the image, then build the feed. Seems like an easier way of doing things for me.
 

This is what my openpli-enigma2-feed.bbappend file looks like:

RDEPENDS:${PN}:remove = " \
    zerotier \
    channelsettings-enigma2-meta \
    kodi-addons-meta \
    enigma2-plugin-extensions-kodi \
    enigma2-plugin-extensions-hbbtv-qt \
    enigma2-plugin-extensions-stalker-qt \
    enigma2-plugin-extensions-webkithbbtv \
    enigma2-plugin-extensions-hbbtv-webkit \
    enigma2-plugin-extensions-hbbtv-gb \
    enigma2-plugin-extensions-openhbbtvbrowser \
    enigma2-plugin-extensions-chromium \
    enigma2-plugin-extensions-libvupldemo \
    enigma2-plugin-extensions-stalkerclient \
    enigma2-plugin-extensions-jedimakerxtream \
    enigma2-plugin-systemplugins-cablescan \
    enigma2-plugin-systemplugins-fastscan \
    ${@bb.utils.contains('TARGET_FPU', 'soft', '', 'nodejs', d)} \
     ${@bb.utils.contains('OPENPLI_FEATURES', 'kodi', 'enigma2-plugin-extensions-kodi kodi-addons-meta', '', d)} \
    ${@bb.utils.contains('MACHINE_FEATURES', 'kodi', 'enigma2-plugin-extensions-kodi kodi-addons-meta', '', d)} \
    ${@bb.utils.contains('OPENPLI_FEATURES', 'qtplugins', 'enigma2-plugin-extensions-qthbbtv enigma2-plugin-extensions-qtstalker', '', d)} \
    ${@bb.utils.contains("MACHINE_FEATURES", "webkithbbtv", "enigma2-plugin-extensions-webkithbbtv", "", d)} \
    ${@bb.utils.contains("MACHINE_FEATURES", "chromiumos", "enigma2-plugin-extensions-chromium", "", d)} \
    ${@bb.utils.contains('OPENPLI_FEATURES', 'openhbbtvbrowser', 'enigma2-plugin-extensions-openhbbtvbrowser', '', d)} \
    ${@bb.utils.contains("DEFAULTTUNE", "sh4", "" , "nodejs", d)} \
    ${@bb.utils.contains('TARGET_FPU', 'soft', '', 'nodejs', d)} \
    "

Attached Files



Re: Build issues #23 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 11 September 2024 - 18:01

If you can live with a stripped image, that works too... :thumbs-up:

 

In general, these things are not a big deal, they get built once, and since OE recipes hardly ever change, once built bitbake will not try to build them again.

 

The downside is that because of that, you miss things like missing repo's, as these aren't checked if they aren't build.


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #24 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 12 September 2024 - 16:11

Thanks @WanWizard now i have finished building image and the feed  for the vuplus. But still having memory issue with qtwebkit and qtwebengine. Maybe you can give me correct setting parallel building for 4 core pc :)

Attached Files

  • Attached File  log.txt   206.92KB   1 downloads


Re: Build issues #25 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 12 September 2024 - 17:31

Add something like

PARALLEL_MAKE:pn-qtwebkit = " -j 2"
PARALLEL_MAKE:pn-qtwebengine = " -j 2"

to your local.conf. It will limit make to 2 cores.

 

Won't help much though, if your 4-core PC only has 1GB of memory... ;)


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #26 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 14 September 2024 - 08:47

Add something like

PARALLEL_MAKE:pn-qtwebkit = " -j 2"
PARALLEL_MAKE:pn-qtwebengine = " -j 2"

to your local.conf. It will limit make to 2 cores.

 

Won't help much though, if your 4-core PC only has 1GB of memory... ;)

Hi no didn't help , still getting same error.  My system is  4core cpu , 6 gb ram and 600 gb memory. 



Re: Build issues #27 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 14 September 2024 - 11:33

Are the settings found and used? Check when the compile is running with "top" and "ps" what exactly is running.


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #28 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 14 September 2024 - 19:08

Are the settings found and used? Check when the compile is running with "top" and "ps" what exactly is running.

Hope i done correctly :)
top

 

   PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
    104 root      20   0       0      0      0 R  93.9   0.0  46:23.42 kswapd0
 924204 mypc    20   0  278884 181124    220 R  35.4   3.0   0:03.75 enigma2+
 920842 mypc    20   0 2291532   2.1g      0 R  28.6  35.9   1:13.94 cc1plus
 921548 mypc    20   0 2174936   2.0g     52 R  27.0  33.7   0:56.82 cc1plus
 913721 mypc    20   0  691056 517228     32 D  25.4   8.5   0:54.37 Cooker
 835416 root      20   0  176196 168224      0 D  19.0   2.8 291:54.37 stats.pl
 913719 mypc    20   0  120052  22024     12 S   6.1   0.4   0:04.10 KnottyUI
 915056 mypc    20   0  278852 180848      0 S   3.5   3.0   0:04.58 Worker
 885685 mypc    20   0   17472   2696      0 S   2.9   0.0   0:01.26 sshd
 913742 root      20   0   13076    756      0 R   1.6   0.0   0:00.59 top
 885464 root      20   0       0      0      0 I   1.3   0.0   0:00.37 kworker+
 915108 mypc    20   0  279136 180968      0 S   1.3   3.0   0:03.17 Worker +
 885755 root      20   0       0      0      0 I   1.0   0.0   0:00.33 kworker+
 910809 root      20   0       0      0      0 I   1.0   0.0   0:00.16 kworker+
    495 mysql     20   0 1271788  59544      0 S   0.6   1.0   3:29.36 mariadbd
    660 root      20   0   47076  28308      0 S   0.6   0.5   4:29.92 miniser+
 893325 root      20   0       0      0      0 I   0.6   0.0   0:00.26 kworker+

 

 

 

ps

 

    PID TTY          TIME CMD
 922308 pts/2    00:00:00 bash
 924227 pts/2    00:00:00 ps

 


Edited by levi45@, 14 September 2024 - 19:09.


Re: Build issues #29 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 14 September 2024 - 19:37

A bit difficult to see without details, but that top shows 2 compile threads (so that limit seems to work), each grabbing more than 2Gb of memory.

 

Which doesn't leave much space for other things, and I can see this is not a buildserver, but used for all sorts (I see a mariadb instance for example, also requiring lots of memory, and I even see an "enigma2" running (on a linux machine you build on?)

 

6Gb is simply not enough memory, especially not with all other stuff active. Our oldest buildserver runs with 16Gb, and even then we need to limit parallelism to avoid running out of memory. Our newer buildservers all have 32Gb memory.


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #30 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 14 September 2024 - 19:46

A bit difficult to see without details, but that top shows 2 compile threads (so that limit seems to work), each grabbing more than 2Gb of memory.

 

Which doesn't leave much space for other things, and I can see this is not a buildserver, but used for all sorts (I see a mariadb instance for example, also requiring lots of memory, and I even see an "enigma2" running (on a linux machine you build on?)

 

6Gb is simply not enough memory, especially not with all other stuff active. Our oldest buildserver runs with 16Gb, and even then we need to limit parallelism to avoid running out of memory. Our newer buildservers all have 32Gb memory.

Im not sure why mariadb and enigma2 showing up , it could be that vps server is shared . 



Re: Build issues #31 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 14 September 2024 - 19:48

EIther way, I think you can forget using that for building, also because a VPS only gives you virtual CPU's,. so compiling can take ages (on my own Core i7 7700K build machine, compiling kodi already takes over 45 minutes, and that is dedicated to building OpenPLi).


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #32 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 15 September 2024 - 19:48

Thank you very much for your help and support  



Re: Build issues #33 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 16 September 2024 - 17:11

EIther way, I think you can forget using that for building, also because a VPS only gives you virtual CPU's,. so compiling can take ages (on my own Core i7 7700K build machine, compiling kodi already takes over 45 minutes, and that is dedicated to building OpenPLi).

Please can you adapted building with Ubuntu 24.04.1 LTS many thanks.



Re: Build issues #34 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 16 September 2024 - 18:26

Ubuntu is a nightmare for building, as it lacks long term compatibility.  If you adapt for one version, you can't build other versions anymore.

 

What adaptations do you exactly need?


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #35 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 16 September 2024 - 19:00

Ubuntu is a nightmare for building, as it lacks long term compatibility.  If you adapt for one version, you can't build other versions anymore.

 

What adaptations do you exactly need?

when i try to Install prerequisite packages i get this error so i think the stop using the python3-distutils.
sudo apt-get install sed wget cvs subversion git-core git-lfs \
  coreutils unzip texi2html texinfo docbook-utils \
  gawk python3-distutils diffstat help2man make gcc build-essential g++ \
  desktop-file-utils chrpath default-jre gettext zip libssl-dev
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Note, selecting 'git' instead of 'git-core'
Package python3-distutils is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

E: Package 'python3-distutils' has no installation candidate

 



Re: Build issues #36 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 16 September 2024 - 19:31

That is one of the typical examples where Ubuntu upgrades are a nightmare.

 

Distutils is used all over OE, it is not limited to OpenPLi. But is is deprecated in Python 3.12, which is why it is missing from 24.04.

 

You could try

sudo apt install python3-setuptools

or you might want to start building from the Scarthgap branch (which will become OpenPLi 10), it uses a more recent OE and Pythlon 3.12, so it doesn't need distutils.


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.


Re: Build issues #37 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 16 September 2024 - 21:42

That is one of the typical examples where Ubuntu upgrades are a nightmare.

 

Distutils is used all over OE, it is not limited to OpenPLi. But is is deprecated in Python 3.12, which is why it is missing from 24.04.

 

You could try

sudo apt install python3-setuptools

or you might want to start building from the Scarthgap branch (which will become OpenPLi 10), it uses a more recent OE and Pythlon 3.12, so it doesn't need distutils.

i have switch to the  Scarthgap but im getting this error now .

 

 

Traceback (most recent call last):
  File "/home/mypc/openpli-oe-core/bitbake/bin/bitbake", line 24, in <module>
    from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
  File "/home/mypc/openpli-oe-core/bitbake/lib/bb/main.py", line 24, in <module>
    from bb import cooker
  File "/home/mypc/openpli-oe-core/bitbake/lib/bb/cooker.py", line 26, in <module>
    import pyinotify
  File "/home/mypc/openpli-oe-core/bitbake/lib/pyinotify.py", line 55, in <module>
    import asyncore
ModuleNotFoundError: No module named 'asyncore'
make: *** [Makefile:131: image] Error 1

 



Re: Build issues #38 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 16 September 2024 - 22:34

Please ignore my post above :D :D  .



Re: Build issues #39 levi45@

  • Senior Member
  • 37 posts

0
Neutral

Posted 16 September 2024 - 22:42

Im getting this error now :(

 

ERROR: update-rc.d-0.8-r0 do_package: Fatal errors occurred in subprocesses:
Command '['/home/mypc/openpli-oe-core/build/tmp/work/all-oe-linux/update-rc.d/0.8-r0/recipe-sysroot-native/usr/lib/rpm/rpmdeps', '--alldeps', '--define', '__font_provides %{nil}', '/home/mypc/openpli-oe-core/build/tmp/work/all-oe-linux/update-rc.d/0.8-r0/packages-split/update-rc.d/usr/sbin/update-rc.d']' returned non-zero exit status 1.
Subprocess output:error: No file attributes configured



Re: Build issues #40 WanWizard

  • PLi® Core member
  • 70,340 posts

+1,803
Excellent

Posted 17 September 2024 - 10:38

Why is it building rpm stuff?


Currently in use: VU+ Duo 4K (2xFBC S2), VU+ Solo 4K (1xFBC S2), uClan Usytm 4K Ultimate (S2+T2), Octagon SF8008 (S2+T2), Zgemma H9.2H (S2+T2)

Due to my bad health, I will not be very active at times and may be slow to respond. I will not read the forum or PM on a regular basis.

Many answers to your question can be found in our new and improved wiki.



10 user(s) are reading this topic

0 members, 10 guests, 0 anonymous users