139 replies to this topic

[scriptmelvin †]

You can lower the number of processors used by setting NR_CPU to the number of processors you want to use in the main Makefile. Here.

[serdeliuk]

How do I limit RAM memory? The computer crashes after a while as it uses all the memory. When all processor is used, all memory is also used, causing freeze.

 

See:

 

 

Captura de tela de 2023-04-07 16-32-34.png

 

 

Thx

From your image I can see that you have 48 CPU cores, 16GB ram and 2GB swap (virtual memory), you may need to increase the swap memory, or add more ram to your computer, 16GB ram for 48 CPUs is too low anyways

[neo]

We build on 8 cores with 16GB, and 20 cores with 32GB.

 

By default both BB_NUM_THREADS and PARALLEL_MAKE "-j" is set by bitbake to the number of cores, which is way to high, especially for machines with large numbers of cores (btw, what CPU is that?).

 

We have limited both to 12 on the Core i9 10900K, and that can already max out the 32GB if the parallel processing timing is unlucky (like when qtwebengine, kodi and a few other heavyweights compile at the same time).

[frankviana]

Now, after some command lines, I have 34,4 GB for swap.

 

 

 Captura de tela de 2023-04-07 21-45-13.png   86.22KB   0 downloads

 

 

 Captura de tela de 2023-04-07 21-48-11.png   28.63KB   0 downloads

 

 

 Captura de tela de 2023-04-07 22-03-56.png   692.06KB   0 downloads

 

Thx

==============

[frankviana]

We build on 8 cores with 16GB, and 20 cores with 32GB.

 

By default both BB_NUM_THREADS and PARALLEL_MAKE "-j" is set by bitbake to the number of cores, which is way to high, especially for machines with large numbers of cores (btw, what CPU is that?).

 

We have limited both to 12 on the Core i9 10900K, and that can already max out the 32GB if the parallel processing timing is unlucky (like when qtwebengine, kodi and a few other heavyweights compile at the same time).

CPU: See pictures from post 91 and 92

 

Dual CPU Xeon 2670 v3 (12 cores 24 threads = 24/48)

 

https://forums.openp...dpost&p=1530831

 

Frank

===================

[frankviana]

After some time, the "terminal/console" crashes and stop/exit. I don't know why.

 

Is there any way to debug to see what happens?

 

I have 34,4 GB for swap. Maybe low RAM anyway?

 

Thx

[rantanplan]

There are many reasons why it crashes.
There is also the question of how it crashes.
Is the terminal open and an error message appears?
Then you can verify the 'crash' exactly.
If the terminal is finished and reports "signal9", then the build actually breaks away with a system error.

Storage?
CPU?
Can't say then.

Nodejs
QT
If both are extremely memory-intensive applications, if something goes wrong here, then it crashes.
The bad thing about it is that this crash is not easy to fix, you have to delete it and create it again.

A crash is also possible if depends or symlinks are missing.

Your swap is big enough.
I would always activate Zram.

Swap to disk can also be a problem if the disk isn't there fast enough.

You can see it quite well if you monitor the construction.
With your system performance you should see it quickly.

It may be coincidence, but on my ryzon5 it never crashes with 'Signal9'.
With the Intel i5 it happens all the time when building the Nodej.

[frankviana]

Now, all cores and 11,4 GB only for cache (RAM) when compiling GCC-CROSS-ARM

 

I reinstalled it on the SSD, but before that I had already tested it with the internal nvme and the same thing happened.

 

I wasn't remembering the other 2 slots of 16 GB that I had in the other two pc gamer, so I took it and put it to test.

 

When placing, I was left with 50.4 GB DDR4.

 

I am convinced that the problem was the RAM memory. I'll buy others for the other two pc gamer and leave these here for testing.

 

It seems stable now. No crashes.... waiting finish the job (sf8008 homebuild image)

 

Next step: buy other 2 cpu to replace: 18 cores/36 threads. Then, 36 cores/72 threads.

 

I want 72 threads and 64 GB RAM. So I am satisfied with my project.

 

 

 Captura de tela de 2023-04-08 09-23-11.png   381.58KB   1 downloads

Edited by frankviana, 8 April 2023 - 13:34.

[frankviana]

My compilations on Linux could be faster, but here in Brazil we have internet connection problems, as they are slow and we pay a lot of money in remote areas. But even so, there is still something you can do.

Here is the cpu model I bought now and I'm waiting to replace the current ones, along with the memories.

 

 

 Captura de tela de 2023-04-08 10-03-47.png   348.74KB   1 downloads

 

 

Image successfully built: sf8008 homebuild

 

 

 Captura de tela de 2023-04-08 10-05-23.png   445.37KB   1 downloads

 

 

 

[frankviana]

sf8008 OK

 

h9se OK (very fast after sf8008)

 

osmini4k openssl problem:

ERROR: Task (/home/frank/OpenPli/openpli-oe-core/openembedded-core/meta/recipes-connectivity/openssl/openssl_1.1.1n.bb:do_compile) failed with exit code '1'
NOTE: Tasks Summary: Attempted 2351 tasks of which 2212 didn't need to be rerun and 1 failed.

Summary: 1 task failed:
  /home/frank/OpenPli/openpli-oe-core/openembedded-core/meta/recipes-connectivity/openssl/openssl_1.1.1n.bb:do_compile
Summary: There were 2 ERROR messages shown, returning a non-zero exit code.
make: *** [Makefile:131: image] Erro 1
frank@frank-X99:~/OpenPli/openpli-oe-core$

Edited by frankviana, 8 April 2023 - 14:52.

[neo]

You need to check the log file to see what exactly the error is.

[frankviana]

You need to check the log file to see what exactly the error is.

https://forums.openp...dpost&p=1530923

 

Post 95

[rantanplan]

sudo apt-get install -y autoconf automake bison bzip2 chrpath coreutils cpio curl cvs debianutils default-jre default-jre-headless diffstat flex g++ gawk gcc gcc-12 gcc-multilib g++-multilib gettext git git-core gzip help2man info iputils-ping java-common libc6-dev libegl1-mesa libglib2.0-dev libncurses5-dev libperl4-corelibs-perl libproc-processtable-perl libsdl1.2-dev libserf-dev libtool libxml2-utils make ncurses-bin patch perl pkg-config psmisc python3 python3-git python3-jinja2 python3-pexpect python3-pip python-setuptools qemu quilt socat sshpass subversion tar texi2html texinfo unzip wget xsltproc xterm xz-utils zip zlib1g-dev zstd fakeroot lz4

Something doesn't fit with the symlinks, just reinstall the depends.
(Ubuntu22)

You (still) only build the images, that's pretty quick.
Do the stress test and build the feed.
Then your PC finally gets something to work on.
 

[frankviana]

All dependencies were already up to date.

 

I have not yet tested whether this homebuild contains feeds.

 

But if it doesn't, is there any way to compile a complete image?

 

The stress I was able to analyze by the use of cpu and memory.

Edited by frankviana, 8 April 2023 - 23:42.

[frankviana]

sudo apt-get -f reinstall........

 

Same openssl 1.1.1n problem.

 

ERROR: Task (/home/frank/OpenPli/openpli-oe-core/openembedded-core/meta/recipes-connectivity/openssl/openssl_1.1.1n.bb:do_compile) failed with exit code '1'

But anyway, I already tested what I wanted, despite the problems with the osmini4k image.

I'll continue testing other images, including OE-A and LibreElec/CoreElec.

 

Thx

[scriptmelvin †]

No build contains feeds. You need to compile the feed separately with:

make feed

[frankviana]

Now, 72 threads

 

 Captura de tela de 2023-05-01 22-36-06.png   760.5KB   3 downloads

 

But I see only until 52 threads.

 

Waiting the 2 x 32 GB DDR4:

 

16+16+32+32 = 96

Edited by frankviana, 2 May 2023 - 02:55.

[frankviana]

WARNING: openresolv-3.5.2-r0 do_fetch: Failed to fetch URL http://roy.marples.n...v-3.5.2.tar.bz2, attempting MIRRORS if available
 

This page left intentionally blank

Downloads of my software releases are now available via github.

I apologise for the inconvenience, but let's face it - downloading tagged source from a repository has been a thing for many years now and I don't self host anymore.

[Tech]

Edit the recipe and correct the URI ….

[neo]

I'll have a look.

Edited by neo, 2 May 2023 - 13:48.