17 replies to this topic

[brentener]

Hello ! I have deleted some movies, but the memory didn’t free up. The. deleted movies have landed in the hidden trash folder. How delete them manually ?

I have changed the settings in OpenPLI to get deleted movies erased right away, without using the trash !


Sent from my iPad using Tapatalk Pro

[WanWizard]

OpenPLi will delete files in trash automatically, in the background, based on minimum space and maximum days configured.

 

You can empty the trash manually by navigating to the trash folder, and press the red button. It will prompt you to empty the trash.

[brentener]

Thanks for your help! I tried this but I get the following error : Sorry, deleting directories can (for now) only be done through the trash can .


Sent from my iPhone using Tapatalk Pro

[WanWizard]

You're not trying to delete recordings, but entire directories?

 

The trashcan is there so that your storage isn't overloaded with requests, thus corrupting recordings running at the same time. It is not a smart idea to disable the trashcan.

 

If you want to delete files in the trashcan, you can simply navigate to them in the trashcan, and press red to delete them immediately. But it is better just to press Red on the trashcan, and have Enigma empty it.

 

(p.s. please disable your tapatalk footer )

[dany]

if you want to get free memory ( space on your hdd)

step 1-delete movie-step 2-empty trasch- step 3-restart enigma2) after restart enigma2 you will have free space on your harddisk

the most important is to restart enigma2 after step1 and 2

[WanWizard]

???

 

There is ZERO relation to space on a device and the state of Enigma.

 

And Enigma will empty trash when needed, you can define in the settings how much space you want to have available at a minimum. Enigma will delete files from trash after the number of days configured, or earlier if you run out of space.

 

There is virtually no reason to do anything manually, the only reason I can think of is a process other than Enigma2 using the same storage. In which case you can configure Enigma to empty trash immediately.

[dany]

This is what i mean because Enigma will delete the recorded files from the trash after of days configured. therefore, if you look at the free space of the hard disk after deleting the recorded files from the hard disk and from the trash, you will find that it has not changed until you do an Enigma restart or a restart of the box .
This is what happened to brentener... He deleted the recorded files from the hard disk and from the trash, and when he looked at the free space in the hard disk... he found that it was the same size as before ... it had not changed.

[WanWizard]

There is some optimisation in Enigma to avoid repeated disk access, but that doesn't warant an Enigma restart, if value will adjust after a few seconds.

[ims]

I have set up automatic deletion in the trash for all boxes to 365 days - it's safer, especially if more people, especially children, are working with the box. The trash is emptied manually using RED button on Trash - "Empty Trash." Remember that the freed space is displayed gradually as the files are deleted in the background. Occasionally, it's good to perform a "Check Filesystem" in the disk settings (sometimes it's necessary to restart the GUI first before run check disk).

[hcau1]

I am running OpenPLi 9.0-release (2024-10-11-release-9.0). Recordings are made on a USB connected HDD to the sat tuner. (An Octagon SF8)

However deleting the recording using the OpenwebIF the amount of free capacity slowly decreases with each delete. about 0.5GB for a 4GB recording).

On rebooting the capacity is restored back to normal. 

 

There seems to be nothing wrong with the HDD or even a USB stick the same effect is seen.

 

On checking the storage with a Linux Mint laptop and the USB storage attached directly (no Sat tuner) worked perfectly.

So the issue seems to be in the Sat tuner / OpenPLI system.

 

I even tried accessing the USB storage when connected to the sat tuner directly (no OpenWebIF) from the Linux Mint file manager (nemo) to move and delete files.

The same slow decrease in capacatity is seen.

 

I can live with it as a regular reboot resets the system so to speak. But I would like to understand what is going amiss.

Any ideas?

[WanWizard]

I think the question is, where and what are you checking?

 

Because enigma caches all sorts of data, and deleting trash is a background tasks that deletes in small chucks over time (so the disk isn't overloaded with delete operations, which can easily kill a recording). So space isn't immediately freed after a delete in the GUI.

[hcau1]

Thanks for the heads up. The files concerned are .ts files of recordings.

When I no longer need the recording after viewing it I delete it using OpenWebif

But I then had habit of emptying the trash can on a regular basis, also via OpenWebif. Emptying the "Rubbish bin" is normal practice in Linux Mint for example.

 

I access the sat tuner remotely hence the use of OpenWebif, works very well (timer programming, downloading recordings, deleting them. etc). 

 

But over a few months I noticed I had lost about 100GB capacity from a 250GB HDD and even one fouled up recording, a reboot cleaned things up. 

My current setup is "Remove from trash after 8 days" and "Keep 40GB for recordings". 

But from your comments it seems the best approach is to let enigma take care of trash management.

[WanWizard]

I have no idea how you can "lose" 100GB, and mysteriously "find it back" after a reboot.

 

There is nothing wrong with manually deleting things, but deleting a recording just moves it to the trashcan (so nothing is deleted at that point), and files in the transcan are deleted (after the number of configured days and/or free space threshold) in small chunks over time. The same happens if you navigate to the trashcan manually and delete the files., They look gone, but they aren't, they are slowly deleted. Like I wrote, this is done to minimize the impact on the disk, especially with USB devices such a delete at OS level could easily block all I/O for some time, ruining any running recordings.

 

But... eventually everything should be deleted, it can't be that you have a mysterious black storage hole somewhere. In the end, the box just runs plain linux, with a standard linux file ext4 system.

 

So the question remains: how and where did you determine your disk capacity is reduced by 100GB? In the web interface somewhere? On the box in the UI somewhere? On the linux commandline of the box?

 

Oh, and a side remark:

 

We don't make software for an SF8, so if you have something running that claims to be OpenPLi, it is a fake, make by someone else. You may have the XP1000 image running, appearently that is compatible.

 

And it is a very old and slow box, I'm not sure OpenPLi 9 is a good idea, that will almost fill up all flash space (can't cause storage to temporarily disappear though).

[WanWizard]

What could be the issue:

 

if the disk is failing, it could leave "holes" in the management structures on the disk, causing the free space calculations to be off. When you reboot the box, linux will force a file system check, which temporarily fixes things.

[hcau1]

Indeed I find it strange. While it is an Octagon, the image for XP1000 has always been used as it is the same product just a different label

It is old but it works, I've been using OpenPLI for years with no issues.... (so far !)

 

So to check and test I bought a new SansDisk 128GB USB stick and have used that to make recordings. It works.

NOTE: both storage devices were tested with Linux Mint's disk utilities, no issues. But over the years my experience with storage is that it works until it doesn't !!!! (hence back ups).

 

But the new USB stick also shows the same problem, slowly declining free space. About 0.5GB for a 3.3GB .ts recording. 

 

So a series of systematic tests were carried out. The first with Linux Mint and stick, the second series with the sat tuner.

The initial testing of the USB stick was done with Linux Mint running on a laptop and stick connected directly with USB

I use Mint's file manager (Nemo) to check properties and move the 3.3GB file to the stick and delete it.

 

Start with an empty stick

121.4GB free and 1.1GB used, and it is a ext3/est4 file system type

Move a 3.3GB .ts file to stick

118.1 GB free and 4.4GB used

Delete file

121.4GB free and 1.1GB used, perfect result

This was done several times, the numbers never change. Everything seems fine.

 

There are several ways to do a similar test with the Sat tuner.

The stick is accessed via the sat tuner using an IP address (i.e. sat tuner acts as a server)

Here the process is the same as using the laptop as noted above. The results are very different, they are reported via the Linux Mints file manger

Start with empty stick

121.4GB free and 1.1GB used and file system is cifs.

Move the same 3.3GB .ts file to the stick with Linux's file manager

117.4GB free and 5.1GB used

delete the file via the file manager (need to be sudo to do that), also deleted from the sat tuners trash folder

120.7GB free and 1.8GB used  (already some capacity is disappearing)

 

The second method uses OpenWebif to delete the files and "Box Info" to report status

NOTE: the reported status via OpenWebif "Box info" and the Enigma menus  show quite different results for an empty unused stick or even one with recordings on it. Also a reboot was carried out to ensure everything was starting from the same level.

 

Status report: 113.1GB free via OpenWebif "Box Info" and 116.8GB via the tuners user menus

A 3.3.ts file was copied to the sat tuner "movie folder" via the Linux mint file manager

108.7 free (OpenWebif - "Box info")

delete the file via OpenWebif and further deletion from Trash with OpenWebif

111.8GB free

These steps were carried out several times and the free capactiy drops step by step. A reboot restores the starting condition.

 

My increasing suspicion (no proof) is that OpenPLI might be using the external storage in some non visible way.

So the next step is do no manual delete and let OpenPLI take care of emptying trash.

To that end the default values seem fine (minimum 40GB and 8days old are dumped)

But I now changed the background delete which seems to default on a, for me non existent, internal HDD to "everywhere"

 I know of nothing else I can do, now monitor the situation to see if OpenPLI really does manage the trash.

 

Sorry for the long post.....

[WanWizard]

Indeed I find it strange. While it is an Octagon, the image for XP1000 has always been used as it is the same product just a different label
It is old but it works, I've been using OpenPLI for years with no issues.... (so far !)

 
This happens a lot, different resellers ordering the same hardware from an OEM manufacturer, and sticking their own logo on it.
 
Sometimes that's it (like appearently in this case), sometimes not ( you can't flash the SF8008 with the GBTrio4K image ).
 

Status report: 113.1GB free via OpenWebif "Box Info" and 116.8GB via the tuners user menus
A 3.3.ts file was copied to the sat tuner "movie folder" via the Linux mint file manager
108.7 free (OpenWebif - "Box info")
delete the file via OpenWebif and further deletion from Trash with OpenWebif
111.8GB free
These steps were carried out several times and the free capactiy drops step by step. A reboot restores the starting condition.

 

Which is why I asked how you check, because that matters.

 

For starters, what is displayed? GB? GiB? Does it check every time? Or does it cache?

 

If  I check my box here, it says:

320 GB / 303.GB free

but boxinfo says

Device:   WD (My Passport 071A)
Capacity: 295.9 GB free / 298.1 GB ("320 GB") total (Mount point: /media/hdd)

and the OS reports:

/dev/sdb1               297.0G     91.3M    295.9G   0% /media/hdd

So, the UI of the box displays GB (which is base 1000), while the OS and the Web interface display GiB (which is base 1024). So that explains that difference.

 

 

I've then copied a TS file to it:

root@ustym4kultimate:/media/hdd/movie# ls -l
-rw-r--r--    1 1029     users    5311406080 Oct 15 22:59 20241015_2102_-_M6_-_TULSA_KING.ts

The OS now reports

/dev/sdb1               297.0G      5.5G    290.5G   2% /media/hdd

and boxinfo shows

Capacity: 290.5 GB free / 298.1 GB ("320 GB") total (Mount point: /media/hdd)

which is correct and consistent.

 

I them removed the file again:

root@ustym4kultimate:/media/hdd/movie# rm 20241015_2102_-_M6_-_TULSA_KING.ts 

and the OS reports

/dev/sdb1               297.0G    543.5M    295.5G   0% /media/hdd

so you see the 91.3M has gone up to 543M.

 

A double check of what is really on the disk:

root@ustym4kultimate:/media/hdd/movie# du -x /media/hdd/ -d1 -hs
90.8M	/media/hdd/

so df displays cached superblock data, and as the web interface uses the same mechanism, it repoorts the same data.
 

My 2ct's is that you're looking at the ext3 journal, which is maintained for disk consistency, and which is flushed after a reboot.

Edited by WanWizard, 1 November 2024 - 17:32.

[hcau1]

Many thanks for your patience and explanation.

I will now progress as I mentioned (let OpenPLI take care of trash management) and keep an eye on things. 

[WanWizard]

If it bothers you too much, you can disable journalling with

 tune2fs -O^has_journal /dev/sd? 

but that means that on a crash there is no journal to recover damaged files.