61 replies to this topic

[littlesat]

Here I get a timestamp.

[dudule22]

I am not sure that is is the good topic, but i have some troubles on DUO4K and a friend DUO4K SE.

After, a reboot there is a black screen and the the solution is to disconnect the power. Switch on and off, is not enought.

It is not all the time.

It happends on openpli 8.3 and openpli 9 (last releases)

[Dimitrij]

Here I get a timestamp.

Not.

[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/gbquad4k
[UpdatePlugin] Error in get timestamp an integer is required (got type str)
[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/cortexa15hf-neon-vfpv4
[UpdatePlugin] Error in get timestamp an integer is required (got type str)
[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/all
[UpdatePlugin] Error in get timestamp an integer is required (got type str)

Need this

If telnet python work:

>>> modified = datetime.strptime(urlopen("%s/Packages.gz" % url, timeout=1).info().get('Last-Modified'), '%a, %d %b %Y %H:%M:%S GMT')
>>> strftime("%Y-%m-%d %H:%M:%S", gmtime(datetime.timestamp(modified) - altzone))
'2023-12-27 20:57:28'

byt SoftwareUpdate.py not work

			try:
				print('[UpdatePlugin] Trying to fetch time from %s' % url)
				modified = datetime.strptime(urlopen("%s/Packages.gz" % url, timeout=1).info().get('Last-Modified'), '%a, %d %b %Y %H:%M:%S GMT')
				return strftime("%Y-%m-%d %H:%M:%S", gmtime(datetime.timestamp(modified) - altzone))
			except Exception as er:
				print('[UpdatePlugin] Error in get timestamp', er)

 

[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/gbquad4k
[UpdatePlugin] Error in get timestamp time data 'Wed, 27 Dec 2023 19:26:56 GMT' does not match format '%a, %d %b %Y %H:%M:%S GMT'
[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/cortexa15hf-neon-vfpv4
[UpdatePlugin] Error in get timestamp time data 'Wed, 27 Dec 2023 19:57:35 GMT' does not match format '%a, %d %b %Y %H:%M:%S GMT'
[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/all
[UpdatePlugin] Error in get timestamp time data 'Wed, 27 Dec 2023 19:57:28 GMT' does not match format '%a, %d %b %Y %H:%M:%S GMT'

 

 

 

[littlesat]

Weird I could not verify this, but I can also not check today

[WanWizard]

Chances are this is a problem with complex oneliners and lack of return value checking again.

 

Split the line into its pieces and do proper retuvn value checking. For example, you could get that because of the 1 second timeout,.in which case info() doesn't return any headers.

[littlesat]

Maybe I can check tomorrow or Saturday please be patience. When this was not perfect since python 3 then we need not to speed it up.
At the last commit I get a value with the date which I tripple checked and it was a string with the expected format. So no idea why it fails. The example above does not look like my code.

Edited by littlesat, 28 December 2023 - 19:33.

[Dimitrij]

	def getLatestImageTimestamp(self):
		def gettime(url):
			try:
				print('[UpdatePlugin] Trying to fetch time from %s' % url)
				#return strftime("%Y-%m-%d %H:%M:%S", gmtime(timegm(urlopen("%s/Packages.gz" % url, timeout=1).info().get('Last-Modified')) - altzone))
				data = urlopen("%s/Packages.gz" % url, timeout=3).info().get('Last-Modified')
				print(data)
				time_gm = timegm(data)
				return strftime("%Y-%m-%d %H:%M:%S", gmtime(time_gm - altzone))
			except Exception as er:
				print('[UpdatePlugin] Error in get timestamp', er)
				return ""
		return sorted([gettime(open("/etc/opkg/%s" % file, "r").readlines()[0].split()[2]) for file in listdir("/etc/opkg") if not file.startswith("3rd-party") and file not in ("arch.conf", "opkg.conf", "picons-feed.conf")], reverse=True)[0]

RU locale

[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/gbquad4k
Thu, 28 Dec 2023 22:53:38 GMT
[UpdatePlugin] Error in get timestamp an integer is required (got type str)
[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/cortexa15hf-neon-vfpv4
Thu, 28 Dec 2023 23:24:24 GMT
[UpdatePlugin] Error in get timestamp an integer is required (got type str)
[UpdatePlugin] Trying to fetch time from http://downloads.openpli.org/feeds/openpli-develop/all
Thu, 28 Dec 2023 23:24:12 GMT
[UpdatePlugin] Error in get timestamp an integer is required (got type str)

 

[littlesat]

There is something extreme strange playing here... when I try this via console it is working fine, But when I do the same in enigma2 then it tells me the string is not in line with the format.

from datetime import datetime
from urllib.request import urlopen
 
url = 'http://downloads.openpli.org/feeds/openpli-develop/all'
time = urlopen("%s/Packages.gz" % url, timeout=1).info().get('Last-Modified')
print(time)
 
out = datetime.strptime(time , '%a, %d %b %Y %H:%M:%S GMT')
print(out)

[littlesat]

                                def gettime(url):
                                                try:
                                                                print('[UpdatePlugin] Trying to fetch time from %s' % url)
                                                               
                                                               
                                                                time = urlopen("%s/Packages.gz" % url, timeout=1).info().get('Last-Modified')
                                                                #time = "Maa, 24 Jan 2024 10:10:23 GMT"
                                                                print('     >     ', time)
                                                                out = datetime.strptime(time , '%a, %d %b %Y %H:%M:%S GMT')
                                                                print('     >     ', time)
                                                                time = gmtime(time - altzone)
                                                                print('     >     ', time)
                                                                time = strftime("%Y-%m-%d %H:%M:%S", time)
                                                                print('     >     ', time)
                                                                return time
                                                except Exception as er:
                                                                print('[UpdatePlugin] Error in get timestamp', er)
                                                                return ""
                                print('    >    ', sorted([gettime(open("/etc/opkg/%s" % file, "r").readlines()[0].split()[2]) for file in listdir("/etc/opkg") if not file.startswith("3rd-party") and file not in ("arch.conf", "opkg.conf", "picons-feed.conf")], reverse=True)) 
                                return sorted([gettime(open("/etc/opkg/%s" % file, "r").readlines()[0].split()[2]) for file in listdir("/etc/opkg") if not file.startswith("3rd-party") and file not in ("arch.conf", "opkg.conf", "picons-feed.conf")], reverse=True)[0]

Edited by littlesat, 29 December 2023 - 11:49.

[Dimitrij]

 

There is something extreme strange playing here... when I try this via console it is working fine, But when I do the same in enigma2 then it tells me the string is not in line with the format.

Same problem here https://forums.openp...dpost&p=1593772

Maybe problem in locale?

[littlesat]

I'm afraid indeed the translations are involved here....  The 'website' is in English...

Edited by littlesat, 29 December 2023 - 12:05.

[littlesat]

We miss the getdate() now that was not language depended!!! Issue found, but no solution yet.

[Dimitrij]

We miss the getdate() now that was not language depended!!! Issue found, but no solution yet.

solution,but output only english,e.g. "Maa, 24 Jan 2024 10:10:23 GMT"

return urlopen("%s/Packages.gz" % url, timeout=2).info().get('Last-Modified')

 

[littlesat]

I tried to force Dutch here in the string. And your suggestion does not work as then you order on weekday name.

Edited by littlesat, 29 December 2023 - 16:17.

[WanWizard]

I'm afraid indeed the translations are involved here....  The 'website' is in English...

 

The HTTP standard describes timestamps in a response header in that format (RFC 822 / RFC 1123). Not related to "the website" as such.

 

If you are using datetime, which is locale aware, you can switch to en_US before parsing the timestamp:

locale.setlocale(locale.LC_TIME, 'en_US')

but it is suggested not to do that, as it is not thread safe (it also changes the locale in running threads).

 

It is better to use

>>> from email.utils import parsedate_to_datetime
>>> x = "Mon, 24 Jan 2024 10:10:23 GMT"
>>> parsedate_to_datetime(x)
datetime.datetime(2024, 1, 24, 10, 10, 23, tzinfo=datetime.timezone.utc)
>>> int(parsedate_to_datetime(x).timestamp())
1706091023

and continue from there.
 

[Dimitrij]

	def getLatestImageTimestamp(self):
		def gettime(url):
			try:
				print('[UpdatePlugin] Trying to fetch time from %s' % url)
				from locale import setlocale
				locale.setlocale(locale.LC_TIME, 'en_US')
				modified = datetime.strptime(urlopen("%s/Packages.gz" % url, timeout=2).info().get('Last-Modified'), '%a, %d %b %Y %H:%M:%S GMT')
				return strftime("%Y-%m-%d %H:%M:%S", gmtime(datetime.timestamp(modified) - altzone))
			except Exception as er:
				print('[UpdatePlugin] Error in get timestamp', er)
				return ""
		return sorted([gettime(open("/etc/opkg/%s" % file, "r").readlines()[0].split()[2]) for file in listdir("/etc/opkg") if not file.startswith("3rd-party") and file not in ("arch.conf", "opkg.conf", "picons-feed.conf")], reverse=True)[0]

Edited by Dimitrij, 29 December 2023 - 17:55.

[WanWizard]

Two issues with this:

• you shouldn't use setlocale as it is not thread-safe
• you've now changed the locale on your box to US English permanently

Instead, use

	def getLatestImageTimestamp(self):
		def gettime(url):
			try:
				print('[UpdatePlugin] Trying to fetch time from %s' % url)
				from email.utils import parsedate_to_datetime
				modified = int(parsedate_to_datetime(urlopen("%s/Packages.gz" % url, timeout=2).info().get('Last-Modified')).timestamp())
				return strftime("%Y-%m-%d %H:%M:%S", gmtime(modified - altzone))
			except Exception as er:
				print('[UpdatePlugin] Error in get timestamp', er)
				return ""
		return sorted([gettime(open("/etc/opkg/%s" % file, "r").readlines()[0].split()[2]) for file in listdir("/etc/opkg") if not file.startswith("3rd-party") and file not in ("arch.conf", "opkg.conf", "picons-feed.conf")], reverse=True)[0]

 

[littlesat]

locale.setlocale(locale.LC_TIME, 'en_US') does not work.... locale.setlocale(locale.LC_TIME, 'en_EN.utf8') does work... I just push something.... As far I can see this is working... But I do not like it at all... as it is indeed not thread safe... but I set the language back.

Since getdate(...) is not there anymore in urllib I do not find a real solution to get this done.... So I tried to resolve it but I also have to sleep on it.

Google wasn't also not helpfull...
 

Edited by littlesat, 29 December 2023 - 19:47.

[WanWizard]

On the box en_US works, "en_EN.utf8" looks like a PC distro.

 

But I suggest you take what I posted instead, as it has no locale issues.

[VeryClear]

Looks like this was fixed? It's been a while since I've seen the problem.