kaggle datasets download not working

[junkoda]

There seems to be a simple bug for kaggle datasets download in version 1.5.15. It worked with 1.5.13, and broken in 1.5.14 and 1.5.15.

$ kaggle datasets download -d shashwatraman/contrails-images-ash-color
time data 'Mon, 05 Jun 2023 10:54:39 GMT' does not match format '%a, %d %b %Y %X %Z'

The command is given by the Copy API Command menu in the right top corner of the data page.

The command works with 1.5.13.

$ pip install kaggle==1.5.13
$ kaggle datasets download -d shashwatraman/contrails-images-ash-color

Version 1.5.14 had an addition bug that does not recognize -d option, but without -d it also has the same time data error.

This does not depend on the data. I tried one more data path and get the same error.

[Philmod]

I wasn't able to reproduce the bug

What OS are you using?

[junkoda]

Thanks for the reply. I have investigated a bit more.

The error occurs at:

remote_date = datetime.strptime(response.headers['Last-Modified'],
                                  '%a, %d %b %Y %X %Z')
# with response.headers['Last-Modified'] = 'Mon, 05 Jun 2023 10:54:39 GMT'

in kaggle_api_extended.py.

The problem is that the code depends on locale or other settings for the datetime. In my environment. '%X' requires AM/PM:

from datetime import datetime
import locale
datetime.strptime('10:54:39', '%X') # => Error
datetime.strptime('10:54:39 AM', '%X') # => OK

locale.getlocale()  # => ('en_US', 'UTF-8')
datetime.now().strftime('%X')  # => '05:16:31 PM'

• OS: Ubuntu 18.04.6 LTS
• Python 3.10.10
• System Locale: en_US.UTF-8

My other computer MacOS Ventura, getlocal() returns (None, None) and the kaggle download works with no error.

Weekday and month might also fail in other languages.

from datetime import datetime
import locale

remote_date = datetime.strptime('04 Jul', '%d %b')  # OK for me

locale.setlocale(locale.LC_ALL, 'it_IT.UTF-8')
remote_date = datetime.strptime('04 Jul', '%d %b')  # Error July is luglio in Italian

Since I am not familiar with locales, I'll leave the proper locale-independent solution to the professionals. Thanks.

[Philmod]

Internal bug: http://b/291578234

[Philmod]

It should be fixed in https://github.com/Kaggle/kaggle-api/releases/tag/1.5.16. Let me know if that works for you now.

[junkoda]

Thanks! Yes, datasets download worked with 1.5.16.

[Karesto]

Up because this error is now back for me.

[junkoda]

Thanks. Nice to see someone else other than me is experiencing this error. I've opened an another issue.
#523
en_US was fixed but not fixed for other languages (locale)