Repository navigation
Unable to convert string to the requested encoding when reading sav files with long strings #241
Description
Activity
- changed the title
[-]Unable to convert string to the requested encoding when writing sav files with long strings with international characters[/-][+]Unable to convert string to the requested encoding when reading sav files with long strings with international characters[/+]on Apr 23, 2021 another observation is that a very similar file with only one character of difference (first variable name "aaaaa3" instead of "aaaaa2") does not raise the error, attached example file.
eg3.sav.zipAre UTF-8 strings being provided to the writer?
Yes
- changed the title
[-]Unable to convert string to the requested encoding when reading sav files with long strings with international characters[/-][+]Unable to convert string to the requested encoding when reading sav files with long strings[/+]on Dec 15, 2021 as mentioned in #260, it is possible to reproduce this error without any international character, (using only 'a's in this example) if the length of the string is at least 757. Another important thing to reproduce this is that the numerical values must be NANs. See #260 for C code to reproduce the issue.
is this likely to be fixed?
Should be fixed in 3cab443
Reacted by jacob-lee
Hi,
When reading a sav file that contains a long string (756 characters to be precise, with 755 the error does not show up) with an international character, Readstat gives the error:
Attached an example save file. The sav file was produced with pyreadstat.
thanks in advance!
original report: Roche/pyreadstat#128
note: initially I reported the error was on writing, it is on reading!
eg.sav.zip
also attached a csv version of the file
eg.csv