Getting error 'Some bytes have been replaced with the Unicode substitution...
I am getting an error when trying to open my VS2015 project:Some bytes have been replaced with the Unicode substitution character while loading file ... with Unicode (UTF-8)This seems to be related to...
View ArticleCalculate difference in encoding WITHOUT actually writing to a file?
I have some text, that will be written to 2 files using UTF-8 and 1252 encoding.Observation when comparing these 2 files:most text characters will remain the same.some UTF-8 characters that don't exist...
View Articlejava.nio.file.InvalidPathException: Malformed input or input contains...
I'm trying to create some directories which have national symbols like "äöü" etc. Unfortunately I'm getting this exception whenever that is being attempted:java.nio.file.InvalidPathException: Malformed...
View Articlehow to convert a text with [Øَدَّ...] chars to normal text? [closed]
how to convert this text to normal text?Øَدَّ-ÙŠÙŽØÙدّÙ-Øَدّ-ØÙدÙوْد-–-Øَادّ-–-ØÙداد-–-ØَدÙيْد-الØَدÙيْدThis text was probably written in Arabic or...
View ArticleWhat encoding to use for Zip archive comments?
What encoding is supposed to be used for Zip archive comments? I know that the encoding of file comments (and file names) are determined by Bit 11 of the files' General Purpose Bit Flags. However,...
View ArticleDetect UTF-16 file content
Is it possible to know if a file has Unicode (16-byte per char) or 8-bit ASCII content?
View ArticleClik here to view.
pdftk generated pdf does not render correct utf-8
Version is 2.02I have a simple pdf with a name field. I created an fdf using pdftkpdftk form4.pdf generate_fdf output data4.fdfRemoving the unnecessary fields, here is what it has: (full view on...
View Articleunable to get uppercase to 'ß' (german character called eszett)
Hello I have to convert a string column into its uppercase version, but when 'ß' is present in the string, it gets changed to 'SS' while doing uppercaseI understand that this is because,earlier 'SS'...
View ArticleUsing PowerShell to write a file in UTF-8 without the BOM
Out-File seems to force the BOM when using UTF-8:$MyFile = Get-Content $MyPath$MyFile | Out-File -Encoding "UTF8" $MyPathHow can I write a file in UTF-8 with no BOM using PowerShell?Update...
View ArticleHow to fix ANSII character in SQL Server table to UTF-8
I have a data import process to import data from csv file into a table in SQL server.I have noticed that some columns contain some accented characters.For example I have noticed the following text in...
View ArticleSQLite, python, unicode, and non-utf data
I started by trying to store strings in sqlite using python, and got the message:sqlite3.ProgrammingError: You mustnot use 8-bit bytestrings unless youuse a text_factory that can interpret8-bit...
View ArticleHow to solve this problem Python configuration [closed]
SyntaxError: Non-UTF-8 code starting with '\xe3' in file D:\Projetos\M74Chat\M74Chat\config.py on line 4, but no encoding decared; see https://peps.python.org/pep-0263/ for detailsimport...
View ArticleVS Code integrated terminal UTF-8 input problem [duplicate]
I don't understand why my question was closed? The problem is not in the encoding. The problem is in the integrated terminal of vs code.I am working with MSVC compiler in VS Code. I set the integrated...
View ArticleHow can I escape all unicode characters in a QString so that only ASCII is...
I'm searching for a safe method to escape all non-ASCII characters in a QString (and of course to un-escape them later) that will result in pure (printable) ASCII but yield the shortest possible...
View ArticleHow to get character position in a text file encode in UTF-8 in C?
The C Standard specifies that ftell() returns the position of a character from the beginning of the file when it's opened in binary mode.... obtains the current value of the file position indicator for...
View ArticleValues in UTF-8 being encoded as NULL in JSON [duplicate]
I have a set of keywords that are passed through via JSON from a DB (encoded UTF-8), some of which may have special characters like é, è, ç, etc. This is used as part of an auto-completer....
View ArticleCharacter encoding of GET request parameter
Hello fellow Stackoverflowers.I have an issue that i need some help with:We're making an http GET web service call from a smartphone app to a Java/Spring MVC application. We're on a Tomcat application...
View ArticleEncoding problem on MySQL: Why some non-ASCII characters get encoded on more...
I've encountered a problem using MySQL on Docker. When I directly insert non-ASCII characters in the database using the initialization sql script, the characters are correctly shown on MySQL's console,...
View ArticleHow to store metadata for a UTF-8 text file cross-platform?
I'm looking for a cross-platform way of storing small amounts of metadata for UTF-8 text files. Things like current selection and cursor position. I know about filesystem-specific solutions like using...
View Article