Encoding problem with tar file

Both 7zip and rar support international character, but since tar file does not have encoding attribute, it only support ascii character. For tar file that works on windows, it may encounter a character encoding problem in mac or linux.

Convert encoding of a text file

iconv --from-code=gb2312 --to-code=utf-8 < readme.txt > out.txt

Detect encoding of file

• For file that has encoding metadata in it, use file command

file -I <filename>

• Use sublime text to detect the text file
• For windows user, try trid
• hex dump using xxd <filename> in terminal or vim

Reference

• convert text file encoding on stackoverflow
• file signatures
• detect file encoding on stack exchange
• file signatures database online
• forensic tools
• file carving by forensicswiki
• find text string in folder using grep command