Wednesday, 16 July 2014

Check Foreign characters support on Unix machine and Informatica.

If you want to test all the foreign characters supported on your machine then checking the encodings supported on your machine helps. This kind of test might be required when you copy a file into your unix machine and see that some of the characters are not getting displayed. BEncodings such as ISO8859-1 and UTF-8, UTF-16 can support french characters. ISO-8859-15 supports some of the characters such as the pound sign that is not supported by ISO8859-1. Below is the test results on the solaris machine.

Try the command locale -a to check all the character encodings.

mymachine>locale -a
en_CA
en_CA.ISO8859-1
en_CA.UTF-8
en_US
en_US.ISO8859-1
en_US.ISO8859-15
en_US.ISO8859-15@euro
es
es_MX
es_MX.ISO8859-1
es_MX.UTF-8
fr
fr_CA
fr_CA.ISO8859-1
fr_CA.UTF-8
iso_8859_1

To change the encoding try the following commands:

mymachine>export LC_CTYPE=fr_CA.ISO8859-1

mymachine>dumpcs
:::::::::::::::::::::::::::::
LC_CTYPE:fr_CA.ISO8859-1 CS:0
::::::::::::::::::::::::::::
    ! " # $ % & ' ( ) * + , - . / 0 1 2 3 4 5 6 7 8 9 : ; < = > ?
@ A B C D E F G H I J K L M N O P Q R S T U V W X Y Z [ \ ] ^ _
` a b c d e f g h i j k l m n o p q r s t u v w x y z { | } ~*

dumpcs command above is used to display all the characters supported by an encoding.


In Informatica, code page setting determines the characters supported by informatica. If any character is not supported by Informatica try changing the code page setting on the source or target setting in the informatica setting. For flat files we should be able to edit the code page in the advance file properties in the session.
In general, the code page settings are done at the server level using the Informatica admin or while creating the informatica repository. To test if Informatica supports french character, process a simple text file using a simple informatica mapping and write the flat file contents to a target flat file. If you can see all the characters in the target file then informatica supports those characters.


See Also:
http://dwbitechguru.blogspot.ca/2014/07/issue-xml-reader-error.html