SLIDE 1
"why perl ⤠utf-8" also (bonus!) "why OmniGraffle is not a replacement for Powerpoint"
- me. and mark, sometimes.
"why perl utf-8" also (bonus!) "why OmniGraffle - - PowerPoint PPT Presentation
"why perl utf-8" also (bonus!) "why OmniGraffle - - PowerPoint PPT Presentation
"why perl utf-8" also (bonus!) "why OmniGraffle is not a replacement for Powerpoint" perl programmers who everyone understand character sets me. and mark, sometimes. and nick. 10010110 byte character a
SLIDE 2 perl programmers who understand character sets everyone
SLIDE 3
10010110
byte
SLIDE 4
贘
character
SLIDE 5
10010101 01101100 1101011 00110100
a sequence of bytes
SLIDE 6
a sequence of characters
a sequence of characters
SLIDE 7
10010101 01101100 1101011 001101
≠
☃
SLIDE 8
≠
☃
11100010 10011000 10000011 + "that's utf-8"
⇨
☃
SLIDE 9 Perl String (utf-8 flag on) utf-8 byte sequence latin-1 byte sequence Perl String (utf-8 flag off)
Encode::encode("latin-1", $a) utf8::upgrade($a) (in place) utf8::downgrade($a) (in place) Encode::encode("utf8", $a) OR Encode::_utf8_off($a) (in place) Encode::encode("utf8", $a) Encode::decode("utf8", $a) OR Encode::_utf8_on($a) (in place) Encode::decode("utf8", $a) Encode::encode("latin-1", $a) Encode::decode("latin-1", $a) Encode::decode("latin-1", $a) Encode::from_to("utf8", "latin-1", $a) (in place) Encode::from_to("latin-1", "utf-8", $a) (in place)
☃
SLIDE 10 latin-1 byte sequence
bytes = code points = characters everything Just Works
SLIDE 11 Perl String (utf-8 flag off)
bytes = code points = characters everything Just Works
SLIDE 12 Perl String (utf-8 flag off) latin-1 byte sequence
SLIDE 13 utf-8 byte sequence
This is a sequence of bytes
SLIDE 14 Perl String (utf-8 flag on)
This is a sequence of characters
SLIDE 15 Perl String (utf-8 flag on) utf-8 byte sequence Encode::_utf8_on($scalar) Encode::_utf8_off($scalar)
SLIDE 16 Perl String (utf-8 flag on) latin 1 byte sequence Encode::_utf8_on($scalar) Encode::_utf8_off($scalar)
SLIDE 17 Perl String (utf-8 flag on) latin 1 byte sequence Encode::_utf8_on($scalar) Encode::_utf8_off($scalar) segfault
SLIDE 18 Perl String (utf-8 flag on) Perl String (utf-8 flag off) latin-1 byte sequence utf-8 byte sequence
SLIDE 19 Perl String (utf-8 flag on) utf-8 byte sequence latin-1 byte sequence Perl String (utf-8 flag off)
Encode::encode("latin-1", $a) utf8::upgrade($a) (in place) utf8::downgrade($a) (in place) Encode::encode("utf8", $a) OR Encode::_utf8_off($a) (in place) Encode::encode("utf8", $a) Encode::decode("utf8", $a) OR Encode::_utf8_on($a) (in place) Encode::decode("utf8", $a) Encode::encode("latin-1", $a) Encode::decode("latin-1", $a) Encode::decode("latin-1", $a) Encode::from_to("utf8", "latin-1", $a) (in place) Encode::from_to("latin-1", "utf-8", $a) (in place)
SLIDE 20 Perl String (utf-8 flag on) utf-8 byte sequence latin-1 byte sequence Perl String (utf-8 flag off)
Encode::encode("utf8", $a) Encode::decode("utf8", $a) Encode::encode("latin-1", $a) Encode::decode("latin-1", $a) Encode::from_to("utf8", "latin-1", $a) (in place) Encode::from_to("latin-1", "utf-8", $a) (in place)
SLIDE 21 utf-8 byte sequence latin-1 byte sequence Perl String
Encode::encode("utf8", $a) Encode::decode("utf8", $a) Encode::encode("latin-1", $a) Encode::decode("latin-1", $a)
SLIDE 22
$bytes = Encode::encode( 'encoding', $chars ) $chars = Encode::decode( 'encoding', $bytes )
SLIDE 23
use Devel::Peek
SLIDE 24
XS
not very nice SLIDE 25
SV = PV(0x8131020) at 0x811d234 REFCNT = 1 FLAGS = (POK,READONLY,pPOK) PV = 0x812a9c8 "\351"\0 CUR = 1 LEN = 2
the character the bytes
é
SLIDE 26
SV = PV(0x811d470) at 0x8127c38 REFCNT = 1 FLAGS = (POK,pPOK,UTF8) PV = 0x8122ee8 "\303\251"\0 [UTF8 "\x{e9}"] CUR = 2 LEN = 3
the character the bytes
é é
SLIDE 27
é
DBD::mysql
SLIDE 28
2 approaches
right fast Encode::encode Encode::decode Encode::_utf8_on
SLIDE 29
the real correct approach
DBD::Pg
SLIDE 30
XML
SLIDE 31
XML::LibXML nice perl strings XML
SLIDE 32
XML::LibXML nice perl strings XML garbage
SLIDE 33
use java
there are very expensive courses you can go to
SLIDE 34