Handling a Unicode String in Delphi Versions <= 2007

Solution 1:

Delphi versions prior to Delphi 2009 do have Unicode support built in. The WideString type has been available since Delphi 4, I think, maybe earlier. WideString isn't as nice as the new UnicodeString type, but it still holds 16-bit Unicode characters, and you can type-cast it to PWideChar to send strings to Unicode API functions. The Windows unit declares most of the "wide" versions of the API functions, and there's nothing to stop you from declaring other functions yourself if you find some missing.

What prior versions don't have is Unicode support in the VCL. For that, you can use the Tnt Unicode controls. They used to be free. Looks like there are a few places where the latest free version is still available: (1), (2).

The JCL has a couple of units for working with Unicode. The JclWideStrings unit has mostly light-weight utility functions. The JclUnicode unit is more complete, but it also includes a sizable resource for determining character properties of all Unicode characters.

With the JCL you have a few choices for classes to hold lists of WideString values. I think Delphi 7 even comes with a class for that.

Don't think that just because you don't have Delphi 2009 you can't write a Unicode program.

If you have a WideString value, and you want to encode it as UTF-8, then call the Utf8Encode function. It will return an AnsiString value, or possibly Utf8String, if your Delphi version declares that type. It's not the same as Delphi 2009's Utf8String type, though. Delphi 2009's will automatically convert to UnicodeString or AnsiString(x) and vice versa in assignment statements. Prior versions just have a single AnsiString type, so you need to keep track for yourself which variables hold UTF-8 data and which hold Ansi data. (Hungarian notation on your variable and parameter names can help you keep track.) And of course, there's also a Utf8Decode function for converting UTF-8 data back to WideString.

For handling other character encodings, you want to check out Open XML, a free XML library for Delphi. As part of its XML handling, it has support for converting between 70 different encodings.

Solution 2:

I built a full unicode application without using Delphi 2009 (prior to it's release).

I have used the following:

1. Use widestring as main string datatype.

2. Used database component with unicode support(ADO use widestring too, but I didnt' use it cuz it doesn't handle unicode field names).

3. Used free TNTControls for the UI, worked fine but it's same as Standard controls, don't have much features like other third party's controls.

4. I have setup a VM with different language, so I can test the version in different system that doesn't support my language.

5. FastReport was my reporting tool which support Unicode too.

also I have used DIConverters from Delphi Inspiration to convert a database from ansi to UTI8 with it's functions, you can use it for the conversion from/to UTF8, and it's freeware;-)

there's also an open source project Delphi fundamentals, which have usefual function for unicode.

but I think, if you could use D2009 for full support unicode, your work will be much easier and faster, because you will not use a slow widestring data type, and you will find most of third party offered a Unicode version or working now on it.

Solution 3:

Use the type widestring and encoding functions to/from utf8 (UTF8Encode/UTF8Decode)

Don't use the string type and don't use Ansi-functions - if you are doing that, you are losing information.