gettext
In computing, gettext is an internationalization and localization (i18n and l10n) system commonly used for writing multilingual programs on Unix-like computer operating systems. One of the main benefits of gettext is that it separates programming from translating.[3] The most commonly used implementation of gettext is GNU gettext,[4] released by the GNU Project in 1995. The runtime library is libintl. gettext provides an option to use different strings for any number of plural forms of nouns, but it has no support for grammatical gender.
Original author(s) | Sun Microsystems |
---|---|
Developer(s) | various |
Initial release | 1990[1] |
Stable release | 0.21[2]
/ July 27, 2020 |
Repository | various based on OpenSolaris and GNU gettext |
Operating system | Cross-platform |
Type | Internationalization and localization |
License | Various free software licenses |
Website | www |
History
Initially, POSIX provided no means of localizing messages. Two proposals were raised in the late 1980s, the 1988 Uniforum gettext and the 1989 X/Open catgets (XPG-3 § 5). Sun Microsystems implemented the first gettext in 1993. The Unix and POSIX developers never really agreed on what kind of interface to use (the other option is the X/Open catgets), so many C libraries, including glibc, implemented both.[5] As of August 2019, whether gettext should be part of POSIX was still a point of debate in the Austin Group, despite the fact that its old foe has already fallen out of use. Concerns cited included its dependence on the system-set locale (a global variable subject to multithreading problems) and its support for newer C-language extensions involving wide strings.[6]
The GNU Project decided that the message-as-key approach of gettext is simpler and more friendly. (Most other systems, including catgets, requires the developer to come up with "key" names for every string.)[7] They released GNU gettext, a free software implementation of the system in 1995.[1] Gettext, GNU or not, has since been ported to many programming languages.[8] The simplicity of po and widespread editor support even lead to its adoption in non-program contexts for text documents or as an intermediate between other localization formats, with converters like po4a (po for anything) and Translate Toolkit emerging to provide such a bridge.[9][10]
Operation
Programming
The basic interface of gettext is the gettext(const char*)
function, which accepts a string that the user will see in the original language, usually English. To save typing time, and to reduce code clutter, this function is commonly aliased to _
:
printf(gettext("My name is %s.\n"), my_name);
printf(_("My name is %s.\n"), my_name); // same, but shorter
gettext()
then uses the supplied strings as keys for looking up translations, and will return the original string when no translation is available. This is in contrast to POSIX catgets()
,[11] AmigaOS GetString()
, or Microsoft Windows LoadString()
where a programmatic ID (often an integer) is used. To handle the case where the same original-language text can have different meanings, gettext has functions like cgettext()
that accept an additional "context" string.
xgettext
is run on the sources to produce a .pot
(Portable Object Template) file, which contains a list of all the translatable strings extracted from the sources. Comments starting with ///
are used to give translators hints, although other prefixes are also configurable to further limit the scope. One such common prefix is TRANSLATORS:
.
For example, an input file with a comment might look like:
/// TRANSLATORS: %s contains the user's name as specified in Preferences
printf(_("My name is %s.\n"), my_name);
xgettext
is run using the command:
xgettext -c /
The resultant .pot file looks like this with the comment (note that xgettext recognizes the string as a C-language printf format string):
#. TRANSLATORS: %s contains the user's name as specified in Preferences
#, c-format
#: src/name.c:36
msgid "My name is %s.\n"
msgstr ""
In POSIX shell script, gettext provides a gettext.sh
library one can include that provides the many same functions gettext provides in similar languages.[12] GNU bash also has a simplified construct $"msgid"
for the simple gettext function, although it depends on the C library to provide a gettext()
function.[13]
Translating
The translator derives a .po
(Portable Object) file from the template using the msginit
program, then fills out the translations.[14] msginit
initializes the translations so, for instance, for a French language translation, the command to run would be:[15]
msginit --locale=fr --input=name.pot
This will create fr.po
. The translator then edits the resultant file, either by hand or with a translation tool like Poedit, or Emacs with its editing mode for .po
files. An edited entry will look like:
#: src/name.c:36
msgid "My name is %s.\n"
msgstr "Je m'appelle %s.\n"
Finally, the .po files are compiled with msgfmt
into binary .mo
(Machine Object) files. GNU gettext may use its own file name extension .gmo
on systems with another gettext implementation.[16] These are now ready for distribution with the software package.
GNU msgfmt
can also perform some checks relevant to the format string used by the programming language. It also allows for outputting to language-specific formats other than MO;[17] the X/Open equivalent is gencat
.
In later phases of the developmental workflow, msgmerge
can be used to "update" an old translation to a newer template. There is also msgunfmt
for reverse-compiling .mo
files, and many other utilities for batch processing.
Running
The user, on Unix-type systems, sets the environment variable LC_MESSAGES
, and the program will display strings in the selected language, if there is an .mo
file for it.
Users on GNU variants can also use the environment variable LANGUAGE
instead. Its main difference from the Unix variable is that it supports multiple languages, separated with a colon, for fallback.[18]
Plural form
The ngettext()
interface accounts for the count of a noun in the string. As with the convention of gettext()
, it is often aliased to N_
in practical use. Consider the code sample:
// parameters: english singular, english plural, integer count
printf(ngettext("%d translated message", "%d translated messages", n), n);
A header in the ""
(empty string) entry of the PO file stores some metadata, one of which is the plural form that the language uses, usually specified using a C-style ternary operator. Let's say we want to translate for the Slovene language:
msgid ""
msgstr ""
"..."
"Language: sl\n"
"Plural-Forms: nplurals=4; plural=(n%100==1 ? 1 : n%100==2 ? 2 : n%100==3 || n%100==4 ? 3 : 0);\n"
Since now there are four plural forms, the final po would look like:
#: src/msgfmt.c:876
#, c-format
msgid "%d translated message"
msgid_plural "%d translated messages"
msgstr[0] "%d prevedenih sporočil"
msgstr[1] "%d prevedeno sporočilo"
msgstr[2] "%d prevedeni sporočili"
msgstr[3] "%d prevedena sporočila"
Reference plural rules for languages are provided by the Unicode consortium.[19] msginit also prefills the appropriate rule when creating a file for one specific language.[14]
Implementations
In addition to C, gettext has the following implementations: C# for both ASP.NET[20][21] and for WPF,[22] Perl,[23] PHP,[24] Python,[25] Scala,[26] and Node.js.[27]
GNU gettext has native support for Objective-C, but there is no support for the Swift programming language yet. A commonly used gettext implementation on these Cocoa platforms is POLocalizedString.[28] The Microsoft Outlook for iOS team also provides a LocalizedStringsKit library with a gettext-like API.[29]
See also
Wikimedia Commons has media related to GNU gettext. |
References
- "History of gettext() et al? - comp.unix.solaris". Compgroups.net. Retrieved 3 April 2016.
- https://ftp.gnu.org/pub/gnu/gettext/
- Martindale, Linda (1 November 2002). "Bridging the Digital Divide in South Africa | Linux Journal". linuxjournal.com. Linux Journal. Archived from the original on 17 September 2019. Retrieved 17 September 2019.
- Tykhomyrov, Olexiy Ye (1 November 2002). "Introduction to Internationalization Programming | Linux Journal". linuxjournal.com. Linux Journal. Archived from the original on 17 September 2019. Retrieved 17 September 2019.
- "Message Translation". The GNU C Library.
- "0001122: POSIX should include gettext() and friends - Austin Group Defect Tracker". Austin Group Defect Tracker.
- "The Programmer's View". gettext 0.10.35. 30 April 1998.
- "GNU gettext utilities: List of Programming Languages".
- "po4a". po4a.org.
- "The essential toolkit for localization engineers". Translate Toolkit.
- "About catgets". gnu.org. Retrieved 24 October 2017.
- "GNU gettext utilities: sh".
- "GNU gettext utilities: bash".
- "GNU gettext utilities: PO Files". Gnu.org. Retrieved 3 April 2016.
- "How to Translate With GetText PO and POT Files". Icanlocalize.com. Retrieved 3 April 2016.
- "Files Conveying Translations". Gnu.org. Retrieved 22 April 2014.
- "msgfmt Invocation". GNU gettext utilities.
- "GNU gettext utilities: Locale Environment Variables". Gnu.org. Retrieved 3 April 2016.
- "Language Plural Rules". unicode.org.
- "Google Code Archive - Long-term storage for Google Code Project Hosting". Code.google.com. Retrieved 3 April 2016.
- "turquoiseowl/i18n: Smart internationalization for ASP.NET". GitHub.com. Retrieved 3 April 2016.
- "NGettext.Wpf - Proper internationalization support for WPF (via NGettext)".
- "libintl-perl - An Internationalization Library for Perl That Aims To Be Compatible With the Uniforum Message Translations System as Implemented For Example in GNU Gettext". github.com. Retrieved 14 September 2017.
- "Gettext". php.net. Retrieved 24 October 2017.
- "gettext – Multilingual internationalization services – Python 3.7.0 documentation". docs.python.org. Retrieved 21 September 2018.
- "makkarpov/scalingua: A simple gettext-like internationalization library for Scala". github.com. Retrieved 28 April 2016.
- "DanielBaulig/node-gettext: An adaption of Joshua I. Miller's Javascript Gettext library for node.js". GitHub.com. Retrieved 3 April 2016.
- "hulab/POLocalizedString: gettext for iOS/OS X/watchOS/tvOS". GitHub. hulab. 19 September 2019.
- "microsoft/LocalizedStringKit: Generate .strings files directly from your code". GitHub. Microsoft. 12 February 2020.