net: golang.org/x/net/idna Index | Examples | Files

package idna

import "golang.org/x/net/idna"

Package idna implements IDNA2008 using the compatibility processing defined by UTS (Unicode Technical Standard) #46, which defines a standard to deal with the transition from IDNA2003.

IDNA2008 (Internationalized Domain Names for Applications), is defined in RFC 5890, RFC 5891, RFC 5892, RFC 5893 and RFC 5894. UTS #46 is defined in http://www.unicode.org/reports/tr46. See http://unicode.org/cldr/utility/idna.jsp for a visualization of the differences between these two standards.

Index

Examples

Package Files

idna.go punycode.go tables.go trie.go trieval.go

Constants

const UnicodeVersion = "9.0.0"

UnicodeVersion is the Unicode version from which the tables in this package are derived.

func ToASCII Uses

func ToASCII(s string) (string, error)

ToASCII is a wrapper for Punycode.ToASCII.

func ToUnicode Uses

func ToUnicode(s string) (string, error)

ToUnicode is a wrapper for Punycode.ToUnicode.

type Option Uses

type Option func(*options)

An Option configures a Profile at creation time.

func BidiRule Uses

func BidiRule() Option

BidiRule enables the Bidi rule as defined in RFC 5893. Any application that relies on proper validation of labels should include this rule.

func MapForLookup Uses

func MapForLookup() Option

MapForLookup sets validation and mapping options such that a given IDN is transformed for domain name lookup according to the requirements set out in Section 5 of RFC 5891. The mappings follow the recommendations of RFC 5894, RFC 5895 and UTS 46. It does not add the Bidi Rule. Use the BidiRule option to add this check.

The mappings include normalization and mapping case, width and other compatibility mappings.

func RemoveLeadingDots Uses

func RemoveLeadingDots(remove bool) Option

RemoveLeadingDots removes leading label separators. Leading runes that map to dots, such as U+3002, are removed as well.

This is the behavior suggested by the UTS #46 and is adopted by some browsers.

func StrictDomainName Uses

func StrictDomainName(use bool) Option

StrictDomainName limits the set of permissable ASCII characters to those allowed in domain names as defined in RFC 1034 (A-Z, a-z, 0-9 and the hyphen). This is set by default for MapForLookup and ValidateForRegistration.

This option is useful, for instance, for browsers that allow characters outside this range, for example a '_' (U+005F LOW LINE). See http://www.rfc-editor.org/std/std3.txt for more details This option corresponds to the UseSTD3ASCIIRules option in UTS #46.

func Transitional Uses

func Transitional(transitional bool) Option

Transitional sets a Profile to use the Transitional mapping as defined in UTS #46. This will cause, for example, "ß" to be mapped to "ss". Using the transitional mapping provides a compromise between IDNA2003 and IDNA2008 compatibility. It is used by most browsers when resolving domain names. This option is only meaningful if combined with MapForLookup.

func ValidateForRegistration Uses

func ValidateForRegistration() Option

ValidateForRegistration sets validation options to verify that a given IDN is properly formatted for registration as defined by Section 4 of RFC 5891.

func ValidateLabels Uses

func ValidateLabels(enable bool) Option

ValidateLabels sets whether to check the mandatory label validation criteria as defined in Section 5.4 of RFC 5891. This includes testing for correct use of hyphens ('-'), normalization, validity of runes, and the context rules.

func VerifyDNSLength Uses

func VerifyDNSLength(verify bool) Option

VerifyDNSLength sets whether a Profile should fail if any of the IDN parts are longer than allowed by the RFC.

type Profile Uses

type Profile struct {
    // contains filtered or unexported fields
}

A Profile defines the configuration of an IDNA mapper.

var (
    // Punycode is a Profile that does raw punycode processing with a minimum
    // of validation.
    Punycode *Profile = punycode

    // Lookup is the recommended profile for looking up domain names, according
    // to Section 5 of RFC 5891. The exact configuration of this profile may
    // change over time.
    Lookup *Profile = lookup

    // Display is the recommended profile for displaying domain names.
    // The configuration of this profile may change over time.
    Display *Profile = display

    // Registration is the recommended profile for checking whether a given
    // IDN is valid for registration, according to Section 4 of RFC 5891.
    Registration *Profile = registration
)

Code:

// Raw Punycode has no restrictions and does no mappings.
fmt.Println(idna.ToASCII(""))
fmt.Println(idna.ToASCII("*.faß.com"))
fmt.Println(idna.Punycode.ToASCII("*.faß.com"))

// Rewrite IDN for lookup. This (currently) uses transitional mappings to
// find a balance between IDNA2003 and IDNA2008 compatibility.
fmt.Println(idna.Lookup.ToASCII(""))
fmt.Println(idna.Lookup.ToASCII("www.faß.com"))

// Convert an IDN to ASCII for registration purposes. This changes the
// encoding, but reports an error if the input was illformed.
fmt.Println(idna.Registration.ToASCII(""))
fmt.Println(idna.Registration.ToASCII("www.faß.com"))

Output:

 <nil>
*.xn--fa-hia.com <nil>
*.xn--fa-hia.com <nil>
 <nil>
www.fass.com <nil>
 idna: invalid label ""
www.xn--fa-hia.com <nil>

func New Uses

func New(o ...Option) *Profile

New creates a new Profile.

With no options, the returned Profile is the most permissive and equals the Punycode Profile. Options can be passed to further restrict the Profile. The MapForLookup and ValidateForRegistration options set a collection of options, for lookup and registration purposes respectively, which can be tailored by adding more fine-grained options, where later options override earlier options.

Code:

var p *idna.Profile

// Raw Punycode has no restrictions and does no mappings.
p = idna.New()
fmt.Println(p.ToASCII("*.faß.com"))

// Do mappings. Note that star is not allowed in a DNS lookup.
p = idna.New(
    idna.MapForLookup(),
    idna.Transitional(true)) // Map ß -> ss
fmt.Println(p.ToASCII("*.faß.com"))

// Lookup for registration. Also does not allow '*'.
p = idna.New(idna.ValidateForRegistration())
fmt.Println(p.ToUnicode("*.faß.com"))

// Set up a profile maps for lookup, but allows wild cards.
p = idna.New(
    idna.MapForLookup(),
    idna.Transitional(true),      // Map ß -> ss
    idna.StrictDomainName(false)) // Set more permissive ASCII rules.
fmt.Println(p.ToASCII("*.faß.com"))

Output:

*.xn--fa-hia.com <nil>
*.fass.com idna: disallowed rune U+002A
*.faß.com idna: disallowed rune U+002A
*.fass.com <nil>

func (*Profile) String Uses

func (p *Profile) String() string

String reports a string with a description of the profile for debugging purposes. The string format may change with different versions.

func (*Profile) ToASCII Uses

func (p *Profile) ToASCII(s string) (string, error)

ToASCII converts a domain or domain label to its ASCII form. For example, ToASCII("bücher.example.com") is "xn--bcher-kva.example.com", and ToASCII("golang") is "golang". If an error is encountered it will return an error and a (partially) processed result.

func (*Profile) ToUnicode Uses

func (p *Profile) ToUnicode(s string) (string, error)

ToUnicode converts a domain or domain label to its Unicode form. For example, ToUnicode("xn--bcher-kva.example.com") is "bücher.example.com", and ToUnicode("golang") is "golang". If an error is encountered it will return an error and a (partially) processed result.

Package idna imports 6 packages (graph) and is imported by 65 packages. Updated 2017-09-16. Refresh now. Tools for package owners.