Documentation
¶
Overview ¶
Package segmentation exposes the locale tags supported by the embedded segmenter.
Segmenter boundaries are computed by github.com/rivo/uniseg using Unicode Standard Annex #29 algorithms. The boundary algorithm itself is locale-independent; this list mirrors the locales we actively conformance-test.
Package segmentation exposes text segmentation backend capabilities.
It keeps supported-locale claims tied to the active Unicode segmentation implementation instead of advertising unsupported dictionary behavior.
Only the Segmenter implementation should use this package; public callers use segmenter APIs.
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
func SupportedLocales ¶
func SupportedLocales() []string
SupportedLocales returns locale tags whose active word/sentence boundaries do not require dictionary or locale-specific tailoring beyond UAX #29 defaults.
Types ¶
This section is empty.
Source Files