Tidy Tools for Chinese, Japanese and Korean Text


[Up] [Top]

Documentation for package ‘tidycjk’ version 0.2.0

Help Pages

cjk_blocks The Unicode blocks 'tidycjk' recognises
cjk_char_counts Count the CJK characters in a text column
cjk_compose_jamo Decompose and recompose Hangul syllables
cjk_detect_language Which language is the text written in?
cjk_jamo Decompose and recompose Hangul syllables
cjk_ngrams Character n-grams
cjk_normalize Apply Unicode normalisation
cjk_order Sort CJK text by pronunciation or stroke
cjk_pad Pad text to a display width
cjk_ratio What share of the text is CJK?
cjk_romanize Romanise CJK text
cjk_script Which CJK script dominates the text?
cjk_segment Split CJK text into words
cjk_segmenters Segmentation engines
cjk_sentences Split text into sentences
cjk_simplify Convert between simplified and traditional Han
cjk_sort Sort CJK text by pronunciation or stroke
cjk_strip_punct Remove punctuation from CJK text
cjk_summary Summarise CJK content in a text column
cjk_tokens One row per token
cjk_traditionalize Convert between simplified and traditional Han
cjk_truncate Truncate text to a display width
cjk_width Display width in terminal columns
cjk_wrap Wrap text to a display width
has_cjk Does the text contain CJK characters?
register_cjk_segmenter Segmentation engines
to_fullwidth Normalise fullwidth and halfwidth forms
to_halfwidth Normalise fullwidth and halfwidth forms
to_hiragana Convert between hiragana and katakana
to_katakana Convert between hiragana and katakana