{"id":3262,"date":"2024-11-16T21:49:47","date_gmt":"2024-11-16T12:49:47","guid":{"rendered":"https:\/\/best-biostatistics.com\/toukei-er\/?p=3262"},"modified":"2024-11-16T21:49:50","modified_gmt":"2024-11-16T12:49:50","slug":"how-to-perform-text-mining-in-r-and-create-a-frequency-table-with-n-grams","status":"publish","type":"post","link":"https:\/\/best-biostatistics.com\/toukei-er\/entry\/how-to-perform-text-mining-in-r-and-create-a-frequency-table-with-n-grams\/","title":{"rendered":"R \u3067\u30c6\u30ad\u30b9\u30c8\u30de\u30a4\u30cb\u30f3\u30b0\u3092\u884c\u3044\u983b\u5ea6\u8868\u3092\u4f5c\u6210\u3057 n-gram \u3092\u66f8\u304f\u65b9\u6cd5"},"content":{"rendered":"\n

R \u3067\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u3092\u5358\u8a9e\u306b\u533a\u5207\u308a\u3001\u983b\u5ea6\u8868\u3092\u4f5c\u6210\u3057\u3066\u3001N-gram \u3092\u66f8\u304f\u65b9\u6cd5\u3092\u89e3\u8aac<\/p>\n\n\n\n\n\n\n\n

\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u306e\u8aad\u307f\u8fbc\u307f\u304b\u3089\u983b\u5ea6\u8868\u4f5c\u6210\u307e\u3067<\/h2>\n\n\n\n

\u307e\u305a\u3001\u524d\u63d0\u3068\u3057\u3066\u3001MeCab \u3068 RMeCab \u3092\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u304a\u304f<\/p>\n\n\n\n

MeCab \u3068 RMeCab \u306e\u6e96\u5099\u306b\u3064\u3044\u3066\u306f\u3001\u4ee5\u4e0b\u306e\u95a2\u9023\u8a18\u4e8b\u3092\u53c2\u7167<\/p>\n\n\n

\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\u3042\u308f\u305b\u3066\u8aad\u307f\u305f\u3044<\/span>\n\t\t\t\t\t
\"\"<\/figure><\/div>\t\t\t\t\t
\n\t\t\t\t\t\tR \u3068 MeCab \u3067\u30c6\u30ad\u30b9\u30c8\u30de\u30a4\u30cb\u30f3\u30b0\u3092\u884c\u3046\u65b9\u6cd5<\/a>\n\t\t\t\t\t\tR\u3067\u30c6\u30ad\u30b9\u30c8\u30de\u30a4\u30cb\u30f3\u30b0\u3059\u308b\u3084\u308a\u65b9\u3002 MeCab \u3068 RMeCab \u3092\u4f7f\u3046\u65b9\u6cd5\u3002 \u4f8b\u3068\u3057\u3066\u3001\u30ef\u30fc\u30c9\u30af\u30e9\u30a6\u30c9\u3092\u63cf\u304f\u65b9\u6cd5\u3092\u7d39\u4ecb\u3002 \u30c6\u30ad\u30b9\u30c8\u30de\u30a4\u30cb\u30f3\u30b0\u3068\u306f\uff1f \u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u3092\u540d\u8a5e\u3001\u52d5\u8a5e…<\/span>\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\n\n

\u307e\u305a\u3001\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u3092\u8aad\u307f\u8fbc\u3080<\/p>\n\n\n\n

\u6e96\u5099\u3057\u3066\u3044\u308b\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u306f\u3001\u30a8\u30af\u30bb\u30eb\u3067\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u5165\u529b\u3055\u308c\u3066\u3044\u308b\u3068\u3059\u308b<\/p>\n\n\n\n

\u7a7a\u6c17\u6e05\u6d44\u6a5f\u30fb\u52a0\u6e7f\u5668\u306e\u30ec\u30d3\u30e5\u30fc\u30b3\u30e1\u30f3\u30c8\u3092\u53d6\u308a\u51fa\u3057\u305f\u3082\u306e\u3067\u3042\u308b<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

name \u3068 rating \u304c comment \u306b\u5bfe\u3059\u308b\u5916\u90e8\u5909\u6570\u3067\u3001\u5c5e\u6027\u306a\u3069\u3092\u8868\u3059\u5909\u6570\u3067\u3042\u308b<\/p>\n\n\n\n

comment \u304c\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u3067\u3042\u308b<\/p>\n\n\n\n

\u307e\u305a\u3053\u306e\u30a8\u30af\u30bb\u30eb\u30d5\u30a1\u30a4\u30eb\u3092 Dataset \u3068\u3044\u3046\u540d\u524d\u3067\u8aad\u307f\u8fbc\u3080<\/p>\n\n\n\n

library(readxl)\nDataset <- read_excel(\"20201121 Air Purifier Humidifier Review.xlsx\")<\/code><\/pre>\n\n\n\n
\u3082\u3057\u3001readxl \u30d1\u30c3\u30b1\u30fc\u30b8\u304c\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3055\u308c\u3066\u3044\u306a\u3051\u308c\u3070\u3001install.packages(\"readxl\")<\/code> \u3067\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u304a\u304f<\/p>\n\n\n\n
RMeCab \u30d1\u30c3\u30b1\u30fc\u30b8\u3068 dplyr \u30d1\u30c3\u30b1\u30fc\u30b8\u3082\u547c\u3073\u51fa\u3057\u3066\u304a\u304f<\/p>\n\n\n\n
\u307e\u3060\u3001\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u3044\u306a\u3051\u308c\u3070\u3001\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u304a\u304f<\/p>\n\n\n\n
install.packages(c(\"RMeCab\", \"dplyr\"))<\/code> \u3092\u5b9f\u884c\u3059\u308c\u3070\u3001\u4e00\u5ea6\u306b\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u304f\u308c\u308b<\/p>\n\n\n\n
\u307e\u305a\u3001\u30b3\u30e1\u30f3\u30c8\u5217\u3092\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb temp_file \u3068\u3057\u3066\u4e00\u6642\u4fdd\u5b58\u3059\u308b<\/p>\n\n\n\n
# \u30b3\u30e1\u30f3\u30c8\u5217\u3092\u30c6\u30ad\u30b9\u30c8\u30d5\u30a1\u30a4\u30eb\u3068\u3057\u3066\u4e00\u6642\u4fdd\u5b58\ntemp_file <- tempfile(fileext = \".txt\")\nwriteLines(Dataset$comment, temp_file)<\/code><\/pre>\n\n\n\n
\u6b21\u304c\u3001\u672c\u756a\u3067\u3001docDF \u95a2\u6570\u3067\u8a00\u8449\u306b\u5206\u3051\u308b\u4f5c\u696d\u3092\u884c\u3046<\/p>\n\n\n\n
revi <- docDF(temp_file, type=1, pos=c(\"\u540d\u8a5e\", \"\u5f62\u5bb9\u8a5e\", \"\u52d5\u8a5e\"))\nrevi %>% head(10)<\/code><\/pre>\n\n\n\n
temp_file \u3092 docDF \u306b\u6295\u5165\u3057\u3066\u3001type=1 \uff08\u5f62\u614b\u7d20\uff09\u3067\u5206\u5272\u3057\u3001\u54c1\u8a5e\u306f\u3001\u540d\u8a5e\u30fb\u5f62\u5bb9\u8a5e\u30fb\u52d5\u8a5e\u306e\u307f\u3092\u53d6\u308a\u51fa\u3059\u3088\u3046\u306b\u3057\u3066\u3044\u308b<\/p>\n\n\n\n
\u5f62\u614b\u7d20\u3068\u306f\u3001\u7c21\u5358\u306b\u8a00\u3048\u3070\u300c\u5358\u8a9e\u300d\u3068\u601d\u3048\u3070\u3088\u3044<\/p>\n\n\n\n
head(10) \u3067\u5148\u982d\u306e 10 \u884c\u3092\u8868\u793a\u3057\u3066\u307f\u308b\u3068\u3001\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u51fa\u529b\u3055\u308c\u308b<\/p>\n\n\n\n
> revi %>% head(10)\n   TERM POS1     POS2 file223470863193.txt\n1     ! \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                    1\n2     # \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                    1\n3     % \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                   35\n4    %( \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                    1\n5    %) \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                    1\n6   %\u3001 \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                    1\n7   %\u3002 \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                    1\n8   %\uff5e \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                    1\n9    &# \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                   12\n10    ( \u540d\u8a5e \u30b5\u5909\u63a5\u7d9a                   34<\/code><\/pre>\n\n\n\n
POS1 \u306e\u5217\u3092\u898b\u308b\u3068\u300c\u540d\u8a5e\u300d\u3068\u66f8\u3044\u3066\u3042\u308b\u304c\u3001\u3044\u305a\u308c\u3082\u8a18\u53f7\u3067\u3042\u308a\u3001\u3044\u308f\u3086\u308b\u30a4\u30e1\u30fc\u30b8\u3055\u308c\u308b\u540d\u8a5e\u3067\u306f\u306a\u3044\u3053\u3068\u304c\u308f\u304b\u308b<\/p>\n\n\n\n
\u3044\u308f\u3086\u308b\u540d\u8a5e\u306b\u7d5e\u308b\u5834\u5408\u3001POS2 \u3067\u7d30\u304b\u304f\u6307\u5b9a\u3059\u308b\u5fc5\u8981\u304c\u3042\u308b<\/p>\n\n\n\n
\u540d\u8a5e\u3060\u3051\u3067\u306a\u304f\u3001\u5f62\u5bb9\u8a5e\u3001\u52d5\u8a5e\u3082\u8003\u616e\u3059\u308b\u3068\u3001POS2 \u306b\u3001\u4e00\u822c\u3001\u56fa\u6709\u540d\u8a5e\u3001\u81ea\u7acb\u3068\u66f8\u3044\u3066\u3042\u308b\u8a9e\u304c\u3044\u308f\u3086\u308b\u540d\u8a5e\u30fb\u5f62\u5bb9\u8a5e\u30fb\u52d5\u8a5e\u3067\u3042\u308b<\/p>\n\n\n\n
revi2 <- revi %>% filter(POS2 %in% c(\"\u4e00\u822c\", \"\u56fa\u6709\u540d\u8a5e\", \"\u81ea\u7acb\"))\nrevi2 %>% arrange(desc(file223470863193.txt)) %>% head(10)<\/code><\/pre>\n\n\n\n
\u591a\u3044\u983b\u5ea6\u9806\u306b\u5148\u982d\u304b\u3089 10 \u884c\u3092\u8868\u793a\u3059\u308b\u3068\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u306a\u308b<\/p>\n\n\n\n
\u3059\u308b\u3001\u306a\u308b\u3001\u601d\u3046\u3001\u3042\u308b\u306a\u3069\u3042\u308a\u3075\u308c\u305f\u52d5\u8a5e\u304c\u3082\u3063\u3068\u3082\u591a\u3044\u306e\u304c\u308f\u304b\u308b<\/p>\n\n\n\n
> revi2 %>% arrange(desc(file223470863193.txt)) %>% head(10)\n     TERM   POS1 POS2 file223470863193.txt\n329  \u3059\u308b   \u52d5\u8a5e \u81ea\u7acb                  991\n407  \u306a\u308b   \u52d5\u8a5e \u81ea\u7acb                  235\n1503 \u601d\u3046   \u52d5\u8a5e \u81ea\u7acb                  168\n196  \u3042\u308b   \u52d5\u8a5e \u81ea\u7acb                  159\n2065 \u7a7a\u6c17   \u540d\u8a5e \u4e00\u822c                  154\n1814   \u6c34   \u540d\u8a5e \u4e00\u822c                  140\n990  \u4f7f\u3046   \u52d5\u8a5e \u81ea\u7acb                  124\n1882 \u6e7f\u5ea6   \u540d\u8a5e \u4e00\u822c                  119\n399  \u306a\u3044 \u5f62\u5bb9\u8a5e \u81ea\u7acb                   98\n2181 \u826f\u3044 \u5f62\u5bb9\u8a5e \u81ea\u7acb                   87<\/code><\/pre>\n\n\n\n
\u3053\u3053\u3067\u3001arrange \u306f\u4e26\u3073\u66ff\u3048\u306e\u95a2\u6570\u3067\u3042\u308b<\/p>\n\n\n\n
desc \u306f\u964d\u9806\uff08\u591a\u3044\u3082\u306e\u9806\uff09\u306b\u4e26\u3079\u308b\u95a2\u6570<\/p>\n\n\n\n
file223470863193.txt \u306f\u3001\u4e00\u6642\u30d5\u30a1\u30a4\u30eb\u306b\u4fdd\u5b58\u3057\u305f\u3068\u304d\u306b\u3064\u3044\u305f\u30e9\u30f3\u30c0\u30e0\u306a\u30d5\u30a1\u30a4\u30eb\u540d\u3067\u3001\u3053\u306e\u540d\u524d\u306e\u5909\u6570\u304c\u51fa\u73fe\u983b\u5ea6\u306e\u5909\u6570\u540d\u306b\u306a\u3063\u3066\u3044\u308b<\/p>\n\n\n\n
\u3053\u306e\u983b\u5ea6\u5217\u540d\u306f\u3001\u4e00\u6642\u4fdd\u5b58\u3057\u3066\u8aad\u307f\u8fbc\u3093\u3060\u30d5\u30a1\u30a4\u30eb\u540d\uff08\u81ea\u52d5\u4ed8\u4e0e\u3055\u308c\u3066\u3044\u308b\uff09\u306b\u3088\u3063\u3066\u7570\u306a\u308b\u306e\u3067\u3001\u307e\u305a\u306f\u3001docDF \u306e\u7d50\u679c\u30aa\u30d6\u30b8\u30a7\u30af\u30c8\uff08\u30c7\u30fc\u30bf\u30d5\u30ec\u30fc\u30e0\u306b\u306a\u3063\u3066\u3044\u308b\uff09\u3092\u958b\u304f\u306a\u3069\u3057\u3066\u3001\u5909\u6570\u540d\u3092\u78ba\u8a8d\u3057\u3066\u304a\u304f\u306e\u304c\u826f\u3044<\/p>\n\n\n\n
\u307e\u305f\u3001\u3053\u3053\u3067\u306f\u3001head(10)<\/code> \u3068\u3057\u3066 10 \u884c\u3060\u3051\u3092\u8868\u793a\u3055\u305b\u305f\u304c\u3001head(50) \u306a\u3069\u6570\u5024\u3092\u5927\u304d\u304f\u3059\u308b\u304b\u3001\u4f55\u3082\u6307\u5b9a\u3057\u306a\u3051\u308c\u3070\u3001\u3082\u3063\u3068\u591a\u304f\u306e\u5358\u8a9e\u306e\u983b\u5ea6\u304c\u51fa\u529b\u3055\u308c\u308b<\/p>\n\n\n\n
N-gram \u3092\u66f8\u304f\u65b9\u6cd5 \u30d0\u30a4\u30b0\u30e9\u30e0\u3092\u4f8b\u306b<\/h2>\n\n\n\n
\u6b21\u306b\u3001n-gram\uff08N \u30b0\u30e9\u30e0\uff09\u3092\u751f\u6210\u3057\u3066\u3001\u30b0\u30e9\u30d5\u3092\u63cf\u304f\u65b9\u6cd5\u3092\u7d39\u4ecb\u3059\u308b<\/p>\n\n\n\n
N-gram \u306f\u5358\u8a9e\u306e\u9023\u306a\u308a\u3092\u610f\u5473\u3057\u3066\u3044\u3066\u3001\u4e00\u822c\u7684\u306b\u306f 2 \u3064\uff08\u30d0\u30a4\u30b0\u30e9\u30e0\uff09\u307e\u305f\u306f\u3001 3 \u3064\uff08\u30c8\u30ea\u30b0\u30e9\u30e0\uff09\u306e\u9023\u306a\u308a\u3092\u89e3\u6790\u3059\u308b<\/p>\n\n\n\n
\u3053\u3053\u3067\u306f\u3001\u4e00\u756a\u30b7\u30f3\u30d7\u30eb\u306a\u30d0\u30a4\u30b0\u30e9\u30e0\u3092\u751f\u6210\u3057\u3001\u30b0\u30e9\u30d5\u306b\u3057\u3066\u307f\u308b<\/p>\n\n\n\n
\u307e\u305a\u3001\u30d0\u30a4\u30b0\u30e9\u30e0\u3092\u751f\u6210\u3059\u308b\u306b\u306f\u3001\u4ee5\u4e0b\u306e\u3088\u3046\u306a\u30b9\u30af\u30ea\u30d7\u30c8\u3092\u66f8\u3044\u3066\u5b9f\u884c\u3059\u308b<\/p>\n\n\n\n
bigram <- docDF(temp_file, type=1, nDF=1, N=2, \n                pos=c(\"\u540d\u8a5e\", \"\u5f62\u5bb9\u8a5e\", \"\u52d5\u8a5e\")) %>% \n  filter(POS2 %in% c(\"\u4e00\u822c-\u4e00\u822c\",\"\u4e00\u822c-\u81ea\u7acb\", \"\u81ea\u7acb-\u4e00\u822c\", \n                     \"\u56fa\u6709\u540d\u8a5e-\u56fa\u6709\u540d\u8a5e\", \"\u56fa\u6709\u540d\u8a5e-\u81ea\u7acb\", \"\u81ea\u7acb-\u56fa\u6709\u540d\u8a5e\",\n                     \"\u4e00\u822c-\u56fa\u6709\u540d\u8a5e\", \"\u56fa\u6709\u540d\u8a5e-\u4e00\u822c\"))<\/code><\/pre>\n\n\n\n
docDF \u95a2\u6570\u3092\u4f7f\u3046\u306e\u306f\u3001\u983b\u5ea6\u8868\u3068\u540c\u3058\u3067\u3042\u308b<\/p>\n\n\n\n
type=1 \u306f\u3001\u5f62\u614b\u7d20\uff08\u3044\u308f\u3086\u308b\u5358\u8a9e\uff09\u3067\u5206\u6790\u3059\u308b\u3068\u3044\u3046\u6307\u5b9a\u3067\u3042\u308b<\/p>\n\n\n\n
nDF=1 \u306f\u3001\u5358\u8a9e\u3054\u3068\u306b\u5217\u3092\u72ec\u7acb\u3055\u305b\u305f\u30c7\u30fc\u30bf\u30d5\u30ec\u30fc\u30e0\u3092\u4f5c\u6210\u3059\u308b\u6307\u5b9a\u3067\u3042\u308b<\/p>\n\n\n\n
N=2 \u306f\u30012 \u3064\u306e\u5358\u8a9e\u306e\u9023\u306a\u308a\u3001\u30d0\u30a4\u30b0\u30e9\u30e0\u3092\u751f\u6210\u3059\u308b\u6307\u5b9a\u3067\u3042\u308b<\/p>\n\n\n\n
\u305d\u3057\u3066\u3001\u3053\u3061\u3089\u3067\u3082\u3001\u540d\u8a5e\u30fb\u5f62\u5bb9\u8a5e\u30fb\u52d5\u8a5e\u306b\u9650\u3063\u3066\u3044\u308b<\/p>\n\n\n\n
\u3055\u3089\u306b\u3001POS2 \u306b\u3001\u30d0\u30a4\u30b0\u30e9\u30e0\u306e\u54c1\u8a5e\u306e\u7d44\u307f\u5408\u308f\u305b\u304c\u3042\u308b\u306e\u3067\u3001\u305d\u306e\u7d44\u307f\u5408\u308f\u305b\u3067\u5fc5\u8981\u306a\u7d44\u307f\u5408\u308f\u305b\u306b\u7d5e\u3063\u3066\u3044\u308b<\/p>\n\n\n\n
\u4f8b\u3048\u3070\u3001\u4e00\u822c-\u4e00\u822c\u306f\u3001\u4e00\u822c\u540d\u8a5e\u3068\u4e00\u822c\u52d5\u8a5e\u3001\u4e00\u822c\u5f62\u5bb9\u8a5e\u3068\u4e00\u822c\u540d\u8a5e\u3001\u3068\u3044\u3046\u7d44\u307f\u5408\u308f\u305b\u3092\u610f\u5473\u3057\u3066\u3044\u308b<\/p>\n\n\n\n
\u751f\u6210\u3055\u308c\u305f\u30d0\u30a4\u30b0\u30e9\u30e0\u306e\u5148\u982d 25 \u884c\u3068 \u6700\u5f8c\u5c3e\u306e 25 \u884c\u3092\u898b\u3066\u307f\u308b\u5834\u5408\u3001\u4ee5\u4e0b\u306e\u30b9\u30af\u30ea\u30d7\u30c8\u3067\u8868\u793a\u3067\u304d\u308b<\/p>\n\n\n\n
bigram %>% arrange(file223470863193.txt) %>% head(25)\nbigram %>% arrange(file223470863193.txt) %>% tail(25)<\/code><\/pre>\n\n\n\n
arrange \u5185\u306b desc \u3092\u52a0\u3048\u306a\u3044\u3068\u6607\u9806\uff08\u5c11\u306a\u3044\u3082\u306e\u9806\uff09\u306b\u4e26\u3076<\/p>\n\n\n\n
\u5148\u982d\u306f\u30011 \u4ef6\u3070\u304b\u308a\u3067\u3042\u308b<\/p>\n\n\n\n
> bigram %>% arrange(file223470863193.txt) %>% head(25)\n        N1       N2        POS1              POS2 file223470863193.txt\n387     CM     \u8a00\u3046   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    1\n388     CM   \u99b4\u67d3\u307f   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n392     HP       \u6c34   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n398    LDK     \u5e83\u3044 \u540d\u8a5e-\u5f62\u5bb9\u8a5e     \u56fa\u6709\u540d\u8a5e-\u81ea\u7acb                    1\n399    LED     \u5149\u91cf   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n401    MAX     \u3059\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    1\n402    MAX \u30d2\u30fc\u30bf\u30fc   \u540d\u8a5e-\u540d\u8a5e     \u56fa\u6709\u540d\u8a5e-\u4e00\u822c                    1\n403    MAX     \u4f7f\u3046   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    1\n406    OFF     \u3059\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    1\n407    OFF \u30af\u30fc\u30dd\u30f3   \u540d\u8a5e-\u540d\u8a5e     \u56fa\u6709\u540d\u8a5e-\u4e00\u822c                    1\n409     OH \u30e9\u30b8\u30ab\u30eb   \u540d\u8a5e-\u540d\u8a5e     \u56fa\u6709\u540d\u8a5e-\u4e00\u822c                    1\n410     ON      OFF   \u540d\u8a5e-\u540d\u8a5e     \u56fa\u6709\u540d\u8a5e-\u4e00\u822c                    1\n413     PC       TV   \u540d\u8a5e-\u540d\u8a5e \u56fa\u6709\u540d\u8a5e-\u56fa\u6709\u540d\u8a5e                    1\n416   Pana     \u8cb7\u3046   \u540d\u8a5e-\u52d5\u8a5e     \u56fa\u6709\u540d\u8a5e-\u81ea\u7acb                    1\n417  SHARP     \u578b\u756a   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n424     TV     \uff74\uff71\uff7a\uff9d   \u540d\u8a5e-\u540d\u8a5e     \u56fa\u6709\u540d\u8a5e-\u4e00\u822c                    1\n426   VAPE       \u7a93   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n427      W \u30db\u30ef\u30a4\u30c8   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n431    and   \u30b3\u30ed\u30ca   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n432     cm     \u96e2\u3059   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    1\n433     cm     \u96e2\u3059   \u540d\u8a5e-\u52d5\u8a5e     \u56fa\u6709\u540d\u8a5e-\u81ea\u7acb                    1\n434     cm     \u9ad8\u3044 \u540d\u8a5e-\u5f62\u5bb9\u8a5e         \u4e00\u822c-\u81ea\u7acb                    1\n435     dB     \u4f4e\u3044 \u540d\u8a5e-\u5f62\u5bb9\u8a5e         \u4e00\u822c-\u81ea\u7acb                    1\n437      h     \u3064\u3051   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1\n461 \u3042\u305f\u308a     \u5916\u308c   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    1<\/code><\/pre>\n\n\n\n
\u6700\u5f8c\u5c3e\u306f\u3001\u767b\u5834\u56de\u6570\u304c\u591a\u3044\u9023\u306a\u308a\u304c\u4e26\u3076<\/p>\n\n\n\n
> bigram %>% arrange(file223470863193.txt) %>% tail(25)\n             N1       N2        POS1              POS2 file223470863193.txt\n7436         \u6c34 \u3053\u307c\u308c\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    5\n7468         \u6c34     \u6e1b\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    5\n9400       \u90e8\u5c4b     \u7a7a\u6c17   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    5\n9670         \u97f3   \u5927\u304d\u3044 \u540d\u8a5e-\u5f62\u5bb9\u8a5e         \u4e00\u822c-\u81ea\u7acb                    5\n411          ON     \u3059\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    6\n1649       \u3059\u308b       \u97f3   \u52d5\u8a5e-\u540d\u8a5e         \u81ea\u7acb-\u4e00\u822c                    6\n2939       \u30b3\u30b9       \u30d1   \u540d\u8a5e-\u540d\u8a5e \u56fa\u6709\u540d\u8a5e-\u56fa\u6709\u540d\u8a5e                    6\n4918       \u52b9\u679c     \u3042\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    6\n7448         \u6c34     \u5165\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    6\n7675       \u6e7f\u5ea6   \u4e0a\u304c\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    6\n9569       \u96fb\u6e90   \u5165\u308c\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    6\n1589       \u3059\u308b     \u6e7f\u5ea6   \u52d5\u8a5e-\u540d\u8a5e         \u81ea\u7acb-\u4e00\u822c                    7\n2958 \u30b3\u30f3\u30bb\u30f3\u30c8     \u629c\u304f   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    7\n3153     \u30bf\u30d0\u30b3     \u5438\u3046   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    7\n1583       \u3059\u308b       \u6c34   \u52d5\u8a5e-\u540d\u8a5e         \u81ea\u7acb-\u4e00\u822c                    8\n5216       \u5546\u54c1     \u5c4a\u304f   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                    9\n9677         \u97f3       \u6c17   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                    9\n9570       \u96fb\u6e90     \u5207\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                   10\n3110     \u30bb\u30c3\u30c8     \u3059\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                   11\n3194     \u30bf\u30f3\u30af       \u6c34   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                   12\n7443         \u6c34   \u30bf\u30f3\u30af   \u540d\u8a5e-\u540d\u8a5e         \u4e00\u822c-\u4e00\u822c                   13\n9568       \u96fb\u6e90     \u5165\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                   14\n9653         \u97f3     \u3059\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                   17\n7450         \u6c34   \u5165\u308c\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                   31\n7396         \u6c17     \u306a\u308b   \u540d\u8a5e-\u52d5\u8a5e         \u4e00\u822c-\u81ea\u7acb                   48<\/code><\/pre>\n\n\n\n
\u30d0\u30a4\u30b0\u30e9\u30e0\u5168\u4f53\u306e\u96c6\u8a08\u3082\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u3059\u308b\u3068\u78ba\u8a8d\u3067\u304d\u308b<\/p>\n\n\n\n
bigram %>% NROW()\nbigram %>% group_by(POS2) %>% \n  summarize(SUM = sum(file223470863193.txt))<\/code><\/pre>\n\n\n\n
\u30d0\u30a4\u30b0\u30e9\u30e0\u306e\u7a2e\u985e\u3068\u3057\u3066\u306f\u30012404 \u7a2e\u985e\u306e\u9023\u306a\u308a\u304c\u3042\u3063\u305f<\/p>\n\n\n\n
> bigram %>% NROW()\n[1] 2404<\/code><\/pre>\n\n\n\n
POS2 \u306e\u9023\u306a\u308a\u306e\u7a2e\u985e\u3067\u96c6\u8a08\u3059\u308b\u3068\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u306a\u3063\u305f<\/p>\n\n\n\n
> bigram %>% group_by(POS2) %>% \n+   summarize(SUM = sum(file223470863193.txt))\n# A tibble: 8 \u00d7 2\n  POS2                SUM\n  <chr>             <int>\n1 \u4e00\u822c-\u4e00\u822c           867\n2 \u4e00\u822c-\u56fa\u6709\u540d\u8a5e        19\n3 \u4e00\u822c-\u81ea\u7acb          1230\n4 \u56fa\u6709\u540d\u8a5e-\u4e00\u822c        32\n5 \u56fa\u6709\u540d\u8a5e-\u56fa\u6709\u540d\u8a5e     9\n6 \u56fa\u6709\u540d\u8a5e-\u81ea\u7acb        18\n7 \u81ea\u7acb-\u4e00\u822c           777\n8 \u81ea\u7acb-\u56fa\u6709\u540d\u8a5e        20<\/code><\/pre>\n\n\n\n
\u4e00\u822c-\u81ea\u7acb \u304c\u6700\u3082\u591a\u304f\u3001\u4e00\u822c\u540d\u8a5e\u3068\u81ea\u7acb\u52d5\u8a5e\uff08\u4f8b\uff1a\u6c34\u3092\u5165\u308c\u308b \u306a\u3069\uff09\u306e\u7d44\u307f\u5408\u308f\u305b\u304c\u591a\u304b\u3063\u305f\u3082\u306e\u3068\u601d\u3046<\/p>\n\n\n\n
\u751f\u6210\u3057\u305f n-gram \u3092\u30b0\u30e9\u30d5\u306b\u3059\u308b\u65b9\u6cd5<\/h3>\n\n\n\n
\u4e0a\u8a18\u306e\u30d0\u30a4\u30b0\u30e9\u30e0\u306e\u6700\u5f8c\u5c3e\u3092\u898b\u308b\u3068\u3001\u6700\u5927\u3067 48 \u56de\u51fa\u73fe\uff08\u6c17 \u306a\u308b\uff09\u3067\u30016 \u56de\u4ee5\u4e0a\u306b\u7d5e\u308b\u3068\u3001\u7279\u5fb4\u7684\u306a\u30d0\u30a4\u30b0\u30e9\u30e0\u306e\u307f\u306b\u3067\u304d\u308b\u3068\u601d\u308f\u308c\u308b<\/p>\n\n\n\n
\u4eca\u56de\u306f\u30015 \u56de\u3092\u8d85\u3048\u3066\u767b\u5834\u3057\u305f\u30d0\u30a4\u30b0\u30e9\u30e0\u306b\u7d5e\u3063\u3066\u3001\u30cd\u30c3\u30c8\u30ef\u30fc\u30af\u30b0\u30e9\u30d5\u3092\u63cf\u3044\u3066\u307f\u3088\u3046\u3068\u601d\u3046<\/p>\n\n\n\n
bigram2 <- bigram %>% select(N1, N2, file223470863193.txt) %>%\n  filter(file223470863193.txt > 5)\nbigram2 %>% arrange(file223470863193.txt) \nbigram2 %>% NROW()<\/code><\/pre>\n\n\n\n
21 \u500b\u306e\u9023\u306a\u308a\u304c\u62bd\u51fa\u3055\u308c\u305f<\/p>\n\n\n\n
> bigram2 %>% arrange(file223470863193.txt) \n             N1     N2 file223470863193.txt\n411          ON   \u3059\u308b                    6\n1649       \u3059\u308b     \u97f3                    6\n2939       \u30b3\u30b9     \u30d1                    6\n4918       \u52b9\u679c   \u3042\u308b                    6\n7448         \u6c34   \u5165\u308b                    6\n7675       \u6e7f\u5ea6 \u4e0a\u304c\u308b                    6\n9569       \u96fb\u6e90 \u5165\u308c\u308b                    6\n1589       \u3059\u308b   \u6e7f\u5ea6                    7\n2958 \u30b3\u30f3\u30bb\u30f3\u30c8   \u629c\u304f                    7\n3153     \u30bf\u30d0\u30b3   \u5438\u3046                    7\n1583       \u3059\u308b     \u6c34                    8\n5216       \u5546\u54c1   \u5c4a\u304f                    9\n9677         \u97f3     \u6c17                    9\n9570       \u96fb\u6e90   \u5207\u308b                   10\n3110     \u30bb\u30c3\u30c8   \u3059\u308b                   11\n3194     \u30bf\u30f3\u30af     \u6c34                   12\n7443         \u6c34 \u30bf\u30f3\u30af                   13\n9568       \u96fb\u6e90   \u5165\u308b                   14\n9653         \u97f3   \u3059\u308b                   17\n7450         \u6c34 \u5165\u308c\u308b                   31\n7396         \u6c17   \u306a\u308b                   48\n> bigram2 %>% NROW()\n[1] 21<\/code><\/pre>\n\n\n\n
\u30b0\u30e9\u30d5\u306f\u3001igraph \u3068 ggraph \u3068\u3044\u3046\u30d1\u30c3\u30b1\u30fc\u30b8\u3092\u4f7f\u7528\u3059\u308b<\/p>\n\n\n\n
\u307e\u3060\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3057\u3066\u3044\u306a\u3051\u308c\u3070\u3001install.packages(c(\"igraph\", \"ggraph\"))<\/code> \u3092\u5b9f\u884c\u3057\u3066\u30a4\u30f3\u30b9\u30c8\u30fc\u30eb\u3059\u308b<\/p>\n\n\n\n
library(igraph)\nbigramN <- graph_from_data_frame(bigram2)\nprint(bigramN)<\/code><\/pre>\n\n\n\n
graph_from_data_frame \u3067\u30d0\u30a4\u30b0\u30e9\u30e0\u30c7\u30fc\u30bf\u3092\u30b0\u30e9\u30d5\u30c7\u30fc\u30bf\u306b\u5909\u63db\u3059\u308b<\/p>\n\n\n\n
print \u3059\u308b\u3068\u4ee5\u4e0b\u306e\u3088\u3046\u306b\u51fa\u529b\u3055\u308c\u308b<\/p>\n\n\n\n
> print(bigramN)\nIGRAPH 726aaa8 DN-- 24 21 -- \n+ attr: name (v\/c), file223470863193.txt (e\/n)\n+ edges from 726aaa8 (vertex names):\n [1] ON        ->\u3059\u308b   \u3059\u308b      ->\u6c34     \u3059\u308b      ->\u6e7f\u5ea6   \u3059\u308b      ->\u97f3     \u30b3\u30b9      ->\u30d1     \u30b3\u30f3\u30bb\u30f3\u30c8->\u629c\u304f   \u30bb\u30c3\u30c8    ->\u3059\u308b  \n [8] \u30bf\u30d0\u30b3    ->\u5438\u3046   \u30bf\u30f3\u30af    ->\u6c34     \u52b9\u679c      ->\u3042\u308b   \u5546\u54c1      ->\u5c4a\u304f   \u6c17        ->\u306a\u308b   \u6c34        ->\u30bf\u30f3\u30af \u6c34        ->\u5165\u308b  \n[15] \u6c34        ->\u5165\u308c\u308b \u6e7f\u5ea6      ->\u4e0a\u304c\u308b \u96fb\u6e90      ->\u5165\u308b   \u96fb\u6e90      ->\u5165\u308c\u308b \u96fb\u6e90      ->\u5207\u308b   \u97f3        ->\u3059\u308b   \u97f3        ->\u6c17    <\/code><\/pre>\n\n\n\n
\u3053\u308c\u306f\u77e2\u5370\u306e\u6839\u5143\u304b\u3089\u77e2\u5370\u306e\u77e2\u306e\u65b9\u5411\u306b\u6d41\u308c\u308b\u9023\u306a\u308a\u3068\u3044\u3046\u300c\u3064\u306a\u304c\u308a\u300d\u3067\u3042\u308b\u3053\u3068\u3092\u793a\u3057\u3066\u3044\u308b<\/p>\n\n\n\n
\u3053\u306e\u3064\u306a\u304c\u308a\u3092 plot \u3067\u30b0\u30e9\u30d5\u306b\u3059\u308b<\/p>\n\n\n\n
vertex.color \u306f \u30ce\u30fc\u30c9\uff08\u3053\u306e\u5834\u5408\u306f\u5358\u8a9e\uff09\u306e\u8272\u3067\u3042\u308a\u3001vertex.size \u306f\u30ce\u30fc\u30c9\u306e\u4e38\u306e\u5927\u304d\u3055\u3067\u3042\u308b<\/p>\n\n\n\n
library(ggraph)\nplot(bigramN, vertex.color=\"SkyBlue\", vertex.size=18)<\/code><\/pre>\n\n\n\n
\u9023\u306a\u308a\u306e\u5143\u3068\u5148\u304c\u308f\u304b\u308b\u3088\u3046\u306a\u77e2\u5370\u304c\u4ed8\u3044\u3066\u3044\u308b<\/p>\n\n\n\n
\u300c\u3059\u308b\u300d\u306b\u306f\u3055\u307e\u3056\u307e\u306a\u8a9e\u304b\u3089\u9023\u306a\u3063\u3066\u3044\u308b\u306e\u304c\u308f\u304b\u308b\u3057\u3001\u300c\u6c34\u300d\u3084\u300c\u96fb\u6e90\u300d\u306f\u3044\u308d\u3044\u308d\u306a\u8a9e\u306b\u9023\u306a\u3063\u3066\u3044\u304f\u3055\u307e\u304c\u308f\u304b\u308b<\/p>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\uff1e\uff1e\u3082\u3046\u7d71\u8a08\u3067\u60a9\u3080\u306e\u306f\u7d42\u308f\u308a\u306b\u3057\u307e\u305b\u3093\u304b\uff1f\u00a0<\/a><\/strong><\/span><\/p>\r\n\"\"<\/a>\r\n
\u21911\u4e07\u4eba\u4ee5\u4e0a\u306e\u533b\u7642\u5f93\u4e8b\u8005\u304c\u8cfc\u8aad\u4e2d<\/span><\/strong><\/span><\/p><\/div>
\u307e\u3068\u3081<\/h2>\n\n\n\n
R \u3067 RMeCab \u3092\u7528\u3044\u3066\u3001\u5f62\u614b\u7d20\uff08\u5358\u8a9e\uff09\u89e3\u6790\u3092\u884c\u3044\u3001\u983b\u5ea6\u8868\u3092\u51fa\u529b\u3057\u3001\u30d0\u30a4\u30b0\u30e9\u30e0\u3092\u751f\u6210\u3057\u3001\u30b0\u30e9\u30d5\u3092\u63cf\u304f\u65b9\u6cd5\u3092\u7d39\u4ecb\u3057\u305f<\/p>\n\n\n\n
\u53c2\u8003\u306b\u306a\u308c\u3070<\/p>\n\n\n\n
\u53c2\u8003\u66f8\u7c4d<\/h2>\n\n\n\n
R\u306b\u3088\u308b\u30c6\u30ad\u30b9\u30c8\u30de\u30a4\u30cb\u30f3\u30b0\u5165\u9580(\u7b2c2\u7248)<\/a><\/p>\n\n\n\n\n","protected":false},"excerpt":{"rendered":"
R \u3067\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u3092\u5358\u8a9e\u306b\u533a\u5207\u308a\u3001\u983b\u5ea6\u8868\u3092\u4f5c\u6210\u3057\u3066\u3001N-gram \u3092\u66f8\u304f\u65b9\u6cd5\u3092\u89e3\u8aac<\/p>\n","protected":false},"author":2,"featured_media":3268,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"swell_btn_cv_data":"","_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[63,5,93],"tags":[],"class_list":["post-3262","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-igraph","category-r","category-93"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/best-biostatistics.com\/toukei-er\/wp-content\/uploads\/2024\/11\/\u30b9\u30af\u30ea\u30fc\u30f3\u30b7\u30e7\u30c3\u30c8-2024-11-16-213724.png","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/posts\/3262","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/comments?post=3262"}],"version-history":[{"count":2,"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/posts\/3262\/revisions"}],"predecessor-version":[{"id":3269,"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/posts\/3262\/revisions\/3269"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/media\/3268"}],"wp:attachment":[{"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/media?parent=3262"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/categories?post=3262"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/best-biostatistics.com\/toukei-er\/wp-json\/wp\/v2\/tags?post=3262"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}