1
0

index.html 69 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586587588589590591592593594595596597598599600601602603604605606607608609610611612613614615616617618619620621622623624625626627628629630631632633634635636637638639640641642643644645646647648649650651652653654655656657658659660661662663664665666667668669670671672673674675676677678679680681682683684685686687688689690691692693694695696697698699700701702703704705706707708709710711712713714715716717718719720721722723724725726727728729730731732733734735736737738739740741742743744745746747748749750751752753754755756757758759760761762763764765766767768769770771772773774775776777778779780781782783784785786787788789790791792793794795796797798799800801802803804805806807808809810811812813814815816817818819820821822823824825826827828829830831832833834835836837838839840841842843844845846847848849850851852853854855856857858859860861862863864865866867868869870871872873874875876877878879880881882883884885886887888889890891892893894895896897898899900901902903904905906907908909910911912913914915916917918919920921922923924925926927928929930931932933934935936937938939940941942943944945946947948949950951952953954955
  1. <!DOCTYPE html>
  2. <html>
  3. <head>
  4. <title>Deep Learning in R</title>
  5. <meta charset="utf-8">
  6. <meta name="author" content="metya" />
  7. <meta name="date" content="2018-12-08" />
  8. <link href="libs/pagedtable/css/pagedtable.css" rel="stylesheet" />
  9. <script src="libs/pagedtable/js/pagedtable.js"></script>
  10. <link rel="stylesheet" href="xaringan-themer.css" type="text/css" />
  11. </head>
  12. <body>
  13. <textarea id="source">
  14. class: center, middle, inverse, title-slide
  15. # Deep Learning in R
  16. ## ░ <br/>Обзор фреймворков с примерами
  17. ### metya
  18. ### 2018-12-08
  19. ---
  20. class: center, middle
  21. background-color: #8d6e63
  22. #Disclaimer
  23. Цель доклада не дать понимаение что такое глубокое обучение и детально разобрать как работать с ним и обучать современные модели, а скорее показать как просто можно начать тем, кто давно хотел и чесались руки, но все было никак не взяться
  24. ---
  25. # Deep Learning
  26. ## Что это?
  27. --
  28. * Когда у нас есть исскуственная нейронная сеть
  29. --
  30. * Когда скрытых слоев в этой сети больше чем два
  31. --
  32. ![](https://cdn-images-1.medium.com/max/1600/1*dnvGC-PORSoCo7VXT3PV_A.png)
  33. .footnotes[[1] https://machinelearningmastery.com/what-is-deep-learning/]
  34. ---
  35. ## Как это математически
  36. ![](Deep_Learning_in_R_files/perceptron.png)
  37. ???
  38. На самом деле это конечно самый простой юнит, самый базовый.
  39. ---
  40. background-image: url(https://3qeqpr26caki16dnhd19sv6by6v-wpengine.netdna-ssl.com/wp-content/uploads/2016/08/Why-Deep-Learning-1024x742.png)
  41. ???
  42. Image credit: [Andrew Ng](http://www.slideshare.net/ExtractConf)
  43. ---
  44. class: inverse, center, middle, title-slide
  45. # Frameworks
  46. ---
  47. ![](https://cdn-images-1.medium.com/max/1600/1*s_BwkYxpGv34vjOHi8tDzg.png)
  48. .footnotes[
  49. [1] https://towardsdatascience.com/deep-learning-framework-power-scores-2018-23607ddf297a
  50. ]
  51. ---
  52. ## Нас интересуют только те, что есть в R через API
  53. --
  54. * ###TensorFlow
  55. --
  56. * ###theano
  57. --
  58. * ###Keras
  59. --
  60. * ###CNTK
  61. --
  62. * ###MXNet
  63. --
  64. * ###ONNX
  65. ---
  66. ## Есть еше несколько пакетов
  67. * darch (removed from cran)
  68. * deepnet
  69. * deepr
  70. * H2O (interface) ([Tutorial](https://htmlpreview.github.io/?https://github.com/ledell/sldm4-h2o/blob/master/sldm4-deeplearning-h2o.html))
  71. ???
  72. Вода это по большей части МЛ фреймворк, с недавних пор, где появился модуль про глубокое обучение. Есть неплохой туториал для р пакета. Умеет в поиск гиперпараметров, кроссвалидацию и прочие нужные для МЛ штуки для сеток, очевидно это работает только для маленьких сетей)
  73. Но они р специфичны, кроме воды, и соотвественно медленные, да и умеют довольно мало. Новые годные архитектуры сетей туда не имплементированы.
  74. ---
  75. ![](https://cdn-images-1.medium.com/max/1600/1*zmMOdVZ_j9vwMcpdD8Uceg.png)
  76. https://www.tensorflow.org/
  77. https://tensorflow.rstudio.com/
  78. - Делает Google
  79. - Самый популярный, имеет тучу туториалов и книг
  80. - Имеет самый большой спрос у продакшн систем
  81. - Имеет API во множестве языков
  82. - Имеет статический граф вычислений, что бывает неудобно, зато оптимизированно
  83. - Примерно с лета имеет фичу **eager execution**, который почти нивелирует это неудобство. Но почти не считается
  84. - Доступен в R как самостоятельно, так и как бэкэнд Keras
  85. ---
  86. ![](https://cdn-images-1.medium.com/max/1600/1*dT-zhP2bmtxSuOja8gNGxA.png)
  87. http://www.deeplearning.net/software/theano/
  88. - Делался силами университета Монреаль с 2007
  89. - Один из самый старых фреймворков, но почти почил в забытьи
  90. - Придумали идею абстракции вычислительных графов (статических) для оптимизации и вычисления нейронных сетей
  91. - В R доступен как бэкенд через Keras
  92. ---
  93. ![](https://cdn-images-1.medium.com/max/1600/1*tzgWkBhJPl5FFFe4uhn1AA.png)
  94. https://cntk.ai/
  95. - Делается силами Майкрософт
  96. - Имеет половинчатые динамические вычислительные графы (на самом деле динамические тензоры скорее)
  97. - Доступен как бэкенд Keras так и как самостоятельный бэкенд с биндингами в R через reticulate package, что значит нужно иметь python версию фреймворка
  98. ---
  99. ![](https://cdn-images-1.medium.com/max/1600/1*k9LIDsTb1K-Uejn7MCO7nA.png)
  100. https://keras.io/
  101. https://keras.rstudio.com/
  102. https://tensorflow.rstudio.com/keras/
  103. - Высокоуровневый фреймворк над другими такими бэкэндами как Theano, CNTK, Tensorflow, и еще некоторые на подходе
  104. - Делается Франсуа Шолле, который написал книгу Deep Learning in R
  105. - Очень простой код
  106. - Один и тот же код рабоает на разных бэкендах, что теоретически может быть полезно (нет)
  107. - Есть очень много блоков нейросетей из современных SOTA работ
  108. - Нивелирует боль статических вычислительных графов
  109. - Уже давно дефолтом поставляется вместе с TensorFlow как его часть, но можно использовать и отдельно
  110. ---
  111. ![](https://raw.githubusercontent.com/dmlc/web-data/master/mxnet/image/mxnet_logo_2.png)&lt;img src="https://raw.githubusercontent.com/dmlc/dmlc.github.io/master/img/logo-m/mxnetR.png" style=width:30% /&gt;
  112. https://mxnet.apache.org/
  113. https://github.com/apache/incubator-mxnet/tree/master/R-package
  114. - Является проектом Apache
  115. - Сочетает в себе динамические и статические графы
  116. - Тоже имеет зоопарк предобученных моделей
  117. - Как и TensorFlow поддерживается многими языками, что может быть очень полезно
  118. - Довольно разумный и хороший фреймворк, непонятно, почему не пользуется популярностью
  119. ---
  120. ![](https://onnx.ai/onnx-r/articles/imgs/ONNX_logo_main.png)
  121. https://onnx.ai/
  122. https://onnx.ai/onnx-r/
  123. - Предоставляет открытый формат представления вычислительных графов, чтобы можно было обмениваться запускать одни и теже, экспортированные в этот формат, модели с помощью разных фреймворков и своего рантайма
  124. - Можно работать из R
  125. - Изначально делался Microsoft вместе с Facebook
  126. - Поддерживает кучу фреймворков нативно и конвертацию в ML и TF, Keras
  127. ---
  128. class: inverse, middle, center
  129. # Deep Learning with MXNet
  130. ---
  131. ## Установка
  132. В Windows и MacOS в R
  133. ```r
  134. # Windows and MacOs
  135. cran &lt;- getOption("repos")
  136. cran["dmlc"] &lt;- "https://apache-mxnet.s3-accelerate.dualstack.amazonaws.com/R/CRAN/GPU/cu92"
  137. options(repos = cran)
  138. install.packages("mxnet")
  139. ```
  140. Linux bash
  141. ```bash
  142. # On linux
  143. git clone --recursive https://github.com/apache/incubator-mxnet.git mxnet
  144. cd mxnet/docs/install
  145. ./install_mxnet_ubuntu_python.sh
  146. ./install_mxnet_ubuntu_r.sh
  147. cd incubator-mxnet
  148. make rpkg
  149. ```
  150. ---
  151. ## Загрузка и обработка данных
  152. ```r
  153. df &lt;- read_csv("data.csv")
  154. set.seed(100)
  155. ```
  156. ```r
  157. #transform and split train on x and y
  158. train_ind &lt;- sample(1:77, 60)
  159. x_train &lt;- as.matrix(df[train_ind, 2:8])
  160. y_train &lt;- unlist(df[train_ind, 9])
  161. x_val &lt;- as.matrix(df[-train_ind, 2:8])
  162. y_val &lt;- unlist(df[-train_ind, 9])
  163. ```
  164. ---
  165. ## Задания архитектуры сети
  166. ```r
  167. require(mxnet)
  168. # define graph
  169. data &lt;- mx.symbol.Variable("data")
  170. fc1 &lt;- mx.symbol.FullyConnected(data, num_hidden = 1)
  171. linreg &lt;- mx.symbol.LinearRegressionOutput(fc1)
  172. # define learing parameters
  173. initializer &lt;- mx.init.normal(sd = 0.1)
  174. optimizer &lt;- mx.opt.create("sgd",
  175. learning.rate = 1e-6,
  176. momentum = 0.9)
  177. # define logger
  178. logger &lt;- mx.metric.logger()
  179. epoch.end.callback &lt;- mx.callback.log.train.metric(
  180. period = 4, # число батчей, после которого оценивается метрика
  181. logger = logger)
  182. # num of epoch
  183. n_epoch &lt;- 20
  184. ```
  185. ---
  186. ## Построим граф модели
  187. ```r
  188. # plot our model
  189. graph.viz(linreg)
  190. ```
  191. &lt;img src="Deep_Learning_in_R_files/graph.png" style="width:50%" &gt;
  192. ---
  193. ## Обучим
  194. ```r
  195. model &lt;- mx.model.FeedForward.create(
  196. symbol = linreg, # our model
  197. X = x_train, # our data
  198. y = y_train, # our label
  199. ctx = mx.cpu(), # engine
  200. num.round = n_epoch,
  201. initializer = initializer, # inizialize weigths
  202. optimizer = optimizer, # sgd optimizer
  203. eval.data = list(data = x_val, label = y_val), # evaluation on evey epoch
  204. eval.metric = mx.metric.rmse, # metric
  205. array.batch.size = 15,
  206. epoch.end.callback = epoch.end.callback) # logger
  207. ```
  208. ```
  209. ## Warning in mx.model.select.layout.train(X, y): Auto detect layout of input matrix, use rowmajor..
  210. ```
  211. ```
  212. ## Start training with 1 devices
  213. ```
  214. ```
  215. ## [1] Train-rmse=2.93010157346725
  216. ```
  217. ```
  218. ## [1] Validation-rmse=2.1820957660675
  219. ```
  220. ```
  221. ## [2] Train-rmse=2.7339181303978
  222. ```
  223. ```
  224. ## [2] Validation-rmse=1.30357313156128
  225. ```
  226. ```
  227. ## [3] Train-rmse=2.27879548072815
  228. ```
  229. ```
  230. ## [3] Validation-rmse=1.52991008758545
  231. ```
  232. ```
  233. ## [4] Train-rmse=2.56086665391922
  234. ```
  235. ```
  236. ## [4] Validation-rmse=1.58689796924591
  237. ```
  238. ```
  239. ## [5] Train-rmse=2.41835105419159
  240. ```
  241. ```
  242. ## [5] Validation-rmse=1.29586094617844
  243. ```
  244. ```
  245. ## [6] Train-rmse=2.19059863686562
  246. ```
  247. ```
  248. ## [6] Validation-rmse=1.28153175115585
  249. ```
  250. ```
  251. ## [7] Train-rmse=2.34774935245514
  252. ```
  253. ```
  254. ## [7] Validation-rmse=1.36112868785858
  255. ```
  256. ```
  257. ## [8] Train-rmse=2.26453876495361
  258. ```
  259. ```
  260. ## [8] Validation-rmse=1.27354842424393
  261. ```
  262. ```
  263. ## [9] Train-rmse=2.14015638828278
  264. ```
  265. ```
  266. ## [9] Validation-rmse=1.21434193849564
  267. ```
  268. ```
  269. ## [10] Train-rmse=2.21449598670006
  270. ```
  271. ```
  272. ## [10] Validation-rmse=1.27596288919449
  273. ```
  274. ```
  275. ## [11] Train-rmse=2.16698306798935
  276. ```
  277. ```
  278. ## [11] Validation-rmse=1.25101959705353
  279. ```
  280. ```
  281. ## [12] Train-rmse=2.09303680062294
  282. ```
  283. ```
  284. ## [12] Validation-rmse=1.20111221075058
  285. ```
  286. ```
  287. ## [13] Train-rmse=2.12218028306961
  288. ```
  289. ```
  290. ## [13] Validation-rmse=1.23818081617355
  291. ```
  292. ```
  293. ## [14] Train-rmse=2.09280279278755
  294. ```
  295. ```
  296. ## [14] Validation-rmse=1.23113989830017
  297. ```
  298. ```
  299. ## [15] Train-rmse=2.04531860351562
  300. ```
  301. ```
  302. ## [15] Validation-rmse=1.19717788696289
  303. ```
  304. ```
  305. ## [16] Train-rmse=2.05167061090469
  306. ```
  307. ```
  308. ## [16] Validation-rmse=1.21595668792725
  309. ```
  310. ```
  311. ## [17] Train-rmse=2.03092896938324
  312. ```
  313. ```
  314. ## [17] Validation-rmse=1.21327614784241
  315. ```
  316. ```
  317. ## [18] Train-rmse=1.99812644720078
  318. ```
  319. ```
  320. ## [18] Validation-rmse=1.19119483232498
  321. ```
  322. ```
  323. ## [19] Train-rmse=1.99355441331863
  324. ```
  325. ```
  326. ## [19] Validation-rmse=1.19869828224182
  327. ```
  328. ```
  329. ## [20] Train-rmse=1.9768915772438
  330. ```
  331. ```
  332. ## [20] Validation-rmse=1.19634580612183
  333. ```
  334. ---
  335. ## Построим кривую обучения
  336. ```r
  337. rmse_log &lt;- data.frame(RMSE = c(logger$train, logger$eval),dataset = c(rep("train", length(logger$train)), rep("val", length(logger$eval))),epoch = 1:n_epoch)
  338. library(ggplot2)
  339. ggplot(rmse_log, aes(epoch, RMSE, group = dataset, colour = dataset)) + geom_point() + geom_line()
  340. ```
  341. ![](Deep_Learning_in_R_files/figure-html/unnamed-chunk-7-1.svg)&lt;!-- --&gt;
  342. ---
  343. class: inverse, center, middle
  344. # Deep Learning with Keras
  345. ---
  346. ## Установка
  347. ```r
  348. install.packages("keras")
  349. keras::install_keras(tensorflow = 'gpu')
  350. ```
  351. ### Загрузка нужных нам пакетов
  352. ```r
  353. require(keras) # Neural Networks
  354. require(tidyverse) # Data cleaning / Visualization
  355. require(knitr) # Table printing
  356. require(rmarkdown) # Misc. output utilities
  357. require(ggridges) # Visualization
  358. ```
  359. ---
  360. ## Загрузка данных
  361. ```r
  362. activityLabels &lt;- read.table("Deep_Learning_in_R_files/HAPT Data Set/activity_labels.txt",
  363. col.names = c("number", "label"))
  364. activityLabels %&gt;% kable(align = c("c", "l"))
  365. ```
  366. number label
  367. -------- -------------------
  368. 1 WALKING
  369. 2 WALKING_UPSTAIRS
  370. 3 WALKING_DOWNSTAIRS
  371. 4 SITTING
  372. 5 STANDING
  373. 6 LAYING
  374. 7 STAND_TO_SIT
  375. 8 SIT_TO_STAND
  376. 9 SIT_TO_LIE
  377. 10 LIE_TO_SIT
  378. 11 STAND_TO_LIE
  379. 12 LIE_TO_STAND
  380. ---
  381. ```r
  382. labels &lt;- read.table("Deep_Learning_in_R_files/HAPT Data Set/RawData/labels.txt",
  383. col.names = c("experiment", "userId", "activity", "startPos", "endPos"))
  384. dataFiles &lt;- list.files("Deep_Learning_in_R_files/HAPT Data Set/RawData")
  385. labels %&gt;%
  386. head(50) %&gt;%
  387. paged_table()
  388. ```
  389. &lt;div data-pagedtable="false"&gt;
  390. &lt;script data-pagedtable-source type="application/json"&gt;
  391. {"columns":[{"label":[""],"name":["_rn_"],"type":[""],"align":["left"]},{"label":["experiment"],"name":[1],"type":["int"],"align":["right"]},{"label":["userId"],"name":[2],"type":["int"],"align":["right"]},{"label":["activity"],"name":[3],"type":["int"],"align":["right"]},{"label":["startPos"],"name":[4],"type":["int"],"align":["right"]},{"label":["endPos"],"name":[5],"type":["int"],"align":["right"]}],"data":[{"1":"1","2":"1","3":"5","4":"250","5":"1232","_rn_":"1"},{"1":"1","2":"1","3":"7","4":"1233","5":"1392","_rn_":"2"},{"1":"1","2":"1","3":"4","4":"1393","5":"2194","_rn_":"3"},{"1":"1","2":"1","3":"8","4":"2195","5":"2359","_rn_":"4"},{"1":"1","2":"1","3":"5","4":"2360","5":"3374","_rn_":"5"},{"1":"1","2":"1","3":"11","4":"3375","5":"3662","_rn_":"6"},{"1":"1","2":"1","3":"6","4":"3663","5":"4538","_rn_":"7"},{"1":"1","2":"1","3":"10","4":"4539","5":"4735","_rn_":"8"},{"1":"1","2":"1","3":"4","4":"4736","5":"5667","_rn_":"9"},{"1":"1","2":"1","3":"9","4":"5668","5":"5859","_rn_":"10"},{"1":"1","2":"1","3":"6","4":"5860","5":"6786","_rn_":"11"},{"1":"1","2":"1","3":"12","4":"6787","5":"6977","_rn_":"12"},{"1":"1","2":"1","3":"1","4":"7496","5":"8078","_rn_":"13"},{"1":"1","2":"1","3":"1","4":"8356","5":"9250","_rn_":"14"},{"1":"1","2":"1","3":"1","4":"9657","5":"10567","_rn_":"15"},{"1":"1","2":"1","3":"1","4":"10750","5":"11714","_rn_":"16"},{"1":"1","2":"1","3":"3","4":"13191","5":"13846","_rn_":"17"},{"1":"1","2":"1","3":"2","4":"14069","5":"14699","_rn_":"18"},{"1":"1","2":"1","3":"3","4":"14869","5":"15492","_rn_":"19"},{"1":"1","2":"1","3":"2","4":"15712","5":"16377","_rn_":"20"},{"1":"1","2":"1","3":"3","4":"16530","5":"17153","_rn_":"21"},{"1":"1","2":"1","3":"2","4":"17298","5":"17970","_rn_":"22"},{"1":"2","2":"1","3":"5","4":"251","5":"1226","_rn_":"23"},{"1":"2","2":"1","3":"7","4":"1227","5":"1432","_rn_":"24"},{"1":"2","2":"1","3":"4","4":"1433","5":"2221","_rn_":"25"},{"1":"2","2":"1","3":"8","4":"2222","5":"2377","_rn_":"26"},{"1":"2","2":"1","3":"5","4":"2378","5":"3304","_rn_":"27"},{"1":"2","2":"1","3":"11","4":"3305","5":"3572","_rn_":"28"},{"1":"2","2":"1","3":"6","4":"3573","5":"4435","_rn_":"29"},{"1":"2","2":"1","3":"10","4":"4436","5":"4619","_rn_":"30"},{"1":"2","2":"1","3":"4","4":"4620","5":"5452","_rn_":"31"},{"1":"2","2":"1","3":"9","4":"5453","5":"5689","_rn_":"32"},{"1":"2","2":"1","3":"6","4":"5690","5":"6467","_rn_":"33"},{"1":"2","2":"1","3":"12","4":"6468","5":"6709","_rn_":"34"},{"1":"2","2":"1","3":"1","4":"7624","5":"8252","_rn_":"35"},{"1":"2","2":"1","3":"1","4":"8618","5":"9576","_rn_":"36"},{"1":"2","2":"1","3":"1","4":"9991","5":"10927","_rn_":"37"},{"1":"2","2":"1","3":"1","4":"11311","5":"12282","_rn_":"38"},{"1":"2","2":"1","3":"3","4":"13129","5":"13379","_rn_":"39"},{"1":"2","2":"1","3":"3","4":"13495","5":"13927","_rn_":"40"},{"1":"2","2":"1","3":"2","4":"14128","5":"14783","_rn_":"41"},{"1":"2","2":"1","3":"3","4":"15037","5":"15684","_rn_":"42"},{"1":"2","2":"1","3":"2","4":"15920","5":"16598","_rn_":"43"},{"1":"2","2":"1","3":"3","4":"16847","5":"17471","_rn_":"44"},{"1":"2","2":"1","3":"2","4":"17725","5":"18425","_rn_":"45"},{"1":"3","2":"2","3":"5","4":"298","5":"1398","_rn_":"46"},{"1":"3","2":"2","3":"7","4":"1399","5":"1555","_rn_":"47"},{"1":"3","2":"2","3":"4","4":"1686","5":"2627","_rn_":"48"},{"1":"3","2":"2","3":"8","4":"2628","5":"2769","_rn_":"49"},{"1":"3","2":"2","3":"5","4":"2770","5":"3904","_rn_":"50"}],"options":{"columns":{"min":{},"max":[10]},"rows":{"min":[10],"max":[10]},"pages":{}}}
  392. &lt;/script&gt;
  393. &lt;/div&gt;
  394. ---
  395. ## TLDR
  396. ```r
  397. allObservations &lt;- read_rds("allObservations.rds")
  398. allObservations %&gt;% dim()
  399. ```
  400. ---
  401. ## Посмотрим на данные
  402. ```r
  403. allObservations %&gt;%
  404. mutate(recording_length = map_int(data,nrow)) %&gt;%
  405. ggplot(aes(x = recording_length, y = activityName)) +
  406. geom_density_ridges(alpha = 0.8)
  407. ```
  408. ```
  409. ## Picking joint bandwidth of 32.5
  410. ```
  411. ![](Deep_Learning_in_R_files/figure-html/unnamed-chunk-13-1.svg)&lt;!-- --&gt;
  412. ---
  413. ## Отфильтруем
  414. ```r
  415. desiredActivities &lt;- c("STAND_TO_SIT", "SIT_TO_STAND", "SIT_TO_LIE", "LIE_TO_SIT", "STAND_TO_LIE","LIE_TO_STAND")
  416. filteredObservations &lt;- allObservations %&gt;%
  417. filter(activityName %in% desiredActivities) %&gt;%
  418. mutate(observationId = 1:n())
  419. filteredObservations %&gt;% paged_table()
  420. ```
  421. &lt;div data-pagedtable="false"&gt;
  422. &lt;script data-pagedtable-source type="application/json"&gt;
  423. {"columns":[{"label":["experiment"],"name":[1],"type":["int"],"align":["right"]},{"label":["userId"],"name":[2],"type":["int"],"align":["right"]},{"label":["activity"],"name":[3],"type":["int"],"align":["right"]},{"label":["data"],"name":[4],"type":["list"],"align":["right"]},{"label":["activityName"],"name":[5],"type":["fctr"],"align":["left"]},{"label":["observationId"],"name":[6],"type":["int"],"align":["right"]}],"data":[{"1":"1","2":"1","3":"7","4":"&lt;data.frame [160 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"1"},{"1":"2","2":"1","3":"7","4":"&lt;data.frame [206 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"2"},{"1":"3","2":"2","3":"7","4":"&lt;data.frame [157 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"3"},{"1":"4","2":"2","3":"7","4":"&lt;data.frame [160 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"4"},{"1":"5","2":"3","3":"7","4":"&lt;data.frame [142 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"5"},{"1":"6","2":"3","3":"7","4":"&lt;data.frame [190 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"6"},{"1":"7","2":"4","3":"7","4":"&lt;data.frame [236 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"7"},{"1":"8","2":"4","3":"7","4":"&lt;data.frame [178 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"8"},{"1":"9","2":"5","3":"7","4":"&lt;data.frame [165 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"9"},{"1":"10","2":"5","3":"7","4":"&lt;data.frame [235 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"10"},{"1":"11","2":"6","3":"7","4":"&lt;data.frame [185 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"11"},{"1":"12","2":"6","3":"7","4":"&lt;data.frame [151 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"12"},{"1":"13","2":"7","3":"7","4":"&lt;data.frame [114 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"13"},{"1":"14","2":"7","3":"7","4":"&lt;data.frame [90 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"14"},{"1":"15","2":"8","3":"7","4":"&lt;data.frame [111 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"15"},{"1":"16","2":"8","3":"7","4":"&lt;data.frame [129 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"16"},{"1":"17","2":"9","3":"7","4":"&lt;data.frame [118 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"17"},{"1":"18","2":"9","3":"7","4":"&lt;data.frame [132 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"18"},{"1":"19","2":"10","3":"7","4":"&lt;data.frame [133 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"19"},{"1":"20","2":"10","3":"7","4":"&lt;data.frame [112 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"20"},{"1":"22","2":"11","3":"7","4":"&lt;data.frame [141 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"21"},{"1":"23","2":"11","3":"7","4":"&lt;data.frame [172 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"22"},{"1":"24","2":"12","3":"7","4":"&lt;data.frame [175 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"23"},{"1":"25","2":"12","3":"7","4":"&lt;data.frame [190 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"24"},{"1":"26","2":"13","3":"7","4":"&lt;data.frame [138 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"25"},{"1":"27","2":"13","3":"7","4":"&lt;data.frame [250 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"26"},{"1":"28","2":"14","3":"7","4":"&lt;data.frame [298 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"27"},{"1":"29","2":"14","3":"7","4":"&lt;data.frame [177 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"28"},{"1":"30","2":"15","3":"7","4":"&lt;data.frame [144 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"29"},{"1":"31","2":"15","3":"7","4":"&lt;data.frame [138 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"30"},{"1":"32","2":"16","3":"7","4":"&lt;data.frame [180 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"31"},{"1":"33","2":"16","3":"7","4":"&lt;data.frame [175 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"32"},{"1":"34","2":"17","3":"7","4":"&lt;data.frame [142 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"33"},{"1":"35","2":"17","3":"7","4":"&lt;data.frame [154 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"34"},{"1":"36","2":"18","3":"7","4":"&lt;data.frame [307 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"35"},{"1":"37","2":"18","3":"7","4":"&lt;data.frame [227 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"36"},{"1":"38","2":"19","3":"7","4":"&lt;data.frame [179 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"37"},{"1":"39","2":"19","3":"7","4":"&lt;data.frame [163 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"38"},{"1":"40","2":"20","3":"7","4":"&lt;data.frame [201 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"39"},{"1":"41","2":"20","3":"7","4":"&lt;data.frame [219 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"40"},{"1":"42","2":"21","3":"7","4":"&lt;data.frame [177 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"41"},{"1":"43","2":"21","3":"7","4":"&lt;data.frame [140 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"42"},{"1":"44","2":"22","3":"7","4":"&lt;data.frame [214 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"43"},{"1":"45","2":"22","3":"7","4":"&lt;data.frame [119 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"44"},{"1":"46","2":"23","3":"7","4":"&lt;data.frame [143 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"45"},{"1":"47","2":"23","3":"7","4":"&lt;data.frame [222 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"46"},{"1":"48","2":"24","3":"7","4":"&lt;data.frame [171 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"47"},{"1":"49","2":"24","3":"7","4":"&lt;data.frame [187 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"48"},{"1":"50","2":"25","3":"7","4":"&lt;data.frame [138 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"49"},{"1":"51","2":"25","3":"7","4":"&lt;data.frame [219 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"50"},{"1":"52","2":"26","3":"7","4":"&lt;data.frame [129 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"51"},{"1":"53","2":"26","3":"7","4":"&lt;data.frame [151 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"52"},{"1":"54","2":"27","3":"7","4":"&lt;data.frame [168 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"53"},{"1":"55","2":"27","3":"7","4":"&lt;data.frame [188 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"54"},{"1":"56","2":"28","3":"7","4":"&lt;data.frame [259 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"55"},{"1":"57","2":"28","3":"7","4":"&lt;data.frame [162 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"56"},{"1":"58","2":"29","3":"7","4":"&lt;data.frame [157 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"57"},{"1":"59","2":"29","3":"7","4":"&lt;data.frame [169 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"58"},{"1":"60","2":"30","3":"7","4":"&lt;data.frame [113 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"59"},{"1":"61","2":"30","3":"7","4":"&lt;data.frame [216 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_SIT","6":"60"},{"1":"1","2":"1","3":"8","4":"&lt;data.frame [165 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"61"},{"1":"2","2":"1","3":"8","4":"&lt;data.frame [156 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"62"},{"1":"3","2":"2","3":"8","4":"&lt;data.frame [142 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"63"},{"1":"4","2":"2","3":"8","4":"&lt;data.frame [139 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"64"},{"1":"5","2":"3","3":"8","4":"&lt;data.frame [110 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"65"},{"1":"6","2":"3","3":"8","4":"&lt;data.frame [183 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"66"},{"1":"7","2":"4","3":"8","4":"&lt;data.frame [130 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"67"},{"1":"8","2":"4","3":"8","4":"&lt;data.frame [143 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"68"},{"1":"9","2":"5","3":"8","4":"&lt;data.frame [126 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"69"},{"1":"10","2":"5","3":"8","4":"&lt;data.frame [129 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"70"},{"1":"11","2":"6","3":"8","4":"&lt;data.frame [114 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"71"},{"1":"12","2":"6","3":"8","4":"&lt;data.frame [132 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"72"},{"1":"13","2":"7","3":"8","4":"&lt;data.frame [93 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"73"},{"1":"14","2":"7","3":"8","4":"&lt;data.frame [74 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"74"},{"1":"15","2":"8","3":"8","4":"&lt;data.frame [74 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"75"},{"1":"16","2":"8","3":"8","4":"&lt;data.frame [114 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"76"},{"1":"16","2":"8","3":"8","4":"&lt;data.frame [117 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"77"},{"1":"17","2":"9","3":"8","4":"&lt;data.frame [106 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"78"},{"1":"18","2":"9","3":"8","4":"&lt;data.frame [97 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"79"},{"1":"19","2":"10","3":"8","4":"&lt;data.frame [89 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"80"},{"1":"20","2":"10","3":"8","4":"&lt;data.frame [78 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"81"},{"1":"22","2":"11","3":"8","4":"&lt;data.frame [132 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"82"},{"1":"23","2":"11","3":"8","4":"&lt;data.frame [132 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"83"},{"1":"24","2":"12","3":"8","4":"&lt;data.frame [104 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"84"},{"1":"25","2":"12","3":"8","4":"&lt;data.frame [138 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"85"},{"1":"26","2":"13","3":"8","4":"&lt;data.frame [142 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"86"},{"1":"27","2":"13","3":"8","4":"&lt;data.frame [159 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"87"},{"1":"28","2":"14","3":"8","4":"&lt;data.frame [136 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"88"},{"1":"29","2":"14","3":"8","4":"&lt;data.frame [140 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"89"},{"1":"30","2":"15","3":"8","4":"&lt;data.frame [110 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"90"},{"1":"31","2":"15","3":"8","4":"&lt;data.frame [153 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"91"},{"1":"32","2":"16","3":"8","4":"&lt;data.frame [109 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"92"},{"1":"33","2":"16","3":"8","4":"&lt;data.frame [109 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"93"},{"1":"34","2":"17","3":"8","4":"&lt;data.frame [153 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"94"},{"1":"35","2":"17","3":"8","4":"&lt;data.frame [158 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"95"},{"1":"36","2":"18","3":"8","4":"&lt;data.frame [182 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"96"},{"1":"37","2":"18","3":"8","4":"&lt;data.frame [176 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"97"},{"1":"38","2":"19","3":"8","4":"&lt;data.frame [135 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"98"},{"1":"39","2":"19","3":"8","4":"&lt;data.frame [122 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"99"},{"1":"40","2":"20","3":"8","4":"&lt;data.frame [182 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"100"},{"1":"41","2":"20","3":"8","4":"&lt;data.frame [121 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"101"},{"1":"42","2":"21","3":"8","4":"&lt;data.frame [146 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"102"},{"1":"43","2":"21","3":"8","4":"&lt;data.frame [118 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"103"},{"1":"44","2":"22","3":"8","4":"&lt;data.frame [104 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"104"},{"1":"45","2":"22","3":"8","4":"&lt;data.frame [106 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"105"},{"1":"45","2":"22","3":"8","4":"&lt;data.frame [92 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"106"},{"1":"46","2":"23","3":"8","4":"&lt;data.frame [121 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"107"},{"1":"47","2":"23","3":"8","4":"&lt;data.frame [150 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"108"},{"1":"48","2":"24","3":"8","4":"&lt;data.frame [109 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"109"},{"1":"49","2":"24","3":"8","4":"&lt;data.frame [124 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"110"},{"1":"50","2":"25","3":"8","4":"&lt;data.frame [152 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"111"},{"1":"51","2":"25","3":"8","4":"&lt;data.frame [173 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"112"},{"1":"52","2":"26","3":"8","4":"&lt;data.frame [182 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"113"},{"1":"53","2":"26","3":"8","4":"&lt;data.frame [102 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"114"},{"1":"54","2":"27","3":"8","4":"&lt;data.frame [98 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"115"},{"1":"55","2":"27","3":"8","4":"&lt;data.frame [101 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"116"},{"1":"56","2":"28","3":"8","4":"&lt;data.frame [138 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"117"},{"1":"57","2":"28","3":"8","4":"&lt;data.frame [121 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"118"},{"1":"58","2":"29","3":"8","4":"&lt;data.frame [175 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"119"},{"1":"59","2":"29","3":"8","4":"&lt;data.frame [134 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"120"},{"1":"60","2":"30","3":"8","4":"&lt;data.frame [151 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"121"},{"1":"61","2":"30","3":"8","4":"&lt;data.frame [128 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_STAND","6":"122"},{"1":"1","2":"1","3":"9","4":"&lt;data.frame [192 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"123"},{"1":"2","2":"1","3":"9","4":"&lt;data.frame [237 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"124"},{"1":"3","2":"2","3":"9","4":"&lt;data.frame [225 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"125"},{"1":"4","2":"2","3":"9","4":"&lt;data.frame [154 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"126"},{"1":"5","2":"3","3":"9","4":"&lt;data.frame [151 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"127"},{"1":"6","2":"3","3":"9","4":"&lt;data.frame [170 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"128"},{"1":"7","2":"4","3":"9","4":"&lt;data.frame [224 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"129"},{"1":"8","2":"4","3":"9","4":"&lt;data.frame [235 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"130"},{"1":"9","2":"5","3":"9","4":"&lt;data.frame [220 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"131"},{"1":"10","2":"5","3":"9","4":"&lt;data.frame [259 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"132"},{"1":"11","2":"6","3":"9","4":"&lt;data.frame [158 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"133"},{"1":"12","2":"6","3":"9","4":"&lt;data.frame [158 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"134"},{"1":"13","2":"7","3":"9","4":"&lt;data.frame [257 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"135"},{"1":"14","2":"7","3":"9","4":"&lt;data.frame [189 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"136"},{"1":"15","2":"8","3":"9","4":"&lt;data.frame [166 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"137"},{"1":"16","2":"8","3":"9","4":"&lt;data.frame [147 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"138"},{"1":"17","2":"9","3":"9","4":"&lt;data.frame [204 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"139"},{"1":"18","2":"9","3":"9","4":"&lt;data.frame [161 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"140"},{"1":"19","2":"10","3":"9","4":"&lt;data.frame [181 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"141"},{"1":"20","2":"10","3":"9","4":"&lt;data.frame [159 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"142"},{"1":"22","2":"11","3":"9","4":"&lt;data.frame [185 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"143"},{"1":"23","2":"11","3":"9","4":"&lt;data.frame [198 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"144"},{"1":"24","2":"12","3":"9","4":"&lt;data.frame [173 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"145"},{"1":"25","2":"12","3":"9","4":"&lt;data.frame [182 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"146"},{"1":"26","2":"13","3":"9","4":"&lt;data.frame [226 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"147"},{"1":"27","2":"13","3":"9","4":"&lt;data.frame [212 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"148"},{"1":"28","2":"14","3":"9","4":"&lt;data.frame [289 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"149"},{"1":"29","2":"14","3":"9","4":"&lt;data.frame [172 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"150"},{"1":"30","2":"15","3":"9","4":"&lt;data.frame [202 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"151"},{"1":"31","2":"15","3":"9","4":"&lt;data.frame [205 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"152"},{"1":"32","2":"16","3":"9","4":"&lt;data.frame [195 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"153"},{"1":"33","2":"16","3":"9","4":"&lt;data.frame [181 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"154"},{"1":"34","2":"17","3":"9","4":"&lt;data.frame [312 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"155"},{"1":"35","2":"17","3":"9","4":"&lt;data.frame [202 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"156"},{"1":"36","2":"18","3":"9","4":"&lt;data.frame [251 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"157"},{"1":"37","2":"18","3":"9","4":"&lt;data.frame [199 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"158"},{"1":"38","2":"19","3":"9","4":"&lt;data.frame [176 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"159"},{"1":"39","2":"19","3":"9","4":"&lt;data.frame [203 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"160"},{"1":"40","2":"20","3":"9","4":"&lt;data.frame [297 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"161"},{"1":"41","2":"20","3":"9","4":"&lt;data.frame [281 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"162"},{"1":"42","2":"21","3":"9","4":"&lt;data.frame [202 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"163"},{"1":"43","2":"21","3":"9","4":"&lt;data.frame [212 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"164"},{"1":"44","2":"22","3":"9","4":"&lt;data.frame [136 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"165"},{"1":"45","2":"22","3":"9","4":"&lt;data.frame [159 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"166"},{"1":"46","2":"23","3":"9","4":"&lt;data.frame [213 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"167"},{"1":"47","2":"23","3":"9","4":"&lt;data.frame [219 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"168"},{"1":"48","2":"24","3":"9","4":"&lt;data.frame [234 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"169"},{"1":"49","2":"24","3":"9","4":"&lt;data.frame [206 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"170"},{"1":"50","2":"25","3":"9","4":"&lt;data.frame [199 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"171"},{"1":"51","2":"25","3":"9","4":"&lt;data.frame [181 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"172"},{"1":"52","2":"26","3":"9","4":"&lt;data.frame [185 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"173"},{"1":"53","2":"26","3":"9","4":"&lt;data.frame [213 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"174"},{"1":"54","2":"27","3":"9","4":"&lt;data.frame [227 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"175"},{"1":"55","2":"27","3":"9","4":"&lt;data.frame [225 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"176"},{"1":"56","2":"28","3":"9","4":"&lt;data.frame [226 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"177"},{"1":"57","2":"28","3":"9","4":"&lt;data.frame [201 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"178"},{"1":"58","2":"29","3":"9","4":"&lt;data.frame [326 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"179"},{"1":"59","2":"29","3":"9","4":"&lt;data.frame [201 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"180"},{"1":"60","2":"30","3":"9","4":"&lt;data.frame [183 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"181"},{"1":"61","2":"30","3":"9","4":"&lt;data.frame [292 &lt;U+00D7&gt; 6]&gt;","5":"SIT_TO_LIE","6":"182"},{"1":"1","2":"1","3":"10","4":"&lt;data.frame [197 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"183"},{"1":"2","2":"1","3":"10","4":"&lt;data.frame [184 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"184"},{"1":"3","2":"2","3":"10","4":"&lt;data.frame [278 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"185"},{"1":"4","2":"2","3":"10","4":"&lt;data.frame [142 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"186"},{"1":"5","2":"3","3":"10","4":"&lt;data.frame [224 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"187"},{"1":"6","2":"3","3":"10","4":"&lt;data.frame [197 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"188"},{"1":"7","2":"4","3":"10","4":"&lt;data.frame [215 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"189"},{"1":"8","2":"4","3":"10","4":"&lt;data.frame [210 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"190"},{"1":"9","2":"5","3":"10","4":"&lt;data.frame [256 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"191"},{"1":"10","2":"5","3":"10","4":"&lt;data.frame [203 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"192"},{"1":"11","2":"6","3":"10","4":"&lt;data.frame [173 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"193"},{"1":"12","2":"6","3":"10","4":"&lt;data.frame [165 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"194"},{"1":"13","2":"7","3":"10","4":"&lt;data.frame [146 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"195"},{"1":"14","2":"7","3":"10","4":"&lt;data.frame [123 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"196"},{"1":"15","2":"8","3":"10","4":"&lt;data.frame [160 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"197"},{"1":"16","2":"8","3":"10","4":"&lt;data.frame [136 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"198"},{"1":"16","2":"8","3":"10","4":"&lt;data.frame [165 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"199"},{"1":"17","2":"9","3":"10","4":"&lt;data.frame [177 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"200"},{"1":"18","2":"9","3":"10","4":"&lt;data.frame [128 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"201"},{"1":"19","2":"10","3":"10","4":"&lt;data.frame [169 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"202"},{"1":"20","2":"10","3":"10","4":"&lt;data.frame [114 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"203"},{"1":"22","2":"11","3":"10","4":"&lt;data.frame [179 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"204"},{"1":"23","2":"11","3":"10","4":"&lt;data.frame [222 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"205"},{"1":"24","2":"12","3":"10","4":"&lt;data.frame [178 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"206"},{"1":"25","2":"12","3":"10","4":"&lt;data.frame [179 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"207"},{"1":"26","2":"13","3":"10","4":"&lt;data.frame [190 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"208"},{"1":"27","2":"13","3":"10","4":"&lt;data.frame [193 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"209"},{"1":"28","2":"14","3":"10","4":"&lt;data.frame [226 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"210"},{"1":"29","2":"14","3":"10","4":"&lt;data.frame [147 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"211"},{"1":"30","2":"15","3":"10","4":"&lt;data.frame [166 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"212"},{"1":"31","2":"15","3":"10","4":"&lt;data.frame [169 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"213"},{"1":"32","2":"16","3":"10","4":"&lt;data.frame [184 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"214"},{"1":"33","2":"16","3":"10","4":"&lt;data.frame [183 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"215"},{"1":"34","2":"17","3":"10","4":"&lt;data.frame [211 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"216"},{"1":"35","2":"17","3":"10","4":"&lt;data.frame [271 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"217"},{"1":"36","2":"18","3":"10","4":"&lt;data.frame [245 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"218"},{"1":"37","2":"18","3":"10","4":"&lt;data.frame [165 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"219"},{"1":"38","2":"19","3":"10","4":"&lt;data.frame [197 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"220"},{"1":"39","2":"19","3":"10","4":"&lt;data.frame [150 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"221"},{"1":"40","2":"20","3":"10","4":"&lt;data.frame [156 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"222"},{"1":"41","2":"20","3":"10","4":"&lt;data.frame [192 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"223"},{"1":"42","2":"21","3":"10","4":"&lt;data.frame [204 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"224"},{"1":"43","2":"21","3":"10","4":"&lt;data.frame [196 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"225"},{"1":"44","2":"22","3":"10","4":"&lt;data.frame [185 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"226"},{"1":"45","2":"22","3":"10","4":"&lt;data.frame [161 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"227"},{"1":"45","2":"22","3":"10","4":"&lt;data.frame [157 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"228"},{"1":"46","2":"23","3":"10","4":"&lt;data.frame [174 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"229"},{"1":"47","2":"23","3":"10","4":"&lt;data.frame [171 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"230"},{"1":"48","2":"24","3":"10","4":"&lt;data.frame [210 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"231"},{"1":"49","2":"24","3":"10","4":"&lt;data.frame [180 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"232"},{"1":"50","2":"25","3":"10","4":"&lt;data.frame [280 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"233"},{"1":"51","2":"25","3":"10","4":"&lt;data.frame [215 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"234"},{"1":"52","2":"26","3":"10","4":"&lt;data.frame [162 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"235"},{"1":"53","2":"26","3":"10","4":"&lt;data.frame [174 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"236"},{"1":"54","2":"27","3":"10","4":"&lt;data.frame [154 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"237"},{"1":"55","2":"27","3":"10","4":"&lt;data.frame [149 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"238"},{"1":"58","2":"29","3":"10","4":"&lt;data.frame [237 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"239"},{"1":"59","2":"29","3":"10","4":"&lt;data.frame [170 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"240"},{"1":"60","2":"30","3":"10","4":"&lt;data.frame [167 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"241"},{"1":"61","2":"30","3":"10","4":"&lt;data.frame [239 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_SIT","6":"242"},{"1":"1","2":"1","3":"11","4":"&lt;data.frame [288 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"243"},{"1":"2","2":"1","3":"11","4":"&lt;data.frame [268 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"244"},{"1":"3","2":"2","3":"11","4":"&lt;data.frame [418 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"245"},{"1":"4","2":"2","3":"11","4":"&lt;data.frame [205 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"246"},{"1":"5","2":"3","3":"11","4":"&lt;data.frame [216 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"247"},{"1":"6","2":"3","3":"11","4":"&lt;data.frame [235 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"248"},{"1":"7","2":"4","3":"11","4":"&lt;data.frame [332 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"249"},{"1":"8","2":"4","3":"11","4":"&lt;data.frame [319 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"250"},{"1":"9","2":"5","3":"11","4":"&lt;data.frame [346 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"251"},{"1":"10","2":"5","3":"11","4":"&lt;data.frame [315 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"252"},{"1":"11","2":"6","3":"11","4":"&lt;data.frame [313 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"253"},{"1":"12","2":"6","3":"11","4":"&lt;data.frame [280 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"254"},{"1":"13","2":"7","3":"11","4":"&lt;data.frame [206 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"255"},{"1":"14","2":"7","3":"11","4":"&lt;data.frame [200 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"256"},{"1":"15","2":"8","3":"11","4":"&lt;data.frame [211 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"257"},{"1":"16","2":"8","3":"11","4":"&lt;data.frame [196 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"258"},{"1":"17","2":"9","3":"11","4":"&lt;data.frame [188 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"259"},{"1":"18","2":"9","3":"11","4":"&lt;data.frame [259 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"260"},{"1":"19","2":"10","3":"11","4":"&lt;data.frame [229 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"261"},{"1":"20","2":"10","3":"11","4":"&lt;data.frame [153 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"262"},{"1":"22","2":"11","3":"11","4":"&lt;data.frame [193 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"263"},{"1":"23","2":"11","3":"11","4":"&lt;data.frame [187 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"264"},{"1":"24","2":"12","3":"11","4":"&lt;data.frame [205 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"265"},{"1":"25","2":"12","3":"11","4":"&lt;data.frame [167 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"266"},{"1":"26","2":"13","3":"11","4":"&lt;data.frame [195 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"267"},{"1":"27","2":"13","3":"11","4":"&lt;data.frame [191 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"268"},{"1":"28","2":"14","3":"11","4":"&lt;data.frame [342 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"269"},{"1":"29","2":"14","3":"11","4":"&lt;data.frame [264 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"270"},{"1":"30","2":"15","3":"11","4":"&lt;data.frame [194 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"271"},{"1":"31","2":"15","3":"11","4":"&lt;data.frame [263 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"272"},{"1":"32","2":"16","3":"11","4":"&lt;data.frame [235 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"273"},{"1":"33","2":"16","3":"11","4":"&lt;data.frame [192 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"274"},{"1":"34","2":"17","3":"11","4":"&lt;data.frame [238 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"275"},{"1":"35","2":"17","3":"11","4":"&lt;data.frame [336 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"276"},{"1":"36","2":"18","3":"11","4":"&lt;data.frame [297 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"277"},{"1":"37","2":"18","3":"11","4":"&lt;data.frame [244 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"278"},{"1":"38","2":"19","3":"11","4":"&lt;data.frame [256 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"279"},{"1":"39","2":"19","3":"11","4":"&lt;data.frame [320 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"280"},{"1":"40","2":"20","3":"11","4":"&lt;data.frame [425 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"281"},{"1":"41","2":"20","3":"11","4":"&lt;data.frame [365 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"282"},{"1":"42","2":"21","3":"11","4":"&lt;data.frame [313 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"283"},{"1":"43","2":"21","3":"11","4":"&lt;data.frame [274 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"284"},{"1":"44","2":"22","3":"11","4":"&lt;data.frame [173 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"285"},{"1":"45","2":"22","3":"11","4":"&lt;data.frame [139 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"286"},{"1":"46","2":"23","3":"11","4":"&lt;data.frame [253 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"287"},{"1":"47","2":"23","3":"11","4":"&lt;data.frame [260 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"288"},{"1":"48","2":"24","3":"11","4":"&lt;data.frame [494 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"289"},{"1":"49","2":"24","3":"11","4":"&lt;data.frame [248 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"290"},{"1":"50","2":"25","3":"11","4":"&lt;data.frame [185 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"291"},{"1":"51","2":"25","3":"11","4":"&lt;data.frame [241 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"292"},{"1":"52","2":"26","3":"11","4":"&lt;data.frame [178 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"293"},{"1":"53","2":"26","3":"11","4":"&lt;data.frame [167 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"294"},{"1":"54","2":"27","3":"11","4":"&lt;data.frame [216 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"295"},{"1":"55","2":"27","3":"11","4":"&lt;data.frame [165 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"296"},{"1":"58","2":"29","3":"11","4":"&lt;data.frame [234 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"297"},{"1":"59","2":"29","3":"11","4":"&lt;data.frame [187 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"298"},{"1":"60","2":"30","3":"11","4":"&lt;data.frame [156 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"299"},{"1":"61","2":"30","3":"11","4":"&lt;data.frame [249 &lt;U+00D7&gt; 6]&gt;","5":"STAND_TO_LIE","6":"300"},{"1":"1","2":"1","3":"12","4":"&lt;data.frame [191 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"301"},{"1":"2","2":"1","3":"12","4":"&lt;data.frame [242 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"302"},{"1":"3","2":"2","3":"12","4":"&lt;data.frame [181 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"303"},{"1":"4","2":"2","3":"12","4":"&lt;data.frame [181 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"304"},{"1":"5","2":"3","3":"12","4":"&lt;data.frame [184 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"305"},{"1":"6","2":"3","3":"12","4":"&lt;data.frame [167 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"306"},{"1":"7","2":"4","3":"12","4":"&lt;data.frame [166 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"307"},{"1":"8","2":"4","3":"12","4":"&lt;data.frame [171 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"308"},{"1":"9","2":"5","3":"12","4":"&lt;data.frame [173 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"309"},{"1":"10","2":"5","3":"12","4":"&lt;data.frame [142 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"310"},{"1":"11","2":"6","3":"12","4":"&lt;data.frame [186 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"311"},{"1":"12","2":"6","3":"12","4":"&lt;data.frame [254 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"312"},{"1":"13","2":"7","3":"12","4":"&lt;data.frame [206 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"313"},{"1":"14","2":"7","3":"12","4":"&lt;data.frame [170 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"314"},{"1":"15","2":"8","3":"12","4":"&lt;data.frame [173 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"315"},{"1":"17","2":"9","3":"12","4":"&lt;data.frame [168 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"316"},{"1":"18","2":"9","3":"12","4":"&lt;data.frame [149 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"317"},{"1":"19","2":"10","3":"12","4":"&lt;data.frame [118 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"318"},{"1":"20","2":"10","3":"12","4":"&lt;data.frame [137 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"319"},{"1":"22","2":"11","3":"12","4":"&lt;data.frame [139 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"320"},{"1":"23","2":"11","3":"12","4":"&lt;data.frame [196 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"321"},{"1":"24","2":"12","3":"12","4":"&lt;data.frame [207 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"322"},{"1":"25","2":"12","3":"12","4":"&lt;data.frame [188 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"323"},{"1":"26","2":"13","3":"12","4":"&lt;data.frame [259 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"324"},{"1":"27","2":"13","3":"12","4":"&lt;data.frame [197 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"325"},{"1":"28","2":"14","3":"12","4":"&lt;data.frame [289 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"326"},{"1":"29","2":"14","3":"12","4":"&lt;data.frame [197 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"327"},{"1":"30","2":"15","3":"12","4":"&lt;data.frame [201 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"328"},{"1":"31","2":"15","3":"12","4":"&lt;data.frame [159 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"329"},{"1":"32","2":"16","3":"12","4":"&lt;data.frame [146 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"330"},{"1":"33","2":"16","3":"12","4":"&lt;data.frame [156 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"331"},{"1":"34","2":"17","3":"12","4":"&lt;data.frame [200 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"332"},{"1":"35","2":"17","3":"12","4":"&lt;data.frame [238 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"333"},{"1":"36","2":"18","3":"12","4":"&lt;data.frame [206 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"334"},{"1":"37","2":"18","3":"12","4":"&lt;data.frame [192 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"335"},{"1":"38","2":"19","3":"12","4":"&lt;data.frame [161 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"336"},{"1":"39","2":"19","3":"12","4":"&lt;data.frame [140 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"337"},{"1":"40","2":"20","3":"12","4":"&lt;data.frame [172 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"338"},{"1":"41","2":"20","3":"12","4":"&lt;data.frame [158 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"339"},{"1":"42","2":"21","3":"12","4":"&lt;data.frame [206 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"340"},{"1":"43","2":"21","3":"12","4":"&lt;data.frame [196 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"341"},{"1":"44","2":"22","3":"12","4":"&lt;data.frame [257 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"342"},{"1":"46","2":"23","3":"12","4":"&lt;data.frame [176 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"343"},{"1":"47","2":"23","3":"12","4":"&lt;data.frame [161 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"344"},{"1":"48","2":"24","3":"12","4":"&lt;data.frame [322 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"345"},{"1":"49","2":"24","3":"12","4":"&lt;data.frame [196 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"346"},{"1":"50","2":"25","3":"12","4":"&lt;data.frame [323 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"347"},{"1":"51","2":"25","3":"12","4":"&lt;data.frame [187 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"348"},{"1":"52","2":"26","3":"12","4":"&lt;data.frame [244 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"349"},{"1":"53","2":"26","3":"12","4":"&lt;data.frame [183 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"350"},{"1":"54","2":"27","3":"12","4":"&lt;data.frame [125 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"351"},{"1":"55","2":"27","3":"12","4":"&lt;data.frame [153 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"352"},{"1":"56","2":"28","3":"12","4":"&lt;data.frame [181 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"353"},{"1":"57","2":"28","3":"12","4":"&lt;data.frame [167 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"354"},{"1":"58","2":"29","3":"12","4":"&lt;data.frame [179 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"355"},{"1":"59","2":"29","3":"12","4":"&lt;data.frame [145 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"356"},{"1":"60","2":"30","3":"12","4":"&lt;data.frame [159 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"357"},{"1":"61","2":"30","3":"12","4":"&lt;data.frame [147 &lt;U+00D7&gt; 6]&gt;","5":"LIE_TO_STAND","6":"358"}],"options":{"columns":{"min":{},"max":[10]},"rows":{"min":[10],"max":[10]},"pages":{}}}
  424. &lt;/script&gt;
  425. &lt;/div&gt;
  426. ---
  427. ## Разделим на трейн тест
  428. ```r
  429. set.seed(100) # seed for reproducibility
  430. ## get all users
  431. userIds &lt;- allObservations$userId %&gt;% unique()
  432. ## randomly choose 24 (80% of 30 individuals) for training
  433. trainIds &lt;- sample(userIds, size = 24)
  434. ## set the rest of the users to the testing set
  435. testIds &lt;- setdiff(userIds,trainIds)
  436. ## filter data.
  437. trainData &lt;- filteredObservations %&gt;%
  438. filter(userId %in% trainIds)
  439. testData &lt;- filteredObservations %&gt;%
  440. filter(userId %in% testIds)
  441. ```
  442. ---
  443. layout: true
  444. ## Посмотрим собственно на активности по классам
  445. ---
  446. ```r
  447. unpackedObs &lt;- 1:nrow(trainData) %&gt;%
  448. map_df(function(rowNum){
  449. dataRow &lt;- trainData[rowNum, ]
  450. dataRow$data[[1]] %&gt;%
  451. mutate(
  452. activityName = dataRow$activityName,
  453. observationId = dataRow$observationId,
  454. time = 1:n() )
  455. }) %&gt;%
  456. gather(reading, value, -time, -activityName, -observationId) %&gt;%
  457. separate(reading, into = c("type", "direction"), sep = "_") %&gt;%
  458. mutate(type = ifelse(type == "a", "acceleration", "gyro"))
  459. ```
  460. ---
  461. ```r
  462. unpackedObs %&gt;%
  463. ggplot(aes(x = time, y = value, color = direction)) +
  464. geom_line(alpha = 0.2) +
  465. geom_smooth(se = FALSE, alpha = 0.7, size = 0.5) +
  466. facet_grid(type ~ activityName, scales = "free_y") +
  467. theme_minimal() +
  468. theme( axis.text.x = element_blank() )
  469. ```
  470. ```
  471. ## `geom_smooth()` using method = 'gam' and formula 'y ~ s(x, bs = "cs")'
  472. ```
  473. ![](Deep_Learning_in_R_files/figure-html/unnamed-chunk-17-1.png)&lt;!-- --&gt;
  474. ---
  475. layout: true
  476. ## Подготовка данных к обучению
  477. ---
  478. ```r
  479. padSize &lt;- trainData$data %&gt;%
  480. map_int(nrow) %&gt;%
  481. quantile(p = 0.98) %&gt;%
  482. ceiling()
  483. padSize
  484. ```
  485. ```
  486. ## 98%
  487. ## 334
  488. ```
  489. ```r
  490. convertToTensor &lt;- . %&gt;%
  491. map(as.matrix) %&gt;%
  492. pad_sequences(maxlen = padSize)
  493. trainObs &lt;- trainData$data %&gt;% convertToTensor()
  494. testObs &lt;- testData$data %&gt;% convertToTensor()
  495. dim(trainObs)
  496. ```
  497. ```
  498. ## [1] 286 334 6
  499. ```
  500. ---
  501. ```r
  502. # one hot encoding
  503. oneHotClasses &lt;- . %&gt;%
  504. {. - 7} %&gt;% # bring integers down to 0-6 from 7-12
  505. to_categorical() # One-hot encode
  506. trainY &lt;- trainData$activity %&gt;% oneHotClasses()
  507. testY &lt;- testData$activity %&gt;% oneHotClasses()
  508. ```
  509. ---
  510. layout:true
  511. ## Наконец то сетка!
  512. ---
  513. ```r
  514. input_shape &lt;- dim(trainObs)[-1]
  515. num_classes &lt;- dim(trainY)[2]
  516. filters &lt;- 24 # number of convolutional filters to learn
  517. kernel_size &lt;- 8 # how many time-steps each conv layer sees.
  518. dense_size &lt;- 48 # size of our penultimate dense layer.
  519. ```
  520. ---
  521. ```r
  522. model &lt;- keras_model_sequential()
  523. model %&gt;% layer_conv_1d(
  524. filters = filters,
  525. kernel_size = kernel_size,
  526. input_shape = input_shape,
  527. padding = "valid",
  528. activation = "relu") %&gt;%
  529. layer_batch_normalization() %&gt;%
  530. layer_spatial_dropout_1d(0.15) %&gt;%
  531. layer_conv_1d(filters = filters/2,
  532. kernel_size = kernel_size,
  533. activation = "relu") %&gt;%
  534. layer_global_average_pooling_1d() %&gt;%
  535. layer_batch_normalization() %&gt;%
  536. layer_dropout(0.2) %&gt;%
  537. layer_dense(dense_size,
  538. activation = "relu") %&gt;%
  539. layer_batch_normalization() %&gt;%
  540. layer_dropout(0.25) %&gt;%
  541. layer_dense(num_classes,
  542. activation = "softmax",
  543. name = "dense_output")
  544. ```
  545. ---
  546. ### Выведем описание нашей сетки
  547. ```r
  548. summary(model)
  549. ```
  550. ![](Deep_Learning_in_R_files/keras_summary.png)
  551. ---
  552. layout:true
  553. ## Обучим же наконец
  554. ---
  555. ## Компиляция графа
  556. ```r
  557. model %&gt;% compile(
  558. loss = "categorical_crossentropy",
  559. optimizer = "rmsprop",
  560. metrics = "accuracy"
  561. )
  562. ```
  563. ---
  564. ## train
  565. ```r
  566. trainHistory &lt;- model %&gt;%
  567. fit(
  568. x = trainObs, y = trainY, # data
  569. epochs = 350, # num epoch
  570. validation_data = list(testObs, testY), # validation tests on each epoch
  571. callbacks = list(
  572. callback_model_checkpoint("best_model.h5",
  573. save_best_only = TRUE))) # update train history and save model
  574. ```
  575. ---
  576. ![](Deep_Learning_in_R_files/train.png)
  577. ---
  578. ![](Deep_Learning_in_R_files/train_plot.png)
  579. ---
  580. layout:true
  581. ## Предсказание
  582. ---
  583. ## Подготовка теста
  584. ```r
  585. oneHotToLabel &lt;- activityLabels %&gt;%
  586. mutate(number = number - 7) %&gt;%
  587. filter(number &gt;= 0) %&gt;%
  588. mutate(class = paste0("V",number + 1)) %&gt;%
  589. select(-number)
  590. ```
  591. ## Выбор лучшей модели
  592. ```r
  593. bestModel &lt;- load_model_hdf5("best_model.h5")
  594. ```
  595. ---
  596. ## Еще немного кода
  597. ```r
  598. tidyPredictionProbs &lt;- bestModel %&gt;%
  599. predict(testObs) %&gt;%
  600. as_data_frame() %&gt;%
  601. mutate(obs = 1:n()) %&gt;%
  602. gather(class, prob, -obs) %&gt;%
  603. right_join(oneHotToLabel, by = "class")
  604. predictionPerformance &lt;- tidyPredictionProbs %&gt;%
  605. group_by(obs) %&gt;%
  606. summarise(
  607. highestProb = max(prob),
  608. predicted = label[prob == highestProb]
  609. ) %&gt;%
  610. mutate(
  611. truth = testData$activityName,
  612. correct = truth == predicted
  613. )
  614. ```
  615. ---
  616. ```r
  617. predictionPerformance %&gt;% paged_table()
  618. ```
  619. &lt;div data-pagedtable="false"&gt;
  620. &lt;script data-pagedtable-source type="application/json"&gt;
  621. {"columns":[{"label":["obs"],"name":[1],"type":["int"],"align":["right"]},{"label":["highestProb"],"name":[2],"type":["dbl"],"align":["right"]},{"label":["predicted"],"name":[3],"type":["fctr"],"align":["left"]},{"label":["truth"],"name":[4],"type":["fctr"],"align":["left"]},{"label":["correct"],"name":[5],"type":["lgl"],"align":["right"]}],"data":[{"1":"1","2":"0.6953406","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"2","2":"0.7918580","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"3","2":"0.8739656","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"4","2":"0.6162640","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"5","2":"0.9656017","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"6","2":"0.9810318","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"7","2":"0.4375742","3":"SIT_TO_STAND","4":"STAND_TO_SIT","5":"FALSE"},{"1":"8","2":"0.7479992","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"9","2":"0.6449857","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"10","2":"0.3713405","3":"STAND_TO_LIE","4":"STAND_TO_SIT","5":"FALSE"},{"1":"11","2":"0.9581490","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"12","2":"0.8832200","3":"STAND_TO_SIT","4":"STAND_TO_SIT","5":"TRUE"},{"1":"13","2":"0.9605206","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"14","2":"0.9163612","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"15","2":"0.8394418","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"16","2":"0.8588013","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"17","2":"0.9150074","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"18","2":"0.9446425","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"19","2":"0.3607596","3":"STAND_TO_SIT","4":"SIT_TO_STAND","5":"FALSE"},{"1":"20","2":"0.8701729","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"21","2":"0.9262933","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"22","2":"0.7589828","3":"LIE_TO_STAND","4":"SIT_TO_STAND","5":"FALSE"},{"1":"23","2":"0.9377650","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"24","2":"0.9595401","3":"SIT_TO_STAND","4":"SIT_TO_STAND","5":"TRUE"},{"1":"25","2":"0.9568424","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"26","2":"0.5518884","3":"STAND_TO_LIE","4":"SIT_TO_LIE","5":"FALSE"},{"1":"27","2":"0.7421954","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"28","2":"0.6583025","3":"STAND_TO_LIE","4":"SIT_TO_LIE","5":"FALSE"},{"1":"29","2":"0.9658179","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"30","2":"0.9121835","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"31","2":"0.4968731","3":"LIE_TO_SIT","4":"SIT_TO_LIE","5":"FALSE"},{"1":"32","2":"0.6501346","3":"STAND_TO_LIE","4":"SIT_TO_LIE","5":"FALSE"},{"1":"33","2":"0.9498605","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"34","2":"0.9800638","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"35","2":"0.9154740","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"36","2":"0.9843051","3":"SIT_TO_LIE","4":"SIT_TO_LIE","5":"TRUE"},{"1":"37","2":"0.8210910","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"38","2":"0.8618044","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"39","2":"0.6584178","3":"LIE_TO_STAND","4":"LIE_TO_SIT","5":"FALSE"},{"1":"40","2":"0.7765780","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"41","2":"0.9013256","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"42","2":"0.3937732","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"43","2":"0.3474609","3":"STAND_TO_SIT","4":"LIE_TO_SIT","5":"FALSE"},{"1":"44","2":"0.3863149","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"45","2":"0.8519310","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"46","2":"0.8703132","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"47","2":"0.9792970","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"48","2":"0.8807071","3":"LIE_TO_SIT","4":"LIE_TO_SIT","5":"TRUE"},{"1":"49","2":"0.8119466","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"50","2":"0.3267542","3":"LIE_TO_STAND","4":"STAND_TO_LIE","5":"FALSE"},{"1":"51","2":"0.7161341","3":"STAND_TO_SIT","4":"STAND_TO_LIE","5":"FALSE"},{"1":"52","2":"0.4828011","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"53","2":"0.8882010","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"54","2":"0.8389294","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"55","2":"0.4201318","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"56","2":"0.9749061","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"57","2":"0.5230636","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"58","2":"0.9764158","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"59","2":"0.9970811","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"60","2":"0.9354617","3":"STAND_TO_LIE","4":"STAND_TO_LIE","5":"TRUE"},{"1":"61","2":"0.7152811","3":"LIE_TO_STAND","4":"LIE_TO_STAND","5":"TRUE"},{"1":"62","2":"0.7489066","3":"LIE_TO_STAND","4":"LIE_TO_STAND","5":"TRUE"},{"1":"63","2":"0.7416736","3":"LIE_TO_SIT","4":"LIE_TO_STAND","5":"FALSE"},{"1":"64","2":"0.5745348","3":"LIE_TO_SIT","4":"LIE_TO_STAND","5":"FALSE"},{"1":"65","2":"0.6248744","3":"LIE_TO_SIT","4":"LIE_TO_STAND","5":"FALSE"},{"1":"66","2":"0.7856053","3":"LIE_TO_STAND","4":"LIE_TO_STAND","5":"TRUE"},{"1":"67","2":"0.3914986","3":"SIT_TO_LIE","4":"LIE_TO_STAND","5":"FALSE"},{"1":"68","2":"0.9219601","3":"SIT_TO_LIE","4":"LIE_TO_STAND","5":"FALSE"},{"1":"69","2":"0.4181097","3":"SIT_TO_STAND","4":"LIE_TO_STAND","5":"FALSE"},{"1":"70","2":"0.8611215","3":"LIE_TO_SIT","4":"LIE_TO_STAND","5":"FALSE"},{"1":"71","2":"0.6578168","3":"LIE_TO_SIT","4":"LIE_TO_STAND","5":"FALSE"},{"1":"72","2":"0.6923091","3":"LIE_TO_STAND","4":"LIE_TO_STAND","5":"TRUE"}],"options":{"columns":{"min":{},"max":[10]},"rows":{"min":[10],"max":[10]},"pages":{}}}
  622. &lt;/script&gt;
  623. &lt;/div&gt;
  624. ---
  625. layout:true
  626. ## Визуализация ошибок
  627. ---
  628. ```r
  629. predictionPerformance %&gt;%
  630. mutate(result = ifelse(correct, 'Correct', 'Incorrect')) %&gt;%
  631. ggplot(aes(highestProb)) +
  632. geom_histogram(binwidth = 0.01) +
  633. geom_rug(alpha = 0.5) +
  634. facet_grid(result~.) +
  635. ggtitle("Probabilities associated with prediction by correctness")
  636. ```
  637. ![](Deep_Learning_in_R_files/figure-html/unnamed-chunk-29-1.png)&lt;!-- --&gt;
  638. ---
  639. ```r
  640. predictionPerformance %&gt;%
  641. group_by(truth, predicted) %&gt;%
  642. summarise(count = n()) %&gt;%
  643. mutate(good = truth == predicted) %&gt;%
  644. ggplot(aes(x = truth, y = predicted)) +
  645. geom_point(aes(size = count, color = good)) +
  646. geom_text(aes(label = count),
  647. hjust = 0, vjust = 0,
  648. nudge_x = 0.1, nudge_y = 0.1) +
  649. guides(color = FALSE, size = FALSE) +
  650. theme_minimal()
  651. ```
  652. ![](Deep_Learning_in_R_files/figure-html/unnamed-chunk-30-1.png)&lt;!-- --&gt;
  653. ---
  654. layout:false
  655. class: inverse, middle, center
  656. # Заключение
  657. ---
  658. background-image: url(https://images.manning.com/720/960/resize/book/a/4e5e97f-4e8d-4d97-a715-f6c2b0eb95f5/Allaire-DLwithR-HI.png)
  659. ---
  660. class: center, middle
  661. # Спасибо!
  662. Слайды сделаны с помощью R package [**xaringan**](https://github.com/yihui/xaringan).
  663. Веб версию слайдов можно найти на https://metya.github.io/DeepLearning_n_R/
  664. Код можно посмотреть здесь
  665. https://github.com/metya/DeepLearning_n_R/
  666. </textarea>
  667. <script src="https://remarkjs.com/downloads/remark-latest.min.js"></script>
  668. <script>var slideshow = remark.create({
  669. "highlightStyle": "github",
  670. "highlightLines": true,
  671. "countIncrementalSlides": false
  672. });
  673. if (window.HTMLWidgets) slideshow.on('afterShowSlide', function (slide) {
  674. window.dispatchEvent(new Event('resize'));
  675. });
  676. (function() {
  677. var d = document, s = d.createElement("style"), r = d.querySelector(".remark-slide-scaler");
  678. if (!r) return;
  679. s.type = "text/css"; s.innerHTML = "@page {size: " + r.style.width + " " + r.style.height +"; }";
  680. d.head.appendChild(s);
  681. })();</script>
  682. <script>
  683. (function() {
  684. var i, text, code, codes = document.getElementsByTagName('code');
  685. for (i = 0; i < codes.length;) {
  686. code = codes[i];
  687. if (code.parentNode.tagName !== 'PRE' && code.childElementCount === 0) {
  688. text = code.textContent;
  689. if (/^\\\((.|\s)+\\\)$/.test(text) || /^\\\[(.|\s)+\\\]$/.test(text) ||
  690. /^\$\$(.|\s)+\$\$$/.test(text) ||
  691. /^\\begin\{([^}]+)\}(.|\s)+\\end\{[^}]+\}$/.test(text)) {
  692. code.outerHTML = code.innerHTML; // remove <code></code>
  693. continue;
  694. }
  695. }
  696. i++;
  697. }
  698. })();
  699. </script>
  700. <!-- dynamically load mathjax for compatibility with self-contained -->
  701. <script>
  702. (function () {
  703. var script = document.createElement('script');
  704. script.type = 'text/javascript';
  705. script.src = 'https://mathjax.rstudio.com/latest/MathJax.js?config=TeX-MML-AM_CHTML';
  706. if (location.protocol !== 'file:' && /^https?:/.test(script.src))
  707. script.src = script.src.replace(/^https?:/, '');
  708. document.getElementsByTagName('head')[0].appendChild(script);
  709. })();
  710. </script>
  711. </body>
  712. </html>