-
Notifications
You must be signed in to change notification settings - Fork 6
/
007-gesture.Rmd
490 lines (391 loc) · 35.8 KB
/
007-gesture.Rmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
# Gesture and Communication {#gesture}
In addition to containing early words, CDI forms designed for infants (the "Words and Gestures" family) also contain a set of items designed to probe early gestural communication. This chapter explores these items. Our goals are to examine (1) the robustness of the measurement properties of these non-verbal parent-report measures, (2) the degree of cross-linguistic consistency and variability of reporting milestones like first pointing, as well as social routines like waving hi and playing peekaboo, and (3) the relationships between gestural development and linguistic development.
## Introduction
Children's most recognizable early linguistic accomplishments are surely their first words -- a topic we turn to in the Chapter \@ref(items-consistency). However, even before infants approach this important milestone, they are already communicating through another modality: gesture. For example, a child who extends their hands and opens and closes their fist likely wants something to be given to them. A child who points to a bird up in a tree likely wants to get their caregiver's attention so that they can share in the delight together. Children's early vocalizations are also sometimes accompanied by gestures, for example, a child might raise both of their hands in the air and say "up!" The social and communicative routines that these gestures enable may themselves form part of the supportive context in which early language learning happens [@bruner1985]. In sum, gestures are an important aspect of children's early communicative development.
Early gestures have long been thought to have a common mental status with later-developing linguistic accomplishments because both may reflect the child's understanding of symbols, i.e., that a name or gesture can "stand in" for a thing in the world. The classic theories of @piaget1962 and @werner1963 proposed that all symbols have their origins in actions carried out on objects, and moreover, such symbols can be manifested in either the vocal or the gestural domain. These proposals suggest a common underlying mental function that is critical to the development of all symbolic skills, both language and in certain types of gestures.
While the strong representational claims in these theories may be too extreme by modern standards, they do correctly predict developmental continuity between early gesture use and children's later lexical and syntactic development [e.g., @bates1975; @thal1988]. For example, children's ability to point to distant objects is linked to the onset of the production of first words [@fenson2007;@brooks2008], and children with delayed onset of pointing are likely to also be delayed in first word production [@clark1977;@butterworth2003]. In addition, children's early gesture use is correlated with their later comprehension abilities [@bates1991], and children's use of gestures in combinations with words is linked to the later production of multi-word combinations [e.g., @goldin-meadow1998; @iverson1994].
These early correlational findings could simply reflect a common cause: Children who use gestures might also be better at learning words. More recent studies have demonstrated more specific links between early gesture use and later lexical and syntactic development, however [e.g., @rowe2009]. For example, the particular lexical items that enter a child’s vocabulary are more likely to be names for those objects that are earlier labeled using gestures [@iverson2005]. Moreover, early gesture vocabulary is specifically linked to later word vocabulary, whereas early gesture plus word combinations are linked specifically to children's later word combination skills [@rowe2009]. Taken together, the pattern of predictive correlations suggests that children's early gestures provide an important social, communicative, and linguistic foundation for later language development.
Early gestures serve many different functions. Children typically first begin to use "deictic gestures," for example, giving, pointing, and showing [e.g., @volterra1985]. Such deictic gestures are clear precursors to important linguistic and communicative functions, including establishing reference and promoting shared attention [@carpenter1998]. However, these deictic gestures do not necessarily have symbolic content *per se* [i.e., they do not stand for objects in the world, @bates1980]. Early on, pointing gestures may serve a general imperative function, i.e. to request something from an adult. In contrast, later pointing is more likely to be referential, directing a caregiver's attention to another object or person [@bates1975; @masur1990; @vygotsky1980].
Children also use gestures as part of social activities, for example, waving "bye bye" or signaling "all done." At first, social gestures might occur simply as imitations, but then later, children are able to produce these social gestures spontaneously in appropriate communicative contexts. Children's social gestures also can reflect their ability to engage in activities during pretend play, e.g., talking on a pretend phone or pretending to stir a soup.
<!-- Thus, social gestures can show children's ability to tune into contextual cues, mentally reconstruct activities, and engage in sequences of events. -->
Finally, older children's gestures also take on a "true" symbolic meaning, as a child might use a conventional gesture to recognize or classify objects as an instance of a category (e.g., pretend to drink from a cup or sniff a flower). Some theorists have hypothesized that children's ability to use gestures in this symbolic way may reflect a common underlying "vocabulary" in both the verbal and gestural domain [e.g., @acredolo1985; @bates1980]. These gestures may thus have a similar relationship to language as children's pretend play [@bergen2002; @smith2011].
In sum, both early deictic gestures and later symbolic gestures have played an important role in shaping theories of communication and language learning. Thus, their cross-linguistic variability and their relationship to other aspects of language learning are important topics for investigation.
```{r gesture-load_data, eval = FALSE}
wgs <- get_instruments() %>%
filter(form == "WG")
wg_data <- map(pull(wgs, language),
~ get_instrument_data(.x, "WG", administrations = T,
iteminfo = T)) %>%
bind_rows()
gesture_langs <- wg_data %>%
filter(str_detect(type, "gestures")) %>%
distinct(language) %>%
pull()
# Hebrew is mismapped
# gestures = gestures_first
# gestures_object = gestures_objects
# gestures_actions = gestures_adult
# gestures_pretend = gestures_parent
# Italian has an extra gestures_play which is just one item of pretend play
hebrew_mappings <- data_frame(type = c("gestures", "gestures_object",
"gestures_actions", "gestures_pretend"),
new_type = c("gestures_first", "gestures_objects",
"gestures_adult", "gestures_parent"))
gesture_data <- wg_data %>%
filter(language %in% gesture_langs) %>%
filter(str_detect(type, "gestures") | type == "word") %>%
filter(type != "gestures_play") %>%
left_join(hebrew_mappings) %>%
mutate(type = if_else(is.na(new_type), type, new_type)) %>%
select(type, language, value, age, definition, category, data_id,
comprehension, production, sex, mom_ed, num_item_id)
# write_feather(gesture_data, "data/gesture/gesture_data.feather")
save(gesture_data, file = "data/gesture/gesture_data.Rds")
```
```{r gesture-load_data_local}
# gesture_data <- read_feather("data/gesture/gesture_data.feather")
load("data/gesture/gesture_data.Rds")
unilemmas <- read_csv("data/gesture/first_gestures.csv")
```
## Measurement properties of CDI gestures
Following our work in Chapter \@ref(psychometrics), we begin by analyzing the degree of measurement signal in the gesture items. The available dataset is unfortunately significantly smaller than is available for vocabulary items -- a number of users of the CDI forms did not measure (or at least did not provide us with data) on gesture items. Consequently, we focus first on the American English Words & Gestures form and use face validity as our primary criterion rather than a more sophisticated metric.
### Measuring the development of gesture
Unlike the word items on the CDI, which typically ask parents to make a binary decision about whether a word is in their child's vocabulary (although comprehension and production are separate decisions), the First Gestures on CDI forms ask parents to make a 3-way decision, determining if their child produces a given gesture "often", "sometimes", or "not yet." We begin by asking whether parents' responses are sensitive to this distinction, as the choice of whether to treat all three levels as meaningful impacts downstream analytic decisions. We perform this sensitivity analysis on the American English CDI as it is the inventory for which we have the best a priori intuitions.
Figure \@ref(fig:gesture-first-gesture-figure) shows the proportion of American English learning children who give each of these responses. If each of the three responses is meaningfully different, the developmental trajectory of each should be distinct and predictable. The proportion of children whose parents indicate that they do "not yet" produce each gesture declines predictably over development. However, the other two responses -- "sometimes" and "often" -- do not appear to have reliably different trajectories. Perhaps they are used differently by different parents or in different samples.
```{r gesture-first_gestures}
first_gestures <- gesture_data %>%
filter(type == "gestures_first") %>%
left_join(unilemmas)
# Get the First Gestures
eng_first_gestures <- first_gestures %>%
filter(language == "English (American)") %>%
filter(!is.na(value)) %>%
mutate(value = parse_factor(value, c("not yet", "sometimes", "often"))) %>%
group_by(age, Unilemma, value) %>%
summarise(n = n()) %>%
mutate(n = n/sum(n)) %>%
complete(age, Unilemma, value, fill = list(n = 0))
# Order by approximate acquistion order to make plotting nicer
acq_order <- eng_first_gestures %>%
filter(value == "not yet") %>%
group_by(Unilemma) %>%
summarise(n = mean(n)) %>%
arrange(n)
first_gestures_ordered <- eng_first_gestures %>%
ungroup() %>%
mutate(Unilemma = parse_factor(Unilemma, acq_order$Unilemma))
```
```{r gesture-first-gesture-figure, fig.width = 8.5, fig.height = 6, fig.cap='Proportion of each response type over age on each First Gestures item for American English.'}
ggplot(first_gestures_ordered, aes(x = age, y = n, color = value, label = value)) +
facet_wrap(~ Unilemma) +
geom_point() +
geom_smooth(method = "loess", se = FALSE, span = 1) +
directlabels::geom_dl(method = list(directlabels::dl.trans(x=x +.2),
"last.qp", cex=0.8, fontfamily = .font)) +
.scale_colour_discrete(guide = FALSE) +
scale_x_continuous(name = "Age (months)", limits = c(7.5, 24.5),
breaks = seq(8, 18, by = 2)) +
scale_y_continuous(name = "Proportion of responses")
```
For comparison, we collapse the "sometimes" and "often" into a single value, and plot the proportion of children at each age whose parents report that they produce each gesture (Figure \@ref(fig:gesture-first-gesture-binary-figure)). The trajectories look generally smooth and *prima facie* reasonable, with the potential exception of the _smack lips_ gesture for which there is very little developmental change (this gesture, which corresponds to the vocalization _yum yum_, may be unusual or less stereotyped).
```{r gesture-first_gestures_binary}
# Get the First Gestures
eng_first_gestures_binary <- eng_first_gestures %>%
mutate(value = if_else(value == "not yet", "no", "yes")) %>%
group_by(value, add = T) %>%
summarise(n = sum(n)) %>%
filter(value == "yes")
first_gestures_binary_ordered <- eng_first_gestures_binary %>%
ungroup() %>%
mutate(definition = parse_factor(Unilemma, acq_order$Unilemma))
```
```{r gesture-first-gesture-binary-figure, fig.width = 6, fig.height = 4, fig.cap='Trajectory over age of each First Gestures item for American English.'}
ggplot(first_gestures_binary_ordered, aes(x = age, y = n, color = definition,
label = Unilemma)) +
geom_point() +
geom_smooth(method = "loess", se = FALSE) +
directlabels::geom_dl(method = list(directlabels::dl.trans(x=x -.2),
"first.qp", cex=0.8, fontfamily = .font)) +
.scale_colour_discrete(guide = FALSE) +
scale_x_continuous(name = "Age (months)", limits = c(6.5, 18),
breaks = seq(8, 18)) +
scale_y_continuous(name = "Proportion producing")
```
While these gestures are categorized on the CDI as "first gestures," the form also asks parents about a variety of other kinds of gestures that children produce, including those involved in games and pretend play. Do these gestures have similar trajectories? Figure \@ref(fig:gesture-other-figure) plots developmental trajectories for these other categories of gesture.
```{r gesture-other}
# Get the First Gestures
other <- gesture_data %>%
filter(!type %in% c("gestures_first", "word"),
language == "English (American)") %>%
filter(!is.na(value)) %>%
mutate(value = parse_factor(value, c("no", "yes"))) %>%
group_by(age, type, definition, value) %>%
summarise(n = n()) %>%
mutate(n = n/sum(n)) %>%
complete(age, nesting(type, definition), value, fill = list(n = 0)) %>%
filter(value == "yes")
# Order by approxiamate acquistion order to make plotting nicer
other_type_order <- other %>%
group_by(type, definition) %>%
summarise(n = mean(n)) %>%
summarise(n = mean(n)) %>%
arrange(desc(n))
other_indiv_order <- other %>%
ungroup() %>%
mutate(type = parse_factor(type, other_type_order$type)) %>%
group_by(type, definition) %>%
summarise(n = mean(n)) %>%
arrange(desc(n))
other_gestures_ordered <- other %>%
ungroup() %>%
mutate(type = parse_factor(type, other_type_order$type),
type = type %>% str_replace("_", " ") %>% str_to_title()) %>%
mutate(definition = parse_factor(definition,
other_indiv_order$definition)) %>%
mutate(type = factor(type,
labels = c("Imitating Other Adult Actions",
"Games and Routines",
"Actions with Objects",
"Pretending to be a Parent")))
```
While some are clearly learned later than the early gestures, a number of these appear to be learned quite early as well -- for example, peekaboo and pretend play with cups and spoons. They all also appear to have generally smooth and increasing trajectories with the exception of _so big_ (from Gestures Games) which, like _smack lips_ from the First Gestures section appears to be either less stereotyped, more difficult to identify, or more variable across children.
```{r gesture-other-figure, fig.width = 8, fig.height = 7, fig.cap="Trajectory over age of each gestures item by type for American English."}
ggplot(other_gestures_ordered, aes(x = age, y = n, color = definition,
label = definition)) +
facet_wrap(~type) +
geom_point() +
geom_smooth(method = "loess", se = FALSE) +
directlabels::geom_dl(method = list(directlabels::dl.trans(x = x - .2),
"first.qp", cex = 0.8,
fontfamily = .font)) +
.scale_colour_numerous(guide = FALSE) +
scale_x_continuous(name = "Age (months)", limits = c(5.5, 18),
breaks = seq(8, 18)) +
scale_y_continuous(name = "Proportion producing")
```
Taken as a whole, it is clear that almost all of the gesture items have developmental trajectories not unlike word items, and that they thus have the potential for informative analyses. Further, trajectories look qualitatively similar across categories. Consequently, for general cross-linguistic analyses, we will consider all of the gestures together, and compress "often" and "sometimes" into a single affirmative choice.
To estimate the coherence of these categories, we compute age of acquisition estimates for each of the American English gestures by gesture type: First Gestures (e.g. _pick me up_, _point_), Game Gestures (e.g. _play peekaboo_, _chase_), Object Gestures (e.g. _brush teeth_, _push car_), Adult gestures (e.g. _type_, _use pen_), and Parent Gestures (e.g. _sweep_, _feed from a spoon_). These estimates were produced by fitting a robust linear regression to the proportion of children who produce each gesture and estimating the age at which 50% of children produce the given gesture. The resulting ages of acquisition for each gesture type are shown in Figure \@ref(fig:gesture-aoa). These categories vary in coherence, but overall First Gestures and Games tend to be produced early, and Adult and Parent gestures -- more representative of pretend play -- are produced relatively later (many not reaching 50% within the administration range of the form). The object gestures vary substantially in their ages of acquisition.
```{r gesture-aoa, fig.width = 6, fig.height = 4, fig.cap="Age of acquisition for each gestures item by type for American English."}
eng_gesture_aoas <- gesture_data %>%
filter(type != "word", language == "English (American)") %>%
ungroup() %>%
mutate(value = if_else(is.na(value), as.character(NA),
if_else(value %in% c("often", "sometimes", "yes"),
"produces", ""))) %>%
fit_aoa(method = "glmrob") %>%
ungroup() %>%
mutate(type = gsub("gestures_", "", type),
type = factor(type, labels = c("Imitating Other Adult Actions",
"First Gestures",
"Games and Routines",
"Actions with Objects",
"Pretending to be a Parent")))
order <- eng_gesture_aoas %>%
group_by(type) %>%
summarise(aoa = mean(aoa, na.rm = T)) %>%
arrange(aoa)
eng_gesture_aoas %>%
mutate(type = fct_relevel(type, as.character(order$type))) %>%
ggplot(aes(x = type, y = aoa, fill = type)) +
geom_dotplot(binaxis='y', stackdir='center') +
.scale_fill_discrete(guide = FALSE) +
scale_y_continuous(breaks = seq(8, 18, by = 2)) +
labs(x = "Gesture type", y = "Age of acquisition") +
coord_flip()
```
### Consistency of the first gestures
While the First Gestures are not universally learned before the other gestures measured, they are among the earliest learned. Because of the particular theoretical importance of these early communicative gestures (e.g. deictics like pointing and showing, routines like _pick me up_), we analyze the cross-linguistic consistency of these at the item level.
```{r gesture-crossling-first}
first_gestures_crossling <- gesture_data %>%
filter(type == "gestures_first") %>%
filter(!is.na(value), value != "") %>%
mutate(value = !value %in% c("no", "never", "not yet"))
crossling_aoas <- first_gestures_crossling %>%
mutate(value = if_else(value, "produces", "")) %>%
fit_aoa() %>%
left_join(unilemmas) %>%
group_by(Unilemma) %>%
mutate(n = n()) %>%
filter(n > 2, !is.na(Unilemma))
mean_crossling_aoas <- crossling_aoas %>%
group_by(Unilemma) %>%
summarise(mean = mean(aoa, na.rm = T), sd = sd(aoa, na.rm = T), n = n()) %>%
arrange(mean)
kable(mean_crossling_aoas, digits = 2,
caption = 'Summary statistics for ages of acquistion for each First Gestures item across languages.',
col.names = c("Item", "Mean", "SD", "N")) %>%
kableExtra::kable_styling(full_width = FALSE)
```
Table \@ref(tab:gesture-crossling-first) and Figure \@ref(fig:gesture-crossling-fig) show both consistency and variability across items. As in the learning of words, the means and variances of these ages of acquisition were correlated [_r_ = `r roundp(cor(mean_crossling_aoas$mean, mean_crossling_aoas$sd))`; @mollica2017]. The primary outliers were _request_, which appears to be produced surprisingly late in American English, and _shrug_ which was produced surprisingly late by French-learning infants. In general, however, most of the cross-linguistic differences appear to be consistent across the gestures (i.e. French-learning infants gestures later). It is difficult to tell from this small sample of mostly European languages whether these differences are driven by linguistic factors or rather by properties of our samples or variability in parents' interpretation of the form. Nonetheless, they provide some evidence for consistency in the process of gestural development cross-linguistically. To get additional leverage on this process, we next consider the full set of gestures.
```{r gesture-crossling-fig, fig.width = 8, fig.height = 5, fig.cap='Distribution of ages of acquistion for each First Gestures item for each language.'}
crossling_aoas %>%
ungroup() %>%
mutate(Unilemma = parse_factor(Unilemma, mean_crossling_aoas$Unilemma)) %>%
ggplot(aes(x = Unilemma, y = aoa, group = Unilemma)) +
geom_violin(fill = NA, color = .grey) +
geom_point(aes(color = language), position = position_jitter(width = .25, height = 0)) +
scale_colour_manual(values = lang_colours) +
labs(x = "Item", y = "Age of acquisition") +
theme(legend.position = c(.15, .75), legend.title = element_blank(),
axis.text.x = element_text(size = 10))
```
### Intercorrelation among gestures
```{r gesture-category_intercor}
eng_words <- gesture_data %>%
filter(language == "English (American)", type == "word") %>%
mutate(produces = value == "produces",
understands = value == "understands") %>%
gather(measure, value, produces, understands)
kid_word_type_data <- eng_words %>%
select(category, measure, value, definition, data_id) %>%
group_by(category, measure, data_id) %>%
summarise(prop = mean(value, na.rm = T))
word_intercor_data <- kid_word_type_data %>%
split(.$measure) %>%
map(~ widyr::pairwise_cor(.x, category, data_id, prop, use = "pairwise.complete")) %>%
bind_rows(.id = "measure") %>%
group_by(measure) %>%
summarise(mean = mean(correlation), sd = sd(correlation))
```
```{r gesture-intercorrelation}
binary_data <- gesture_data %>%
filter(type != "word") %>%
mutate(value = if_else(is.na(value) | value == "", NA,
if_else(value %in% c("no", "not yet", "never"), F, T)))
kid_type_data <- binary_data %>%
group_by(language, type, data_id) %>%
summarise(prop = mean(value, na.rm = T))
intercor_data <- kid_type_data %>%
split(.$language) %>%
map(~ widyr::pairwise_cor(.x, type, data_id, prop, use = "pairwise.complete")) %>%
bind_rows(.id = "language") %>%
group_by(language) %>%
summarise(mean = mean(correlation), sd = sd(correlation))
```
Given both the similarity and the variability in the developmental trajectories of different gestures, as well as the cross-linguistic variability in first gestures, a natural next step is to quantify the relationship of gestures to each-other. We begin by computing the average intercorrelation between each of these gesture categories. In this analysis, we take gesture categories in pairs (e.g., Adult Gestures and First Gestures) and ask how the proportion of items that children know in one predict the proportion of items they know in the other. For American English learning children, the proportion of gestures they know across categories is correlated at _r_ = `r intercor_data %>% filter(language == "English (American)") %>% pull(mean) %>% roundp()` -- nearly identical to the value of ~0.6 reported by @fenson1994. For comparison, the same intercorrelation computed across categories of words (e.g. "animals" and "places") yield `r word_intercor_data %>% filter(measure == "produces") %>% pull(mean) %>% roundp(2)` for production and `r word_intercor_data %>% filter(measure == "understands") %>% pull(mean) %>% roundp()` for comprehension.
This cross-category intercorrelation is quite similar cross-linguistically, ranging from `r roundp(min(intercor_data$mean))` in `r intercor_data %>% filter(mean == min(mean)) %>% pull(language)` to `r roundp(max(intercor_data$mean))` in `r intercor_data %>% filter(mean == max(mean)) %>% pull(language)`. The full set of intercorrelations is shown in Table \@ref(tab:gesture-intercor-table).
```{r gesture-intercor-table}
kable(intercor_data, digits = 3, col.names = c("Language", "Mean", "SD"),
caption = "Summary statistics for intercorrelations between gesture categories for each language.") %>%
kableExtra::kable_styling(full_width = FALSE)
```
## The relationship between language and gesture
A critical theoretical question in early communicative development concerns the relationship between language and gesture. As alluded to above, a number of early influential theories [e.g., @piaget1962; @werner1963] held that gesture and language should be intimately related because of their reliance on a shared system of symbolic reasoning. To the extent that they are underpinned by the same system, words and gestures should have related developmental trajectories -- children who gesture early should also speak early and vice versa [@bates1991]. Following in the footsteps of @fenson2007, we ask this question at larger scale, and cross-linguistically. To assess this relationship, we will look at the correlations between children's gestural and linguistic vocabularies.
To first provide a baseline, however, we compute the correlation between children's language and gesture development and their age. As Figure \@ref(fig:gesture-age-cor-fig) below shows, gesture shows as much or more developmental change than comprehension and production -- at least over the age range measured by the CDI Words & Gestures forms. The variability in the correlation with age in all three measures hangs together within languages: Languages where there is more developmental change in linguistic development also tend to have more gestural development. Production typically shows the lowest correlation, presumably because many childre are still at floor on this measure for most of the age range being measured.
```{r gesture-age-cor-fig, fig.cap='Correlations between age and subscales (gesture, comprehension, production) across languages.', fig.height=3}
age_cors <- binary_data %>%
group_by(language, age, comprehension, production, data_id) %>%
summarise(gesture = mean(value, na.rm = TRUE)) %>%
ungroup() %>%
gather(measure, value, comprehension, production, gesture) %>%
split(paste0(.$language, "_", .$measure)) %>%
map(~ cor(.x$age, .x$value, use = "pairwise.complete")) %>%
as_data_frame() %>%
gather(id, cor) %>%
separate(id, into = c("language", "measure"), "_") %>%
select(language, measure, cor) %>%
mutate(measure = factor(measure,
levels = c("gesture", "comprehension", "production")))
ggplot(age_cors, aes(x = language, y = cor, color = measure)) +
geom_point() +
coord_flip() +
.scale_color_discrete(name = "Measure") +
labs(x = "", y = "", color = "subscale") +
theme(legend.position = "top", legend.title = element_blank(),
panel.grid.major.y = .coef_line)
```
```{r gesture-growths, eval = F, include = F}
#The Figure below shows the proportion of gesture items produced by children in each of these 3 languages across development.
binary_data %>%
group_by(language, age, data_id) %>%
summarise(prop = mean(value, na.rm = T)) %>%
ggplot(aes(x = age, y = prop, color = language,
group = language, label = language)) +
geom_jitter(alpha = .1, size = .1) +
geom_smooth(method = "loess", se = F) +
directlabels::geom_dl(method = "smart.grid", cex=1) +
theme(legend.position = "none")
```
But what is the relationship between language and gesture? As both children's lingusitic and gestural vocabularies increase over development, we should expect to see a positive correlation between language and gesture regardless of any interesting assocations between them. One way of getting leverage on their relationship is to exploit the difference between comprehension and production. As noted previously, comprehension and production do not proceed in lock-step and comprehension generally outpaces production. This is, in part, because production requires additional control over the developing motor systems necessary for speech. But it may also be driven by individual differences in children's personalities or communicative goals: Some children may want to talk more than others (see Chapter \@ref(style)).
To the extent that gesture and language are related by their shared reliance on symbolic understanding, their correlation should be highest when only this shared system is tapped. In this case, we should predict that gesture *production* and language *comprehension* are more tightly correlated than gesture *production* and language *production*. In contrast, if the correlation is due primarily to a shared desire to communicate and engage socially with caregivers, we should predict a stronger correlation between gesture *production* and language *production*. Across these `r nrow(intercor_data)` languages, children's production of gestures is consistently more highly correlated with their comprehension of language than their production of language (Table \@ref(tab:gesture-gest-lang)). This analysis provides at least some initial evidence for the role of symbolic understanding in driving the correlation between language and gesture. An alternative explanation is also plausible, however -- comprehension may simply show more variability than production in this age range, allowing for a higher level of correlation.
```{r gesture-gest-lang}
gest_lang_data <- binary_data %>%
group_by(language, comprehension, production, data_id) %>%
summarise(gesture = mean(value, na.rm = T)) %>%
ungroup() %>%
gather(measure, value, comprehension, production) %>%
split(paste0(.$language, "_", .$measure)) %>%
map(~ cor(.x$gesture, .x$value, use = "pairwise.complete")) %>%
as_data_frame() %>%
gather(id, cor) %>%
separate(id, into = c("language", "measure"), "_") %>%
spread(measure, cor)
kable(gest_lang_data, digits = 2,
caption = "Correlation with gesture subscale for each vocabulary subscale in each language.",
col.names = c("Language", "Comprehension", "Production")) %>%
kableExtra::kable_styling(full_width = FALSE)
```
```{r gesture-gest-lang-categories}
early_gestures_type <- binary_data %>%
left_join(unilemmas) %>%
filter(type == "gestures_first") %>%
mutate(type = if_else(Unilemma %in% c("point", "give", "show"),
"deictic", "other"))
other_types <- early_gestures_type %>%
filter(type == "other") %>%
ungroup() %>%
distinct(Unilemma) %>%
filter(!is.na(Unilemma),
!Unilemma %in% c("smack lips", "finger turn", "hot", "come here")) %>%
pull()
other_type_combs <- combn(other_types, 3, simplify = F)
```
As a second, more specific test of this hypothesized relationship, we consider explicitly the deictic gestures. Deictic gestures are most closely associated directly with communicative goals rather than symbolic content: pointing, showing, and giving [@bates1991]. Because all of these gestures are produced by children relatively early, and thus contain less signal for older children, we compare these to the remaining Early Gestures that appear in at least 6 languages: `r paste(other_types, collapse = ", ")`. We excluded "smack lips" because of its lack of developmental change (see above). We then applied the same analytic method as above -- computing the correlation between children's gestureal and language development -- seperately for these deictic and non-deictic early gestures. Because there are many more non-deictics, we take all `r length(other_type_combs)` possible combinations of 3 of these gestures at a time.
Figure \@ref(fig:gesture-early-type-cors-fig) shows deictic gesture-vocabulary correlations. As before, correlations between gesture and comprehension are higher than gesture and production, but in all cases language is more correlated with the children's non-deictic gestural development rather than their deictic gestural development. This finding provides a second piece of evidence that the relationship between linguistic and gestural develompent is driven more strongly by reliance on a shared symbolic format rather than reliance on individual children's motoric develompent or desire to communicate. Although this finding adds additional specificity to our analysis, we still mark this conclusion as tentative due to possible confounding with measurement issues.
```{r gesture-early-type-cors-fig, fig.cap='Correlations between gesture and vocabulary size, for both deictic and non-deictic gestures, split by production and comprehension vocabulary.', fig.height=3}
gest_lang_cor_table <- function(gests) {
early_gestures_type %>%
filter(Unilemma %in% gests) %>%
group_by(language, comprehension, production, data_id) %>%
summarise(gesture = mean(value, na.rm = T)) %>%
ungroup() %>%
gather(measure, value, comprehension, production) %>%
split(paste0(.$language, "_", .$measure)) %>%
map(~ cor(.x$gesture, .x$value, use = "pairwise.complete")) %>%
as_data_frame() %>%
gather(id, cor) %>%
separate(id, into = c("language", "measure"), "_")
}
deictic_gest_lang_data <- gest_lang_cor_table(c("point", "give", "show")) %>%
mutate(type = "deictic")
other_gest_lang_data <- map(other_type_combs, gest_lang_cor_table) %>%
bind_rows(.id = "comb") %>%
group_by(language, measure) %>%
summarise(cor = mean(cor)) %>%
mutate(type = "other")
type_gest_lang_data <- bind_rows(deictic_gest_lang_data, other_gest_lang_data)
ggplot(type_gest_lang_data, aes(x = language, y = cor, color = type)) +
facet_wrap(~ measure, labeller = label_caps) +
geom_point() +
labs(x = "", y = "Correlation between gesture and vocabulary size",
color = "Gesture Type") +
theme(legend.position = "top")+
.scale_colour_discrete() +
coord_flip() +
theme(panel.grid.major.y = .coef_line)
```
## Conclusions
Gestures appear early in young children's communicative repertoires, with an understanding of the deictic purpose of pointing being found as early as 12 months of age [@liszkowski2007]. The frequency of gestures in children's input -- as well as the precociousness of their own gesture productions -- are also reliably correlated with their linguistic development [@rowe2009; @brooks2008]. In this chapter, we extended the analyses developed in @fenson2007 to look at these relationships cross-linguistically using large-scale CDI data.
In the first part of the chapter, we evaluated the measurement properties of the gesture items, as well as the coherence of the groupings of items on the CDI forms. Our analyses confirm that parents are likely able to report reliably on their children's gesture development. We found a high degree of consistency in development of different gestures within child -- children who learn some gestures early are also likely to learn other gestures early. Further, we observed a high degree of cross-linguistic consistency in the age of acquisition of different gestures.
Finally, we examine the relationship between gesture and language directly. We found that individual differences in gesture development were highly correlated with language development, and that gesture was more related to comprehension than production. Further, development of deictic gestures is less predictive of language development than development of non-deictic gestures. One speculative conclusion from these analyses is that precociousness in the gestural domain may be related to children's developing understanding of symbolic communication systems, rather than shared motoric development or a strong desire to communicate with their caregivers.
```{r gesture-cvs}
cvs <- gest_lang_data %>%
gather(measure, correlation, comprehension, production) %>%
group_by(measure) %>%
summarise(cv = cv(correlation),
sem = cv_sem(correlation),
n = n(),
category = "Relations") %>%
mutate(signature = "gesture/vocab correlation")
write_feather(cvs, "data/cvs/gesture_cvs.feather")
```