Suppose we have paired bivariate data
So far, we have considered the case where
library(NHANES)bwplot(BPSysAve ~ Race1 | Gender, data = NHANES, subset = Age >= 21)
bwplot(BPSysAve ~ Race1 | Gender, data = NHANES, subset = Age >= 21, panel = panel.average, fun = function(x) median(x, na.rm = TRUE), col = "black")
bwplot(BPSysAve ~ Race1 | Gender, data = NHANES, subset = Age >= 21, panel = panel.average, fun = function(x) mean(x, na.rm = TRUE), col = "black")
xyplot(BPSysAve ~ log(Weight) | Gender, data = NHANES, subset = Age >= 21, grid = TRUE)
xyplot(BPSysAve ~ log(Weight) | Gender, data = NHANES, subset = Age >= 21, grid = TRUE, smooth = "lm")
The other combinations we can consider:
The other combinations we can consider:
In this course, we will only consider the first case
In fact, we will typically consider
Categorical data can be summarized by frequency of each combination
This process is known as cross-tabulation
The resulting summary is known as a contingency table
head(NHANES[c("Race1", "Gender")], 20)
Race1 Gender1 White male2 White male3 White male4 Other male5 White female6 White male7 White male8 White female9 White female10 White female11 White male12 White male13 White male14 White female15 Mexican female16 White male17 Black female18 White male19 White male20 Other male
unique(NHANES[c("Race1", "Gender")])
Race1 Gender1 White male4 Other male5 White female15 Mexican female17 Black female24 Hispanic male31 Other female35 Mexican male45 Black male46 Hispanic female
xtabs(~ Race1 + Gender, NHANES)
GenderRace1 female male Black 614 583 Hispanic 320 290 Mexican 452 563 White 3221 3151 Other 413 393
xtabs(~ Race1 + Gender, NHANES) |> array2DF()
Race1 Gender Value1 Black female 6142 Hispanic female 3203 Mexican female 4524 White female 32215 Other female 4136 Black male 5837 Hispanic male 2908 Mexican male 5639 White male 315110 Other male 393
The above examples show two standard methods to represent contingency tables
The data frame representation is more familiar to us
The "table"-like format is more standard in many situations
The above examples show two standard methods to represent contingency tables
The data frame representation is more familiar to us
The "table"-like format is more standard in many situations
The "table" representation is generalized to "arrays" in R
We can switch between the representations using xtabs()
and array2DF()
UCBAdmissions
UCBAdmissions
UCBAdmissions
, , Dept = A GenderAdmit Male Female Admitted 512 89 Rejected 313 19, , Dept = B GenderAdmit Male Female Admitted 353 17 Rejected 207 8, , Dept = C GenderAdmit Male Female Admitted 120 202 Rejected 205 391, , Dept = D GenderAdmit Male Female Admitted 138 131 Rejected 279 244, , Dept = E GenderAdmit Male Female Admitted 53 94 Rejected 138 299, , Dept = F GenderAdmit Male Female Admitted 22 24 Rejected 351 317
UCBAdmissions
UCBAdmissions[1, , ]
DeptGender A B C D E F Male 512 353 120 138 53 22 Female 89 17 202 131 94 24
UCBAdmissions[, 1, ]
DeptAdmit A B C D E F Admitted 512 353 120 138 53 22 Rejected 313 207 205 279 138 351
UCBAdmissions[, , 1]
GenderAdmit Male Female Admitted 512 89 Rejected 313 19
UCBAdmissions
UCBAdmissionsDF <- array2DF(UCBAdmissions) # convert to data frame representationUCBAdmissionsDF
Admit Gender Dept Value1 Admitted Male A 5122 Rejected Male A 3133 Admitted Female A 894 Rejected Female A 195 Admitted Male B 3536 Rejected Male B 2077 Admitted Female B 178 Rejected Female B 89 Admitted Male C 12010 Rejected Male C 20511 Admitted Female C 20212 Rejected Female C 39113 Admitted Male D 13814 Rejected Male D 27915 Admitted Female D 13116 Rejected Female D 24417 Admitted Male E 5318 Rejected Male E 13819 Admitted Female E 9420 Rejected Female E 29921 Admitted Male F 2222 Rejected Male F 35123 Admitted Female F 2424 Rejected Female F 317
UCBAdmissions
(admitByGender <- xtabs(Value ~ Gender + Admit, data = UCBAdmissionsDF))
AdmitGender Admitted Rejected Female 557 1278 Male 1198 1493
apply(UCBAdmissions, c(1, 2), sum) # alternative using apply() function
GenderAdmit Male Female Admitted 1198 557 Rejected 1493 1278
UCBAdmissions
barchart(admitByGender, auto.key = TRUE, stack = FALSE)
UCBAdmissions
library(vcd)mosaic(admitByGender)
UCBAdmissions
barchart(Gender ~ Value | Dept, data = UCBAdmissionsDF, groups = Admit, origin = 0, auto.key = TRUE, stack = FALSE, as.table = TRUE)
UCBAdmissions
mosaic(xtabs(Value ~ Gender + Dept + Admit, UCBAdmissionsDF)) # change order
UCBAdmissions
This dataset is a well-known example that illustrates Simpson's Paradox
Ignoring one variable can lead to wrong conclusions about relationship between two other variables
For numeric
For categorical
For numeric
For categorical
For binary response, this can be sample proportion of any one category
For numeric
For categorical
For binary response, this can be sample proportion of any one category
However, it is also common to measure it by the "odds" of one of the categories
Let the probability of an event
Think of
Let the probability of an event
Think of
The "odds" are defined as the ratio of success probability and failure probability
Let the probability of an event
Think of
The "odds" are defined as the ratio of success probability and failure probability
Examples
For
For
For
The idea of odds is closer to how we usually think of probability
Mathematically, we can think of
This transformation converts the bounded parameter
The idea of odds is closer to how we usually think of probability
Mathematically, we can think of
This transformation converts the bounded parameter
However, the odds are still bounded below by
It is "asymmetric" in the sense that
for unfavourable odds,
for favourable odds,
We often symmetrize this by considering the log-odds
The value of log-odds can be any real number
We often symmetrize this by considering the log-odds
The value of log-odds can be any real number
The log-odds transformation is often useful for proportions
data(UN, package = "carData")xyplot(pctUrban ~ log(ppgdp), data = UN, grid = TRUE, type = c("p", "smooth"), col.line = "red") + layer(panel.lmline(x, y))
logodds <- function(p) log(p / (1-p))xyplot(logodds(pctUrban/100) ~ log(ppgdp), data = UN, grid = TRUE, subset = pctUrban < 100, type = c("p", "smooth"), col.line = "red") + layer(panel.lmline(x, y))
Suppose we want to compare success probability in two groups
For example, probability of admission for males vs females
Suppose we want to compare success probability in two groups
For example, probability of admission for males vs females
Odds ratio: Compute odds for both groups, take their ratio
Suppose we want to compare success probability in two groups
For example, probability of admission for males vs females
Odds ratio: Compute odds for both groups, take their ratio
Interpretation: If
Suppose we want to compare success probability in two groups
For example, probability of admission for males vs females
Odds ratio: Compute odds for both groups, take their ratio
Interpretation: If
UCBAdmissions
revisitedoddsratio <- function(x) { # x = 2 x 2 matrix, column 1 = success, column 2 = failure (x[1,1] / x[1,2]) / (x[2,1] / x[2,2])}admitByGender
AdmitGender Admitted Rejected Female 557 1278 Male 1198 1493
oddsratio(admitByGender)
[1] 0.5431594
log(oddsratio(admitByGender))
[1] -0.6103524
UCBAdmissions
revisitedUCBAdmissions[,, "A"]
GenderAdmit Male Female Admitted 512 89 Rejected 313 19
t(UCBAdmissions[, c(2, 1), "A"])
AdmitGender Admitted Rejected Female 89 19 Male 512 313
log(oddsratio(t(UCBAdmissions[, c(2, 1), "A"])))
[1] 1.052076
UCBAdmissions
revisitedlog(oddsratio(t(UCBAdmissions[, c(2, 1), "A"])))
[1] 1.052076
log(oddsratio(t(UCBAdmissions[, c(2, 1), "B"])))
[1] 0.2200225
log(oddsratio(t(UCBAdmissions[, c(2, 1), "C"])))
[1] -0.1249216
log(oddsratio(t(UCBAdmissions[, c(2, 1), "D"])))
[1] 0.08198719
log(oddsratio(t(UCBAdmissions[, c(2, 1), "E"])))
[1] -0.200187
log(oddsratio(t(UCBAdmissions[, c(2, 1), "F"])))
[1] 0.1888958
nhsub <- subset(NHANES, Age >= 21 & !is.na(BPSysAve) & Race1 == "White" & Gender == "female")nhsub$HyperTension <- ifelse(nhsub$BPSysAve > 120, "Yes", "No")HypTable <- xtabs(~ Age + HyperTension, nhsub)head(HypTable, 20)
HyperTensionAge No Yes 21 18 4 22 20 1 23 42 7 24 31 15 25 37 2 26 35 7 27 36 4 28 28 5 29 29 6 30 43 3 31 28 11 32 26 4 33 35 6 34 25 4 35 21 3 36 28 4 37 30 11 38 46 6 39 38 8 40 29 6
HypProp <- HypTable[, "Yes"] / rowSums(HypTable)HypOdds <- HypTable[, "Yes"] / HypTable[, "No"]HypLogOdds <- log(HypOdds)Age <- as.numeric(rownames(HypTable))
data.frame(Age, HypProp, HypOdds, HypLogOdds) |> head(15)
Age HypProp HypOdds HypLogOdds21 21 0.18181818 0.22222222 -1.504077422 22 0.04761905 0.05000000 -2.995732323 23 0.14285714 0.16666667 -1.791759524 24 0.32608696 0.48387097 -0.725937025 25 0.05128205 0.05405405 -2.917770726 26 0.16666667 0.20000000 -1.609437927 27 0.10000000 0.11111111 -2.197224628 28 0.15151515 0.17857143 -1.722766629 29 0.17142857 0.20689655 -1.575536430 30 0.06521739 0.06976744 -2.662587831 31 0.28205128 0.39285714 -0.934309232 32 0.13333333 0.15384615 -1.871802233 33 0.14634146 0.17142857 -1.763588634 34 0.13793103 0.16000000 -1.832581535 35 0.12500000 0.14285714 -1.9459101
xyplot(HypProp ~ Age, grid = TRUE)
xyplot(HypOdds ~ Age, grid = TRUE)
xyplot(HypLogOdds ~ Age, grid = TRUE)
Titanic
dataTitanic
, , Age = Child, Survived = No SexClass Male Female 1st 0 0 2nd 0 0 3rd 35 17 Crew 0 0, , Age = Adult, Survived = No SexClass Male Female 1st 118 4 2nd 154 13 3rd 387 89 Crew 670 3, , Age = Child, Survived = Yes SexClass Male Female 1st 5 1 2nd 11 13 3rd 13 14 Crew 0 0, , Age = Adult, Survived = Yes SexClass Male Female 1st 57 140 2nd 14 80 3rd 75 76 Crew 192 20
Titanic
dataarray2DF(Titanic)
Class Sex Age Survived Value1 1st Male Child No 02 2nd Male Child No 03 3rd Male Child No 354 Crew Male Child No 05 1st Female Child No 06 2nd Female Child No 07 3rd Female Child No 178 Crew Female Child No 09 1st Male Adult No 11810 2nd Male Adult No 15411 3rd Male Adult No 38712 Crew Male Adult No 67013 1st Female Adult No 414 2nd Female Adult No 1315 3rd Female Adult No 8916 Crew Female Adult No 317 1st Male Child Yes 518 2nd Male Child Yes 1119 3rd Male Child Yes 1320 Crew Male Child Yes 021 1st Female Child Yes 122 2nd Female Child Yes 1323 3rd Female Child Yes 1424 Crew Female Child Yes 025 1st Male Adult Yes 5726 2nd Male Adult Yes 1427 3rd Male Adult Yes 7528 Crew Male Adult Yes 19229 1st Female Adult Yes 14030 2nd Female Adult Yes 8031 3rd Female Adult Yes 7632 Crew Female Adult Yes 20
Titanic
dataData on survival status of Titanic passengers by Age / Sex / Class
Exercise: Compute and compare odds of survival for various passenger subgroups
Natural next question: Are two attributes independent? (in the population)
We can consider the admissions data as an example
t(UCBAdmissions[, c(2, 1), "C"])
AdmitGender Admitted Rejected Female 202 391 Male 120 205
Natural next question: Are two attributes independent? (in the population)
We can consider the admissions data as an example
t(UCBAdmissions[, c(2, 1), "C"])
AdmitGender Admitted Rejected Female 202 391 Male 120 205
Question (about population)
Assume that this represents a random sample from all potential applicants
Is that data consistent with what we would expect if there is no gender bias?
log(oddsratio(t(UCBAdmissions[, c(2, 1), "C"])))
[1] -0.1249216
log(oddsratio(t(UCBAdmissions[, c(2, 1), "C"])))
[1] -0.1249216
Is this value sufficiently different from zero?
To answer this question, we need to know what the odds ratio could have been under independence
log(oddsratio(t(UCBAdmissions[, c(2, 1), "C"])))
[1] -0.1249216
Is this value sufficiently different from zero?
To answer this question, we need to know what the odds ratio could have been under independence
Answering such questions is an important reason for studying Statistics formally
This sort of insight is more valuable than simple data summarization and visualization
log(oddsratio(t(UCBAdmissions[, c(2, 1), "C"])))
[1] -0.1249216
Is this value sufficiently different from zero?
To answer this question, we need to know what the odds ratio could have been under independence
Answering such questions is an important reason for studying Statistics formally
This sort of insight is more valuable than simple data summarization and visualization
This area of Statistics is known as inference (what we have been doing is descriptive statistics)
X <- t(UCBAdmissions[, c(2, 1), "C"])X
AdmitGender Admitted Rejected Female 202 391 Male 120 205
log(oddsratio(X))
[1] -0.1249216
Intuitively, bias against female candidates
But how large should the value be to decide that there is bias?
X <- t(UCBAdmissions[, c(2, 1), "C"])X
AdmitGender Admitted Rejected Female 202 391 Male 120 205
log(oddsratio(X))
[1] -0.1249216
Intuitively, bias against female candidates
But how large should the value be to decide that there is bias?
We will study such questions using parametric models in the next semester
Here, we will consider a simple intuitive approach
We want to study the "distribution" of log odds ratio if there was no bias
Of course, we do not know whether there was any bias
We want to study the "distribution" of log odds ratio if there was no bias
Of course, we do not know whether there was any bias
Imagine doing a hypothetical experiment
Suppose gender of candidate is hidden from admission committee
This will guarantee that there was no gender bias
We want to study the "distribution" of log odds ratio if there was no bias
Of course, we do not know whether there was any bias
Imagine doing a hypothetical experiment
Suppose gender of candidate is hidden from admission committee
This will guarantee that there was no gender bias
If the process was indeed gender-neutral, then the outcomes would not have changed
We want to study the "distribution" of log odds ratio if there was no bias
Of course, we do not know whether there was any bias
Imagine doing a hypothetical experiment
Suppose gender of candidate is hidden from admission committee
This will guarantee that there was no gender bias
If the process was indeed gender-neutral, then the outcomes would not have changed
Even if we added fake random values for gender, the outcomes would not have changed
We want to study the "distribution" of log odds ratio if there was no bias
Of course, we do not know whether there was any bias
Imagine doing a hypothetical experiment
Suppose gender of candidate is hidden from admission committee
This will guarantee that there was no gender bias
If the process was indeed gender-neutral, then the outcomes would not have changed
Even if we added fake random values for gender, the outcomes would not have changed
This is something we can do easily:
Take all candidates, keep admission status unchanged, but assign gender randomly
How many females vs males? Easiest to keep the totals unchanged
This is equivalent to randomly permuting the gender variable
X
AdmitGender Admitted Rejected Female 202 391 Male 120 205
d <- array2DF(X)d
Gender Admit Value1 Female Admitted 2022 Male Admitted 1203 Female Rejected 3914 Male Rejected 205
dlong <- d[rep(1:4, d$Value) , c("Gender", "Admit")]dlong
Gender Admit1 Female Admitted1.1 Female Admitted1.2 Female Admitted1.3 Female Admitted1.4 Female Admitted1.5 Female Admitted1.6 Female Admitted1.7 Female Admitted1.8 Female Admitted1.9 Female Admitted1.10 Female Admitted1.11 Female Admitted1.12 Female Admitted1.13 Female Admitted1.14 Female Admitted1.15 Female Admitted1.16 Female Admitted1.17 Female Admitted1.18 Female Admitted1.19 Female Admitted1.20 Female Admitted1.21 Female Admitted1.22 Female Admitted1.23 Female Admitted1.24 Female Admitted1.25 Female Admitted1.26 Female Admitted1.27 Female Admitted1.28 Female Admitted1.29 Female Admitted1.30 Female Admitted1.31 Female Admitted1.32 Female Admitted1.33 Female Admitted1.34 Female Admitted1.35 Female Admitted1.36 Female Admitted1.37 Female Admitted1.38 Female Admitted1.39 Female Admitted1.40 Female Admitted1.41 Female Admitted1.42 Female Admitted1.43 Female Admitted1.44 Female Admitted1.45 Female Admitted1.46 Female Admitted1.47 Female Admitted1.48 Female Admitted1.49 Female Admitted1.50 Female Admitted1.51 Female Admitted1.52 Female Admitted1.53 Female Admitted1.54 Female Admitted1.55 Female Admitted1.56 Female Admitted1.57 Female Admitted1.58 Female Admitted1.59 Female Admitted1.60 Female Admitted1.61 Female Admitted1.62 Female Admitted1.63 Female Admitted1.64 Female Admitted1.65 Female Admitted1.66 Female Admitted1.67 Female Admitted1.68 Female Admitted1.69 Female Admitted1.70 Female Admitted1.71 Female Admitted1.72 Female Admitted1.73 Female Admitted1.74 Female Admitted1.75 Female Admitted1.76 Female Admitted1.77 Female Admitted1.78 Female Admitted1.79 Female Admitted1.80 Female Admitted1.81 Female Admitted1.82 Female Admitted1.83 Female Admitted1.84 Female Admitted1.85 Female Admitted1.86 Female Admitted1.87 Female Admitted1.88 Female Admitted1.89 Female Admitted1.90 Female Admitted1.91 Female Admitted1.92 Female Admitted1.93 Female Admitted1.94 Female Admitted1.95 Female Admitted1.96 Female Admitted1.97 Female Admitted1.98 Female Admitted1.99 Female Admitted1.100 Female Admitted1.101 Female Admitted1.102 Female Admitted1.103 Female Admitted1.104 Female Admitted1.105 Female Admitted1.106 Female Admitted1.107 Female Admitted1.108 Female Admitted1.109 Female Admitted1.110 Female Admitted1.111 Female Admitted1.112 Female Admitted1.113 Female Admitted1.114 Female Admitted1.115 Female Admitted1.116 Female Admitted1.117 Female Admitted1.118 Female Admitted1.119 Female Admitted1.120 Female Admitted1.121 Female Admitted1.122 Female Admitted1.123 Female Admitted1.124 Female Admitted1.125 Female Admitted1.126 Female Admitted1.127 Female Admitted1.128 Female Admitted1.129 Female Admitted1.130 Female Admitted1.131 Female Admitted1.132 Female Admitted1.133 Female Admitted1.134 Female Admitted1.135 Female Admitted1.136 Female Admitted1.137 Female Admitted1.138 Female Admitted1.139 Female Admitted1.140 Female Admitted1.141 Female Admitted1.142 Female Admitted1.143 Female Admitted1.144 Female Admitted1.145 Female Admitted1.146 Female Admitted1.147 Female Admitted1.148 Female Admitted1.149 Female Admitted1.150 Female Admitted1.151 Female Admitted1.152 Female Admitted1.153 Female Admitted1.154 Female Admitted1.155 Female Admitted1.156 Female Admitted1.157 Female Admitted1.158 Female Admitted1.159 Female Admitted1.160 Female Admitted1.161 Female Admitted1.162 Female Admitted1.163 Female Admitted1.164 Female Admitted1.165 Female Admitted1.166 Female Admitted1.167 Female Admitted1.168 Female Admitted1.169 Female Admitted1.170 Female Admitted1.171 Female Admitted1.172 Female Admitted1.173 Female Admitted1.174 Female Admitted1.175 Female Admitted1.176 Female Admitted1.177 Female Admitted1.178 Female Admitted1.179 Female Admitted1.180 Female Admitted1.181 Female Admitted1.182 Female Admitted1.183 Female Admitted1.184 Female Admitted1.185 Female Admitted1.186 Female Admitted1.187 Female Admitted1.188 Female Admitted1.189 Female Admitted1.190 Female Admitted1.191 Female Admitted1.192 Female Admitted1.193 Female Admitted1.194 Female Admitted1.195 Female Admitted1.196 Female Admitted1.197 Female Admitted1.198 Female Admitted1.199 Female Admitted1.200 Female Admitted1.201 Female Admitted2 Male Admitted2.1 Male Admitted2.2 Male Admitted2.3 Male Admitted2.4 Male Admitted2.5 Male Admitted2.6 Male Admitted2.7 Male Admitted2.8 Male Admitted2.9 Male Admitted2.10 Male Admitted2.11 Male Admitted2.12 Male Admitted2.13 Male Admitted2.14 Male Admitted2.15 Male Admitted2.16 Male Admitted2.17 Male Admitted2.18 Male Admitted2.19 Male Admitted2.20 Male Admitted2.21 Male Admitted2.22 Male Admitted2.23 Male Admitted2.24 Male Admitted2.25 Male Admitted2.26 Male Admitted2.27 Male Admitted2.28 Male Admitted2.29 Male Admitted2.30 Male Admitted2.31 Male Admitted2.32 Male Admitted2.33 Male Admitted2.34 Male Admitted2.35 Male Admitted2.36 Male Admitted2.37 Male Admitted2.38 Male Admitted2.39 Male Admitted2.40 Male Admitted2.41 Male Admitted2.42 Male Admitted2.43 Male Admitted2.44 Male Admitted2.45 Male Admitted2.46 Male Admitted2.47 Male Admitted2.48 Male Admitted2.49 Male Admitted2.50 Male Admitted2.51 Male Admitted2.52 Male Admitted2.53 Male Admitted2.54 Male Admitted2.55 Male Admitted2.56 Male Admitted2.57 Male Admitted2.58 Male Admitted2.59 Male Admitted2.60 Male Admitted2.61 Male Admitted2.62 Male Admitted2.63 Male Admitted2.64 Male Admitted2.65 Male Admitted2.66 Male Admitted2.67 Male Admitted2.68 Male Admitted2.69 Male Admitted2.70 Male Admitted2.71 Male Admitted2.72 Male Admitted2.73 Male Admitted2.74 Male Admitted2.75 Male Admitted2.76 Male Admitted2.77 Male Admitted2.78 Male Admitted2.79 Male Admitted2.80 Male Admitted2.81 Male Admitted2.82 Male Admitted2.83 Male Admitted2.84 Male Admitted2.85 Male Admitted2.86 Male Admitted2.87 Male Admitted2.88 Male Admitted2.89 Male Admitted2.90 Male Admitted2.91 Male Admitted2.92 Male Admitted2.93 Male Admitted2.94 Male Admitted2.95 Male Admitted2.96 Male Admitted2.97 Male Admitted2.98 Male Admitted2.99 Male Admitted2.100 Male Admitted2.101 Male Admitted2.102 Male Admitted2.103 Male Admitted2.104 Male Admitted2.105 Male Admitted2.106 Male Admitted2.107 Male Admitted2.108 Male Admitted2.109 Male Admitted2.110 Male Admitted2.111 Male Admitted2.112 Male Admitted2.113 Male Admitted2.114 Male Admitted2.115 Male Admitted2.116 Male Admitted2.117 Male Admitted2.118 Male Admitted2.119 Male Admitted3 Female Rejected3.1 Female Rejected3.2 Female Rejected3.3 Female Rejected3.4 Female Rejected3.5 Female Rejected3.6 Female Rejected3.7 Female Rejected3.8 Female Rejected3.9 Female Rejected3.10 Female Rejected3.11 Female Rejected3.12 Female Rejected3.13 Female Rejected3.14 Female Rejected3.15 Female Rejected3.16 Female Rejected3.17 Female Rejected3.18 Female Rejected3.19 Female Rejected3.20 Female Rejected3.21 Female Rejected3.22 Female Rejected3.23 Female Rejected3.24 Female Rejected3.25 Female Rejected3.26 Female Rejected3.27 Female Rejected3.28 Female Rejected3.29 Female Rejected3.30 Female Rejected3.31 Female Rejected3.32 Female Rejected3.33 Female Rejected3.34 Female Rejected3.35 Female Rejected3.36 Female Rejected3.37 Female Rejected3.38 Female Rejected3.39 Female Rejected3.40 Female Rejected3.41 Female Rejected3.42 Female Rejected3.43 Female Rejected3.44 Female Rejected3.45 Female Rejected3.46 Female Rejected3.47 Female Rejected3.48 Female Rejected3.49 Female Rejected3.50 Female Rejected3.51 Female Rejected3.52 Female Rejected3.53 Female Rejected3.54 Female Rejected3.55 Female Rejected3.56 Female Rejected3.57 Female Rejected3.58 Female Rejected3.59 Female Rejected3.60 Female Rejected3.61 Female Rejected3.62 Female Rejected3.63 Female Rejected3.64 Female Rejected3.65 Female Rejected3.66 Female Rejected3.67 Female Rejected3.68 Female Rejected3.69 Female Rejected3.70 Female Rejected3.71 Female Rejected3.72 Female Rejected3.73 Female Rejected3.74 Female Rejected3.75 Female Rejected3.76 Female Rejected3.77 Female Rejected3.78 Female Rejected3.79 Female Rejected3.80 Female Rejected3.81 Female Rejected3.82 Female Rejected3.83 Female Rejected3.84 Female Rejected3.85 Female Rejected3.86 Female Rejected3.87 Female Rejected3.88 Female Rejected3.89 Female Rejected3.90 Female Rejected3.91 Female Rejected3.92 Female Rejected3.93 Female Rejected3.94 Female Rejected3.95 Female Rejected3.96 Female Rejected3.97 Female Rejected3.98 Female Rejected3.99 Female Rejected3.100 Female Rejected3.101 Female Rejected3.102 Female Rejected3.103 Female Rejected3.104 Female Rejected3.105 Female Rejected3.106 Female Rejected3.107 Female Rejected3.108 Female Rejected3.109 Female Rejected3.110 Female Rejected3.111 Female Rejected3.112 Female Rejected3.113 Female Rejected3.114 Female Rejected3.115 Female Rejected3.116 Female Rejected3.117 Female Rejected3.118 Female Rejected3.119 Female Rejected3.120 Female Rejected3.121 Female Rejected3.122 Female Rejected3.123 Female Rejected3.124 Female Rejected3.125 Female Rejected3.126 Female Rejected3.127 Female Rejected3.128 Female Rejected3.129 Female Rejected3.130 Female Rejected3.131 Female Rejected3.132 Female Rejected3.133 Female Rejected3.134 Female Rejected3.135 Female Rejected3.136 Female Rejected3.137 Female Rejected3.138 Female Rejected3.139 Female Rejected3.140 Female Rejected3.141 Female Rejected3.142 Female Rejected3.143 Female Rejected3.144 Female Rejected3.145 Female Rejected3.146 Female Rejected3.147 Female Rejected3.148 Female Rejected3.149 Female Rejected3.150 Female Rejected3.151 Female Rejected3.152 Female Rejected3.153 Female Rejected3.154 Female Rejected3.155 Female Rejected3.156 Female Rejected3.157 Female Rejected3.158 Female Rejected3.159 Female Rejected3.160 Female Rejected3.161 Female Rejected3.162 Female Rejected3.163 Female Rejected3.164 Female Rejected3.165 Female Rejected3.166 Female Rejected3.167 Female Rejected3.168 Female Rejected3.169 Female Rejected3.170 Female Rejected3.171 Female Rejected3.172 Female Rejected3.173 Female Rejected3.174 Female Rejected3.175 Female Rejected3.176 Female Rejected3.177 Female Rejected3.178 Female Rejected3.179 Female Rejected3.180 Female Rejected3.181 Female Rejected3.182 Female Rejected3.183 Female Rejected3.184 Female Rejected3.185 Female Rejected3.186 Female Rejected3.187 Female Rejected3.188 Female Rejected3.189 Female Rejected3.190 Female Rejected3.191 Female Rejected3.192 Female Rejected3.193 Female Rejected3.194 Female Rejected3.195 Female Rejected3.196 Female Rejected3.197 Female Rejected3.198 Female Rejected3.199 Female Rejected3.200 Female Rejected3.201 Female Rejected3.202 Female Rejected3.203 Female Rejected3.204 Female Rejected3.205 Female Rejected3.206 Female Rejected3.207 Female Rejected3.208 Female Rejected3.209 Female Rejected3.210 Female Rejected3.211 Female Rejected3.212 Female Rejected3.213 Female Rejected3.214 Female Rejected3.215 Female Rejected3.216 Female Rejected3.217 Female Rejected3.218 Female Rejected3.219 Female Rejected3.220 Female Rejected3.221 Female Rejected3.222 Female Rejected3.223 Female Rejected3.224 Female Rejected3.225 Female Rejected3.226 Female Rejected3.227 Female Rejected3.228 Female Rejected3.229 Female Rejected3.230 Female Rejected3.231 Female Rejected3.232 Female Rejected3.233 Female Rejected3.234 Female Rejected3.235 Female Rejected3.236 Female Rejected3.237 Female Rejected3.238 Female Rejected3.239 Female Rejected3.240 Female Rejected3.241 Female Rejected3.242 Female Rejected3.243 Female Rejected3.244 Female Rejected3.245 Female Rejected3.246 Female Rejected3.247 Female Rejected3.248 Female Rejected3.249 Female Rejected3.250 Female Rejected3.251 Female Rejected3.252 Female Rejected3.253 Female Rejected3.254 Female Rejected3.255 Female Rejected3.256 Female Rejected3.257 Female Rejected3.258 Female Rejected3.259 Female Rejected3.260 Female Rejected3.261 Female Rejected3.262 Female Rejected3.263 Female Rejected3.264 Female Rejected3.265 Female Rejected3.266 Female Rejected3.267 Female Rejected3.268 Female Rejected3.269 Female Rejected3.270 Female Rejected3.271 Female Rejected3.272 Female Rejected3.273 Female Rejected3.274 Female Rejected3.275 Female Rejected3.276 Female Rejected3.277 Female Rejected3.278 Female Rejected3.279 Female Rejected3.280 Female Rejected3.281 Female Rejected3.282 Female Rejected3.283 Female Rejected3.284 Female Rejected3.285 Female Rejected3.286 Female Rejected3.287 Female Rejected3.288 Female Rejected3.289 Female Rejected3.290 Female Rejected3.291 Female Rejected3.292 Female Rejected3.293 Female Rejected3.294 Female Rejected3.295 Female Rejected3.296 Female Rejected3.297 Female Rejected3.298 Female Rejected3.299 Female Rejected3.300 Female Rejected3.301 Female Rejected3.302 Female Rejected3.303 Female Rejected3.304 Female Rejected3.305 Female Rejected3.306 Female Rejected3.307 Female Rejected3.308 Female Rejected3.309 Female Rejected3.310 Female Rejected3.311 Female Rejected3.312 Female Rejected3.313 Female Rejected3.314 Female Rejected3.315 Female Rejected3.316 Female Rejected3.317 Female Rejected3.318 Female Rejected3.319 Female Rejected3.320 Female Rejected3.321 Female Rejected3.322 Female Rejected3.323 Female Rejected3.324 Female Rejected3.325 Female Rejected3.326 Female Rejected3.327 Female Rejected3.328 Female Rejected3.329 Female Rejected3.330 Female Rejected3.331 Female Rejected3.332 Female Rejected3.333 Female Rejected3.334 Female Rejected3.335 Female Rejected3.336 Female Rejected3.337 Female Rejected3.338 Female Rejected3.339 Female Rejected3.340 Female Rejected3.341 Female Rejected3.342 Female Rejected3.343 Female Rejected3.344 Female Rejected3.345 Female Rejected3.346 Female Rejected3.347 Female Rejected3.348 Female Rejected3.349 Female Rejected3.350 Female Rejected3.351 Female Rejected3.352 Female Rejected3.353 Female Rejected3.354 Female Rejected3.355 Female Rejected3.356 Female Rejected3.357 Female Rejected3.358 Female Rejected3.359 Female Rejected3.360 Female Rejected3.361 Female Rejected3.362 Female Rejected3.363 Female Rejected3.364 Female Rejected3.365 Female Rejected3.366 Female Rejected3.367 Female Rejected3.368 Female Rejected3.369 Female Rejected3.370 Female Rejected3.371 Female Rejected3.372 Female Rejected3.373 Female Rejected3.374 Female Rejected3.375 Female Rejected3.376 Female Rejected3.377 Female Rejected3.378 Female Rejected3.379 Female Rejected3.380 Female Rejected3.381 Female Rejected3.382 Female Rejected3.383 Female Rejected3.384 Female Rejected3.385 Female Rejected3.386 Female Rejected3.387 Female Rejected3.388 Female Rejected3.389 Female Rejected3.390 Female Rejected4 Male Rejected4.1 Male Rejected4.2 Male Rejected4.3 Male Rejected4.4 Male Rejected4.5 Male Rejected4.6 Male Rejected4.7 Male Rejected4.8 Male Rejected4.9 Male Rejected4.10 Male Rejected4.11 Male Rejected4.12 Male Rejected4.13 Male Rejected4.14 Male Rejected4.15 Male Rejected4.16 Male Rejected4.17 Male Rejected4.18 Male Rejected4.19 Male Rejected4.20 Male Rejected4.21 Male Rejected4.22 Male Rejected4.23 Male Rejected4.24 Male Rejected4.25 Male Rejected4.26 Male Rejected4.27 Male Rejected4.28 Male Rejected4.29 Male Rejected4.30 Male Rejected4.31 Male Rejected4.32 Male Rejected4.33 Male Rejected4.34 Male Rejected4.35 Male Rejected4.36 Male Rejected4.37 Male Rejected4.38 Male Rejected4.39 Male Rejected4.40 Male Rejected4.41 Male Rejected4.42 Male Rejected4.43 Male Rejected4.44 Male Rejected4.45 Male Rejected4.46 Male Rejected4.47 Male Rejected4.48 Male Rejected4.49 Male Rejected4.50 Male Rejected4.51 Male Rejected4.52 Male Rejected4.53 Male Rejected4.54 Male Rejected4.55 Male Rejected4.56 Male Rejected4.57 Male Rejected4.58 Male Rejected4.59 Male Rejected4.60 Male Rejected4.61 Male Rejected4.62 Male Rejected4.63 Male Rejected4.64 Male Rejected4.65 Male Rejected4.66 Male Rejected4.67 Male Rejected4.68 Male Rejected4.69 Male Rejected4.70 Male Rejected4.71 Male Rejected4.72 Male Rejected4.73 Male Rejected4.74 Male Rejected4.75 Male Rejected4.76 Male Rejected4.77 Male Rejected4.78 Male Rejected4.79 Male Rejected4.80 Male Rejected4.81 Male Rejected4.82 Male Rejected4.83 Male Rejected4.84 Male Rejected4.85 Male Rejected4.86 Male Rejected4.87 Male Rejected4.88 Male Rejected4.89 Male Rejected4.90 Male Rejected4.91 Male Rejected4.92 Male Rejected4.93 Male Rejected4.94 Male Rejected4.95 Male Rejected4.96 Male Rejected4.97 Male Rejected4.98 Male Rejected4.99 Male Rejected4.100 Male Rejected4.101 Male Rejected4.102 Male Rejected4.103 Male Rejected4.104 Male Rejected4.105 Male Rejected4.106 Male Rejected4.107 Male Rejected4.108 Male Rejected4.109 Male Rejected4.110 Male Rejected4.111 Male Rejected4.112 Male Rejected4.113 Male Rejected4.114 Male Rejected4.115 Male Rejected4.116 Male Rejected4.117 Male Rejected4.118 Male Rejected4.119 Male Rejected4.120 Male Rejected4.121 Male Rejected4.122 Male Rejected4.123 Male Rejected4.124 Male Rejected4.125 Male Rejected4.126 Male Rejected4.127 Male Rejected4.128 Male Rejected4.129 Male Rejected4.130 Male Rejected4.131 Male Rejected4.132 Male Rejected4.133 Male Rejected4.134 Male Rejected4.135 Male Rejected4.136 Male Rejected4.137 Male Rejected4.138 Male Rejected4.139 Male Rejected4.140 Male Rejected4.141 Male Rejected4.142 Male Rejected4.143 Male Rejected4.144 Male Rejected4.145 Male Rejected4.146 Male Rejected4.147 Male Rejected4.148 Male Rejected4.149 Male Rejected4.150 Male Rejected4.151 Male Rejected4.152 Male Rejected4.153 Male Rejected4.154 Male Rejected4.155 Male Rejected4.156 Male Rejected4.157 Male Rejected4.158 Male Rejected4.159 Male Rejected4.160 Male Rejected4.161 Male Rejected4.162 Male Rejected4.163 Male Rejected4.164 Male Rejected4.165 Male Rejected4.166 Male Rejected4.167 Male Rejected4.168 Male Rejected4.169 Male Rejected4.170 Male Rejected4.171 Male Rejected4.172 Male Rejected4.173 Male Rejected4.174 Male Rejected4.175 Male Rejected4.176 Male Rejected4.177 Male Rejected4.178 Male Rejected4.179 Male Rejected4.180 Male Rejected4.181 Male Rejected4.182 Male Rejected4.183 Male Rejected4.184 Male Rejected4.185 Male Rejected4.186 Male Rejected4.187 Male Rejected4.188 Male Rejected4.189 Male Rejected4.190 Male Rejected4.191 Male Rejected4.192 Male Rejected4.193 Male Rejected4.194 Male Rejected4.195 Male Rejected4.196 Male Rejected4.197 Male Rejected4.198 Male Rejected4.199 Male Rejected4.200 Male Rejected4.201 Male Rejected4.202 Male Rejected4.203 Male Rejected4.204 Male Rejected
dlong$GenderRandomized <- sample(dlong$Gender)dlong
Gender Admit GenderRandomized1 Female Admitted Male1.1 Female Admitted Female1.2 Female Admitted Female1.3 Female Admitted Male1.4 Female Admitted Female1.5 Female Admitted Female1.6 Female Admitted Male1.7 Female Admitted Female1.8 Female Admitted Female1.9 Female Admitted Male1.10 Female Admitted Male1.11 Female Admitted Male1.12 Female Admitted Female1.13 Female Admitted Female1.14 Female Admitted Male1.15 Female Admitted Female1.16 Female Admitted Female1.17 Female Admitted Male1.18 Female Admitted Male1.19 Female Admitted Female1.20 Female Admitted Female1.21 Female Admitted Male1.22 Female Admitted Male1.23 Female Admitted Male1.24 Female Admitted Female1.25 Female Admitted Male1.26 Female Admitted Female1.27 Female Admitted Male1.28 Female Admitted Female1.29 Female Admitted Female1.30 Female Admitted Female1.31 Female Admitted Male1.32 Female Admitted Female1.33 Female Admitted Female1.34 Female Admitted Male1.35 Female Admitted Female1.36 Female Admitted Female1.37 Female Admitted Female1.38 Female Admitted Male1.39 Female Admitted Male1.40 Female Admitted Male1.41 Female Admitted Female1.42 Female Admitted Male1.43 Female Admitted Female1.44 Female Admitted Female1.45 Female Admitted Male1.46 Female Admitted Female1.47 Female Admitted Female1.48 Female Admitted Female1.49 Female Admitted Female1.50 Female Admitted Female1.51 Female Admitted Male1.52 Female Admitted Female1.53 Female Admitted Female1.54 Female Admitted Female1.55 Female Admitted Female1.56 Female Admitted Male1.57 Female Admitted Female1.58 Female Admitted Female1.59 Female Admitted Male1.60 Female Admitted Female1.61 Female Admitted Female1.62 Female Admitted Female1.63 Female Admitted Female1.64 Female Admitted Female1.65 Female Admitted Female1.66 Female Admitted Male1.67 Female Admitted Female1.68 Female Admitted Female1.69 Female Admitted Female1.70 Female Admitted Female1.71 Female Admitted Female1.72 Female Admitted Male1.73 Female Admitted Female1.74 Female Admitted Male1.75 Female Admitted Female1.76 Female Admitted Male1.77 Female Admitted Female1.78 Female Admitted Female1.79 Female Admitted Female1.80 Female Admitted Female1.81 Female Admitted Female1.82 Female Admitted Male1.83 Female Admitted Female1.84 Female Admitted Female1.85 Female Admitted Male1.86 Female Admitted Female1.87 Female Admitted Male1.88 Female Admitted Female1.89 Female Admitted Female1.90 Female Admitted Female1.91 Female Admitted Female1.92 Female Admitted Female1.93 Female Admitted Male1.94 Female Admitted Female1.95 Female Admitted Female1.96 Female Admitted Female1.97 Female Admitted Male1.98 Female Admitted Female1.99 Female Admitted Female1.100 Female Admitted Female1.101 Female Admitted Female1.102 Female Admitted Male1.103 Female Admitted Female1.104 Female Admitted Female1.105 Female Admitted Male1.106 Female Admitted Female1.107 Female Admitted Male1.108 Female Admitted Male1.109 Female Admitted Male1.110 Female Admitted Female1.111 Female Admitted Female1.112 Female Admitted Female1.113 Female Admitted Male1.114 Female Admitted Female1.115 Female Admitted Female1.116 Female Admitted Female1.117 Female Admitted Male1.118 Female Admitted Female1.119 Female Admitted Female1.120 Female Admitted Female1.121 Female Admitted Male1.122 Female Admitted Female1.123 Female Admitted Female1.124 Female Admitted Female1.125 Female Admitted Female1.126 Female Admitted Male1.127 Female Admitted Male1.128 Female Admitted Male1.129 Female Admitted Male1.130 Female Admitted Female1.131 Female Admitted Male1.132 Female Admitted Female1.133 Female Admitted Female1.134 Female Admitted Female1.135 Female Admitted Male1.136 Female Admitted Male1.137 Female Admitted Male1.138 Female Admitted Male1.139 Female Admitted Female1.140 Female Admitted Female1.141 Female Admitted Female1.142 Female Admitted Female1.143 Female Admitted Male1.144 Female Admitted Male1.145 Female Admitted Female1.146 Female Admitted Female1.147 Female Admitted Male1.148 Female Admitted Female1.149 Female Admitted Female1.150 Female Admitted Male1.151 Female Admitted Female1.152 Female Admitted Female1.153 Female Admitted Female1.154 Female Admitted Female1.155 Female Admitted Female1.156 Female Admitted Male1.157 Female Admitted Male1.158 Female Admitted Female1.159 Female Admitted Male1.160 Female Admitted Female1.161 Female Admitted Female1.162 Female Admitted Male1.163 Female Admitted Female1.164 Female Admitted Female1.165 Female Admitted Female1.166 Female Admitted Female1.167 Female Admitted Female1.168 Female Admitted Male1.169 Female Admitted Female1.170 Female Admitted Male1.171 Female Admitted Male1.172 Female Admitted Male1.173 Female Admitted Female1.174 Female Admitted Female1.175 Female Admitted Female1.176 Female Admitted Male1.177 Female Admitted Female1.178 Female Admitted Female1.179 Female Admitted Male1.180 Female Admitted Female1.181 Female Admitted Male1.182 Female Admitted Female1.183 Female Admitted Male1.184 Female Admitted Female1.185 Female Admitted Male1.186 Female Admitted Female1.187 Female Admitted Female1.188 Female Admitted Female1.189 Female Admitted Female1.190 Female Admitted Female1.191 Female Admitted Female1.192 Female Admitted Female1.193 Female Admitted Female1.194 Female Admitted Female1.195 Female Admitted Male1.196 Female Admitted Male1.197 Female Admitted Female1.198 Female Admitted Female1.199 Female Admitted Female1.200 Female Admitted Female1.201 Female Admitted Female2 Male Admitted Female2.1 Male Admitted Male2.2 Male Admitted Female2.3 Male Admitted Female2.4 Male Admitted Male2.5 Male Admitted Male2.6 Male Admitted Female2.7 Male Admitted Male2.8 Male Admitted Female2.9 Male Admitted Female2.10 Male Admitted Male2.11 Male Admitted Female2.12 Male Admitted Female2.13 Male Admitted Male2.14 Male Admitted Male2.15 Male Admitted Male2.16 Male Admitted Female2.17 Male Admitted Female2.18 Male Admitted Female2.19 Male Admitted Female2.20 Male Admitted Female2.21 Male Admitted Female2.22 Male Admitted Male2.23 Male Admitted Male2.24 Male Admitted Male2.25 Male Admitted Female2.26 Male Admitted Female2.27 Male Admitted Female2.28 Male Admitted Female2.29 Male Admitted Male2.30 Male Admitted Female2.31 Male Admitted Male2.32 Male Admitted Female2.33 Male Admitted Female2.34 Male Admitted Female2.35 Male Admitted Female2.36 Male Admitted Female2.37 Male Admitted Female2.38 Male Admitted Male2.39 Male Admitted Female2.40 Male Admitted Male2.41 Male Admitted Female2.42 Male Admitted Female2.43 Male Admitted Male2.44 Male Admitted Male2.45 Male Admitted Female2.46 Male Admitted Male2.47 Male Admitted Male2.48 Male Admitted Female2.49 Male Admitted Male2.50 Male Admitted Male2.51 Male Admitted Female2.52 Male Admitted Male2.53 Male Admitted Female2.54 Male Admitted Male2.55 Male Admitted Female2.56 Male Admitted Male2.57 Male Admitted Female2.58 Male Admitted Female2.59 Male Admitted Male2.60 Male Admitted Female2.61 Male Admitted Male2.62 Male Admitted Female2.63 Male Admitted Female2.64 Male Admitted Female2.65 Male Admitted Male2.66 Male Admitted Male2.67 Male Admitted Female2.68 Male Admitted Female2.69 Male Admitted Female2.70 Male Admitted Female2.71 Male Admitted Male2.72 Male Admitted Female2.73 Male Admitted Female2.74 Male Admitted Male2.75 Male Admitted Male2.76 Male Admitted Male2.77 Male Admitted Female2.78 Male Admitted Male2.79 Male Admitted Male2.80 Male Admitted Female2.81 Male Admitted Male2.82 Male Admitted Female2.83 Male Admitted Female2.84 Male Admitted Female2.85 Male Admitted Female2.86 Male Admitted Male2.87 Male Admitted Female2.88 Male Admitted Female2.89 Male Admitted Female2.90 Male Admitted Male2.91 Male Admitted Female2.92 Male Admitted Male2.93 Male Admitted Male2.94 Male Admitted Female2.95 Male Admitted Female2.96 Male Admitted Female2.97 Male Admitted Female2.98 Male Admitted Female2.99 Male Admitted Female2.100 Male Admitted Male2.101 Male Admitted Female2.102 Male Admitted Male2.103 Male Admitted Female2.104 Male Admitted Female2.105 Male Admitted Male2.106 Male Admitted Male2.107 Male Admitted Female2.108 Male Admitted Female2.109 Male Admitted Female2.110 Male Admitted Male2.111 Male Admitted Female2.112 Male Admitted Female2.113 Male Admitted Male2.114 Male Admitted Male2.115 Male Admitted Female2.116 Male Admitted Female2.117 Male Admitted Male2.118 Male Admitted Female2.119 Male Admitted Male3 Female Rejected Male3.1 Female Rejected Female3.2 Female Rejected Male3.3 Female Rejected Male3.4 Female Rejected Female3.5 Female Rejected Female3.6 Female Rejected Female3.7 Female Rejected Male3.8 Female Rejected Female3.9 Female Rejected Female3.10 Female Rejected Female3.11 Female Rejected Male3.12 Female Rejected Male3.13 Female Rejected Male3.14 Female Rejected Female3.15 Female Rejected Male3.16 Female Rejected Female3.17 Female Rejected Female3.18 Female Rejected Female3.19 Female Rejected Male3.20 Female Rejected Female3.21 Female Rejected Female3.22 Female Rejected Female3.23 Female Rejected Male3.24 Female Rejected Male3.25 Female Rejected Male3.26 Female Rejected Female3.27 Female Rejected Male3.28 Female Rejected Male3.29 Female Rejected Female3.30 Female Rejected Female3.31 Female Rejected Male3.32 Female Rejected Male3.33 Female Rejected Female3.34 Female Rejected Female3.35 Female Rejected Female3.36 Female Rejected Female3.37 Female Rejected Female3.38 Female Rejected Female3.39 Female Rejected Male3.40 Female Rejected Female3.41 Female Rejected Female3.42 Female Rejected Male3.43 Female Rejected Male3.44 Female Rejected Female3.45 Female Rejected Male3.46 Female Rejected Female3.47 Female Rejected Male3.48 Female Rejected Female3.49 Female Rejected Female3.50 Female Rejected Female3.51 Female Rejected Female3.52 Female Rejected Female3.53 Female Rejected Female3.54 Female Rejected Male3.55 Female Rejected Female3.56 Female Rejected Female3.57 Female Rejected Male3.58 Female Rejected Male3.59 Female Rejected Male3.60 Female Rejected Female3.61 Female Rejected Female3.62 Female Rejected Female3.63 Female Rejected Female3.64 Female Rejected Male3.65 Female Rejected Female3.66 Female Rejected Female3.67 Female Rejected Female3.68 Female Rejected Female3.69 Female Rejected Female3.70 Female Rejected Female3.71 Female Rejected Female3.72 Female Rejected Male3.73 Female Rejected Female3.74 Female Rejected Female3.75 Female Rejected Female3.76 Female Rejected Female3.77 Female Rejected Female3.78 Female Rejected Male3.79 Female Rejected Female3.80 Female Rejected Male3.81 Female Rejected Female3.82 Female Rejected Female3.83 Female Rejected Female3.84 Female Rejected Male3.85 Female Rejected Female3.86 Female Rejected Female3.87 Female Rejected Male3.88 Female Rejected Female3.89 Female Rejected Female3.90 Female Rejected Female3.91 Female Rejected Male3.92 Female Rejected Female3.93 Female Rejected Male3.94 Female Rejected Male3.95 Female Rejected Female3.96 Female Rejected Female3.97 Female Rejected Male3.98 Female Rejected Male3.99 Female Rejected Male3.100 Female Rejected Female3.101 Female Rejected Male3.102 Female Rejected Male3.103 Female Rejected Male3.104 Female Rejected Female3.105 Female Rejected Female3.106 Female Rejected Female3.107 Female Rejected Female3.108 Female Rejected Male3.109 Female Rejected Female3.110 Female Rejected Female3.111 Female Rejected Female3.112 Female Rejected Female3.113 Female Rejected Female3.114 Female Rejected Female3.115 Female Rejected Male3.116 Female Rejected Female3.117 Female Rejected Male3.118 Female Rejected Male3.119 Female Rejected Male3.120 Female Rejected Male3.121 Female Rejected Female3.122 Female Rejected Male3.123 Female Rejected Male3.124 Female Rejected Female3.125 Female Rejected Male3.126 Female Rejected Female3.127 Female Rejected Female3.128 Female Rejected Male3.129 Female Rejected Female3.130 Female Rejected Female3.131 Female Rejected Male3.132 Female Rejected Female3.133 Female Rejected Male3.134 Female Rejected Male3.135 Female Rejected Female3.136 Female Rejected Male3.137 Female Rejected Male3.138 Female Rejected Male3.139 Female Rejected Female3.140 Female Rejected Female3.141 Female Rejected Male3.142 Female Rejected Female3.143 Female Rejected Female3.144 Female Rejected Male3.145 Female Rejected Male3.146 Female Rejected Male3.147 Female Rejected Female3.148 Female Rejected Female3.149 Female Rejected Female3.150 Female Rejected Female3.151 Female Rejected Male3.152 Female Rejected Female3.153 Female Rejected Female3.154 Female Rejected Male3.155 Female Rejected Female3.156 Female Rejected Male3.157 Female Rejected Female3.158 Female Rejected Male3.159 Female Rejected Female3.160 Female Rejected Female3.161 Female Rejected Male3.162 Female Rejected Female3.163 Female Rejected Female3.164 Female Rejected Male3.165 Female Rejected Male3.166 Female Rejected Female3.167 Female Rejected Female3.168 Female Rejected Male3.169 Female Rejected Female3.170 Female Rejected Female3.171 Female Rejected Male3.172 Female Rejected Male3.173 Female Rejected Female3.174 Female Rejected Female3.175 Female Rejected Female3.176 Female Rejected Male3.177 Female Rejected Female3.178 Female Rejected Male3.179 Female Rejected Male3.180 Female Rejected Male3.181 Female Rejected Female3.182 Female Rejected Female3.183 Female Rejected Male3.184 Female Rejected Female3.185 Female Rejected Male3.186 Female Rejected Female3.187 Female Rejected Female3.188 Female Rejected Female3.189 Female Rejected Female3.190 Female Rejected Female3.191 Female Rejected Male3.192 Female Rejected Male3.193 Female Rejected Female3.194 Female Rejected Female3.195 Female Rejected Female3.196 Female Rejected Female3.197 Female Rejected Female3.198 Female Rejected Female3.199 Female Rejected Male3.200 Female Rejected Female3.201 Female Rejected Female3.202 Female Rejected Male3.203 Female Rejected Female3.204 Female Rejected Male3.205 Female Rejected Female3.206 Female Rejected Female3.207 Female Rejected Female3.208 Female Rejected Male3.209 Female Rejected Female3.210 Female Rejected Male3.211 Female Rejected Male3.212 Female Rejected Female3.213 Female Rejected Female3.214 Female Rejected Female3.215 Female Rejected Female3.216 Female Rejected Female3.217 Female Rejected Female3.218 Female Rejected Female3.219 Female Rejected Female3.220 Female Rejected Male3.221 Female Rejected Female3.222 Female Rejected Female3.223 Female Rejected Male3.224 Female Rejected Female3.225 Female Rejected Male3.226 Female Rejected Male3.227 Female Rejected Female3.228 Female Rejected Male3.229 Female Rejected Female3.230 Female Rejected Female3.231 Female Rejected Female3.232 Female Rejected Female3.233 Female Rejected Female3.234 Female Rejected Male3.235 Female Rejected Male3.236 Female Rejected Female3.237 Female Rejected Female3.238 Female Rejected Male3.239 Female Rejected Female3.240 Female Rejected Female3.241 Female Rejected Male3.242 Female Rejected Female3.243 Female Rejected Male3.244 Female Rejected Male3.245 Female Rejected Male3.246 Female Rejected Female3.247 Female Rejected Female3.248 Female Rejected Female3.249 Female Rejected Male3.250 Female Rejected Female3.251 Female Rejected Female3.252 Female Rejected Male3.253 Female Rejected Female3.254 Female Rejected Male3.255 Female Rejected Male3.256 Female Rejected Female3.257 Female Rejected Male3.258 Female Rejected Male3.259 Female Rejected Female3.260 Female Rejected Female3.261 Female Rejected Female3.262 Female Rejected Male3.263 Female Rejected Female3.264 Female Rejected Female3.265 Female Rejected Female3.266 Female Rejected Female3.267 Female Rejected Female3.268 Female Rejected Male3.269 Female Rejected Female3.270 Female Rejected Female3.271 Female Rejected Male3.272 Female Rejected Female3.273 Female Rejected Female3.274 Female Rejected Male3.275 Female Rejected Female3.276 Female Rejected Female3.277 Female Rejected Female3.278 Female Rejected Male3.279 Female Rejected Female3.280 Female Rejected Female3.281 Female Rejected Female3.282 Female Rejected Female3.283 Female Rejected Male3.284 Female Rejected Female3.285 Female Rejected Female3.286 Female Rejected Female3.287 Female Rejected Male3.288 Female Rejected Female3.289 Female Rejected Male3.290 Female Rejected Female3.291 Female Rejected Male3.292 Female Rejected Female3.293 Female Rejected Female3.294 Female Rejected Female3.295 Female Rejected Female3.296 Female Rejected Male3.297 Female Rejected Male3.298 Female Rejected Male3.299 Female Rejected Female3.300 Female Rejected Female3.301 Female Rejected Female3.302 Female Rejected Female3.303 Female Rejected Male3.304 Female Rejected Female3.305 Female Rejected Male3.306 Female Rejected Male3.307 Female Rejected Female3.308 Female Rejected Female3.309 Female Rejected Female3.310 Female Rejected Male3.311 Female Rejected Female3.312 Female Rejected Male3.313 Female Rejected Male3.314 Female Rejected Male3.315 Female Rejected Male3.316 Female Rejected Female3.317 Female Rejected Male3.318 Female Rejected Male3.319 Female Rejected Female3.320 Female Rejected Female3.321 Female Rejected Male3.322 Female Rejected Male3.323 Female Rejected Female3.324 Female Rejected Male3.325 Female Rejected Male3.326 Female Rejected Female3.327 Female Rejected Male3.328 Female Rejected Male3.329 Female Rejected Male3.330 Female Rejected Female3.331 Female Rejected Male3.332 Female Rejected Female3.333 Female Rejected Female3.334 Female Rejected Female3.335 Female Rejected Female3.336 Female Rejected Female3.337 Female Rejected Female3.338 Female Rejected Female3.339 Female Rejected Female3.340 Female Rejected Female3.341 Female Rejected Female3.342 Female Rejected Male3.343 Female Rejected Female3.344 Female Rejected Male3.345 Female Rejected Female3.346 Female Rejected Female3.347 Female Rejected Female3.348 Female Rejected Male3.349 Female Rejected Male3.350 Female Rejected Female3.351 Female Rejected Female3.352 Female Rejected Female3.353 Female Rejected Male3.354 Female Rejected Male3.355 Female Rejected Female3.356 Female Rejected Female3.357 Female Rejected Female3.358 Female Rejected Male3.359 Female Rejected Female3.360 Female Rejected Female3.361 Female Rejected Female3.362 Female Rejected Female3.363 Female Rejected Male3.364 Female Rejected Male3.365 Female Rejected Male3.366 Female Rejected Female3.367 Female Rejected Female3.368 Female Rejected Male3.369 Female Rejected Male3.370 Female Rejected Female3.371 Female Rejected Female3.372 Female Rejected Female3.373 Female Rejected Female3.374 Female Rejected Female3.375 Female Rejected Female3.376 Female Rejected Female3.377 Female Rejected Female3.378 Female Rejected Female3.379 Female Rejected Male3.380 Female Rejected Female3.381 Female Rejected Male3.382 Female Rejected Female3.383 Female Rejected Female3.384 Female Rejected Female3.385 Female Rejected Male3.386 Female Rejected Male3.387 Female Rejected Male3.388 Female Rejected Male3.389 Female Rejected Male3.390 Female Rejected Male4 Male Rejected Female4.1 Male Rejected Male4.2 Male Rejected Female4.3 Male Rejected Female4.4 Male Rejected Female4.5 Male Rejected Female4.6 Male Rejected Female4.7 Male Rejected Male4.8 Male Rejected Female4.9 Male Rejected Female4.10 Male Rejected Male4.11 Male Rejected Male4.12 Male Rejected Female4.13 Male Rejected Male4.14 Male Rejected Female4.15 Male Rejected Male4.16 Male Rejected Female4.17 Male Rejected Female4.18 Male Rejected Female4.19 Male Rejected Female4.20 Male Rejected Female4.21 Male Rejected Female4.22 Male Rejected Female4.23 Male Rejected Male4.24 Male Rejected Female4.25 Male Rejected Female4.26 Male Rejected Male4.27 Male Rejected Female4.28 Male Rejected Female4.29 Male Rejected Female4.30 Male Rejected Male4.31 Male Rejected Male4.32 Male Rejected Female4.33 Male Rejected Female4.34 Male Rejected Male4.35 Male Rejected Female4.36 Male Rejected Female4.37 Male Rejected Male4.38 Male Rejected Female4.39 Male Rejected Male4.40 Male Rejected Male4.41 Male Rejected Female4.42 Male Rejected Male4.43 Male Rejected Female4.44 Male Rejected Female4.45 Male Rejected Female4.46 Male Rejected Male4.47 Male Rejected Female4.48 Male Rejected Female4.49 Male Rejected Female4.50 Male Rejected Female4.51 Male Rejected Female4.52 Male Rejected Female4.53 Male Rejected Female4.54 Male Rejected Female4.55 Male Rejected Male4.56 Male Rejected Female4.57 Male Rejected Female4.58 Male Rejected Female4.59 Male Rejected Female4.60 Male Rejected Female4.61 Male Rejected Female4.62 Male Rejected Female4.63 Male Rejected Male4.64 Male Rejected Female4.65 Male Rejected Male4.66 Male Rejected Female4.67 Male Rejected Male4.68 Male Rejected Female4.69 Male Rejected Female4.70 Male Rejected Female4.71 Male Rejected Female4.72 Male Rejected Female4.73 Male Rejected Male4.74 Male Rejected Female4.75 Male Rejected Female4.76 Male Rejected Female4.77 Male Rejected Female4.78 Male Rejected Male4.79 Male Rejected Male4.80 Male Rejected Male4.81 Male Rejected Female4.82 Male Rejected Female4.83 Male Rejected Female4.84 Male Rejected Female4.85 Male Rejected Male4.86 Male Rejected Female4.87 Male Rejected Female4.88 Male Rejected Female4.89 Male Rejected Female4.90 Male Rejected Female4.91 Male Rejected Female4.92 Male Rejected Female4.93 Male Rejected Female4.94 Male Rejected Female4.95 Male Rejected Female4.96 Male Rejected Female4.97 Male Rejected Female4.98 Male Rejected Female4.99 Male Rejected Female4.100 Male Rejected Male4.101 Male Rejected Male4.102 Male Rejected Female4.103 Male Rejected Female4.104 Male Rejected Female4.105 Male Rejected Female4.106 Male Rejected Female4.107 Male Rejected Male4.108 Male Rejected Female4.109 Male Rejected Female4.110 Male Rejected Female4.111 Male Rejected Female4.112 Male Rejected Female4.113 Male Rejected Female4.114 Male Rejected Female4.115 Male Rejected Male4.116 Male Rejected Male4.117 Male Rejected Female4.118 Male Rejected Male4.119 Male Rejected Female4.120 Male Rejected Female4.121 Male Rejected Female4.122 Male Rejected Female4.123 Male Rejected Female4.124 Male Rejected Female4.125 Male Rejected Female4.126 Male Rejected Male4.127 Male Rejected Male4.128 Male Rejected Female4.129 Male Rejected Female4.130 Male Rejected Male4.131 Male Rejected Female4.132 Male Rejected Female4.133 Male Rejected Male4.134 Male Rejected Male4.135 Male Rejected Female4.136 Male Rejected Female4.137 Male Rejected Female4.138 Male Rejected Female4.139 Male Rejected Male4.140 Male Rejected Female4.141 Male Rejected Male4.142 Male Rejected Female4.143 Male Rejected Female4.144 Male Rejected Male4.145 Male Rejected Male4.146 Male Rejected Female4.147 Male Rejected Male4.148 Male Rejected Female4.149 Male Rejected Male4.150 Male Rejected Female4.151 Male Rejected Male4.152 Male Rejected Female4.153 Male Rejected Male4.154 Male Rejected Female4.155 Male Rejected Female4.156 Male Rejected Male4.157 Male Rejected Male4.158 Male Rejected Male4.159 Male Rejected Male4.160 Male Rejected Female4.161 Male Rejected Female4.162 Male Rejected Female4.163 Male Rejected Male4.164 Male Rejected Male4.165 Male Rejected Female4.166 Male Rejected Female4.167 Male Rejected Male4.168 Male Rejected Female4.169 Male Rejected Female4.170 Male Rejected Female4.171 Male Rejected Female4.172 Male Rejected Female4.173 Male Rejected Male4.174 Male Rejected Female4.175 Male Rejected Female4.176 Male Rejected Female4.177 Male Rejected Female4.178 Male Rejected Female4.179 Male Rejected Male4.180 Male Rejected Female4.181 Male Rejected Female4.182 Male Rejected Female4.183 Male Rejected Female4.184 Male Rejected Female4.185 Male Rejected Female4.186 Male Rejected Female4.187 Male Rejected Female4.188 Male Rejected Female4.189 Male Rejected Female4.190 Male Rejected Female4.191 Male Rejected Female4.192 Male Rejected Male4.193 Male Rejected Female4.194 Male Rejected Female4.195 Male Rejected Female4.196 Male Rejected Female4.197 Male Rejected Male4.198 Male Rejected Male4.199 Male Rejected Female4.200 Male Rejected Female4.201 Male Rejected Female4.202 Male Rejected Female4.203 Male Rejected Female4.204 Male Rejected Female
xtabs(~ GenderRandomized + Admit, dlong)
AdmitGenderRandomized Admitted Rejected Female 205 388 Male 117 208
log(oddsratio(xtabs(~ GenderRandomized + Admit, dlong)))
[1] -0.06263122
We can repeat this process as many times as we want
These are simulations from the distribution of log odds ratio (under independence)
sim_logOR <- replicate(10000, { dlong$GenderRandomized <- sample(dlong$Gender) log(oddsratio(xtabs(~ GenderRandomized + Admit, dlong))) })
str(sim_logOR)
num [1:10000] 0.3191 -0.187 -0.1249 0.1474 -0.0418 ...
histogram(~ sim_logOR, nint = 30)
histogram(~ sim_logOR, nint = 30) + layer(panel.abline(v = log(oddsratio(X)), col = "red"))
ecdfplot(~ sim_logOR, grid = TRUE) + layer(panel.abline(v = log(oddsratio(X)), col = "red"))
Is the observed value unusual?
Roughly 20% of simulations had log OR less than the observed value
So we should probably not consider this very strong evidence of gender bias
Is the observed value unusual?
Roughly 20% of simulations had log OR less than the observed value
So we should probably not consider this very strong evidence of gender bias
This procedure is known as Fisher's Exact Test of Independence
X <- t(UCBAdmissions[, c(2, 1), "E"])X
AdmitGender Admitted Rejected Female 94 299 Male 53 138
log(oddsratio(X))
[1] -0.200187
d <- array2DF(X)dlong <- d[rep(1:4, d$Value) , c("Gender", "Admit")]sim_logOR <- replicate(10000, { dlong$GenderRandomized <- sample(dlong$Gender) log(oddsratio(xtabs(~ GenderRandomized + Admit, dlong))) })
ecdfplot(~ sim_logOR, grid = TRUE) + layer(panel.abline(v = log(oddsratio(X)), col = "red"))
Try this for department A
Do we really need to do this permutation?
Note that if row totals are fixed, log OR depends only on
Try this for department A
Do we really need to do this permutation?
Note that if row totals are fixed, log OR depends only on
Exercise: Explicitly calculate distribution of
Suppose we have paired bivariate data
So far, we have considered the case where
Keyboard shortcuts
↑, ←, Pg Up, k | Go to previous slide |
↓, →, Pg Dn, Space, j | Go to next slide |
Home | Go to first slide |
End | Go to last slide |
Number + Return | Go to specific slide |
b / m / f | Toggle blackout / mirrored / fullscreen mode |
c | Clone slideshow |
p | Toggle presenter mode |
t | Restart the presentation timer |
?, h | Toggle this help |
Esc | Back to slideshow |