1 Changelog
- 202309: Disabled GSVA analyses until/unless we get permission to include the mSigDB 7.5.1 release. I will simplify the filenames so that one may easily drop in a downloaded copy of the data and run those blocks. Until then, I guess you will have to trust me when I say those blocks all work?
- 202309: Moved all GSEA analyses to 04lrt_gsea_gsva.Rmd
- 202309 next day: Moving GSEA back because it adds too much complexity to save/reload the DE results for gProfiler and friends.
- Still hunting for messed up colors, changed input data to match new version.
2 Introduction
The various differential expression analyses of the data generated in tmrc3_datasets will occur in this document.
2.1 Naming conventions
I am going to try to standardize how I name the various data structures created in this document. Most of the large data created are either sets of differential expression analyses, their combined results, or the set of results deemed ‘significant’.
Hopefully by now they all follow these guidelines:
{clinic(s)}sample-subset}{primary-question(s)}{datatype}{batch-method}
- {clinic}: This is either tc or t for Tumaco and Cali, or just Tumaco.
- {sample-subset}: Things like ‘all’ or ‘monocytes’.
- {primary-question}: Shorthand name for the primary contrasts performed, thus ‘clinics’ would suggest a comparison of Tumaco vs. Cali. ‘visits’ would compare v2/v1, etc.
- {datatype}: de, table, sig
- {batch-type}: nobatch, batch{factor}, sva. {factor} in this instance should be a column from the metadata.
With this in mind, ‘tc_biopsies_clinic_de_sva’ should be the Tumaco+Cali biopsy data after performing the differential expression analyses comparing the clinics using sva.
I suspect there remain some exceptions and/or errors.
2.2 Define contrasts for DE analyses
Each of the following lists describes the set of contrasts that I think are interesting for the various ways one might consider the TMRC3 dataset. The variables are named according to the assumed data with which they will be used, thus tc_cf_contrasts is expected to be used for the Tumaco+Cali data and provide a series of cure/fail comparisons which (to the extent possible) across both locations. In every case, the name of the list element will be used as the contrast name, and will thus be seen as the sheet name in the output xlsx file(s); the two pieces of the character vector value are the numerator and denominator of the associated contrast.
2.3 GSEA
The GSEA analyses will follow each DE analysis during this document.
Most (all?) of the GSEA analyses used in this paper were done via gProfiler rather than goseq/clusterProfiler/topGO/GOstats. Primarily because it is so easy to invoke gprofiler.
clinic_contrasts <- list(
"clinics" = c("cali", "tumaco"))
## In some cases we have no Cali failure samples, so there remain only 2
## contrasts that are likely of interest
tc_cf_contrasts <- list(
"tumaco" = c("tumaco_failure", "tumaco_cure"),
"cure" = c("tumaco_cure", "cali_cure"))
## In other cases, we have cure/fail for both places.
clinic_cf_contrasts <- list(
"cali" = c("cali_failure", "cali_cure"),
"tumaco" = c("tumaco_failure", "tumaco_cure"),
"cure" = c("tumaco_cure", "cali_cure"),
"fail" = c("tumaco_failure", "cali_failure"))
cf_contrast <- list(
"outcome" = c("tumaco_failure", "tumaco_cure"))
t_cf_contrast <- list(
"outcome" = c("failure", "cure"))
visitcf_contrasts <- list(
"v1cf" = c("v1_failure", "v1_cure"),
"v2cf" = c("v2_failure", "v2_cure"),
"v3cf" = c("v3_failure", "v3_cure"))
visit_contrasts <- list(
"v2v1" = c("c2", "c1"),
"v3v1" = c("c3", "c1"),
"v3v2" = c("c3", "c2"))
visit_v1later <- list(
"later_vs_first" = c("later", "first"))
celltypes <- list(
"eo_mono" = c("eosinophils", "monocytes"),
"ne_mono" = c("neutrophils", "monocytes"),
"eo_ne" = c("eosinophils", "neutrophils"))
ethnicity_contrasts <- list(
"mestizo_indigenous" = c("mestiza", "indigena"),
"mestizo_afrocol" = c("mestiza", "afrocol"),
"indigenous_afrocol" = c("indigena", "afrocol"))3 Compare samples by clinic
3.1 DE: Compare clinics, all samples
Perform a svaseq-guided comparison of the two clinics. Ideally this will give some clue about just how strong the clinic-based batch effect really is and what its causes are.
tc_clinic_type <- tc_valid %>%
set_expt_conditions(fact = "clinic") %>%
set_expt_batches(fact = "typeofcells")## The numbers of samples by condition are:##
## cali tumaco
## 61 123## The number of samples by batch are:##
## biopsy eosinophils monocytes neutrophils
## 18 41 63 62table(pData(tc_clinic_type)[["condition"]])##
## cali tumaco
## 61 123tc_all_clinic_de_sva <- all_pairwise(tc_clinic_type, model_batch = "svaseq",
filter = TRUE, methods = methods)##
## cali tumaco
## 61 123## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cali tumaco
## 61 123## Choosing among model matrix columns: conditioncali, conditiontumaco.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali tumaco
## 61 123## Choosing among model matrix columns: conditioncali, conditiontumaco.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali tumaco
## 61 123## Choosing among model matrix columns: conditioncali, conditiontumaco.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cali tumaco
## 61 123## Choosing among model matrix columns: conditioncali, conditiontumaco.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali tumaco
## 61 123## Choosing among model matrix columns: conditioncali, conditiontumaco.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali tumaco
## 61 123## Choosing among model matrix columns: conditioncali, conditiontumaco.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: tumaco_vs_cali. Adjust = BH## Limma step 6/6: 1/2: Creating table: cali. Adjust = BH## Limma step 6/6: 2/2: Creating table: tumaco. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali tumaco
## 61 123## Choosing among model matrix columns: conditioncali, conditiontumaco.
tc_all_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.## The logFC agreement among the methods follows:## tumc_vs_cl
## basic_vs_deseq 0.8086
## basic_vs_ebseq 0.7548
## basic_vs_edger 0.8735
## basic_vs_limma 0.9693
## basic_vs_noiseq 0.9114
## deseq_vs_ebseq 0.8504
## deseq_vs_edger 0.9377
## deseq_vs_limma 0.7998
## deseq_vs_noiseq 0.8770
## ebseq_vs_edger 0.8618
## ebseq_vs_limma 0.7772
## ebseq_vs_noiseq 0.8382
## edger_vs_limma 0.8621
## edger_vs_noiseq 0.9363
## limma_vs_noiseq 0.8895tc_all_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_vs_cali"tc_all_clinic_table_sva <- combine_de_tables(
tc_all_clinic_de_sva, keepers = clinic_contrasts,
excel = glue("{clinic_prefix}/tc_all_clinic_table_sva-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_all_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 tumaco_vs_cali-inverted 273 1799 323 1667
## limma_sigup limma_sigdown
## 1 392 606## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_all_clinic_sig_sva <- extract_significant_genes(
tc_all_clinic_table_sva,
excel = glue("{clinic_prefix}/compare_clinics/tc_clinic_type_sig_sva-v{ver}.xlsx"))
tc_all_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## clinics 392 606 323 1667 273 1799 224
## ebseq_down basic_up basic_down
## clinics 424 2670 2029
3.1.1 GSEA: comparing the clinics
increased_tumaco_categories_up <- simple_gprofiler(
tc_all_clinic_sig_sva[["deseq"]][["ups"]][["clinics"]],
excel = glue("{gsea_prefix}/tumaco_cateogies_up-v{ver}.xlsx"))
increased_tumaco_categories_up## A set of ontologies produced by gprofiler using 273
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 17 MF
## 12 BP
## 1 KEGG
## 1 REAC
## 0 WP
## 100 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.increased_tumaco_categories_up[["pvalue_plots"]][["BP"]]## NULLincreased_cali_categories <- simple_gprofiler(
tc_all_clinic_sig_sva[["deseq"]][["downs"]][["clinics"]],
excel = glue("{gsea_prefix}/cali_cateogies_up-v{ver}.xlsx"))
increased_cali_categories## A set of ontologies produced by gprofiler using 1799
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 59 MF
## 686 BP
## 2 KEGG
## 20 REAC
## 7 WP
## 333 TF
## 2 MIRNA
## 16 HPA
## 0 CORUM
## 14 HP hits.increased_cali_categories[["pvalue_plots"]][["BP"]]## NULL3.1.2 Visualize clinic differences
Let us take a quick look at the results of the comparison of Tumaco/Cali
Note: I keep re-introducing an error which causes these (volcano and MA) plots to be reversed with respect to the logFC values. Pay careful attention to these and make sure that they agree with the numbers of genes observed in the contrast.
## Check that up is up
summary(tc_all_clinic_table_sva[["data"]][["clinics"]][["deseq_logfc"]])## Min. 1st Qu. Median Mean 3rd Qu. Max.
## -20.280 -0.584 -0.155 -0.255 0.172 3.514## I think we can assume that most genes are down when considering Tumaco/Cali.
sum(tc_all_clinic_table_sva$data$clinics$deseq_logfc < -1.0 &
tc_all_clinic_table_sva$data$clinics$deseq_adjp < 0.05)## [1] 1795tc_all_clinic_table_sva[["plots"]][["clinics"]][["deseq_vol_plots"]]
## Ok, so it says 1794 up, but that is clearly the down side... Something is definitely messed up.
## The points are on the correct sides of the plot, but the categories of up/down are reversed.
## Theresa noted that she colors differently, and I think better: left side gets called
## 'increased in denominator', right side gets called 'increased in numerator';
## these two groups are colored according to their condition colors, and everything else is gray.
## I am checking out Theresa's helper_functions.R to get a sense of how she handles this, I think
## I can use a variant of her idea pretty easily:
## 1. Add a column 'Significance', which is a factor, and contains either 'Not enriched',
## 'Enriched in x', or 'Enriched in y' according to the logfc/adjp.
## 2. use the significance column for the geom_point color/fill in the volcano plot.
## My change to this idea would be to extract the colors from the input expressionset.There appear to be many more genes which are increased in the Tumaco samples with respect to the Cali samples.
3.2 DE: Compare clinics, eosinophil samples
The remaining cell types all have pretty strong clinic-based variance; but I am not certain if it is consistent across cell types.
table(pData(tc_eosinophils)[["condition"]])##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9tc_eosinophils_clinic_de_nobatch <- all_pairwise(tc_eosinophils, parallel = parallel,
model_batch = FALSE, filter = TRUE,
methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 6 comparisons.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Dream/limma step 5/6: Running eBayes.## Dream/limma step 6/6: Creating tables.## Varpart/limma step 6/6: 1/6: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 2/6: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 3/6: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Varpart/limma step 6/6: 4/6: Creating table: conditioncali_cure. Adjust = BH## Varpart/limma step 6/6: 5/6: Creating table: conditiontumaco_cure. Adjust = BH## Varpart/limma step 6/6: 6/6: Creating table: conditiontumaco_failure. Adjust = BH## Limma step 6/6: 1/6: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/6: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 3/6: Creating table: tumaco_failure. Adjust = BH## Limma step 6/6: 4/6: Creating table: conditioncali_cure. Adjust = BH## Limma step 6/6: 5/6: Creating table: conditiontumaco_cure. Adjust = BH## Limma step 6/6: 6/6: Creating table: conditiontumaco_failure. Adjust = BH## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/3: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Limma step 6/6: 2/3: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 3/3: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Limma step 6/6: 1/3: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/3: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 3/3: Creating table: tumaco_failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.
tc_eosinophils_clinic_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_eosinophils_clinic_de_nobatch[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_eosinophils_clinic_table_nobatch <- combine_de_tables(
tc_eosinophils_clinic_de_nobatch, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_table_nobatch-v{ver}.xlsx"))
tc_eosinophils_clinic_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 102 35 114
## 2 tumaco_cure_vs_cali_cure 834 814 856
## edger_sigdown limma_sigup limma_sigdown
## 1 32 62 17
## 2 817 712 705## Plot describing unique/shared genes in a differential expression table.
tc_eosinophils_clinic_sig_nobatch <- extract_significant_genes(
tc_eosinophils_clinic_table_nobatch,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_sig_nobatch-v{ver}.xlsx"))
tc_eosinophils_clinic_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## tumaco 62 17 114 32 102 35 9
## cure 712 705 856 817 834 814 698
## ebseq_down basic_up basic_down
## tumaco 36 0 0
## cure 599 2768 2947
tc_eosinophils_clinic_de_sva <- all_pairwise(tc_eosinophils, model_batch = "svaseq",
filter = TRUE, methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 6 comparisons.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/3: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Limma step 6/6: 2/3: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 3/3: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Limma step 6/6: 1/3: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/3: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 3/3: Creating table: tumaco_failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.
tc_eosinophils_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.tc_eosinophils_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_eosinophils_clinic_table_sva <- combine_de_tables(
tc_eosinophils_clinic_de_sva, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_table_sva-v{ver}.xlsx"))
tc_eosinophils_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 89 57 90
## 2 tumaco_cure_vs_cali_cure 777 808 781
## edger_sigdown limma_sigup limma_sigdown
## 1 41 77 30
## 2 806 723 710## Plot describing unique/shared genes in a differential expression table.
tc_eosinophils_clinic_sig_sva <- extract_significant_genes(
tc_eosinophils_clinic_table_sva,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_sig_sva-v{ver}.xlsx"))
tc_eosinophils_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## tumaco 77 30 90 41 89 57 9
## cure 723 710 781 806 777 808 698
## ebseq_down basic_up basic_down
## tumaco 36 0 0
## cure 599 2768 2947
3.3 DE: Compare clinics, biopsy samples
Interestingly to me, the biopsy samples appear to have the least location-based variance. But we can perform an explicit DE and see how well that hypothesis holds up.
Note that these data include cure and fail samples for
table(pData(tc_biopsies)[["condition"]])##
## cali_cure tumaco_cure tumaco_failure
## 4 9 5tc_biopsies_clinic_de_sva <- all_pairwise(tc_biopsies, parallel = parallel,
model_batch = "svaseq", filter = TRUE,
methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 6 comparisons.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/3: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Limma step 6/6: 2/3: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 3/3: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Limma step 6/6: 1/3: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/3: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 3/3: Creating table: tumaco_failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Choosing among model matrix columns: conditioncali_cure, conditiontumaco_cure, conditiontumaco_failure.
tc_biopsies_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.tc_biopsies_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_biopsies_clinic_table_sva <- combine_de_tables(
tc_biopsies_clinic_de_sva, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Biopsies/tc_biopsies_clinic_table_sva-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_biopsies_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 14 11 18
## 2 tumaco_cure_vs_cali_cure 1 0 0
## edger_sigdown limma_sigup limma_sigdown
## 1 6 0 0
## 2 0 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_biopsies_clinic_sig_sva <- extract_significant_genes(
tc_biopsies_clinic_table_sva,
excel = glue("{clinic_cf_prefix}/Biopsies/tc_biopsies_clinic_sig_sva-v{ver}.xlsx"))
tc_biopsies_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## tumaco 0 0 18 6 14 11 11
## cure 0 0 0 0 1 0 28
## ebseq_down basic_up basic_down
## tumaco 60 0 0
## cure 1 0 0
3.4 DE: Compare clinics, monocyte samples
At least for the moment, I am only looking at the differences between no-batch vs. sva across clinics for the monocyte samples. This was chosen mostly arbitrarily.
3.4.1 DE: Compare clinics, monocytes without batch estimation
Our baseline is the comparison of the monocytes samples without batch in the model or surrogate estimation. In theory at least, this should correspond to the PCA plot above when no batch estimation was performed.
table(pData(tc_monocytes)[["condition"]])##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21tc_monocytes_de_nobatch <- all_pairwise(tc_monocytes, model_batch = FALSE,
filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 10 comparisons.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Dream/limma step 5/6: Running eBayes.## Dream/limma step 6/6: Creating tables.## Varpart/limma step 6/6: 1/10: Creating table: cali_failure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 2/10: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 3/10: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 4/10: Creating table: tumaco_cure_vs_cali_failure. Adjust = BH## Varpart/limma step 6/6: 5/10: Creating table: tumaco_failure_vs_cali_failure. Adjust = BH## Varpart/limma step 6/6: 6/10: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Varpart/limma step 6/6: 7/10: Creating table: conditioncali_cure. Adjust = BH## Varpart/limma step 6/6: 8/10: Creating table: conditioncali_failure. Adjust = BH## Varpart/limma step 6/6: 9/10: Creating table: conditiontumaco_cure. Adjust = BH## Varpart/limma step 6/6: 10/10: Creating table: conditiontumaco_failure. Adjust = BH## Limma step 6/6: 1/8: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/8: Creating table: cali_failure. Adjust = BH## Limma step 6/6: 3/8: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 4/8: Creating table: tumaco_failure. Adjust = BH## Limma step 6/6: 5/8: Creating table: conditioncali_cure. Adjust = BH## Limma step 6/6: 6/8: Creating table: conditioncali_failure. Adjust = BH## Limma step 6/6: 7/8: Creating table: conditiontumaco_cure. Adjust = BH## Limma step 6/6: 8/8: Creating table: conditiontumaco_failure. Adjust = BH## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/6: Creating table: cali_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 2/6: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Limma step 6/6: 3/6: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 4/6: Creating table: tumaco_cure_vs_cali_failure. Adjust = BH## Limma step 6/6: 5/6: Creating table: tumaco_failure_vs_cali_failure. Adjust = BH## Limma step 6/6: 6/6: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Limma step 6/6: 1/4: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/4: Creating table: cali_failure. Adjust = BH## Limma step 6/6: 3/4: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 4/4: Creating table: tumaco_failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
tc_monocytes_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_monocytes_table_nobatch <- combine_de_tables(
tc_monocytes_de_nobatch, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_table_nobatch-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_monocytes_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 16 20 32
## 2 tumaco_failure_vs_tumaco_cure 48 121 60
## 3 tumaco_cure_vs_cali_cure 786 729 778
## 4 tumaco_failure_vs_cali_failure 638 492 518
## edger_sigdown limma_sigup limma_sigdown
## 1 13 38 5
## 2 139 24 37
## 3 784 646 716
## 4 540 395 570## Plot describing unique/shared genes in a differential expression table.
tc_monocytes_sig_nobatch <- extract_significant_genes(
tc_monocytes_table_nobatch,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_sig_nobatch-v{ver}.xlsx"))
tc_monocytes_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 38 5 32 13 16 20 92
## tumaco 24 37 60 139 48 121 0
## cure 646 716 778 784 786 729 646
## fail 395 570 518 540 638 492 165
## ebseq_down basic_up basic_down
## cali 23 412 313
## tumaco 23 158 185
## cure 664 3198 3530
## fail 529 1642 2355
3.4.2 DE: Compare clinics, monocytes with svaseq
In contrast, the following comparison should give a view of the data corresponding to the svaseq PCA plot above. In the best case scenario, we should therefore be able to see some significane differences between the Tumaco cure and fail samples.
tc_monocytes_de_sva <- all_pairwise(tc_monocytes, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 10 comparisons.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/6: Creating table: cali_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 2/6: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Limma step 6/6: 3/6: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 4/6: Creating table: tumaco_cure_vs_cali_failure. Adjust = BH## Limma step 6/6: 5/6: Creating table: tumaco_failure_vs_cali_failure. Adjust = BH## Limma step 6/6: 6/6: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Limma step 6/6: 1/4: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/4: Creating table: cali_failure. Adjust = BH## Limma step 6/6: 3/4: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 4/4: Creating table: tumaco_failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
tc_monocytes_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.tc_monocytes_table_sva <- combine_de_tables(
tc_monocytes_de_sva, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_table_sva-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_monocytes_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 28 36 40
## 2 tumaco_failure_vs_tumaco_cure 34 86 29
## 3 tumaco_cure_vs_cali_cure 761 732 713
## 4 tumaco_failure_vs_cali_failure 684 584 583
## edger_sigdown limma_sigup limma_sigdown
## 1 17 52 7
## 2 70 14 57
## 3 762 640 663
## 4 623 434 567## Plot describing unique/shared genes in a differential expression table.
tc_monocytes_sig_sva <- extract_significant_genes(
tc_monocytes_table_sva,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_sig_sva-v{ver}.xlsx"))
tc_monocytes_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 52 7 40 17 28 36 92
## tumaco 14 57 29 70 34 86 0
## cure 640 663 713 762 761 732 646
## fail 434 567 583 623 684 584 165
## ebseq_down basic_up basic_down
## cali 23 412 313
## tumaco 23 158 185
## cure 664 3198 3530
## fail 529 1642 2355
3.4.3 DE Compare: How similar are the no-batch vs. SVA results?
The following block shows that these two results are exceedingly different, sugesting that the Cali cure/fail and Tumaco cure/fail cannot easily be considered in the same analysis. I did some playing around with my calculate_aucc function in this block and found that it is in some important way broken, at least if one expands the top-n genes to more than 20% of the number of genes in the data.
cali_table <- tc_monocytes_table_nobatch[["data"]][["cali"]]
table <- tc_monocytes_table_nobatch[["data"]][["tumaco"]]
cali_aucc <- calculate_aucc(cali_table, table, px = "deseq_adjp", py = "deseq_adjp",
lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc## These two tables have an aucc value of: 0.0659267365585479 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 1.2, df = 11106, p-value = 0.2
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.006843 0.030345
## sample estimates:
## cor
## 0.01175
cali_table_sva <- tc_monocytes_table_sva[["data"]][["cali"]]
tumaco_table_sva <- tc_monocytes_table_sva[["data"]][["tumaco"]]
cali_aucc_sva <- calculate_aucc(cali_table_sva, tumaco_table_sva, px = "deseq_adjp",
py = "deseq_adjp", lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc_sva## These two tables have an aucc value of: 0.0842668799254026 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 16, df = 11106, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.1356 0.1719
## sample estimates:
## cor
## 0.1538
3.5 DE: Compare clinics, neutrophil samples
tc_neutrophils_de_nobatch <- all_pairwise(tc_neutrophils, parallel = parallel,
model_batch = FALSE, filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 10 comparisons.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Dream/limma step 5/6: Running eBayes.## Dream/limma step 6/6: Creating tables.## Varpart/limma step 6/6: 1/10: Creating table: cali_failure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 2/10: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 3/10: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Varpart/limma step 6/6: 4/10: Creating table: tumaco_cure_vs_cali_failure. Adjust = BH## Varpart/limma step 6/6: 5/10: Creating table: tumaco_failure_vs_cali_failure. Adjust = BH## Varpart/limma step 6/6: 6/10: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Varpart/limma step 6/6: 7/10: Creating table: conditioncali_cure. Adjust = BH## Varpart/limma step 6/6: 8/10: Creating table: conditioncali_failure. Adjust = BH## Varpart/limma step 6/6: 9/10: Creating table: conditiontumaco_cure. Adjust = BH## Varpart/limma step 6/6: 10/10: Creating table: conditiontumaco_failure. Adjust = BH## Limma step 6/6: 1/8: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/8: Creating table: cali_failure. Adjust = BH## Limma step 6/6: 3/8: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 4/8: Creating table: tumaco_failure. Adjust = BH## Limma step 6/6: 5/8: Creating table: conditioncali_cure. Adjust = BH## Limma step 6/6: 6/8: Creating table: conditioncali_failure. Adjust = BH## Limma step 6/6: 7/8: Creating table: conditiontumaco_cure. Adjust = BH## Limma step 6/6: 8/8: Creating table: conditiontumaco_failure. Adjust = BH## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/6: Creating table: cali_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 2/6: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Limma step 6/6: 3/6: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 4/6: Creating table: tumaco_cure_vs_cali_failure. Adjust = BH## Limma step 6/6: 5/6: Creating table: tumaco_failure_vs_cali_failure. Adjust = BH## Limma step 6/6: 6/6: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Limma step 6/6: 1/4: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/4: Creating table: cali_failure. Adjust = BH## Limma step 6/6: 3/4: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 4/4: Creating table: tumaco_failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
tc_neutrophils_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_neutrophils_table_nobatch <- combine_de_tables(
tc_neutrophils_de_nobatch, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_table_nobatch-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_neutrophils_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 33 83 42
## 2 tumaco_failure_vs_tumaco_cure 95 50 112
## 3 tumaco_cure_vs_cali_cure 910 337 934
## 4 tumaco_failure_vs_cali_failure 984 257 808
## edger_sigdown limma_sigup limma_sigdown
## 1 32 37 10
## 2 57 7 12
## 3 342 630 520
## 4 283 380 462## Plot describing unique/shared genes in a differential expression table.
tc_neutrophils_sig_nobatch <- extract_significant_genes(
tc_neutrophils_table_nobatch,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_sig_nobatch-v{ver}.xlsx"))
tc_neutrophils_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 37 10 42 32 33 83 91
## tumaco 7 12 112 57 95 50 7
## cure 630 520 934 342 910 337 687
## fail 380 462 808 283 984 257 113
## ebseq_down basic_up basic_down
## cali 38 404 274
## tumaco 7 7 2
## cure 299 2219 2496
## fail 312 1193 1681
tc_neutrophils_de_sva <- all_pairwise(tc_neutrophils, parallel = parallel,
model_batch = "svaseq", filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 10 comparisons.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/6: Creating table: cali_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 2/6: Creating table: tumaco_cure_vs_cali_cure. Adjust = BH## Limma step 6/6: 3/6: Creating table: tumaco_failure_vs_cali_cure. Adjust = BH## Limma step 6/6: 4/6: Creating table: tumaco_cure_vs_cali_failure. Adjust = BH## Limma step 6/6: 5/6: Creating table: tumaco_failure_vs_cali_failure. Adjust = BH## Limma step 6/6: 6/6: Creating table: tumaco_failure_vs_tumaco_cure. Adjust = BH## Limma step 6/6: 1/4: Creating table: cali_cure. Adjust = BH## Limma step 6/6: 2/4: Creating table: cali_failure. Adjust = BH## Limma step 6/6: 3/4: Creating table: tumaco_cure. Adjust = BH## Limma step 6/6: 4/4: Creating table: tumaco_failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Choosing among model matrix columns: conditioncali_cure, conditioncali_failure, conditiontumaco_cure, conditiontumaco_failure.
tc_neutrophils_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.tc_neutrophils_table_sva <- combine_de_tables(
tc_neutrophils_de_sva, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_table_sva-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_neutrophils_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 91 181 103
## 2 tumaco_failure_vs_tumaco_cure 86 38 72
## 3 tumaco_cure_vs_cali_cure 844 379 843
## 4 tumaco_failure_vs_cali_failure 696 197 608
## edger_sigdown limma_sigup limma_sigdown
## 1 122 75 50
## 2 23 37 47
## 3 367 645 481
## 4 214 310 325## Plot describing unique/shared genes in a differential expression table.
tc_neutrophils_sig_sva <- extract_significant_genes(
tc_neutrophils_table_sva,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_sig_sva-v{ver}.xlsx"))
tc_neutrophils_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 75 50 103 122 91 181 91
## tumaco 37 47 72 23 86 38 7
## cure 645 481 843 367 844 379 687
## fail 310 325 608 214 696 197 113
## ebseq_down basic_up basic_down
## cali 38 404 274
## tumaco 7 7 2
## cure 299 2219 2496
## fail 312 1193 1681
3.6 GSEA: Extract clinic-specific genes
Given the above comparisons, we can extract some gene sets which resulted from those DE analyses and eventually perform some ontology/KEGG/reactome/etc searches. This reminds me, I want to make my extract_significant_ functions to return gene-set data structures and my various ontology searches to take them as inputs. This should help avoid potential errors when extracting up/down genes.
clinic_sigenes_up <- rownames(tc_all_clinic_sig_sva[["deseq"]][["ups"]][["clinics"]])
clinic_sigenes_down <- rownames(tc_all_clinic_sig_sva[["deseq"]][["downs"]][["clinics"]])
clinic_sigenes <- c(clinic_sigenes_up, clinic_sigenes_down)
tc_eosinophils_sigenes_up <- rownames(tc_eosinophils_clinic_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_eosinophils_sigenes_down <- rownames(tc_eosinophils_clinic_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_monocytes_sigenes_up <- rownames(tc_monocytes_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_monocytes_sigenes_down <- rownames(tc_monocytes_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_neutrophils_sigenes_up <- rownames(tc_neutrophils_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_neutrophils_sigenes_down <- rownames(tc_neutrophils_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_eosinophils_sigenes <- c(tc_eosinophils_sigenes_up,
tc_eosinophils_sigenes_down)
tc_monocytes_sigenes <- c(tc_monocytes_sigenes_up,
tc_monocytes_sigenes_down)
tc_neutrophils_sigenes <- c(tc_neutrophils_sigenes_up,
tc_neutrophils_sigenes_down)3.7 GSEA: gProfiler of genes deemed up/down when comparing Cali and Tumaco
I was curious to try to understand why the two clinics appear to be so different vis a vis their PCA/DE; so I thought that gProfiler might help boil those results down to something more digestible.
3.7.1 GSEA: Compare clinics, all samples
Note that in the following block I used the function simple_gprofiler(), but later in this document I will use all_gprofiler(). The first invocation limits the search to a single table, while the second will iterate over every result in a pairwise differential expression analysis.
In this instance, we are looking at the vector of gene IDs deemed significantly different between the two clinics in either the up or down direction.
One other thing worth noting, the new version of gProfiler provides some fun interactive plots. I will add an example here.
tc_eosinophil_gprofiler <- simple_gprofiler(
tc_eosinophils_sigenes_up,
excel = glue("{gsea_prefix}/eosinophil_clinics_tumaco_up-v{ver}.xlsx"))
tc_eosinophil_gprofiler## A set of ontologies produced by gprofiler using 777
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 20 MF
## 218 BP
## 0 KEGG
## 2 REAC
## 0 WP
## 540 TF
## 6 MIRNA
## 0 HPA
## 2 CORUM
## 0 HP hits.clinic_gp <- simple_gprofiler(
clinic_sigenes,
excel = glue("{gsea_prefix}/both_clinics_cali_up-v{ver}.xlsx"))
clinic_gp$pvalue_plots$REAC
clinic_gp$pvalue_plots$BP## NULLclinic_gp$pvalue_plots$TF
clinic_gp$interactive_plots$GO## NULL3.7.2 GSEA: Compare clinics, Eosinophil samples
In the following block, I am looking at the gProfiler over represented groups observed across clinics in only the Eosinophils. First I do so for all genes(up or down), followed by only the up and down groups. Each of the following will include only the Reactome and GO:BP plots. These searches did not have too many other hits, excepting the transcription factor database.
tc_eosinophils_gp <- simple_gprofiler(
tc_eosinophils_sigenes,
excel = glue("{gsea_prefix}/eosinophil_clinics-v{ver}.xlsx"))
tc_eosinophils_gp## A set of ontologies produced by gprofiler using 1585
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 39 MF
## 276 BP
## 0 KEGG
## 5 REAC
## 0 WP
## 563 TF
## 10 MIRNA
## 0 HPA
## 5 CORUM
## 0 HP hits.tc_eosinophils_gp$pvalue_plots$REAC
tc_eosinophils_gp$pvalue_plots$BP## NULLtc_eosinophils_up_gp <- simple_gprofiler(
tc_eosinophils_sigenes_up,
excel = glue("{gsea_prefix}/eosinophil_clinics_tumaco_up-v{ver}.xlsx"))
tc_eosinophils_up_gp## A set of ontologies produced by gprofiler using 777
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 20 MF
## 218 BP
## 0 KEGG
## 2 REAC
## 0 WP
## 540 TF
## 6 MIRNA
## 0 HPA
## 2 CORUM
## 0 HP hits.tc_eosinophils_up_gp$pvalue_plots$REAC
tc_eosinophils_down_gp <- simple_gprofiler(
tc_eosinophils_sigenes_down,
excel = glue("{gsea_prefix}/eosinophil_clinics_cali_up-v{ver}.xlsx"))
tc_eosinophils_down_gp## A set of ontologies produced by gprofiler using 808
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 14 MF
## 94 BP
## 2 KEGG
## 9 REAC
## 2 WP
## 77 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.tc_eosinophils_down_gp$pvalue_plots$REAC
3.7.3 GSEA: Compare clinics, Monocyte samples
In the following block I repeated the above query, but this time looking at the monocyte samples.
tc_monocytes_up_gp <- simple_gprofiler(
tc_monocytes_sigenes,
excel = glue("{gsea_prefix}/monocyte_clinics-v{ver}.xlsx"))
tc_monocytes_up_gp## A set of ontologies produced by gprofiler using 1493
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 55 MF
## 476 BP
## 0 KEGG
## 6 REAC
## 4 WP
## 495 TF
## 2 MIRNA
## 0 HPA
## 1 CORUM
## 0 HP hits.tc_monocytes_up_gp$pvalue_plots$REAC
tc_monocytes_up_gp$pvalue_plots$BP## NULLtc_monocytes_down_gp <- simple_gprofiler(
tc_monocytes_sigenes_down,
excel = glue("{gsea_prefix}/monocyte_clinics_cali_up-v{ver}.xlsx"))
tc_monocytes_down_gp$pvalue_plots$REAC
tc_monocytes_down_gp$pvalue_plots$BP## NULL3.7.3.1 GSEA: Compare clinics, Neutrophil samples
Ibid. This time looking at the Neutrophils. Thus the first two images should be a superset of the second and third pairs of images; assuming that the genes in the up/down list do not cause the groups to no longer be significant. Interestingly, the reactome search did not return any hits for the increased search.
tc_neutrophils_gp <- simple_gprofiler(
tc_neutrophils_sigenes,
excel = glue("{gsea_prefix}/neutrophil_clinics-v{ver}.xlsx"))
## tc_neutrophils_gp$pvalue_plots$REAC ## no hits
tc_neutrophils_gp$pvalue_plots$BP## NULLtc_neutrophils_gp$pvalue_plots$TF
tc_neutrophils_up_gp <- simple_gprofiler(
tc_neutrophils_sigenes_up,
excel = glue("{gsea_prefix}/neutrophil_clinics_tumaco_up-v{ver}.xlsx"))
## tc_neutrophils_up_gp$pvalue_plots$REAC ## No hits
tc_neutrophils_up_gp$pvalue_plots$BP## NULLtc_neutrophils_down_gp <- simple_gprofiler(
tc_neutrophils_sigenes_down,
excel = glue("{gsea_prefix}/neutrophil_clinics_cali_up-v{ver}.xlsx"))
tc_neutrophils_down_gp$pvalue_plots$REAC
tc_neutrophils_down_gp$pvalue_plots$BP## NULL4 Compare DE: How similar are Tumaco C/F vs. Cali C/F
The following expands the cross-clinic query above to also test the neutrophils. Once again, I think it will pretty strongly support the hypothesis that the two clinics are not compatible.
We are concerned that the clinic-based batch effect may make our results essentially useless. One way to test this concern is to compare the set of genes observed different between the Cali Cure/Fail vs. the Tumaco Cure/Fail.
cali_table_nobatch <- tc_neutrophils_table_nobatch[["data"]][["cali"]]
tumaco_table_nobatch <- tc_neutrophils_table_nobatch[["data"]][["tumaco"]]
cali_merged_nobatch <- merge(cali_table_nobatch, tumaco_table_nobatch, by="row.names")
cor.test(cali_merged_nobatch[, "deseq_logfc.x"], cali_merged_nobatch[, "deseq_logfc.y"])##
## Pearson's product-moment correlation
##
## data: cali_merged_nobatch[, "deseq_logfc.x"] and cali_merged_nobatch[, "deseq_logfc.y"]
## t = -16, df = 9242, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.1798 -0.1401
## sample estimates:
## cor
## -0.16cali_aucc_nobatch <- calculate_aucc(cali_table_nobatch, tumaco_table_nobatch, px = "deseq_adjp",
py = "deseq_adjp", lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc_nobatch$plot
5 Tumaco and Cali, cure vs. fail
In all of the above, we are looking to understand the differences between the two location. Let us now step back and perform the original question: fail/cure without regard to location.
I performed this query with a few different parameters, notably with(out) sva and again using each cell type, including biopsies. The main reasion I am keeping these comparisons is in the relatively weak hope that there will be sufficient signal in the full dataset that it might be able to overcome the apparently ridiculous batch effect from the two clinics.
5.1 All cell types together, with(out) SVA
table(pData(tc_valid)[["condition"]])##
## cure failure
## 122 62tc_all_cf_de_sva <- all_pairwise(tc_valid, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 122 62## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_all_cf_table_sva <- combine_de_tables(
tc_all_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_table_sva-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_all_cf_sig_sva <- extract_significant_genes(
tc_all_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_sig_sva-v{ver}.xlsx"))
tc_all_cf_de_batch <- all_pairwise(tc_valid, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 122 62
##
## 1 2 3
## 83 50 51## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + batch.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 122 62## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_all_cf_table_batch <- combine_de_tables(
tc_all_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_table_batch-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_all_cf_sig_batch <- extract_significant_genes(
tc_all_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_sig_batch-v{ver}.xlsx"))5.2 All cell types except biopsies
I am not sure if this is the best choice, but I call the set of all samples excluding biopsies ‘clinical’.
table(pData(tc_clinical_nobiop)[["condition"]])##
## cure failure
## 109 57tc_clinical_cf_de_sva <- all_pairwise(tc_clinical_nobiop, filter = TRUE,
model_batch = "svaseq",
methods = methods)##
## cure failure
## 109 57## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_clinical_cf_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## basic_vs_deseq 0.8865
## basic_vs_ebseq 0.7583
## basic_vs_edger 0.9008
## basic_vs_limma 0.9413
## basic_vs_noiseq 0.9206
## deseq_vs_ebseq 0.8258
## deseq_vs_edger 0.9918
## deseq_vs_limma 0.8939
## deseq_vs_noiseq 0.9403
## ebseq_vs_edger 0.8175
## ebseq_vs_limma 0.8180
## ebseq_vs_noiseq 0.8311
## edger_vs_limma 0.8974
## edger_vs_noiseq 0.9512
## limma_vs_noiseq 0.8734tc_clinical_cf_table_sva <- combine_de_tables(
tc_clinical_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_table_sva-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_clinical_cf_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 186 96 214 93
## limma_sigup limma_sigdown
## 1 97 79## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_clinical_cf_sig_sva <- extract_significant_genes(
tc_clinical_cf_table_sva, according_to = "deseq",
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_sig_sva-v{ver}.xlsx"))
tc_clinical_cf_sig_sva## A set of genes deemed significant according to deseq.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## deseq_up deseq_down
## outcome 186 96
tc_clinical_cf_de_batch <- all_pairwise(tc_clinical_nobiop, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 109 57
##
## eosinophils monocytes neutrophils
## 41 63 62## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + batch.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 109 57## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_clinical_cf_de_batch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: batch in model/limma.## The primary analysis performed 15 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## basic_vs_deseq 0.6416
## basic_vs_ebseq 0.7583
## basic_vs_edger 0.6418
## basic_vs_limma 0.7121
## basic_vs_noiseq 0.9206
## deseq_vs_ebseq 0.7638
## deseq_vs_edger 0.9991
## deseq_vs_limma 0.8070
## deseq_vs_noiseq 0.7624
## ebseq_vs_edger 0.7635
## ebseq_vs_limma 0.6891
## ebseq_vs_noiseq 0.8311
## edger_vs_limma 0.8115
## edger_vs_noiseq 0.7625
## limma_vs_noiseq 0.6686tc_clinical_cf_table_batch <- combine_de_tables(
tc_clinical_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_table_batch-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_clinical_cf_table_batch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 106 68 116 74
## limma_sigup limma_sigdown
## 1 83 45## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_clinical_cf_sig_batch <- extract_significant_genes(
tc_clinical_cf_table_batch, according_to = "deseq",
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_sig_batch-v{ver}.xlsx"))
tc_clinical_cf_sig_batch## A set of genes deemed significant according to deseq.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## deseq_up deseq_down
## outcome 106 68
5.2.1 A portion of Supplemental Figure 11.
num_color <- color_choices[["cf"]][["cure"]]
den_color <- color_choices[["cf"]][["failure"]]
tc_clinical_cf_table <- tc_clinical_cf_table_sva[["data"]][["outcome"]]
tc_clinical_cf_volcano_top10 <- plot_volcano_condition_de(
tc_clinical_cf_table, "outcome", label = 10,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = "figures/s11c_tc_clinical_cf_volcano_labeled_top10.svg")
tc_clinical_cf_volcano_top10[["plot"]]
dev.off()## png
## 2tc_clinical_cf_volcano_top10[["plot"]]
5.3 Biopsies, with(out) SVA
In the following block, we repeat the same question, but using only the biopsy samples from both clinics.
tc_biopsies_cf <- set_expt_conditions(tc_biopsies, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 13 5tc_biopsies_cf_de_sva <- all_pairwise(tc_biopsies_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 13 5## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_biopsies_cf_table_sva <- combine_de_tables(
tc_biopsies_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Biopsies/tc_biopsies_cf_table_sva-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_biopsies_cf_sig_sva <- extract_significant_genes(
tc_biopsies_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_sig_sva-v{ver}.xlsx"))
tc_biopsies_cf_de_batch <- all_pairwise(tc_biopsies_cf, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 13 5
##
## 1
## 18## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The condition+batch model failed. Does your experimental design support both condition and batch? Using only a conditional model.## converting counts to integer mode## Getting factors from: ~ 0 + condition.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## The condition+batch model failed. Does your experimental design support both condition and batch? Using only a conditional model.## Getting factors from: ~ 0 + condition.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Dream/limma step 5/6: Running eBayes.## Dream/limma step 6/6: Creating tables.## Varpart/limma step 6/6: 1/3: Creating table: failure_vs_cure. Adjust = BH## Varpart/limma step 6/6: 2/3: Creating table: conditioncure. Adjust = BH## Varpart/limma step 6/6: 3/3: Creating table: conditionfailure. Adjust = BH## Limma step 6/6: 1/4: Creating table: cure. Adjust = BH## Limma step 6/6: 2/4: Creating table: failure. Adjust = BH## Limma step 6/6: 3/4: Creating table: conditioncure. Adjust = BH## Limma step 6/6: 4/4: Creating table: conditionfailure. Adjust = BH## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The condition+batch model failed. Does your experimental design support both condition and batch? Using only a conditional model.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## The condition+batch model failed. Does your experimental design support both condition and batch? Using only a conditional model.## Getting factors from: ~ 0 + condition.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The condition+batch model failed. Does your experimental design support both condition and batch? Using only a conditional model.## The provided conditions are:## conditions
## cure failure
## 13 5## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_biopsies_cf_table_batch <- combine_de_tables(
tc_biopsies_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_table_batch-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_biopsies_cf_sig_batch <- extract_significant_genes(
tc_biopsies_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_sig_batch-v{ver}.xlsx"))5.4 Eosinophils, with(out) SVA
In the following block, we repeat the same question, but using only the Eosinophil samples from both clinics.
tc_eosinophils_cf <- set_expt_conditions(tc_eosinophils, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 32 9tc_eosinophils_cf_de_sva <- all_pairwise(tc_eosinophils_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 32 9## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_eosinophils_cf_table_sva <- combine_de_tables(
tc_eosinophils_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/tc_eosinophils_cf_table_sva-v{ver}.xlsx"))
tc_eosinophils_cf_sig_sva <- extract_significant_genes(
tc_eosinophils_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_sig_sva-v{ver}.xlsx"))
tc_eosinophils_cf_de_batch <- all_pairwise(tc_eosinophils_cf, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 32 9
##
## 3 2 1
## 13 14 14## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + batch.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 32 9## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_eosinophils_cf_table_batch <- combine_de_tables(
tc_eosinophils_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_table_batch-v{ver}.xlsx"))
tc_eosinophils_cf_sig_batch <- extract_significant_genes(
tc_eosinophils_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_sig_batch-v{ver}.xlsx"))5.5 Monocytes, with(out) SVA
Repeat yet again, this time with the monocyte samples. The idea is to see if there is a cell type which is particularly good (or bad) at discriminating the two clinics.
tc_monocytes_cf <- set_expt_conditions(tc_monocytes, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 39 24tc_monocytes_cf_de_sva <- all_pairwise(tc_monocytes_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 39 24## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_monocytes_cf_table_sva <- combine_de_tables(
tc_monocytes_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Monocytes/tc_monocytes_cf_table_sva-v{ver}.xlsx"))
tc_monocytes_cf_sig_sva <- extract_significant_genes(
tc_monocytes_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_sig_sva-v{ver}.xlsx"))
tc_monocytes_cf_de_batch <- all_pairwise(tc_monocytes_cf, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 39 24
##
## 3 2 1
## 19 18 26## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + batch.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 39 24## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_monocytes_cf_table_batch <- combine_de_tables(
tc_monocytes_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_table_batch-v{ver}.xlsx"))
tc_monocytes_cf_sig_batch <- extract_significant_genes(
tc_monocytes_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_sig_batch-v{ver}.xlsx"))5.6 Neutrophils, with(out) SVA
Last try, this time using the Neutrophil samples.
tc_neutrophils_cf <- set_expt_conditions(tc_neutrophils, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 38 24tc_neutrophils_cf_de_sva <- all_pairwise(tc_neutrophils_cf, parallel = parallel,
filter = TRUE, model_batch = "svaseq",
methods = methods)##
## cure failure
## 38 24## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_neutrophils_cf_table_sva <- combine_de_tables(
tc_neutrophils_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/tc_neutrophils_cf_table_sva-v{ver}.xlsx"))
tc_neutrophils_cf_sig_sva <- extract_significant_genes(
tc_neutrophils_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_sig_sva-v{ver}.xlsx"))
tc_neutrophils_cf_de_batch <- all_pairwise(tc_neutrophils_cf, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 38 24
##
## 3 2 1
## 19 18 25## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + batch.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + batch.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: failure_vs_cure. Adjust = BH## Limma step 6/6: 1/2: Creating table: cure. Adjust = BH## Limma step 6/6: 2/2: Creating table: failure. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## cure failure
## 38 24## Choosing among model matrix columns: conditioncure, conditionfailure.
tc_neutrophils_cf_table_batch <- combine_de_tables(
tc_neutrophils_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_table_batch-v{ver}.xlsx"))
tc_neutrophils_cf_sig_batch <- extract_significant_genes(
tc_neutrophils_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_sig_batch-v{ver}.xlsx"))6 Visit comparisons
Later in this document I do a bunch of visit/cf comparisons. In this block I want to explicitly only compare v1 to other visits. This is something I did quite a lot in the 2019 datasets, but never actually moved to this document.
v1_vs_later <- all_pairwise(tc_v1vs, model_batch = "svaseq", methods = methods,
filter = TRUE)##
## first later
## 65 101## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## first later
## 65 101## Choosing among model matrix columns: conditionfirst, conditionlater.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## first later
## 65 101## Choosing among model matrix columns: conditionfirst, conditionlater.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## first later
## 65 101## Choosing among model matrix columns: conditionfirst, conditionlater.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## first later
## 65 101## Choosing among model matrix columns: conditionfirst, conditionlater.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## first later
## 65 101## Choosing among model matrix columns: conditionfirst, conditionlater.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## first later
## 65 101## Choosing among model matrix columns: conditionfirst, conditionlater.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: later_vs_first. Adjust = BH## Limma step 6/6: 1/2: Creating table: first. Adjust = BH## Limma step 6/6: 2/2: Creating table: later. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## first later
## 65 101## Choosing among model matrix columns: conditionfirst, conditionlater.
v1_vs_later_table <- combine_de_tables(
v1_vs_later, keepers = visit_v1later,
excel = glue("{visit_prefix}/v1_vs_later_tables-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.v1_vs_later_sig <- extract_significant_genes(
v1_vs_later_table,
excel = glue("{visit_prefix}/v1_vs_later_sig-v{ver}.xlsx"))6.0.0.1 GSEA: V1 vs other visits.
v1later_gp <- all_gprofiler(v1_vs_later_sig)
v1later_gp[[1]]$pvalue_plots$REAC
v1later_gp[[2]]$pvalue_plots$REAC
7 Sex comparison
tc_sex_de <- all_pairwise(tc_sex, model_batch = "svaseq", methods = methods,
filter = TRUE)##
## female male
## 28 156## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## female male
## 28 156## Choosing among model matrix columns: conditionfemale, conditionmale.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## female male
## 28 156## Choosing among model matrix columns: conditionfemale, conditionmale.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## female male
## 28 156## Choosing among model matrix columns: conditionfemale, conditionmale.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## female male
## 28 156## Choosing among model matrix columns: conditionfemale, conditionmale.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## female male
## 28 156## Choosing among model matrix columns: conditionfemale, conditionmale.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## female male
## 28 156## Choosing among model matrix columns: conditionfemale, conditionmale.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: male_vs_female. Adjust = BH## Limma step 6/6: 1/2: Creating table: female. Adjust = BH## Limma step 6/6: 2/2: Creating table: male. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## female male
## 28 156## Choosing among model matrix columns: conditionfemale, conditionmale.
tc_sex_table <- combine_de_tables(
tc_sex_de, excel = glue("{sex_prefix}/tc_sex_table-v{ver}.xlsx"))
tc_sex_sig <- extract_significant_genes(
tc_sex_table, excel = glue("{sex_prefix}/tc_sex_sig-v{ver}.xlsx"))
tc_sex_gp <- all_gprofiler(tc_sex_sig)tc_sex_cure <- subset_expt(tc_sex, subset = "finaloutcome=='cure'")## subset_expt(): There were 184, now there are 122 samples.tc_sex_cure_de <- all_pairwise(tc_sex_cure, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## female male
## 19 103## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 3 comparisons.## The provided conditions are:## conditions
## female male
## 19 103## Choosing among model matrix columns: conditionfemale, conditionmale.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## female male
## 19 103## Choosing among model matrix columns: conditionfemale, conditionmale.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## female male
## 19 103## Choosing among model matrix columns: conditionfemale, conditionmale.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## female male
## 19 103## Choosing among model matrix columns: conditionfemale, conditionmale.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## female male
## 19 103## Choosing among model matrix columns: conditionfemale, conditionmale.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## female male
## 19 103## Choosing among model matrix columns: conditionfemale, conditionmale.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/1: Creating table: male_vs_female. Adjust = BH## Limma step 6/6: 1/2: Creating table: female. Adjust = BH## Limma step 6/6: 2/2: Creating table: male. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## female male
## 19 103## Choosing among model matrix columns: conditionfemale, conditionmale.
tc_sex_cure_de## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.## The logFC agreement among the methods follows:## mal_vs_fml
## basic_vs_deseq 0.6740
## basic_vs_ebseq 0.5398
## basic_vs_edger 0.8003
## basic_vs_limma 0.9099
## basic_vs_noiseq 0.8159
## deseq_vs_ebseq 0.6490
## deseq_vs_edger 0.8641
## deseq_vs_limma 0.6481
## deseq_vs_noiseq 0.7503
## ebseq_vs_edger 0.6887
## ebseq_vs_limma 0.5899
## ebseq_vs_noiseq 0.6346
## edger_vs_limma 0.7769
## edger_vs_noiseq 0.8670
## limma_vs_noiseq 0.7196tc_sex_cure_table <- combine_de_tables(
tc_sex_cure_de, excel = glue("{sex_prefix}/tc_sex_cure_table-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_sex_cure_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 male_vs_female 70 74 64 80
## limma_sigup limma_sigdown
## 1 40 74## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_sex_cure_sig <- extract_significant_genes(
tc_sex_cure_table, excel = glue("{sex_prefix}/tc_sex_cure_sig-v{ver}.xlsx"))
tc_sex_cure_sig## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## male_vs_female 40 74 64 80 70 74
## ebseq_up ebseq_down basic_up basic_down
## male_vs_female 10 8 12 5
7.0.0.1 GSEA: Sex comparisons both clinics
tc_sex_cure_gp <- all_gprofiler(tc_sex_cure_sig)
tc_sex_cure_gp## Running gProfiler on every set of significant genes found:## BP CORUM HP HPA KEGG MIRNA MF REAC TF WP
## male_vs_female_up 3 0 1 0 1 0 1 0 3 0
## male_vs_female_down 3 0 0 0 0 0 0 1 0 0tc_sex_cure_gp[[1]][["pvalue_plots"]][["BP"]]## NULLtc_sex_cure_gp[[2]][["pvalue_plots"]][["BP"]]## NULL8 Ethnicity comparisons
tc_ethnicity_de <- all_pairwise(tc_etnia_expt, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## afrocol indigena mestiza
## 91 46 47## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 6 comparisons.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 91 46 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## afrocol indigena mestiza
## 91 46 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 91 46 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## afrocol indigena mestiza
## 91 46 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 91 46 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5 + SV6.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## afrocol indigena mestiza
## 91 46 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/3: Creating table: indigena_vs_afrocol. Adjust = BH## Limma step 6/6: 2/3: Creating table: mestiza_vs_afrocol. Adjust = BH## Limma step 6/6: 3/3: Creating table: mestiza_vs_indigena. Adjust = BH## Limma step 6/6: 1/3: Creating table: afrocol. Adjust = BH## Limma step 6/6: 2/3: Creating table: indigena. Adjust = BH## Limma step 6/6: 3/3: Creating table: mestiza. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 91 46 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.
tc_ethnicity_de## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 15 comparisons.tc_ethnicity_table <- combine_de_tables(
tc_ethnicity_de, keepers = ethnicity_contrasts,
excel = glue("{eth_prefix}/tc_ethnicity_table-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.tc_ethnicity_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 mestiza_vs_indigena 48 22 53 23
## 2 mestiza_vs_afrocol 51 171 58 180
## 3 indigena_vs_afrocol 67 269 72 280
## limma_sigup limma_sigdown
## 1 24 14
## 2 44 90
## 3 78 144## Plot describing unique/shared genes in a differential expression table.
tc_ethnicity_table[["plots"]][["mestizo_indigenous"]][["deseq_ma_plots"]]
tc_ethnicity_table[["plots"]][["mestizo_afrocol"]][["deseq_ma_plots"]]
tc_ethnicity_table[["plots"]][["indigenous_afrocol"]][["deseq_ma_plots"]]
tc_ethnicity_sig <- extract_significant_genes(
tc_ethnicity_table, excel = glue("{eth_prefix}/tc_ethnicity_sig-v{ver}.xlsx"))
ethnicity_cure <- subset_expt(tc_etnia_expt, subset = "finaloutcome=='cure'")## subset_expt(): There were 184, now there are 122 samples.ethnicity_cure_de <- all_pairwise(ethnicity_cure, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## afrocol indigena mestiza
## 39 36 47## Starting basic pairwise comparison.## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Basic step 1/3: Creating mean and variance tables.## Basic step 2/3: Performing 6 comparisons.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 39 36 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Basic step 3/3: Creating faux DE Tables.## Basic: Returning tables.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## converting counts to integer mode## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## The provided conditions are:## conditions
## afrocol indigena mestiza
## 39 36 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Dream/limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Dream/limma 2/6: Attempting voomWithDreamWeights.
## Dream/limma step 3/6: running dream.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 39 36 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## Error in cbind(L, Luni) :
## number of rows of matrices must match (see arg 2)## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.
## The provided conditions are:## conditions
## afrocol indigena mestiza
## 39 36 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Starting edgeR pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## EdgeR step 1/9: Importing and normalizing data.## EdgeR step 2/9: Estimating the common dispersion.## EdgeR step 3/9: Estimating dispersion across genes.## EdgeR step 4/9: Estimating GLM Common dispersion.## EdgeR step 5/9: Estimating GLM Trended dispersion.## EdgeR step 6/9: Estimating GLM Tagged dispersion.## EdgeR step 7/9: Running glmFit, switch to glmQLFit by changing the argument 'edger_test'.## EdgeR step 8/9: Making pairwise contrasts.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 39 36 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.
## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Limma step 1/6: choosing model.## Getting factors from: ~ 0 + condition + SV1 + SV2 + SV3 + SV4 + SV5.## Limma step 2/6: running limma::voom(), switch with the argument 'which_voom'.## Using normalize.method = quantile for voom.
## Limma step 3/6: running lmFit with method: ls.## Limma step 4/6: making and fitting contrasts with no intercept. (~ 0 + factors)## The provided conditions are:## conditions
## afrocol indigena mestiza
## 39 36 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.## Limma step 5/6: Running eBayes with robust = FALSE and trend = FALSE.## Limma step 6/6: Creating tables without an intercept.## Limma step 6/6: 1/3: Creating table: indigena_vs_afrocol. Adjust = BH## Limma step 6/6: 2/3: Creating table: mestiza_vs_afrocol. Adjust = BH## Limma step 6/6: 3/3: Creating table: mestiza_vs_indigena. Adjust = BH## Limma step 6/6: 1/3: Creating table: afrocol. Adjust = BH## Limma step 6/6: 2/3: Creating table: indigena. Adjust = BH## Limma step 6/6: 3/3: Creating table: mestiza. Adjust = BH## Starting noiseq pairwise comparisons.## The data should be suitable for EdgeR/DESeq/EBSeq.
## If they freak out, check the state of the count table
## and ensure that it is in integer counts.## The provided conditions are:## conditions
## afrocol indigena mestiza
## 39 36 47## Choosing among model matrix columns: conditionafrocol, conditionindigena, conditionmestiza.
ethnicity_cure_table <- combine_de_tables(
ethnicity_cure_de, keepers = ethnicity_contrasts,
excel = glue("{eth_prefix}/ethnicity_cure_table-v{ver}.xlsx"))## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.## Could not create a linear model of the data.## Going to perform a scatter plot without linear model.ethnicity_cure_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 mestiza_vs_indigena 64 24 60 26
## 2 mestiza_vs_afrocol 68 168 78 167
## 3 indigena_vs_afrocol 87 352 97 340
## limma_sigup limma_sigdown
## 1 36 15
## 2 63 100
## 3 109 180## Plot describing unique/shared genes in a differential expression table.
ethnicity_cure_table[["plots"]][["mestizo_indigenous"]][["deseq_ma_plots"]]
ethnicity_cure_table[["plots"]][["mestizo_afrocol"]][["deseq_ma_plots"]]
ethnicity_cure_table[["plots"]][["indigenous_afrocol"]][["deseq_ma_plots"]]
ethnicity_cure_sig <- extract_significant_genes(
ethnicity_cure_table, excel = glue("{eth_prefix}/ethnicity_cure_sig-v{ver}.xlsx"))
ethnicity_cure_sig## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## mestizo_indigenous 36 15 60 26 64 24
## mestizo_afrocol 63 100 78 167 68 168
## indigenous_afrocol 109 180 97 340 87 352
## ebseq_up ebseq_down basic_up basic_down
## mestizo_indigenous 11 0 0 1
## mestizo_afrocol 6 16 12 20
## indigenous_afrocol 10 38 182 133
8.0.0.1 GSEA: Ethnicity differences
Performed once with both clinics and again with only Tumaco.
tc_ethnicity_gp <- all_gprofiler(tc_ethnicity_sig)pander::pander(sessionInfo())R version 4.4.1 (2024-06-14)
Platform: x86_64-conda-linux-gnu
locale: C
attached base packages: stats4, stats, graphics, grDevices, utils, datasets, methods and base
other attached packages: edgeR(v.4.0.16), ruv(v.0.9.7.1), DOSE(v.3.28.2), forcats(v.1.0.0), dplyr(v.1.1.4), hpgltools(v.1.0), Matrix(v.1.6-5), glue(v.1.7.0), SummarizedExperiment(v.1.32.0), GenomicRanges(v.1.54.1), GenomeInfoDb(v.1.38.6), IRanges(v.2.36.0), S4Vectors(v.0.40.2), MatrixGenerics(v.1.14.0), matrixStats(v.1.2.0), Biobase(v.2.62.0) and BiocGenerics(v.0.48.1)
loaded via a namespace (and not attached): fs(v.1.6.3), bitops(v.1.0-7), enrichplot(v.1.22.0), blockmodeling(v.1.1.5), HDO.db(v.0.99.1), httr(v.1.4.7), RColorBrewer(v.1.1-3), numDeriv(v.2016.8-1.1), tools(v.4.4.1), backports(v.1.4.1), utf8(v.1.2.4), R6(v.2.5.1), lazyeval(v.0.2.2), mgcv(v.1.9-1), withr(v.3.0.0), gridExtra(v.2.3), preprocessCore(v.1.64.0), fdrtool(v.1.2.18), cli(v.3.6.2), scatterpie(v.0.2.1), labeling(v.0.4.3), slam(v.0.1-53), EBSeq(v.2.0.0), sass(v.0.4.8), mvtnorm(v.1.2-4), robustbase(v.0.99-4), genefilter(v.1.84.0), yulab.utils(v.0.1.7), ggupset(v.0.4.0), gson(v.0.1.0), R.utils(v.2.12.3), limma(v.3.58.1), RSQLite(v.2.3.5), gridGraphics(v.0.5-1), generics(v.0.1.3), gtools(v.3.9.5), crosstalk(v.1.2.1), zip(v.2.3.1), GO.db(v.3.18.0), fansi(v.1.0.6), abind(v.1.4-5), R.methodsS3(v.1.8.2), lifecycle(v.1.0.4), yaml(v.2.3.8), gplots(v.3.1.3.1), qvalue(v.2.34.0), SparseArray(v.1.2.4), grid(v.4.4.1), blob(v.1.2.4), promises(v.1.2.1), crayon(v.1.5.2), lattice(v.0.22-5), cowplot(v.1.1.3), annotate(v.1.80.0), KEGGREST(v.1.42.0), pillar(v.1.9.0), knitr(v.1.45), varhandle(v.2.0.6), fgsea(v.1.28.0), boot(v.1.3-29), corpcor(v.1.6.10), codetools(v.0.2-19), fastmatch(v.1.1-4), ggfun(v.0.1.8), data.table(v.1.15.0), Vennerable(v.3.1.0.9000), treeio(v.1.29.1), vctrs(v.0.6.5), png(v.0.1-8), Rdpack(v.2.6), testthat(v.3.2.1), gtable(v.0.3.4), cachem(v.1.0.8), xfun(v.0.42), openxlsx(v.4.2.5.2), rbibutils(v.2.2.16), S4Arrays(v.1.2.0), mime(v.0.12), RcppEigen(v.0.3.3.9.4), tidygraph(v.1.3.1), survival(v.3.5-8), iterators(v.1.0.14), NOISeq(v.2.46.0), statmod(v.1.5.0), ellipsis(v.0.3.2), nlme(v.3.1-164), pbkrtest(v.0.5.2), ggtree(v.3.15.0), bit64(v.4.0.5), EnvStats(v.2.8.1), UpSetR(v.1.4.0), rprojroot(v.2.0.4), bslib(v.0.6.1), KernSmooth(v.2.23-22), colorspace(v.2.1-0), DBI(v.1.2.2), DESeq2(v.1.42.0), tidyselect(v.1.2.0), bit(v.4.0.5), compiler(v.4.4.1), graph(v.1.80.0), desc(v.1.4.3), DelayedArray(v.0.28.0), plotly(v.4.10.4), shadowtext(v.0.1.3), scales(v.1.3.0), caTools(v.1.18.2), DEoptimR(v.1.1-3), remaCor(v.0.0.18), RBGL(v.1.78.0), stringr(v.1.5.1), digest(v.0.6.34), minqa(v.1.2.6), variancePartition(v.1.32.5), rmarkdown(v.2.25), aod(v.1.3.3), XVector(v.0.42.0), RhpcBLASctl(v.0.23-42), htmltools(v.0.5.7), pkgconfig(v.2.0.3), lme4(v.1.1-35.1), lpsymphony(v.1.30.0), highr(v.0.10), fastmap(v.1.1.1), rlang(v.1.1.3), htmlwidgets(v.1.6.4), shiny(v.1.8.0), farver(v.2.1.1), jquerylib(v.0.1.4), IHW(v.1.30.0), jsonlite(v.1.8.8), BiocParallel(v.1.36.0), GOSemSim(v.2.28.1), R.oo(v.1.26.0), RCurl(v.1.98-1.14), magrittr(v.2.0.3), GenomeInfoDbData(v.1.2.11), ggplotify(v.0.1.2), patchwork(v.1.2.0), munsell(v.0.5.0), Rcpp(v.1.0.12), ape(v.5.8), viridis(v.0.6.5), stringi(v.1.8.3), ggraph(v.2.1.0), brio(v.1.1.4), zlibbioc(v.1.48.0), MASS(v.7.3-60.0.1), plyr(v.1.8.9), parallel(v.4.4.1), ggrepel(v.0.9.5), Biostrings(v.2.70.2), graphlayouts(v.1.1.0), splines(v.4.4.1), pander(v.0.6.5), locfit(v.1.5-9.8), igraph(v.2.0.2), reshape2(v.1.4.4), pkgload(v.1.3.4), gprofiler2(v.0.2.3), XML(v.3.99-0.16.1), evaluate(v.0.23), BiocManager(v.1.30.25), nloptr(v.2.0.3), foreach(v.1.5.2), tweenr(v.2.0.2), httpuv(v.1.6.14), tidyr(v.1.3.1), purrr(v.1.0.2), polyclip(v.1.10-6), ggplot2(v.3.5.0), ggforce(v.0.4.2), broom(v.1.0.5), xtable(v.1.8-4), tidytree(v.0.4.6), fANCOVA(v.0.6-1), later(v.1.3.2), viridisLite(v.0.4.2), tibble(v.3.2.1), lmerTest(v.3.1-3), clusterProfiler(v.4.10.1), aplot(v.0.2.2), memoise(v.2.0.1), AnnotationDbi(v.1.64.1), sva(v.3.50.0) and GSEABase(v.1.64.0)
message("This is hpgltools commit: ", get_git_commit())## If you wish to reproduce this exact build of hpgltools, invoke the following:## > git clone http://github.com/abelew/hpgltools.git## > git reset 988802fb3818c20486954362879cb50b7f5f0bd7## This is hpgltools commit: Tue Dec 31 13:59:41 2024 -0500: 988802fb3818c20486954362879cb50b7f5f0bd7message("Saving to ", savefile)## Saving to 03differential_expression_both.rda.xz# tmp <- sm(saveme(filename = savefile))tmp <- loadme(filename = savefile)LS0tCnRpdGxlOiAiVE1SQzMgYHIgU3lzLmdldGVudignVkVSU0lPTicpYDogRGlmZmVyZW50aWFsIEV4cHJlc3Npb24gYW5hbHlzZXMiCmF1dGhvcjogImF0YiBhYmVsZXdAZ21haWwuY29tIgpkYXRlOiAiYHIgU3lzLkRhdGUoKWAiCnJ1bnRpbWU6IHNoaW55Cm91dHB1dDoKICBodG1sX2RvY3VtZW50OgogICAgY29kZV9kb3dubG9hZDogdHJ1ZQogICAgY29kZV9mb2xkaW5nOiBzaG93CiAgICBmaWdfY2FwdGlvbjogdHJ1ZQogICAgZmlnX2hlaWdodDogNwogICAgZmlnX3dpZHRoOiA3CiAgICBoaWdobGlnaHQ6IHplbmJ1cm4KICAgIGtlZXBfbWQ6IGZhbHNlCiAgICBtb2RlOiBzZWxmY29udGFpbmVkCiAgICBudW1iZXJfc2VjdGlvbnM6IHRydWUKICAgIHNlbGZfY29udGFpbmVkOiB0cnVlCiAgICB0aGVtZTogcmVhZGFibGUKICAgIHRvYzogdHJ1ZQogICAgdG9jX2Zsb2F0OgogICAgICBjb2xsYXBzZWQ6IGZhbHNlCiAgICAgIHNtb290aF9zY3JvbGw6IGZhbHNlCi0tLQoKPHN0eWxlIHR5cGU9InRleHQvY3NzIj4KYm9keSAubWFpbi1jb250YWluZXIgewogIG1heC13aWR0aDogMTYwMHB4Owp9CmJvZHksIHRkIHsKICBmb250LXNpemU6IDE2cHg7Cn0KY29kZS5yewogIGZvbnQtc2l6ZTogMTZweDsKfQpwcmUgewogIGZvbnQtc2l6ZTogMTZweAp9Cjwvc3R5bGU+CgpgYGB7ciBvcHRpb25zLCBpbmNsdWRlPUZBTFNFfQpsaWJyYXJ5KGhwZ2x0b29scykKbGlicmFyeShkcGx5cikKbGlicmFyeShmb3JjYXRzKQpsaWJyYXJ5KGdsdWUpCmxpYnJhcnkoRE9TRSkKCmtuaXRyOjpvcHRzX2tuaXQkc2V0KHByb2dyZXNzID0gVFJVRSwgdmVyYm9zZSA9IFRSVUUsIHdpZHRoID0gOTAsIGVjaG8gPSBUUlVFKQprbml0cjo6b3B0c19jaHVuayRzZXQoCiAgZXJyb3IgPSBUUlVFLCBmaWcud2lkdGggPSA4LCBmaWcuaGVpZ2h0ID0gOCwgZmlnLnJldGluYSA9IDIsCiAgb3V0LndpZHRoID0gIjEwMCUiLCBkZXYgPSAicG5nIiwKICBkZXYuYXJncyA9IGxpc3QocG5nID0gbGlzdCh0eXBlID0gImNhaXJvLXBuZyIpKSkKb2xkX29wdGlvbnMgPC0gb3B0aW9ucyhkaWdpdHMgPSA0LCBzdHJpbmdzQXNGYWN0b3JzID0gRkFMU0UsIGtuaXRyLmR1cGxpY2F0ZS5sYWJlbCA9ICJhbGxvdyIpCmdncGxvdDI6OnRoZW1lX3NldChnZ3Bsb3QyOjp0aGVtZV9idyhiYXNlX3NpemUgPSAxMikpCnZlciA8LSBTeXMuZ2V0ZW52KCJWRVJTSU9OIikKcGFyYWxsZWwgPC0gdG91cHBlcihTeXMuZ2V0ZW52KCJQQVJBTExFTCIpKQppZiAocGFyYWxsZWwgPT0gIiIgfHwgcGFyYWxsZWwgPT0gIlRSVUUiKSB7CiAgcGFyYWxsZWwgPC0gVFJVRQp9IGVsc2UgewogIHBhcmFsbGVsIDwtIEZBTFNFCn0KcnVuZGF0ZSA8LSBmb3JtYXQoU3lzLkRhdGUoKSwgZm9ybWF0ID0gIiVZJW0lZCIpCgpybWRfZmlsZSA8LSBnbHVlKCIwM2RpZmZlcmVudGlhbF9leHByZXNzaW9uX2JvdGguUm1kIikKc2F2ZWZpbGUgPC0gZ3N1YihwYXR0ZXJuID0gIlxcLlJtZCIsIHJlcGxhY2UgPSAiXFwucmRhXFwueHoiLCB4ID0gcm1kX2ZpbGUpCmxvYWRlZCA8LSBsb2FkKGZpbGUgPSBnbHVlKCJyZGEvdG1yYzNfZGF0YV9zdHJ1Y3R1cmVzLXZ7dmVyfS5yZGEiKSkKeGxzeF9wcmVmaXggPC0gImFuYWx5c2VzLzNfY2FsaV9hbmRfdHVtYWNvIgpjbGluaWNfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vREVfQ2xpbmljIikKY2xpbmljX2NmX3ByZWZpeCA8LSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX0NsaW5pY19DdXJlX0ZhaWwiKQpjZl9wcmVmaXggPC0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9DdXJlX0ZhaWwiKQp2aXNpdF9wcmVmaXggPC0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMiKQpzZXhfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vU2V4IikKZXRoX3ByZWZpeCA8LSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0V0aG5pY2l0eSIpCmdzZWFfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vR1NFQSIpCmBgYAoKIyBDaGFuZ2Vsb2cKCiogMjAyMzA5OiBEaXNhYmxlZCBHU1ZBIGFuYWx5c2VzIHVudGlsL3VubGVzcyB3ZSBnZXQgcGVybWlzc2lvbiB0bwogIGluY2x1ZGUgdGhlIG1TaWdEQiA3LjUuMSByZWxlYXNlLiAgSSB3aWxsIHNpbXBsaWZ5IHRoZSBmaWxlbmFtZXMgc28KICB0aGF0IG9uZSBtYXkgZWFzaWx5IGRyb3AgaW4gYSBkb3dubG9hZGVkIGNvcHkgb2YgdGhlIGRhdGEgYW5kIHJ1bgogIHRob3NlIGJsb2Nrcy4gIFVudGlsIHRoZW4sIEkgZ3Vlc3MgeW91IHdpbGwgaGF2ZSB0byB0cnVzdCBtZSB3aGVuIEkKICBzYXkgdGhvc2UgYmxvY2tzIGFsbCB3b3JrPwoqIDIwMjMwOTogTW92ZWQgYWxsIEdTRUEgYW5hbHlzZXMgdG8gMDRscnRfZ3NlYV9nc3ZhLlJtZAoqIDIwMjMwOSBuZXh0IGRheTogTW92aW5nIEdTRUEgYmFjayBiZWNhdXNlIGl0IGFkZHMgdG9vIG11Y2gKICBjb21wbGV4aXR5IHRvIHNhdmUvcmVsb2FkIHRoZSBERSByZXN1bHRzIGZvciBnUHJvZmlsZXIgYW5kIGZyaWVuZHMuCiogU3RpbGwgaHVudGluZyBmb3IgbWVzc2VkIHVwIGNvbG9ycywgY2hhbmdlZCBpbnB1dCBkYXRhIHRvIG1hdGNoIG5ldyB2ZXJzaW9uLgoKIyBJbnRyb2R1Y3Rpb24KClRoZSB2YXJpb3VzIGRpZmZlcmVudGlhbCBleHByZXNzaW9uIGFuYWx5c2VzIG9mIHRoZSBkYXRhIGdlbmVyYXRlZCBpbiB0bXJjM19kYXRhc2V0cwp3aWxsIG9jY3VyIGluIHRoaXMgZG9jdW1lbnQuCgojIyBOYW1pbmcgY29udmVudGlvbnMKCkkgYW0gZ29pbmcgdG8gdHJ5IHRvIHN0YW5kYXJkaXplIGhvdyBJIG5hbWUgdGhlIHZhcmlvdXMgZGF0YQpzdHJ1Y3R1cmVzIGNyZWF0ZWQgaW4gdGhpcyBkb2N1bWVudC4gIE1vc3Qgb2YgdGhlIGxhcmdlIGRhdGEgY3JlYXRlZAphcmUgZWl0aGVyIHNldHMgb2YgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzZXMsIHRoZWlyIGNvbWJpbmVkCnJlc3VsdHMsIG9yIHRoZSBzZXQgb2YgcmVzdWx0cyBkZWVtZWQgJ3NpZ25pZmljYW50Jy4KCkhvcGVmdWxseSBieSBub3cgdGhleSBhbGwgZm9sbG93IHRoZXNlIGd1aWRlbGluZXM6Cgp7Y2xpbmljKHMpfV9zYW1wbGUtc3Vic2V0fV97cHJpbWFyeS1xdWVzdGlvbihzKX1fe2RhdGF0eXBlfV97YmF0Y2gtbWV0aG9kfQoKKiB7Y2xpbmljfTogVGhpcyBpcyBlaXRoZXIgdGMgb3IgdCBmb3IgVHVtYWNvIGFuZCBDYWxpLCBvciBqdXN0ClR1bWFjby4KKiB7c2FtcGxlLXN1YnNldH06IFRoaW5ncyBsaWtlICdhbGwnIG9yICdtb25vY3l0ZXMnLgoqIHtwcmltYXJ5LXF1ZXN0aW9ufTogU2hvcnRoYW5kIG5hbWUgZm9yIHRoZSBwcmltYXJ5IGNvbnRyYXN0cwpwZXJmb3JtZWQsIHRodXMgJ2NsaW5pY3MnIHdvdWxkIHN1Z2dlc3QgYSBjb21wYXJpc29uIG9mIFR1bWFjbwp2cy4gQ2FsaS4gICd2aXNpdHMnIHdvdWxkIGNvbXBhcmUgdjIvdjEsIGV0Yy4KKiB7ZGF0YXR5cGV9OiBkZSwgdGFibGUsIHNpZwoqIHtiYXRjaC10eXBlfTogbm9iYXRjaCwgYmF0Y2h7ZmFjdG9yfSwgc3ZhLiAge2ZhY3Rvcn0gaW4gdGhpcwppbnN0YW5jZSBzaG91bGQgYmUgYSBjb2x1bW4gZnJvbSB0aGUgbWV0YWRhdGEuCgpXaXRoIHRoaXMgaW4gbWluZCwgJ3RjX2Jpb3BzaWVzX2NsaW5pY19kZV9zdmEnIHNob3VsZCBiZSB0aGUgVHVtYWNvK0NhbGkKYmlvcHN5IGRhdGEgYWZ0ZXIgcGVyZm9ybWluZyB0aGUgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzZXMKY29tcGFyaW5nIHRoZSBjbGluaWNzIHVzaW5nIHN2YS4KCkkgc3VzcGVjdCB0aGVyZSByZW1haW4gc29tZSBleGNlcHRpb25zIGFuZC9vciBlcnJvcnMuCgojIyBEZWZpbmUgY29udHJhc3RzIGZvciBERSBhbmFseXNlcwoKRWFjaCBvZiB0aGUgZm9sbG93aW5nIGxpc3RzIGRlc2NyaWJlcyB0aGUgc2V0IG9mIGNvbnRyYXN0cyB0aGF0IEkKdGhpbmsgYXJlIGludGVyZXN0aW5nIGZvciB0aGUgdmFyaW91cyB3YXlzIG9uZSBtaWdodCBjb25zaWRlciB0aGUKVE1SQzMgZGF0YXNldC4gIFRoZSB2YXJpYWJsZXMgYXJlIG5hbWVkIGFjY29yZGluZyB0byB0aGUgYXNzdW1lZCBkYXRhCndpdGggd2hpY2ggdGhleSB3aWxsIGJlIHVzZWQsIHRodXMgdGNfY2ZfY29udHJhc3RzIGlzIGV4cGVjdGVkIHRvIGJlCnVzZWQgZm9yIHRoZSBUdW1hY28rQ2FsaSBkYXRhIGFuZCBwcm92aWRlIGEgc2VyaWVzIG9mIGN1cmUvZmFpbApjb21wYXJpc29ucyB3aGljaCAodG8gdGhlIGV4dGVudCBwb3NzaWJsZSkgYWNyb3NzIGJvdGggbG9jYXRpb25zLiAgSW4KZXZlcnkgY2FzZSwgdGhlIG5hbWUgb2YgdGhlIGxpc3QgZWxlbWVudCB3aWxsIGJlIHVzZWQgYXMgdGhlIGNvbnRyYXN0Cm5hbWUsIGFuZCB3aWxsIHRodXMgYmUgc2VlbiBhcyB0aGUgc2hlZXQgbmFtZSBpbiB0aGUgb3V0cHV0IHhsc3gKZmlsZShzKTsgdGhlIHR3byBwaWVjZXMgb2YgdGhlIGNoYXJhY3RlciB2ZWN0b3IgdmFsdWUgYXJlIHRoZQpudW1lcmF0b3IgYW5kIGRlbm9taW5hdG9yIG9mIHRoZSBhc3NvY2lhdGVkIGNvbnRyYXN0LgoKIyMgR1NFQQoKVGhlIEdTRUEgYW5hbHlzZXMgd2lsbCBmb2xsb3cgZWFjaCBERSBhbmFseXNpcyBkdXJpbmcgdGhpcyBkb2N1bWVudC4KCk1vc3QgKGFsbD8pIG9mIHRoZSBHU0VBIGFuYWx5c2VzIHVzZWQgaW4gdGhpcyBwYXBlciB3ZXJlIGRvbmUgdmlhCmdQcm9maWxlciByYXRoZXIgdGhhbiBnb3NlcS9jbHVzdGVyUHJvZmlsZXIvdG9wR08vR09zdGF0cy4gIFByaW1hcmlseQpiZWNhdXNlIGl0IGlzIHNvIGVhc3kgdG8gaW52b2tlIGdwcm9maWxlci4KCmBgYHtyfQpjbGluaWNfY29udHJhc3RzIDwtIGxpc3QoCiAgImNsaW5pY3MiID0gYygiY2FsaSIsICJ0dW1hY28iKSkKIyMgSW4gc29tZSBjYXNlcyB3ZSBoYXZlIG5vIENhbGkgZmFpbHVyZSBzYW1wbGVzLCBzbyB0aGVyZSByZW1haW4gb25seSAyCiMjIGNvbnRyYXN0cyB0aGF0IGFyZSBsaWtlbHkgb2YgaW50ZXJlc3QKdGNfY2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgInR1bWFjbyIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJ0dW1hY29fY3VyZSIpLAogICJjdXJlIiA9IGMoInR1bWFjb19jdXJlIiwgImNhbGlfY3VyZSIpKQojIyBJbiBvdGhlciBjYXNlcywgd2UgaGF2ZSBjdXJlL2ZhaWwgZm9yIGJvdGggcGxhY2VzLgpjbGluaWNfY2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgImNhbGkiID0gYygiY2FsaV9mYWlsdXJlIiwgImNhbGlfY3VyZSIpLAogICJ0dW1hY28iID0gYygidHVtYWNvX2ZhaWx1cmUiLCAidHVtYWNvX2N1cmUiKSwKICAiY3VyZSIgPSBjKCJ0dW1hY29fY3VyZSIsICJjYWxpX2N1cmUiKSwKICAiZmFpbCIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJjYWxpX2ZhaWx1cmUiKSkKY2ZfY29udHJhc3QgPC0gbGlzdCgKICAib3V0Y29tZSIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJ0dW1hY29fY3VyZSIpKQp0X2NmX2NvbnRyYXN0IDwtIGxpc3QoCiAgIm91dGNvbWUiID0gYygiZmFpbHVyZSIsICJjdXJlIikpCnZpc2l0Y2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgInYxY2YiID0gYygidjFfZmFpbHVyZSIsICJ2MV9jdXJlIiksCiAgInYyY2YiID0gYygidjJfZmFpbHVyZSIsICJ2Ml9jdXJlIiksCiAgInYzY2YiID0gYygidjNfZmFpbHVyZSIsICJ2M19jdXJlIikpCnZpc2l0X2NvbnRyYXN0cyA8LSBsaXN0KAogICJ2MnYxIiA9IGMoImMyIiwgImMxIiksCiAgInYzdjEiID0gYygiYzMiLCAiYzEiKSwKICAidjN2MiIgPSBjKCJjMyIsICJjMiIpKQp2aXNpdF92MWxhdGVyIDwtIGxpc3QoCiAgImxhdGVyX3ZzX2ZpcnN0IiA9IGMoImxhdGVyIiwgImZpcnN0IikpCmNlbGx0eXBlcyA8LSBsaXN0KAogICJlb19tb25vIiA9IGMoImVvc2lub3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJuZV9tb25vIiA9IGMoIm5ldXRyb3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJlb19uZSIgPSBjKCJlb3Npbm9waGlscyIsICJuZXV0cm9waGlscyIpKQpldGhuaWNpdHlfY29udHJhc3RzIDwtIGxpc3QoCiAgIm1lc3Rpem9faW5kaWdlbm91cyIgPSBjKCJtZXN0aXphIiwgImluZGlnZW5hIiksCiAgIm1lc3Rpem9fYWZyb2NvbCIgPSBjKCJtZXN0aXphIiwgImFmcm9jb2wiKSwKICAiaW5kaWdlbm91c19hZnJvY29sIiA9IGMoImluZGlnZW5hIiwgImFmcm9jb2wiKSkKYGBgCgojIENvbXBhcmUgc2FtcGxlcyBieSBjbGluaWMKCiMjIERFOiBDb21wYXJlIGNsaW5pY3MsIGFsbCBzYW1wbGVzCgpQZXJmb3JtIGEgc3Zhc2VxLWd1aWRlZCBjb21wYXJpc29uIG9mIHRoZSB0d28gY2xpbmljcy4gIElkZWFsbHkgdGhpcwp3aWxsIGdpdmUgc29tZSBjbHVlIGFib3V0IGp1c3QgaG93IHN0cm9uZyB0aGUgY2xpbmljLWJhc2VkIGJhdGNoCmVmZmVjdCByZWFsbHkgaXMgYW5kIHdoYXQgaXRzIGNhdXNlcyBhcmUuCgpgYGB7cn0KdGNfY2xpbmljX3R5cGUgPC0gdGNfdmFsaWQgJT4lCiAgc2V0X2V4cHRfY29uZGl0aW9ucyhmYWN0ID0gImNsaW5pYyIpICU+JQogIHNldF9leHB0X2JhdGNoZXMoZmFjdCA9ICJ0eXBlb2ZjZWxscyIpCgp0YWJsZShwRGF0YSh0Y19jbGluaWNfdHlwZSlbWyJjb25kaXRpb24iXV0pCnRjX2FsbF9jbGluaWNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19jbGluaWNfdHlwZSwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19hbGxfY2xpbmljX2RlX3N2YQp0Y19hbGxfY2xpbmljX2RlX3N2YVtbImRlc2VxIl1dW1siY29udHJhc3RzX3BlcmZvcm1lZCJdXQoKdGNfYWxsX2NsaW5pY190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYWxsX2NsaW5pY19kZV9zdmEsIGtlZXBlcnMgPSBjbGluaWNfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19wcmVmaXh9L3RjX2FsbF9jbGluaWNfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2FsbF9jbGluaWNfdGFibGVfc3ZhCnRjX2FsbF9jbGluaWNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2FsbF9jbGluaWNfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19wcmVmaXh9L2NvbXBhcmVfY2xpbmljcy90Y19jbGluaWNfdHlwZV9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2FsbF9jbGluaWNfc2lnX3N2YQpgYGAKCiMjIyBHU0VBOiBjb21wYXJpbmcgdGhlIGNsaW5pY3MKCmBgYHtyfQppbmNyZWFzZWRfdHVtYWNvX2NhdGVnb3JpZXNfdXAgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19hbGxfY2xpbmljX3NpZ19zdmFbWyJkZXNlcSJdXVtbInVwcyJdXVtbImNsaW5pY3MiXV0sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L3R1bWFjb19jYXRlb2dpZXNfdXAtdnt2ZXJ9Lnhsc3giKSkKaW5jcmVhc2VkX3R1bWFjb19jYXRlZ29yaWVzX3VwCmluY3JlYXNlZF90dW1hY29fY2F0ZWdvcmllc191cFtbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCgppbmNyZWFzZWRfY2FsaV9jYXRlZ29yaWVzIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfYWxsX2NsaW5pY19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImNsaW5pY3MiXV0sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2NhbGlfY2F0ZW9naWVzX3VwLXZ7dmVyfS54bHN4IikpCmluY3JlYXNlZF9jYWxpX2NhdGVnb3JpZXMKaW5jcmVhc2VkX2NhbGlfY2F0ZWdvcmllc1tbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCmBgYAoKIyMjIFZpc3VhbGl6ZSBjbGluaWMgZGlmZmVyZW5jZXMKCkxldCB1cyB0YWtlIGEgcXVpY2sgbG9vayBhdCB0aGUgcmVzdWx0cyBvZiB0aGUgY29tcGFyaXNvbiBvZgpUdW1hY28vQ2FsaQoKTm90ZTogSSBrZWVwIHJlLWludHJvZHVjaW5nIGFuIGVycm9yIHdoaWNoIGNhdXNlcyB0aGVzZSAodm9sY2FubyBhbmQgTUEpIHBsb3RzIHRvIGJlCnJldmVyc2VkIHdpdGggcmVzcGVjdCB0byB0aGUgbG9nRkMgdmFsdWVzLiAgUGF5IGNhcmVmdWwgYXR0ZW50aW9uIHRvCnRoZXNlIGFuZCBtYWtlIHN1cmUgdGhhdCB0aGV5IGFncmVlIHdpdGggdGhlIG51bWJlcnMgb2YgZ2VuZXMgb2JzZXJ2ZWQKaW4gdGhlIGNvbnRyYXN0LgoKYGBge3J9CiMjIENoZWNrIHRoYXQgdXAgaXMgdXAKc3VtbWFyeSh0Y19hbGxfY2xpbmljX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJjbGluaWNzIl1dW1siZGVzZXFfbG9nZmMiXV0pCiMjIEkgdGhpbmsgd2UgY2FuIGFzc3VtZSB0aGF0IG1vc3QgZ2VuZXMgYXJlIGRvd24gd2hlbiBjb25zaWRlcmluZyBUdW1hY28vQ2FsaS4Kc3VtKHRjX2FsbF9jbGluaWNfdGFibGVfc3ZhJGRhdGEkY2xpbmljcyRkZXNlcV9sb2dmYyA8IC0xLjAgJgogICAgICB0Y19hbGxfY2xpbmljX3RhYmxlX3N2YSRkYXRhJGNsaW5pY3MkZGVzZXFfYWRqcCA8IDAuMDUpCnRjX2FsbF9jbGluaWNfdGFibGVfc3ZhW1sicGxvdHMiXV1bWyJjbGluaWNzIl1dW1siZGVzZXFfdm9sX3Bsb3RzIl1dCiMjIE9rLCBzbyBpdCBzYXlzIDE3OTQgdXAsIGJ1dCB0aGF0IGlzIGNsZWFybHkgdGhlIGRvd24gc2lkZS4uLiAgU29tZXRoaW5nIGlzIGRlZmluaXRlbHkgbWVzc2VkIHVwLgojIyBUaGUgcG9pbnRzIGFyZSBvbiB0aGUgY29ycmVjdCBzaWRlcyBvZiB0aGUgcGxvdCwgYnV0IHRoZSBjYXRlZ29yaWVzIG9mIHVwL2Rvd24gYXJlIHJldmVyc2VkLgojIyBUaGVyZXNhIG5vdGVkIHRoYXQgc2hlIGNvbG9ycyBkaWZmZXJlbnRseSwgYW5kIEkgdGhpbmsgYmV0dGVyOiBsZWZ0IHNpZGUgZ2V0cyBjYWxsZWQKIyMgJ2luY3JlYXNlZCBpbiBkZW5vbWluYXRvcicsIHJpZ2h0IHNpZGUgZ2V0cyBjYWxsZWQgJ2luY3JlYXNlZCBpbiBudW1lcmF0b3InOwojIyB0aGVzZSB0d28gZ3JvdXBzIGFyZSBjb2xvcmVkIGFjY29yZGluZyB0byB0aGVpciBjb25kaXRpb24gY29sb3JzLCBhbmQgZXZlcnl0aGluZyBlbHNlIGlzIGdyYXkuCiMjIEkgYW0gY2hlY2tpbmcgb3V0IFRoZXJlc2EncyBoZWxwZXJfZnVuY3Rpb25zLlIgdG8gZ2V0IGEgc2Vuc2Ugb2YgaG93IHNoZSBoYW5kbGVzIHRoaXMsIEkgdGhpbmsKIyMgSSBjYW4gdXNlIGEgdmFyaWFudCBvZiBoZXIgaWRlYSBwcmV0dHkgZWFzaWx5OgojIyAgMS4gIEFkZCBhIGNvbHVtbiAnU2lnbmlmaWNhbmNlJywgd2hpY2ggaXMgYSBmYWN0b3IsIGFuZCBjb250YWlucyBlaXRoZXIgJ05vdCBlbnJpY2hlZCcsCiMjICAgICAgJ0VucmljaGVkIGluIHgnLCBvciAnRW5yaWNoZWQgaW4geScgYWNjb3JkaW5nIHRvIHRoZSBsb2dmYy9hZGpwLgojIyAgMi4gIHVzZSB0aGUgc2lnbmlmaWNhbmNlIGNvbHVtbiBmb3IgdGhlIGdlb21fcG9pbnQgY29sb3IvZmlsbCBpbiB0aGUgdm9sY2FubyBwbG90LgojIyBNeSBjaGFuZ2UgdG8gdGhpcyBpZGVhIHdvdWxkIGJlIHRvIGV4dHJhY3QgdGhlIGNvbG9ycyBmcm9tIHRoZSBpbnB1dCBleHByZXNzaW9uc2V0LgpgYGAKClRoZXJlIGFwcGVhciB0byBiZSBtYW55IG1vcmUgZ2VuZXMgd2hpY2ggYXJlIGluY3JlYXNlZCBpbiB0aGUgVHVtYWNvCnNhbXBsZXMgd2l0aCByZXNwZWN0IHRvIHRoZSBDYWxpIHNhbXBsZXMuCgojIyBERTogQ29tcGFyZSBjbGluaWNzLCBlb3Npbm9waGlsIHNhbXBsZXMKClRoZSByZW1haW5pbmcgY2VsbCB0eXBlcyBhbGwgaGF2ZSBwcmV0dHkgc3Ryb25nIGNsaW5pYy1iYXNlZCB2YXJpYW5jZTsKYnV0IEkgYW0gbm90IGNlcnRhaW4gaWYgaXQgaXMgY29uc2lzdGVudCBhY3Jvc3MgY2VsbCB0eXBlcy4KCmBgYHtyfQp0YWJsZShwRGF0YSh0Y19lb3Npbm9waGlscylbWyJjb25kaXRpb24iXV0pCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9ub2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19lb3Npbm9waGlscywgcGFyYWxsZWwgPSBwYXJhbGxlbCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gRkFMU0UsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfZW9zaW5vcGhpbHNfY2xpbmljX2RlX25vYmF0Y2gKdGNfZW9zaW5vcGhpbHNfY2xpbmljX2RlX25vYmF0Y2hbWyJkZXNlcSJdXVtbImNvbnRyYXN0c19wZXJmb3JtZWQiXV0KCnRjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9ub2JhdGNoLCBrZWVwZXJzID0gdGNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfbm9iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfbm9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX25vYmF0Y2gKCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX2Vvc2lub3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcykKdGNfZW9zaW5vcGhpbHNfY2xpbmljX2RlX3N2YQp0Y19lb3Npbm9waGlsc19jbGluaWNfZGVfc3ZhW1siZGVzZXEiXV1bWyJjb250cmFzdHNfcGVyZm9ybWVkIl1dCgp0Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9zdmEsIGtlZXBlcnMgPSB0Y19jZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdGNfZW9zaW5vcGhpbHNfY2xpbmljX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfc3ZhCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfZW9zaW5vcGhpbHNfY2xpbmljX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Fb3Npbm9waGlscy90Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YQpgYGAKCiMjIERFOiBDb21wYXJlIGNsaW5pY3MsIGJpb3BzeSBzYW1wbGVzCgpJbnRlcmVzdGluZ2x5IHRvIG1lLCB0aGUgYmlvcHN5IHNhbXBsZXMgYXBwZWFyIHRvIGhhdmUgdGhlIGxlYXN0CmxvY2F0aW9uLWJhc2VkIHZhcmlhbmNlLiAgQnV0IHdlIGNhbiBwZXJmb3JtIGFuIGV4cGxpY2l0IERFIGFuZCBzZWUKaG93IHdlbGwgdGhhdCBoeXBvdGhlc2lzIGhvbGRzIHVwLgoKTm90ZSB0aGF0IHRoZXNlIGRhdGEgaW5jbHVkZSBjdXJlIGFuZCBmYWlsIHNhbXBsZXMgZm9yCgpgYGB7cn0KdGFibGUocERhdGEodGNfYmlvcHNpZXMpW1siY29uZGl0aW9uIl1dKQp0Y19iaW9wc2llc19jbGluaWNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19iaW9wc2llcywgcGFyYWxsZWwgPSBwYXJhbGxlbCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2Jpb3BzaWVzX2NsaW5pY19kZV9zdmEKdGNfYmlvcHNpZXNfY2xpbmljX2RlX3N2YVtbImRlc2VxIl1dW1siY29udHJhc3RzX3BlcmZvcm1lZCJdXQoKdGNfYmlvcHNpZXNfY2xpbmljX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19iaW9wc2llc19jbGluaWNfZGVfc3ZhLCBrZWVwZXJzID0gdGNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Jpb3BzaWVzL3RjX2Jpb3BzaWVzX2NsaW5pY190YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfYmlvcHNpZXNfY2xpbmljX3RhYmxlX3N2YQp0Y19iaW9wc2llc19jbGluaWNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Jpb3BzaWVzX2NsaW5pY190YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vQmlvcHNpZXMvdGNfYmlvcHNpZXNfY2xpbmljX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfYmlvcHNpZXNfY2xpbmljX3NpZ19zdmEKYGBgCgojIyBERTogQ29tcGFyZSBjbGluaWNzLCBtb25vY3l0ZSBzYW1wbGVzCgpBdCBsZWFzdCBmb3IgdGhlIG1vbWVudCwgSSBhbSBvbmx5IGxvb2tpbmcgYXQgdGhlIGRpZmZlcmVuY2VzIGJldHdlZW4Kbm8tYmF0Y2ggdnMuIHN2YSBhY3Jvc3MgY2xpbmljcyBmb3IgdGhlIG1vbm9jeXRlIHNhbXBsZXMuICBUaGlzCndhcyBjaG9zZW4gbW9zdGx5IGFyYml0cmFyaWx5LgoKIyMjIERFOiBDb21wYXJlIGNsaW5pY3MsIG1vbm9jeXRlcyB3aXRob3V0IGJhdGNoIGVzdGltYXRpb24KCk91ciBiYXNlbGluZSBpcyB0aGUgY29tcGFyaXNvbiBvZiB0aGUgbW9ub2N5dGVzIHNhbXBsZXMgd2l0aG91dCBiYXRjaAppbiB0aGUgbW9kZWwgb3Igc3Vycm9nYXRlIGVzdGltYXRpb24uICBJbiB0aGVvcnkgYXQgbGVhc3QsIHRoaXMgc2hvdWxkCmNvcnJlc3BvbmQgdG8gdGhlIFBDQSBwbG90IGFib3ZlIHdoZW4gbm8gYmF0Y2ggZXN0aW1hdGlvbiB3YXMgcGVyZm9ybWVkLgoKYGBge3J9CnRhYmxlKHBEYXRhKHRjX21vbm9jeXRlcylbWyJjb25kaXRpb24iXV0pCnRjX21vbm9jeXRlc19kZV9ub2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19tb25vY3l0ZXMsIG1vZGVsX2JhdGNoID0gRkFMU0UsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX21vbm9jeXRlc19kZV9ub2JhdGNoCgp0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19tb25vY3l0ZXNfZGVfbm9iYXRjaCwga2VlcGVycyA9IGNsaW5pY19jZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTW9ub2N5dGVzL3RjX21vbm9jeXRlc19jbGluaWNfdGFibGVfbm9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaAp0Y19tb25vY3l0ZXNfc2lnX25vYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Nb25vY3l0ZXMvdGNfbW9ub2N5dGVzX2NsaW5pY19zaWdfbm9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfc2lnX25vYmF0Y2gKYGBgCgojIyMgREU6IENvbXBhcmUgY2xpbmljcywgbW9ub2N5dGVzIHdpdGggc3Zhc2VxCgpJbiBjb250cmFzdCwgdGhlIGZvbGxvd2luZyBjb21wYXJpc29uIHNob3VsZCBnaXZlIGEgdmlldyBvZiB0aGUgZGF0YQpjb3JyZXNwb25kaW5nIHRvIHRoZSBzdmFzZXEgUENBIHBsb3QgYWJvdmUuICBJbiB0aGUgYmVzdCBjYXNlCnNjZW5hcmlvLCB3ZSBzaG91bGQgdGhlcmVmb3JlIGJlIGFibGUgdG8gc2VlIHNvbWUgc2lnbmlmaWNhbmUKZGlmZmVyZW5jZXMgYmV0d2VlbiB0aGUgVHVtYWNvIGN1cmUgYW5kIGZhaWwgc2FtcGxlcy4KCmBgYHtyfQp0Y19tb25vY3l0ZXNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19tb25vY3l0ZXMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19tb25vY3l0ZXNfZGVfc3ZhCgp0Y19tb25vY3l0ZXNfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX21vbm9jeXRlc19kZV9zdmEsIGtlZXBlcnMgPSBjbGluaWNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L01vbm9jeXRlcy90Y19tb25vY3l0ZXNfY2xpbmljX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfdGFibGVfc3ZhCnRjX21vbm9jeXRlc19zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfbW9ub2N5dGVzX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Nb25vY3l0ZXMvdGNfbW9ub2N5dGVzX2NsaW5pY19zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX21vbm9jeXRlc19zaWdfc3ZhCmBgYAoKIyMjIERFIENvbXBhcmU6IEhvdyBzaW1pbGFyIGFyZSB0aGUgbm8tYmF0Y2ggdnMuIFNWQSByZXN1bHRzPwoKVGhlIGZvbGxvd2luZyBibG9jayBzaG93cyB0aGF0IHRoZXNlIHR3byByZXN1bHRzIGFyZSBleGNlZWRpbmdseQpkaWZmZXJlbnQsIHN1Z2VzdGluZyB0aGF0IHRoZSBDYWxpIGN1cmUvZmFpbCBhbmQgVHVtYWNvIGN1cmUvZmFpbApjYW5ub3QgZWFzaWx5IGJlIGNvbnNpZGVyZWQgaW4gdGhlIHNhbWUgYW5hbHlzaXMuICBJIGRpZCBzb21lIHBsYXlpbmcKYXJvdW5kIHdpdGggbXkgY2FsY3VsYXRlX2F1Y2MgZnVuY3Rpb24gaW4gdGhpcyBibG9jayBhbmQgZm91bmQgdGhhdCBpdAppcyBpbiBzb21lIGltcG9ydGFudCB3YXkgYnJva2VuLCBhdCBsZWFzdCBpZiBvbmUgZXhwYW5kcyB0aGUgdG9wLW4KZ2VuZXMgdG8gbW9yZSB0aGFuIDIwJSBvZiB0aGUgbnVtYmVyIG9mIGdlbmVzIGluIHRoZSBkYXRhLgoKYGBge3J9CmNhbGlfdGFibGUgPC0gdGNfbW9ub2N5dGVzX3RhYmxlX25vYmF0Y2hbWyJkYXRhIl1dW1siY2FsaSJdXQp0YWJsZSA8LSB0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaFtbImRhdGEiXV1bWyJ0dW1hY28iXV0KCmNhbGlfYXVjYyA8LSBjYWxjdWxhdGVfYXVjYyhjYWxpX3RhYmxlLCB0YWJsZSwgcHggPSAiZGVzZXFfYWRqcCIsIHB5ID0gImRlc2VxX2FkanAiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbHggPSAiZGVzZXFfbG9nZmMiLCBseSA9ICJkZXNlcV9sb2dmYyIpCmNhbGlfYXVjYwoKY2FsaV90YWJsZV9zdmEgPC0gdGNfbW9ub2N5dGVzX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJjYWxpIl1dCnR1bWFjb190YWJsZV9zdmEgPC0gdGNfbW9ub2N5dGVzX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJ0dW1hY28iXV0KY2FsaV9hdWNjX3N2YSA8LSBjYWxjdWxhdGVfYXVjYyhjYWxpX3RhYmxlX3N2YSwgdHVtYWNvX3RhYmxlX3N2YSwgcHggPSAiZGVzZXFfYWRqcCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcHkgPSAiZGVzZXFfYWRqcCIsIGx4ID0gImRlc2VxX2xvZ2ZjIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQpjYWxpX2F1Y2Nfc3ZhCmBgYAoKIyMgREU6IENvbXBhcmUgY2xpbmljcywgbmV1dHJvcGhpbCBzYW1wbGVzCgpgYGB7cn0KdGNfbmV1dHJvcGhpbHNfZGVfbm9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfbmV1dHJvcGhpbHMsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gRkFMU0UsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19uZXV0cm9waGlsc19kZV9ub2JhdGNoCgp0Y19uZXV0cm9waGlsc190YWJsZV9ub2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX25ldXRyb3BoaWxzX2RlX25vYmF0Y2gsIGtlZXBlcnMgPSBjbGluaWNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfdGFibGVfbm9iYXRjaAp0Y19uZXV0cm9waGlsc19zaWdfbm9iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2gsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdGNfbmV1dHJvcGhpbHNfc2lnX25vYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfc2lnX25vYmF0Y2gKCnRjX25ldXRyb3BoaWxzX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfbmV1dHJvcGhpbHMsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfbmV1dHJvcGhpbHNfZGVfc3ZhCgp0Y19uZXV0cm9waGlsc190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfbmV1dHJvcGhpbHNfZGVfc3ZhLCBrZWVwZXJzID0gY2xpbmljX2NmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9OZXV0cm9waGlscy90Y19uZXV0cm9waGlsc190YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfdGFibGVfc3ZhCnRjX25ldXRyb3BoaWxzX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19uZXV0cm9waGlsc190YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdGNfbmV1dHJvcGhpbHNfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19uZXV0cm9waGlsc19zaWdfc3ZhCmBgYAoKIyMgR1NFQTogRXh0cmFjdCBjbGluaWMtc3BlY2lmaWMgZ2VuZXMKCkdpdmVuIHRoZSBhYm92ZSBjb21wYXJpc29ucywgd2UgY2FuIGV4dHJhY3Qgc29tZSBnZW5lIHNldHMgd2hpY2gKcmVzdWx0ZWQgZnJvbSB0aG9zZSBERSBhbmFseXNlcyBhbmQgZXZlbnR1YWxseSBwZXJmb3JtIHNvbWUKb250b2xvZ3kvS0VHRy9yZWFjdG9tZS9ldGMgc2VhcmNoZXMuICBUaGlzIHJlbWluZHMgbWUsIEkgd2FudCB0byBtYWtlCm15IGV4dHJhY3Rfc2lnbmlmaWNhbnRfIGZ1bmN0aW9ucyB0byByZXR1cm4gZ2VuZS1zZXQgZGF0YSBzdHJ1Y3R1cmVzCmFuZCBteSB2YXJpb3VzIG9udG9sb2d5IHNlYXJjaGVzIHRvIHRha2UgdGhlbSBhcyBpbnB1dHMuICBUaGlzIHNob3VsZApoZWxwIGF2b2lkIHBvdGVudGlhbCBlcnJvcnMgd2hlbiBleHRyYWN0aW5nIHVwL2Rvd24gZ2VuZXMuCgpgYGB7cn0KY2xpbmljX3NpZ2VuZXNfdXAgPC0gcm93bmFtZXModGNfYWxsX2NsaW5pY19zaWdfc3ZhW1siZGVzZXEiXV1bWyJ1cHMiXV1bWyJjbGluaWNzIl1dKQpjbGluaWNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX2FsbF9jbGluaWNfc2lnX3N2YVtbImRlc2VxIl1dW1siZG93bnMiXV1bWyJjbGluaWNzIl1dKQpjbGluaWNfc2lnZW5lcyA8LSBjKGNsaW5pY19zaWdlbmVzX3VwLCBjbGluaWNfc2lnZW5lc19kb3duKQoKdGNfZW9zaW5vcGhpbHNfc2lnZW5lc191cCA8LSByb3duYW1lcyh0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YVtbImRlc2VxIl1dW1sidXBzIl1dW1siY3VyZSJdXSkKdGNfZW9zaW5vcGhpbHNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImN1cmUiXV0pCnRjX21vbm9jeXRlc19zaWdlbmVzX3VwIDwtIHJvd25hbWVzKHRjX21vbm9jeXRlc19zaWdfc3ZhW1siZGVzZXEiXV1bWyJ1cHMiXV1bWyJjdXJlIl1dKQp0Y19tb25vY3l0ZXNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX21vbm9jeXRlc19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImN1cmUiXV0pCnRjX25ldXRyb3BoaWxzX3NpZ2VuZXNfdXAgPC0gcm93bmFtZXModGNfbmV1dHJvcGhpbHNfc2lnX3N2YVtbImRlc2VxIl1dW1sidXBzIl1dW1siY3VyZSJdXSkKdGNfbmV1dHJvcGhpbHNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX25ldXRyb3BoaWxzX3NpZ19zdmFbWyJkZXNlcSJdXVtbImRvd25zIl1dW1siY3VyZSJdXSkKCnRjX2Vvc2lub3BoaWxzX3NpZ2VuZXMgPC0gYyh0Y19lb3Npbm9waGlsc19zaWdlbmVzX3VwLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgdGNfZW9zaW5vcGhpbHNfc2lnZW5lc19kb3duKQp0Y19tb25vY3l0ZXNfc2lnZW5lcyA8LSBjKHRjX21vbm9jeXRlc19zaWdlbmVzX3VwLAogICAgICAgICAgICAgICAgICAgICAgICAgIHRjX21vbm9jeXRlc19zaWdlbmVzX2Rvd24pCnRjX25ldXRyb3BoaWxzX3NpZ2VuZXMgPC0gYyh0Y19uZXV0cm9waGlsc19zaWdlbmVzX3VwLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgdGNfbmV1dHJvcGhpbHNfc2lnZW5lc19kb3duKQpgYGAKCiMjIEdTRUE6IGdQcm9maWxlciBvZiBnZW5lcyBkZWVtZWQgdXAvZG93biB3aGVuIGNvbXBhcmluZyBDYWxpIGFuZCBUdW1hY28KCkkgd2FzIGN1cmlvdXMgdG8gdHJ5IHRvIHVuZGVyc3RhbmQgd2h5IHRoZSB0d28gY2xpbmljcyBhcHBlYXIgdG8gYmUgc28KZGlmZmVyZW50IHZpcyBhIHZpcyB0aGVpciBQQ0EvREU7IHNvIEkgdGhvdWdodCB0aGF0IGdQcm9maWxlciBtaWdodApoZWxwIGJvaWwgdGhvc2UgcmVzdWx0cyBkb3duIHRvIHNvbWV0aGluZyBtb3JlIGRpZ2VzdGlibGUuCgojIyMgR1NFQTogQ29tcGFyZSBjbGluaWNzLCBhbGwgc2FtcGxlcwoKTm90ZSB0aGF0IGluIHRoZSBmb2xsb3dpbmcgYmxvY2sgSSB1c2VkIHRoZSBmdW5jdGlvbgpzaW1wbGVfZ3Byb2ZpbGVyKCksIGJ1dCBsYXRlciBpbiB0aGlzIGRvY3VtZW50IEkgd2lsbCB1c2UKYWxsX2dwcm9maWxlcigpLiAgVGhlIGZpcnN0IGludm9jYXRpb24gbGltaXRzIHRoZSBzZWFyY2ggdG8gYSBzaW5nbGUKdGFibGUsIHdoaWxlIHRoZSBzZWNvbmQgd2lsbCBpdGVyYXRlIG92ZXIgZXZlcnkgcmVzdWx0IGluIGEgcGFpcndpc2UKZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzaXMuCgpJbiB0aGlzIGluc3RhbmNlLCB3ZSBhcmUgbG9va2luZyBhdCB0aGUgdmVjdG9yIG9mIGdlbmUgSURzIGRlZW1lZApzaWduaWZpY2FudGx5IGRpZmZlcmVudCBiZXR3ZWVuIHRoZSB0d28gY2xpbmljcyBpbiBlaXRoZXIgdGhlIHVwIG9yCmRvd24gZGlyZWN0aW9uLgoKT25lIG90aGVyIHRoaW5nIHdvcnRoIG5vdGluZywgdGhlIG5ldyB2ZXJzaW9uIG9mIGdQcm9maWxlciBwcm92aWRlcwpzb21lIGZ1biBpbnRlcmFjdGl2ZSBwbG90cy4gIEkgd2lsbCBhZGQgYW4gZXhhbXBsZSBoZXJlLgoKYGBge3J9CnRjX2Vvc2lub3BoaWxfZ3Byb2ZpbGVyIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfZW9zaW5vcGhpbHNfc2lnZW5lc191cCwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vZW9zaW5vcGhpbF9jbGluaWNzX3R1bWFjb191cC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsX2dwcm9maWxlcgoKY2xpbmljX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgY2xpbmljX3NpZ2VuZXMsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2JvdGhfY2xpbmljc19jYWxpX3VwLXZ7dmVyfS54bHN4IikpCmNsaW5pY19ncCRwdmFsdWVfcGxvdHMkUkVBQwpjbGluaWNfZ3AkcHZhbHVlX3Bsb3RzJEJQCmNsaW5pY19ncCRwdmFsdWVfcGxvdHMkVEYKY2xpbmljX2dwJGludGVyYWN0aXZlX3Bsb3RzJEdPCmBgYAoKIyMjIEdTRUE6IENvbXBhcmUgY2xpbmljcywgRW9zaW5vcGhpbCBzYW1wbGVzCgpJbiB0aGUgZm9sbG93aW5nIGJsb2NrLCBJIGFtIGxvb2tpbmcgYXQgdGhlIGdQcm9maWxlciBvdmVyIHJlcHJlc2VudGVkCmdyb3VwcyBvYnNlcnZlZCBhY3Jvc3MgY2xpbmljcyBpbiBvbmx5IHRoZSBFb3Npbm9waGlscy4gIEZpcnN0IEkgZG8gc28KZm9yIGFsbCBnZW5lcyh1cCBvciBkb3duKSwgZm9sbG93ZWQgYnkgb25seSB0aGUgdXAgYW5kIGRvd24gZ3JvdXBzLgpFYWNoIG9mIHRoZSBmb2xsb3dpbmcgd2lsbCBpbmNsdWRlIG9ubHkgdGhlIFJlYWN0b21lIGFuZCBHTzpCUCBwbG90cy4KVGhlc2Ugc2VhcmNoZXMgZGlkIG5vdCBoYXZlIHRvbyBtYW55IG90aGVyIGhpdHMsIGV4Y2VwdGluZyB0aGUKdHJhbnNjcmlwdGlvbiBmYWN0b3IgZGF0YWJhc2UuCgpgYGB7cn0KdGNfZW9zaW5vcGhpbHNfZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19lb3Npbm9waGlsc19zaWdlbmVzLAogIGV4Y2VsID0gZ2x1ZSgie2dzZWFfcHJlZml4fS9lb3Npbm9waGlsX2NsaW5pY3Mtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfZ3AKdGNfZW9zaW5vcGhpbHNfZ3AkcHZhbHVlX3Bsb3RzJFJFQUMKdGNfZW9zaW5vcGhpbHNfZ3AkcHZhbHVlX3Bsb3RzJEJQCgp0Y19lb3Npbm9waGlsc191cF9ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX2Vvc2lub3BoaWxzX3NpZ2VuZXNfdXAsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2Vvc2lub3BoaWxfY2xpbmljc190dW1hY29fdXAtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfdXBfZ3AKdGNfZW9zaW5vcGhpbHNfdXBfZ3AkcHZhbHVlX3Bsb3RzJFJFQUMKCnRjX2Vvc2lub3BoaWxzX2Rvd25fZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19lb3Npbm9waGlsc19zaWdlbmVzX2Rvd24sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2Vvc2lub3BoaWxfY2xpbmljc19jYWxpX3VwLXZ7dmVyfS54bHN4IikpCnRjX2Vvc2lub3BoaWxzX2Rvd25fZ3AKdGNfZW9zaW5vcGhpbHNfZG93bl9ncCRwdmFsdWVfcGxvdHMkUkVBQwpgYGAKCiMjIyBHU0VBOiBDb21wYXJlIGNsaW5pY3MsIE1vbm9jeXRlIHNhbXBsZXMKCkluIHRoZSBmb2xsb3dpbmcgYmxvY2sgSSByZXBlYXRlZCB0aGUgYWJvdmUgcXVlcnksIGJ1dCB0aGlzIHRpbWUKbG9va2luZyBhdCB0aGUgbW9ub2N5dGUgc2FtcGxlcy4KCmBgYHtyfQp0Y19tb25vY3l0ZXNfdXBfZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19tb25vY3l0ZXNfc2lnZW5lcywKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbW9ub2N5dGVfY2xpbmljcy12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfdXBfZ3AKdGNfbW9ub2N5dGVzX3VwX2dwJHB2YWx1ZV9wbG90cyRSRUFDCnRjX21vbm9jeXRlc191cF9ncCRwdmFsdWVfcGxvdHMkQlAKCnRjX21vbm9jeXRlc19kb3duX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfbW9ub2N5dGVzX3NpZ2VuZXNfZG93biwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbW9ub2N5dGVfY2xpbmljc19jYWxpX3VwLXZ7dmVyfS54bHN4IikpCnRjX21vbm9jeXRlc19kb3duX2dwJHB2YWx1ZV9wbG90cyRSRUFDCnRjX21vbm9jeXRlc19kb3duX2dwJHB2YWx1ZV9wbG90cyRCUApgYGAKCiMjIyMgR1NFQTogQ29tcGFyZSBjbGluaWNzLCBOZXV0cm9waGlsIHNhbXBsZXMKCkliaWQuICBUaGlzIHRpbWUgbG9va2luZyBhdCB0aGUgTmV1dHJvcGhpbHMuICBUaHVzIHRoZSBmaXJzdCB0d28KaW1hZ2VzIHNob3VsZCBiZSBhIHN1cGVyc2V0IG9mIHRoZSBzZWNvbmQgYW5kIHRoaXJkIHBhaXJzIG9mIGltYWdlczsKYXNzdW1pbmcgdGhhdCB0aGUgZ2VuZXMgaW4gdGhlIHVwL2Rvd24gbGlzdCBkbyBub3QgY2F1c2UgdGhlIGdyb3VwcyB0bwpubyBsb25nZXIgYmUgc2lnbmlmaWNhbnQuICBJbnRlcmVzdGluZ2x5LCB0aGUgcmVhY3RvbWUgc2VhcmNoIGRpZCBub3QKcmV0dXJuIGFueSBoaXRzIGZvciB0aGUgaW5jcmVhc2VkIHNlYXJjaC4KCmBgYHtyfQp0Y19uZXV0cm9waGlsc19ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX25ldXRyb3BoaWxzX3NpZ2VuZXMsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L25ldXRyb3BoaWxfY2xpbmljcy12e3Zlcn0ueGxzeCIpKQojIyB0Y19uZXV0cm9waGlsc19ncCRwdmFsdWVfcGxvdHMkUkVBQyAjIyBubyBoaXRzCnRjX25ldXRyb3BoaWxzX2dwJHB2YWx1ZV9wbG90cyRCUAp0Y19uZXV0cm9waGlsc19ncCRwdmFsdWVfcGxvdHMkVEYKCnRjX25ldXRyb3BoaWxzX3VwX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfbmV1dHJvcGhpbHNfc2lnZW5lc191cCwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbmV1dHJvcGhpbF9jbGluaWNzX3R1bWFjb191cC12e3Zlcn0ueGxzeCIpKQojIyB0Y19uZXV0cm9waGlsc191cF9ncCRwdmFsdWVfcGxvdHMkUkVBQyAjIyBObyBoaXRzCnRjX25ldXRyb3BoaWxzX3VwX2dwJHB2YWx1ZV9wbG90cyRCUAoKdGNfbmV1dHJvcGhpbHNfZG93bl9ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX25ldXRyb3BoaWxzX3NpZ2VuZXNfZG93biwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbmV1dHJvcGhpbF9jbGluaWNzX2NhbGlfdXAtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfZG93bl9ncCRwdmFsdWVfcGxvdHMkUkVBQwp0Y19uZXV0cm9waGlsc19kb3duX2dwJHB2YWx1ZV9wbG90cyRCUApgYGAKCiMgQ29tcGFyZSBERTogSG93IHNpbWlsYXIgYXJlIFR1bWFjbyBDL0YgdnMuIENhbGkgQy9GCgpUaGUgZm9sbG93aW5nIGV4cGFuZHMgdGhlIGNyb3NzLWNsaW5pYyBxdWVyeSBhYm92ZSB0byBhbHNvIHRlc3QgdGhlCm5ldXRyb3BoaWxzLiAgT25jZSBhZ2FpbiwgSSB0aGluayBpdCB3aWxsIHByZXR0eSBzdHJvbmdseSBzdXBwb3J0IHRoZQpoeXBvdGhlc2lzIHRoYXQgdGhlIHR3byBjbGluaWNzIGFyZSBub3QgY29tcGF0aWJsZS4KCldlIGFyZSBjb25jZXJuZWQgdGhhdCB0aGUgY2xpbmljLWJhc2VkIGJhdGNoIGVmZmVjdCBtYXkgbWFrZSBvdXIKcmVzdWx0cyBlc3NlbnRpYWxseSB1c2VsZXNzLiAgT25lIHdheSB0byB0ZXN0IHRoaXMgY29uY2VybiBpcyB0bwpjb21wYXJlIHRoZSBzZXQgb2YgZ2VuZXMgb2JzZXJ2ZWQgZGlmZmVyZW50IGJldHdlZW4gdGhlIENhbGkgQ3VyZS9GYWlsCnZzLiB0aGUgVHVtYWNvIEN1cmUvRmFpbC4KCmBgYHtyfQpjYWxpX3RhYmxlX25vYmF0Y2ggPC0gdGNfbmV1dHJvcGhpbHNfdGFibGVfbm9iYXRjaFtbImRhdGEiXV1bWyJjYWxpIl1dCnR1bWFjb190YWJsZV9ub2JhdGNoIDwtIHRjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2hbWyJkYXRhIl1dW1sidHVtYWNvIl1dCgpjYWxpX21lcmdlZF9ub2JhdGNoIDwtIG1lcmdlKGNhbGlfdGFibGVfbm9iYXRjaCwgdHVtYWNvX3RhYmxlX25vYmF0Y2gsIGJ5PSJyb3cubmFtZXMiKQpjb3IudGVzdChjYWxpX21lcmdlZF9ub2JhdGNoWywgImRlc2VxX2xvZ2ZjLngiXSwgY2FsaV9tZXJnZWRfbm9iYXRjaFssICJkZXNlcV9sb2dmYy55Il0pCmNhbGlfYXVjY19ub2JhdGNoIDwtIGNhbGN1bGF0ZV9hdWNjKGNhbGlfdGFibGVfbm9iYXRjaCwgdHVtYWNvX3RhYmxlX25vYmF0Y2gsIHB4ID0gImRlc2VxX2FkanAiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBweSA9ICJkZXNlcV9hZGpwIiwgbHggPSAiZGVzZXFfbG9nZmMiLCBseSA9ICJkZXNlcV9sb2dmYyIpCmNhbGlfYXVjY19ub2JhdGNoJHBsb3QKYGBgCgojIFR1bWFjbyBhbmQgQ2FsaSwgY3VyZSB2cy4gZmFpbAoKSW4gYWxsIG9mIHRoZSBhYm92ZSwgd2UgYXJlIGxvb2tpbmcgdG8gdW5kZXJzdGFuZCB0aGUgZGlmZmVyZW5jZXMgYmV0d2VlbiB0aGUgdHdvIGxvY2F0aW9uLgpMZXQgdXMgbm93IHN0ZXAgYmFjayBhbmQgcGVyZm9ybSB0aGUgb3JpZ2luYWwgcXVlc3Rpb246IGZhaWwvY3VyZSB3aXRob3V0IHJlZ2FyZCB0byBsb2NhdGlvbi4KCkkgcGVyZm9ybWVkIHRoaXMgcXVlcnkgd2l0aCBhIGZldyBkaWZmZXJlbnQgcGFyYW1ldGVycywgbm90YWJseSB3aXRoKG91dCkKc3ZhIGFuZCBhZ2FpbiB1c2luZyBlYWNoIGNlbGwgdHlwZSwgaW5jbHVkaW5nIGJpb3BzaWVzLiBUaGUgbWFpbgpyZWFzaW9uIEkgYW0ga2VlcGluZyB0aGVzZSBjb21wYXJpc29ucyBpcyBpbiB0aGUgcmVsYXRpdmVseSB3ZWFrIGhvcGUKdGhhdCB0aGVyZSB3aWxsIGJlIHN1ZmZpY2llbnQgc2lnbmFsIGluIHRoZSBmdWxsIGRhdGFzZXQgdGhhdCBpdCBtaWdodApiZSBhYmxlIHRvIG92ZXJjb21lIHRoZSBhcHBhcmVudGx5IHJpZGljdWxvdXMgYmF0Y2ggZWZmZWN0IGZyb20gdGhlCnR3byBjbGluaWNzLgoKIyMgQWxsIGNlbGwgdHlwZXMgdG9nZXRoZXIsIHdpdGgob3V0KSBTVkEKCmBgYHtyfQp0YWJsZShwRGF0YSh0Y192YWxpZClbWyJjb25kaXRpb24iXV0pCnRjX2FsbF9jZl9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX3ZhbGlkLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIikKdGNfYWxsX2NmX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19hbGxfY2ZfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX3ZhbGlkX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19hbGxfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2FsbF9jZl90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y192YWxpZF9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCgp0Y19hbGxfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX3ZhbGlkLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9IFRSVUUpCnRjX2FsbF9jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19hbGxfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfdmFsaWRfY2ZfdGFibGVfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfYWxsX2NmX3NpZ19iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2FsbF9jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX3ZhbGlkX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIEFsbCBjZWxsIHR5cGVzIGV4Y2VwdCBiaW9wc2llcwoKSSBhbSBub3Qgc3VyZSBpZiB0aGlzIGlzIHRoZSBiZXN0IGNob2ljZSwgYnV0IEkgY2FsbCB0aGUgc2V0IG9mIGFsbApzYW1wbGVzIGV4Y2x1ZGluZyBiaW9wc2llcyAnY2xpbmljYWwnLgoKYGBge3J9CnRhYmxlKHBEYXRhKHRjX2NsaW5pY2FsX25vYmlvcClbWyJjb25kaXRpb24iXV0pCnRjX2NsaW5pY2FsX2NmX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfY2xpbmljYWxfbm9iaW9wLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2NsaW5pY2FsX2NmX2RlX3N2YQoKdGNfY2xpbmljYWxfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2NsaW5pY2FsX2NmX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9DbGluaWNhbF9TYW1wbGVzL3RjX2NsaW5pY2FsX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19jbGluaWNhbF9jZl90YWJsZV9zdmEKCnRjX2NsaW5pY2FsX2NmX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19jbGluaWNhbF9jZl90YWJsZV9zdmEsIGFjY29yZGluZ190byA9ICJkZXNlcSIsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9DbGluaWNhbF9TYW1wbGVzL3RjX2NsaW5pY2FsX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfY2xpbmljYWxfY2Zfc2lnX3N2YQoKdGNfY2xpbmljYWxfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX2NsaW5pY2FsX25vYmlvcCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19jbGluaWNhbF9jZl9kZV9iYXRjaAoKdGNfY2xpbmljYWxfY2ZfdGFibGVfYmF0Y2ggPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfY2xpbmljYWxfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQ2xpbmljYWxfU2FtcGxlcy90Y19jbGluaWNhbF9jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19jbGluaWNhbF9jZl90YWJsZV9iYXRjaAoKdGNfY2xpbmljYWxfY2Zfc2lnX2JhdGNoIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfY2xpbmljYWxfY2ZfdGFibGVfYmF0Y2gsIGFjY29yZGluZ190byA9ICJkZXNlcSIsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9DbGluaWNhbF9TYW1wbGVzL3RjX2NsaW5pY2FsX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19jbGluaWNhbF9jZl9zaWdfYmF0Y2gKYGBgCgojIyMgQSBwb3J0aW9uIG9mIFN1cHBsZW1lbnRhbCBGaWd1cmUgMTEuCgpgYGB7cn0KbnVtX2NvbG9yIDwtIGNvbG9yX2Nob2ljZXNbWyJjZiJdXVtbImN1cmUiXV0KZGVuX2NvbG9yIDwtIGNvbG9yX2Nob2ljZXNbWyJjZiJdXVtbImZhaWx1cmUiXV0KdGNfY2xpbmljYWxfY2ZfdGFibGUgPC0gdGNfY2xpbmljYWxfY2ZfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0KdGNfY2xpbmljYWxfY2Zfdm9sY2Fub190b3AxMCA8LSBwbG90X3ZvbGNhbm9fY29uZGl0aW9uX2RlKAogIHRjX2NsaW5pY2FsX2NmX3RhYmxlLCAib3V0Y29tZSIsIGxhYmVsID0gMTAsCiAgZmNfY29sID0gImRlc2VxX2xvZ2ZjIiwgcF9jb2wgPSAiZGVzZXFfYWRqcCIsIGxpbmVfcG9zaXRpb24gPSBOVUxMLAogIGNvbG9yX2hpZ2ggPSBudW1fY29sb3IsIGNvbG9yX2xvdyA9IGRlbl9jb2xvciwgbGFiZWxfc2l6ZSA9IDYpCnBwKGZpbGUgPSAiZmlndXJlcy9zMTFjX3RjX2NsaW5pY2FsX2NmX3ZvbGNhbm9fbGFiZWxlZF90b3AxMC5zdmciKQp0Y19jbGluaWNhbF9jZl92b2xjYW5vX3RvcDEwW1sicGxvdCJdXQpkZXYub2ZmKCkKdGNfY2xpbmljYWxfY2Zfdm9sY2Fub190b3AxMFtbInBsb3QiXV0KYGBgCgojIyBCaW9wc2llcywgd2l0aChvdXQpIFNWQQoKSW4gdGhlIGZvbGxvd2luZyBibG9jaywgd2UgcmVwZWF0IHRoZSBzYW1lIHF1ZXN0aW9uLCBidXQgdXNpbmcgb25seQp0aGUgYmlvcHN5IHNhbXBsZXMgZnJvbSBib3RoIGNsaW5pY3MuCgpgYGB7cn0KdGNfYmlvcHNpZXNfY2YgPC0gc2V0X2V4cHRfY29uZGl0aW9ucyh0Y19iaW9wc2llcywgZmFjdCA9ICJmaW5hbG91dGNvbWUiKQp0Y19iaW9wc2llc19jZl9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX2Jpb3BzaWVzX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiKQp0Y19iaW9wc2llc19jZl90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYmlvcHNpZXNfY2ZfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0Jpb3BzaWVzL3RjX2Jpb3BzaWVzX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19iaW9wc2llc19jZl9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfYmlvcHNpZXNfY2ZfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfYmlvcHNpZXNfY2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQoKdGNfYmlvcHNpZXNfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX2Jpb3BzaWVzX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSkKdGNfYmlvcHNpZXNfY2ZfdGFibGVfYmF0Y2ggPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYmlvcHNpZXNfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfYmlvcHNpZXNfY2ZfdGFibGVfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfYmlvcHNpZXNfY2Zfc2lnX2JhdGNoIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfYmlvcHNpZXNfY2ZfdGFibGVfYmF0Y2gsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19iaW9wc2llc19jZl9zaWdfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKYGBgCgojIyBFb3Npbm9waGlscywgd2l0aChvdXQpIFNWQQoKSW4gdGhlIGZvbGxvd2luZyBibG9jaywgd2UgcmVwZWF0IHRoZSBzYW1lIHF1ZXN0aW9uLCBidXQgdXNpbmcgb25seQp0aGUgRW9zaW5vcGhpbCBzYW1wbGVzIGZyb20gYm90aCBjbGluaWNzLgoKYGBge3J9CnRjX2Vvc2lub3BoaWxzX2NmIDwtIHNldF9leHB0X2NvbmRpdGlvbnModGNfZW9zaW5vcGhpbHMsIGZhY3QgPSAiZmluYWxvdXRjb21lIikKdGNfZW9zaW5vcGhpbHNfY2ZfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19lb3Npbm9waGlsc19jZiwgZmlsdGVyID0gVFJVRSwgbWV0aG9kcyA9IG1ldGhvZHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIikKdGNfZW9zaW5vcGhpbHNfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2Vvc2lub3BoaWxzX2NmX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Fb3Npbm9waGlscy90Y19lb3Npbm9waGlsc19jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Vvc2lub3BoaWxzX2NmX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX2Vvc2lub3BoaWxzX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKCnRjX2Vvc2lub3BoaWxzX2NmX2RlX2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19lb3Npbm9waGlsc19jZiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19lb3Npbm9waGlsc19jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19lb3Npbm9waGlsc19jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19lb3Npbm9waGlsc19jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19lb3Npbm9waGlsc19jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX2Vvc2lub3BoaWxzX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIE1vbm9jeXRlcywgd2l0aChvdXQpIFNWQQoKUmVwZWF0IHlldCBhZ2FpbiwgdGhpcyB0aW1lIHdpdGggdGhlIG1vbm9jeXRlIHNhbXBsZXMuICBUaGUgaWRlYSBpcyB0bwpzZWUgaWYgdGhlcmUgaXMgYSBjZWxsIHR5cGUgd2hpY2ggaXMgcGFydGljdWxhcmx5IGdvb2QgKG9yIGJhZCkgYXQKZGlzY3JpbWluYXRpbmcgdGhlIHR3byBjbGluaWNzLgoKYGBge3J9CnRjX21vbm9jeXRlc19jZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRjX21vbm9jeXRlcywgZmFjdCA9ICJmaW5hbG91dGNvbWUiKQp0Y19tb25vY3l0ZXNfY2ZfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19tb25vY3l0ZXNfY2YsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiKQp0Y19tb25vY3l0ZXNfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX21vbm9jeXRlc19jZl9kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vTW9ub2N5dGVzL3RjX21vbm9jeXRlc19jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbW9ub2N5dGVzX2NmX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19tb25vY3l0ZXNfY2ZfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfbW9ub2N5dGVzX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKCnRjX21vbm9jeXRlc19jZl9kZV9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfbW9ub2N5dGVzX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9IFRSVUUpCnRjX21vbm9jeXRlc19jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19tb25vY3l0ZXNfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfbW9ub2N5dGVzX2NmX3RhYmxlX2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX21vbm9jeXRlc19jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19tb25vY3l0ZXNfY2ZfdGFibGVfYmF0Y2gsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19tb25vY3l0ZXNfY2Zfc2lnX2JhdGNoLXZ7dmVyfS54bHN4IikpCmBgYAoKIyMgTmV1dHJvcGhpbHMsIHdpdGgob3V0KSBTVkEKCkxhc3QgdHJ5LCB0aGlzIHRpbWUgdXNpbmcgdGhlIE5ldXRyb3BoaWwgc2FtcGxlcy4KCmBgYHtyfQp0Y19uZXV0cm9waGlsc19jZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRjX25ldXRyb3BoaWxzLCBmYWN0ID0gImZpbmFsb3V0Y29tZSIpCnRjX25ldXRyb3BoaWxzX2NmX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfbmV1dHJvcGhpbHNfY2YsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfbmV1dHJvcGhpbHNfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX25ldXRyb3BoaWxzX2NmX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9OZXV0cm9waGlscy90Y19uZXV0cm9waGlsc19jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX25ldXRyb3BoaWxzX2NmX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX25ldXRyb3BoaWxzX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKCnRjX25ldXRyb3BoaWxzX2NmX2RlX2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19uZXV0cm9waGlsc19jZiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19uZXV0cm9waGlsc19jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19uZXV0cm9waGlsc19jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19uZXV0cm9waGlsc19jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19uZXV0cm9waGlsc19jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19uZXV0cm9waGlsc19jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX25ldXRyb3BoaWxzX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQpgYGAKCiMgVmlzaXQgY29tcGFyaXNvbnMKCkxhdGVyIGluIHRoaXMgZG9jdW1lbnQgSSBkbyBhIGJ1bmNoIG9mIHZpc2l0L2NmIGNvbXBhcmlzb25zLiAgSW4gdGhpcwpibG9jayBJIHdhbnQgdG8gZXhwbGljaXRseSBvbmx5IGNvbXBhcmUgdjEgdG8gb3RoZXIgdmlzaXRzLiAgVGhpcyBpcwpzb21ldGhpbmcgSSBkaWQgcXVpdGUgYSBsb3QgaW4gdGhlIDIwMTkgZGF0YXNldHMsIGJ1dCBuZXZlciBhY3R1YWxseQptb3ZlZCB0byB0aGlzIGRvY3VtZW50LgoKYGBge3J9CnYxX3ZzX2xhdGVyIDwtIGFsbF9wYWlyd2lzZSh0Y192MXZzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUpCnYxX3ZzX2xhdGVyX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHYxX3ZzX2xhdGVyLCBrZWVwZXJzID0gdmlzaXRfdjFsYXRlciwKICBleGNlbCA9IGdsdWUoInt2aXNpdF9wcmVmaXh9L3YxX3ZzX2xhdGVyX3RhYmxlcy12e3Zlcn0ueGxzeCIpKQp2MV92c19sYXRlcl9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB2MV92c19sYXRlcl90YWJsZSwKICBleGNlbCA9IGdsdWUoInt2aXNpdF9wcmVmaXh9L3YxX3ZzX2xhdGVyX3NpZy12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIyMgR1NFQTogVjEgdnMgb3RoZXIgdmlzaXRzLgoKYGBge3J9CnYxbGF0ZXJfZ3AgPC0gYWxsX2dwcm9maWxlcih2MV92c19sYXRlcl9zaWcpCnYxbGF0ZXJfZ3BbWzFdXSRwdmFsdWVfcGxvdHMkUkVBQwp2MWxhdGVyX2dwW1syXV0kcHZhbHVlX3Bsb3RzJFJFQUMKYGBgCgojIFNleCBjb21wYXJpc29uCgpgYGB7cn0KdGNfc2V4X2RlIDwtIGFsbF9wYWlyd2lzZSh0Y19zZXgsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUpCnRjX3NleF90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19zZXhfZGUsIGV4Y2VsID0gZ2x1ZSgie3NleF9wcmVmaXh9L3RjX3NleF90YWJsZS12e3Zlcn0ueGxzeCIpKQp0Y19zZXhfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfc2V4X3RhYmxlLCBleGNlbCA9IGdsdWUoIntzZXhfcHJlZml4fS90Y19zZXhfc2lnLXZ7dmVyfS54bHN4IikpCnRjX3NleF9ncCA8LSBhbGxfZ3Byb2ZpbGVyKHRjX3NleF9zaWcpCmBgYAoKYGBge3J9CnRjX3NleF9jdXJlIDwtIHN1YnNldF9leHB0KHRjX3NleCwgc3Vic2V0ID0gImZpbmFsb3V0Y29tZT09J2N1cmUnIikKdGNfc2V4X2N1cmVfZGUgPC0gYWxsX3BhaXJ3aXNlKHRjX3NleF9jdXJlLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19zZXhfY3VyZV9kZQp0Y19zZXhfY3VyZV90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19zZXhfY3VyZV9kZSwgZXhjZWwgPSBnbHVlKCJ7c2V4X3ByZWZpeH0vdGNfc2V4X2N1cmVfdGFibGUtdnt2ZXJ9Lnhsc3giKSkKdGNfc2V4X2N1cmVfdGFibGUKdGNfc2V4X2N1cmVfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfc2V4X2N1cmVfdGFibGUsIGV4Y2VsID0gZ2x1ZSgie3NleF9wcmVmaXh9L3RjX3NleF9jdXJlX3NpZy12e3Zlcn0ueGxzeCIpKQp0Y19zZXhfY3VyZV9zaWcKYGBgCgojIyMjIEdTRUE6IFNleCBjb21wYXJpc29ucyBib3RoIGNsaW5pY3MKCmBgYHtyfQp0Y19zZXhfY3VyZV9ncCA8LSBhbGxfZ3Byb2ZpbGVyKHRjX3NleF9jdXJlX3NpZykKdGNfc2V4X2N1cmVfZ3AKdGNfc2V4X2N1cmVfZ3BbWzFdXVtbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCnRjX3NleF9jdXJlX2dwW1syXV1bWyJwdmFsdWVfcGxvdHMiXV1bWyJCUCJdXQpgYGAKCiMgRXRobmljaXR5IGNvbXBhcmlzb25zCgpgYGB7cn0KdGNfZXRobmljaXR5X2RlIDwtIGFsbF9wYWlyd2lzZSh0Y19ldG5pYV9leHB0LCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2V0aG5pY2l0eV9kZQp0Y19ldGhuaWNpdHlfdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfZXRobmljaXR5X2RlLCBrZWVwZXJzID0gZXRobmljaXR5X2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntldGhfcHJlZml4fS90Y19ldGhuaWNpdHlfdGFibGUtdnt2ZXJ9Lnhsc3giKSkKdGNfZXRobmljaXR5X3RhYmxlCnRjX2V0aG5pY2l0eV90YWJsZVtbInBsb3RzIl1dW1sibWVzdGl6b19pbmRpZ2Vub3VzIl1dW1siZGVzZXFfbWFfcGxvdHMiXV0KdGNfZXRobmljaXR5X3RhYmxlW1sicGxvdHMiXV1bWyJtZXN0aXpvX2Fmcm9jb2wiXV1bWyJkZXNlcV9tYV9wbG90cyJdXQp0Y19ldGhuaWNpdHlfdGFibGVbWyJwbG90cyJdXVtbImluZGlnZW5vdXNfYWZyb2NvbCJdXVtbImRlc2VxX21hX3Bsb3RzIl1dCgp0Y19ldGhuaWNpdHlfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfZXRobmljaXR5X3RhYmxlLCBleGNlbCA9IGdsdWUoIntldGhfcHJlZml4fS90Y19ldGhuaWNpdHlfc2lnLXZ7dmVyfS54bHN4IikpCgpldGhuaWNpdHlfY3VyZSA8LSBzdWJzZXRfZXhwdCh0Y19ldG5pYV9leHB0LCBzdWJzZXQgPSAiZmluYWxvdXRjb21lPT0nY3VyZSciKQpldGhuaWNpdHlfY3VyZV9kZSA8LSBhbGxfcGFpcndpc2UoZXRobmljaXR5X2N1cmUsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCmV0aG5pY2l0eV9jdXJlX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIGV0aG5pY2l0eV9jdXJlX2RlLCBrZWVwZXJzID0gZXRobmljaXR5X2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntldGhfcHJlZml4fS9ldGhuaWNpdHlfY3VyZV90YWJsZS12e3Zlcn0ueGxzeCIpKQpldGhuaWNpdHlfY3VyZV90YWJsZQpldGhuaWNpdHlfY3VyZV90YWJsZVtbInBsb3RzIl1dW1sibWVzdGl6b19pbmRpZ2Vub3VzIl1dW1siZGVzZXFfbWFfcGxvdHMiXV0KZXRobmljaXR5X2N1cmVfdGFibGVbWyJwbG90cyJdXVtbIm1lc3Rpem9fYWZyb2NvbCJdXVtbImRlc2VxX21hX3Bsb3RzIl1dCmV0aG5pY2l0eV9jdXJlX3RhYmxlW1sicGxvdHMiXV1bWyJpbmRpZ2Vub3VzX2Fmcm9jb2wiXV1bWyJkZXNlcV9tYV9wbG90cyJdXQpldGhuaWNpdHlfY3VyZV9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICBldGhuaWNpdHlfY3VyZV90YWJsZSwgZXhjZWwgPSBnbHVlKCJ7ZXRoX3ByZWZpeH0vZXRobmljaXR5X2N1cmVfc2lnLXZ7dmVyfS54bHN4IikpCmV0aG5pY2l0eV9jdXJlX3NpZwpgYGAKCiMjIyMgR1NFQTogRXRobmljaXR5IGRpZmZlcmVuY2VzCgpQZXJmb3JtZWQgb25jZSB3aXRoIGJvdGggY2xpbmljcyBhbmQgYWdhaW4gd2l0aCBvbmx5IFR1bWFjby4KCmBgYHtyfQp0Y19ldGhuaWNpdHlfZ3AgPC0gYWxsX2dwcm9maWxlcih0Y19ldGhuaWNpdHlfc2lnKQpgYGAKCmBgYHtyfQpwYW5kZXI6OnBhbmRlcihzZXNzaW9uSW5mbygpKQptZXNzYWdlKCJUaGlzIGlzIGhwZ2x0b29scyBjb21taXQ6ICIsIGdldF9naXRfY29tbWl0KCkpCm1lc3NhZ2UoIlNhdmluZyB0byAiLCBzYXZlZmlsZSkKIyB0bXAgPC0gc20oc2F2ZW1lKGZpbGVuYW1lID0gc2F2ZWZpbGUpKQpgYGAKCmBgYHtyIGxvYWRtZV9hZnRlciwgZXZhbD1GQUxTRX0KdG1wIDwtIGxvYWRtZShmaWxlbmFtZSA9IHNhdmVmaWxlKQpgYGAK