1 Changelog
- 202309: Disabled GSVA analyses until/unless we get permission to include the mSigDB 7.5.1 release. I will simplify the filenames so that one may easily drop in a downloaded copy of the data and run those blocks. Until then, I guess you will have to trust me when I say those blocks all work?
- 202309: Moved all GSEA analyses to 04lrt_gsea_gsva.Rmd
- 202309 next day: Moving GSEA back because it adds too much complexity to save/reload the DE results for gProfiler and friends.
- Still hunting for messed up colors, changed input data to match new version.
2 Introduction
The various differential expression analyses of the data generated in tmrc3_datasets will occur in this document.
2.1 Naming conventions
I am going to try to standardize how I name the various data structures created in this document. Most of the large data created are either sets of differential expression analyses, their combined results, or the set of results deemed ‘significant’.
Hopefully by now they all follow these guidelines:
{clinic(s)}sample-subset}{primary-question(s)}{datatype}{batch-method}
- {clinic}: This is either tc or t for Tumaco and Cali, or just Tumaco.
- {sample-subset}: Things like ‘all’ or ‘monocytes’.
- {primary-question}: Shorthand name for the primary contrasts performed, thus ‘clinics’ would suggest a comparison of Tumaco vs. Cali. ‘visits’ would compare v2/v1, etc.
- {datatype}: de, table, sig
- {batch-type}: nobatch, batch{factor}, sva. {factor} in this instance should be a column from the metadata.
With this in mind, ‘tc_biopsies_clinic_de_sva’ should be the Tumaco+Cali biopsy data after performing the differential expression analyses comparing the clinics using sva.
I suspect there remain some exceptions and/or errors.
2.2 Define contrasts for DE analyses
Each of the following lists describes the set of contrasts that I think are interesting for the various ways one might consider the TMRC3 dataset. The variables are named according to the assumed data with which they will be used, thus tc_cf_contrasts is expected to be used for the Tumaco+Cali data and provide a series of cure/fail comparisons which (to the extent possible) across both locations. In every case, the name of the list element will be used as the contrast name, and will thus be seen as the sheet name in the output xlsx file(s); the two pieces of the character vector value are the numerator and denominator of the associated contrast.
2.3 GSEA
The GSEA analyses will follow each DE analysis during this document.
Most (all?) of the GSEA analyses used in this paper were done via gProfiler rather than goseq/clusterProfiler/topGO/GOstats. Primarily because it is so easy to invoke gprofiler.
clinic_contrasts <- list(
"clinics" = c("cali", "tumaco"))
## In some cases we have no Cali failure samples, so there remain only 2
## contrasts that are likely of interest
tc_cf_contrasts <- list(
"tumaco" = c("tumaco_failure", "tumaco_cure"),
"cure" = c("tumaco_cure", "cali_cure"))
## In other cases, we have cure/fail for both places.
clinic_cf_contrasts <- list(
"cali" = c("cali_failure", "cali_cure"),
"tumaco" = c("tumaco_failure", "tumaco_cure"),
"cure" = c("tumaco_cure", "cali_cure"),
"fail" = c("tumaco_failure", "cali_failure"))
cf_contrast <- list(
"outcome" = c("tumaco_failure", "tumaco_cure"))
t_cf_contrast <- list(
"outcome" = c("failure", "cure"))
visitcf_contrasts <- list(
"v1cf" = c("v1_failure", "v1_cure"),
"v2cf" = c("v2_failure", "v2_cure"),
"v3cf" = c("v3_failure", "v3_cure"))
visit_contrasts <- list(
"v2v1" = c("c2", "c1"),
"v3v1" = c("c3", "c1"),
"v3v2" = c("c3", "c2"))
visit_v1later <- list(
"later_vs_first" = c("later", "first"))
celltypes <- list(
"eo_mono" = c("eosinophils", "monocytes"),
"ne_mono" = c("neutrophils", "monocytes"),
"eo_ne" = c("eosinophils", "neutrophils"))
ethnicity_contrasts <- list(
"mestizo_indigenous" = c("mestiza", "indigena"),
"mestizo_afrocol" = c("mestiza", "afrocol"),
"indigenous_afrocol" = c("indigena", "afrocol"))3 Compare samples by clinic
3.1 DE: Compare clinics, all samples
Perform a svaseq-guided comparison of the two clinics. Ideally this will give some clue about just how strong the clinic-based batch effect really is and what its causes are.
tc_clinic_type <- tc_valid %>%
set_expt_conditions(fact = "clinic") %>%
set_expt_batches(fact = "typeofcells")## The numbers of samples by condition are:##
## cali tumaco
## 61 123## The number of samples by batch are:##
## biopsy eosinophils monocytes neutrophils
## 18 41 63 62table(pData(tc_clinic_type)[["condition"]])##
## cali tumaco
## 61 123tc_all_clinic_de_sva <- all_pairwise(tc_clinic_type, model_batch = "svaseq",
filter = TRUE, methods = methods)##
## cali tumaco
## 61 123## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_all_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## tumc_vs_cl
## basic_vs_deseq 0.8086
## basic_vs_dream 0.9211
## basic_vs_ebseq 0.7548
## basic_vs_edger 0.8735
## basic_vs_limma 0.9693
## basic_vs_noiseq 0.9114
## deseq_vs_dream 0.8806
## deseq_vs_ebseq 0.8504
## deseq_vs_edger 0.9377
## deseq_vs_limma 0.7998
## deseq_vs_noiseq 0.8770
## dream_vs_ebseq 0.8550
## dream_vs_edger 0.9438
## dream_vs_limma 0.9373
## dream_vs_noiseq 0.9347
## ebseq_vs_edger 0.8618
## ebseq_vs_limma 0.7772
## ebseq_vs_noiseq 0.8382
## edger_vs_limma 0.8621
## edger_vs_noiseq 0.9363
## limma_vs_noiseq 0.8895tc_all_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_vs_cali"tc_all_clinic_table_sva <- combine_de_tables(
tc_all_clinic_de_sva, keepers = clinic_contrasts,
excel = glue("{clinic_prefix}/tc_all_clinic_table_sva-v{ver}.xlsx"))
tc_all_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 tumaco_vs_cali-inverted 273 1799 323 1667
## limma_sigup limma_sigdown
## 1 392 606## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_all_clinic_sig_sva <- extract_significant_genes(
tc_all_clinic_table_sva,
excel = glue("{clinic_prefix}/compare_clinics/tc_clinic_type_sig_sva-v{ver}.xlsx"))
tc_all_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## clinics 392 606 323 1667 273 1799 224
## ebseq_down basic_up basic_down
## clinics 424 0 5914
3.1.1 GSEA: comparing the clinics
increased_tumaco_categories_up <- simple_gprofiler(
tc_all_clinic_sig_sva[["deseq"]][["ups"]][["clinics"]],
excel = glue("{gsea_prefix}/tumaco_cateogies_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eeincreased_tumaco_categories_up## A set of ontologies produced by gprofiler using 273
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 17 MF
## 5 BP
## 0 KEGG
## 1 REAC
## 0 WP
## 100 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.increased_tumaco_categories_up[["pvalue_plots"]][["BP"]]## NULLincreased_cali_categories <- simple_gprofiler(
tc_all_clinic_sig_sva[["deseq"]][["downs"]][["clinics"]],
excel = glue("{gsea_prefix}/cali_cateogies_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eeincreased_cali_categories## A set of ontologies produced by gprofiler using 1799
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 58 MF
## 676 BP
## 0 KEGG
## 20 REAC
## 7 WP
## 333 TF
## 2 MIRNA
## 16 HPA
## 0 CORUM
## 14 HP hits.increased_cali_categories[["pvalue_plots"]][["BP"]]## NULL3.1.2 Visualize clinic differences
Let us take a quick look at the results of the comparison of Tumaco/Cali
Note: I keep re-introducing an error which causes these (volcano and MA) plots to be reversed with respect to the logFC values. Pay careful attention to these and make sure that they agree with the numbers of genes observed in the contrast.
## Check that up is up
summary(tc_all_clinic_table_sva[["data"]][["clinics"]][["deseq_logfc"]])## Min. 1st Qu. Median Mean 3rd Qu. Max.
## -20.280 -0.584 -0.155 -0.255 0.172 3.514## I think we can assume that most genes are down when considering Tumaco/Cali.
sum(tc_all_clinic_table_sva$data$clinics$deseq_logfc < -1.0 &
tc_all_clinic_table_sva$data$clinics$deseq_adjp < 0.05)## [1] 1795tc_all_clinic_table_sva[["plots"]][["clinics"]][["deseq_vol_plots"]]
## Ok, so it says 1794 up, but that is clearly the down side... Something is definitely messed up.
## The points are on the correct sides of the plot, but the categories of up/down are reversed.
## Theresa noted that she colors differently, and I think better: left side gets called
## 'increased in denominator', right side gets called 'increased in numerator';
## these two groups are colored according to their condition colors, and everything else is gray.
## I am checking out Theresa's helper_functions.R to get a sense of how she handles this, I think
## I can use a variant of her idea pretty easily:
## 1. Add a column 'Significance', which is a factor, and contains either 'Not enriched',
## 'Enriched in x', or 'Enriched in y' according to the logfc/adjp.
## 2. use the significance column for the geom_point color/fill in the volcano plot.
## My change to this idea would be to extract the colors from the input expressionset.There appear to be many more genes which are increased in the Tumaco samples with respect to the Cali samples.
3.2 DE: Compare clinics, eosinophil samples
The remaining cell types all have pretty strong clinic-based variance; but I am not certain if it is consistent across cell types.
table(pData(tc_eosinophils)[["condition"]])##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9tc_eosinophils_clinic_de_nobatch <- all_pairwise(tc_eosinophils, parallel = parallel,
model_batch = FALSE, filter = TRUE,
methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.tc_eosinophils_clinic_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_eosinophils_clinic_de_nobatch[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_eosinophils_clinic_table_nobatch <- combine_de_tables(
tc_eosinophils_clinic_de_nobatch, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_table_nobatch-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for tumaco using ebseq does not appear in the pairwise data.## coefficient ebseq did not find tumaco_cure or tumaco_failure.tc_eosinophils_clinic_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 102 35 114
## 2 tumaco_cure_vs_cali_cure 834 814 856
## edger_sigdown limma_sigup limma_sigdown
## 1 32 62 17
## 2 817 712 705## Plot describing unique/shared genes in a differential expression table.
tc_eosinophils_clinic_sig_nobatch <- extract_significant_genes(
tc_eosinophils_clinic_table_nobatch,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_sig_nobatch-v{ver}.xlsx"))
tc_eosinophils_clinic_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## tumaco 62 17 114 32 102 35 8
## cure 712 705 856 817 834 814 5550
## basic_down
## tumaco 0
## cure 0
tc_eosinophils_clinic_de_sva <- all_pairwise(tc_eosinophils, model_batch = "svaseq",
filter = TRUE, methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.
tc_eosinophils_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_eosinophils_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_eosinophils_clinic_table_sva <- combine_de_tables(
tc_eosinophils_clinic_de_sva, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_table_sva-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for tumaco using ebseq does not appear in the pairwise data.## coefficient ebseq did not find tumaco_cure or tumaco_failure.tc_eosinophils_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 89 57 90
## 2 tumaco_cure_vs_cali_cure 777 808 781
## edger_sigdown limma_sigup limma_sigdown
## 1 41 77 30
## 2 806 723 710## Plot describing unique/shared genes in a differential expression table.
tc_eosinophils_clinic_sig_sva <- extract_significant_genes(
tc_eosinophils_clinic_table_sva,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_sig_sva-v{ver}.xlsx"))
tc_eosinophils_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## tumaco 77 30 90 41 89 57 8
## cure 723 710 781 806 777 808 5550
## basic_down
## tumaco 0
## cure 0
3.3 DE: Compare clinics, biopsy samples
Interestingly to me, the biopsy samples appear to have the least location-based variance. But we can perform an explicit DE and see how well that hypothesis holds up.
Note that these data include cure and fail samples for
table(pData(tc_biopsies)[["condition"]])##
## cali_cure tumaco_cure tumaco_failure
## 4 9 5tc_biopsies_clinic_de_sva <- all_pairwise(tc_biopsies, parallel = parallel,
model_batch = "svaseq", filter = TRUE,
methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.tc_biopsies_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_biopsies_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_biopsies_clinic_table_sva <- combine_de_tables(
tc_biopsies_clinic_de_sva, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Biopsies/tc_biopsies_clinic_table_sva-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for tumaco using ebseq does not appear in the pairwise data.## coefficient ebseq did not find tumaco_cure or tumaco_failure.tc_biopsies_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 14 11 18
## 2 tumaco_cure_vs_cali_cure 1 0 0
## edger_sigdown limma_sigup limma_sigdown
## 1 6 0 0
## 2 0 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_biopsies_clinic_sig_sva <- extract_significant_genes(
tc_biopsies_clinic_table_sva,
excel = glue("{clinic_cf_prefix}/Biopsies/tc_biopsies_clinic_sig_sva-v{ver}.xlsx"))
tc_biopsies_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## tumaco 0 0 18 6 14 11 0
## cure 0 0 0 0 1 0 0
## basic_down
## tumaco 0
## cure 0
3.4 DE: Compare clinics, monocyte samples
At least for the moment, I am only looking at the differences between no-batch vs. sva across clinics for the monocyte samples. This was chosen mostly arbitrarily.
3.4.1 DE: Compare clinics, monocytes without batch estimation
Our baseline is the comparison of the monocytes samples without batch in the model or surrogate estimation. In theory at least, this should correspond to the PCA plot above when no batch estimation was performed.
table(pData(tc_monocytes)[["condition"]])##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21tc_monocytes_de_nobatch <- all_pairwise(tc_monocytes, model_batch = FALSE,
filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.tc_monocytes_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_monocytes_table_nobatch <- combine_de_tables(
tc_monocytes_de_nobatch, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_table_nobatch-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for tumaco using ebseq does not appear in the pairwise data.## coefficient ebseq did not find tumaco_cure or tumaco_failure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for cure using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_cure or tumaco_cure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for fail using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_failure or tumaco_failure.tc_monocytes_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 16 20 32
## 2 tumaco_failure_vs_tumaco_cure 48 121 60
## 3 tumaco_cure_vs_cali_cure 786 729 778
## 4 tumaco_failure_vs_cali_failure 638 492 518
## edger_sigdown limma_sigup limma_sigdown
## 1 13 38 5
## 2 139 24 37
## 3 784 646 716
## 4 540 395 570## Plot describing unique/shared genes in a differential expression table.
tc_monocytes_sig_nobatch <- extract_significant_genes(
tc_monocytes_table_nobatch,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_sig_nobatch-v{ver}.xlsx"))## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_vartc_monocytes_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 38 5 32 13 16 20 92
## tumaco 24 37 60 139 48 121 0
## cure 646 716 778 784 786 729 0
## fail 395 570 518 540 638 492 0
## ebseq_down basic_up basic_down
## cali 23 0 0
## tumaco 0 336 0
## cure 0 6383 0
## fail 0 2167 0
3.4.2 DE: Compare clinics, monocytes with svaseq
In contrast, the following comparison should give a view of the data corresponding to the svaseq PCA plot above. In the best case scenario, we should therefore be able to see some significane differences between the Tumaco cure and fail samples.
tc_monocytes_de_sva <- all_pairwise(tc_monocytes, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.tc_monocytes_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_monocytes_table_sva <- combine_de_tables(
tc_monocytes_de_sva, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_table_sva-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for tumaco using ebseq does not appear in the pairwise data.## coefficient ebseq did not find tumaco_cure or tumaco_failure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for cure using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_cure or tumaco_cure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for fail using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_failure or tumaco_failure.tc_monocytes_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 28 36 40
## 2 tumaco_failure_vs_tumaco_cure 34 86 29
## 3 tumaco_cure_vs_cali_cure 761 732 713
## 4 tumaco_failure_vs_cali_failure 684 584 583
## edger_sigdown limma_sigup limma_sigdown
## 1 17 52 7
## 2 70 14 57
## 3 762 640 663
## 4 623 434 567## Plot describing unique/shared genes in a differential expression table.
tc_monocytes_sig_sva <- extract_significant_genes(
tc_monocytes_table_sva,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_sig_sva-v{ver}.xlsx"))## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_vartc_monocytes_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 52 7 40 17 28 36 92
## tumaco 14 57 29 70 34 86 0
## cure 640 663 713 762 761 732 0
## fail 434 567 583 623 684 584 0
## ebseq_down basic_up basic_down
## cali 23 0 0
## tumaco 0 336 0
## cure 0 6383 0
## fail 0 2167 0
3.4.3 DE Compare: How similar are the no-batch vs. SVA results?
The following block shows that these two results are exceedingly different, sugesting that the Cali cure/fail and Tumaco cure/fail cannot easily be considered in the same analysis. I did some playing around with my calculate_aucc function in this block and found that it is in some important way broken, at least if one expands the top-n genes to more than 20% of the number of genes in the data.
cali_table <- tc_monocytes_table_nobatch[["data"]][["cali"]]
table <- tc_monocytes_table_nobatch[["data"]][["tumaco"]]
cali_aucc <- calculate_aucc(cali_table, table, px = "deseq_adjp", py = "deseq_adjp",
lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc## These two tables have an aucc value of: 0.0659267365585479 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 1.2, df = 11106, p-value = 0.2
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.006843 0.030345
## sample estimates:
## cor
## 0.01175
cali_table_sva <- tc_monocytes_table_sva[["data"]][["cali"]]
tumaco_table_sva <- tc_monocytes_table_sva[["data"]][["tumaco"]]
cali_aucc_sva <- calculate_aucc(cali_table_sva, tumaco_table_sva, px = "deseq_adjp",
py = "deseq_adjp", lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc_sva## These two tables have an aucc value of: 0.0842668799254026 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 16, df = 11106, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.1356 0.1719
## sample estimates:
## cor
## 0.1538
3.5 DE: Compare clinics, neutrophil samples
tc_neutrophils_de_nobatch <- all_pairwise(tc_neutrophils, parallel = parallel,
model_batch = FALSE, filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.tc_neutrophils_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_neutrophils_table_nobatch <- combine_de_tables(
tc_neutrophils_de_nobatch, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_table_nobatch-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for tumaco using ebseq does not appear in the pairwise data.## coefficient ebseq did not find tumaco_cure or tumaco_failure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for cure using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_cure or tumaco_cure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for fail using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_failure or tumaco_failure.tc_neutrophils_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 33 83 42
## 2 tumaco_failure_vs_tumaco_cure 95 50 112
## 3 tumaco_cure_vs_cali_cure 910 337 934
## 4 tumaco_failure_vs_cali_failure 984 257 808
## edger_sigdown limma_sigup limma_sigdown
## 1 32 37 10
## 2 57 7 12
## 3 342 630 520
## 4 283 380 462## Plot describing unique/shared genes in a differential expression table.
tc_neutrophils_sig_nobatch <- extract_significant_genes(
tc_neutrophils_table_nobatch,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_sig_nobatch-v{ver}.xlsx"))## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_vartc_neutrophils_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 37 10 42 32 33 83 91
## tumaco 7 12 112 57 95 50 0
## cure 630 520 934 342 910 337 0
## fail 380 462 808 283 984 257 0
## ebseq_down basic_up basic_down
## cali 38 0 0
## tumaco 0 7 0
## cure 0 4601 0
## fail 0 1651 0
tc_neutrophils_de_sva <- all_pairwise(tc_neutrophils, parallel = parallel,
model_batch = "svaseq", filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_cure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## The contrast tumaco_failure is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_cure and ebseq,
## tumaco_cure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_cure and ebseq,
## tumaco_failure_vs_cali_cure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_cure_vs_cali_failure and ebseq,
## tumaco_cure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_cali_failure and ebseq,
## tumaco_failure_vs_cali_failure failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, tumaco_failure_vs_tumaco_cure and ebseq,
## tumaco_failure_vs_tumaco_cure failed.
tc_neutrophils_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_neutrophils_table_sva <- combine_de_tables(
tc_neutrophils_de_sva, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_table_sva-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for tumaco using ebseq does not appear in the pairwise data.## coefficient ebseq did not find tumaco_cure or tumaco_failure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for cure using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_cure or tumaco_cure.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for fail using ebseq does not appear in the pairwise data.## coefficient ebseq did not find cali_failure or tumaco_failure.tc_neutrophils_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 91 181 103
## 2 tumaco_failure_vs_tumaco_cure 86 38 72
## 3 tumaco_cure_vs_cali_cure 844 379 843
## 4 tumaco_failure_vs_cali_failure 696 197 608
## edger_sigdown limma_sigup limma_sigdown
## 1 122 75 50
## 2 23 37 47
## 3 367 645 481
## 4 214 310 325## Plot describing unique/shared genes in a differential expression table.
tc_neutrophils_sig_sva <- extract_significant_genes(
tc_neutrophils_table_sva,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_sig_sva-v{ver}.xlsx"))## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_var## There is no ebseq_logfc column in the table.## The columns are: ensembl_gene_id, ensembl_transcript_id, version, transcript_version, description, gene_biotype, cds_length, chromosome_name, strand, start_position, end_position, hgnc_symbol, uniprot_gn_symbol, transcript, mean_cds_len, basic_logfc, basic_adjp, deseq_logfc, deseq_adjp, dream_logfc, dream_adjp, edger_logfc, edger_adjp, limma_logfc, limma_adjp, noiseq_logfc, noiseq_adjp, basic_num, basic_den, basic_numvar, basic_denvar, basic_t, basic_p, deseq_basemean, deseq_lfcse, deseq_stat, deseq_p, deseq_num, deseq_den, dream_ave, dream_t, dream_p, dream_b, edger_logcpm, edger_lr, edger_p, limma_ave, limma_t, limma_p, limma_b, noiseq_num, noiseq_den, noiseq_mean, noiseq_theta, noiseq_prob, noiseq_p, limma_adjp_ihw, dream_adjp_ihw, deseq_adjp_ihw, edger_adjp_ihw, basic_adjp_ihw, noiseq_adjp_ihw, lfc_meta, lfc_var, lfc_varbymed, p_meta, p_vartc_neutrophils_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 75 50 103 122 91 181 91
## tumaco 37 47 72 23 86 38 0
## cure 645 481 843 367 844 379 0
## fail 310 325 608 214 696 197 0
## ebseq_down basic_up basic_down
## cali 38 0 0
## tumaco 0 7 0
## cure 0 4601 0
## fail 0 1651 0
3.6 GSEA: Extract clinic-specific genes
Given the above comparisons, we can extract some gene sets which resulted from those DE analyses and eventually perform some ontology/KEGG/reactome/etc searches. This reminds me, I want to make my extract_significant_ functions to return gene-set data structures and my various ontology searches to take them as inputs. This should help avoid potential errors when extracting up/down genes.
clinic_sigenes_up <- rownames(tc_all_clinic_sig_sva[["deseq"]][["ups"]][["clinics"]])
clinic_sigenes_down <- rownames(tc_all_clinic_sig_sva[["deseq"]][["downs"]][["clinics"]])
clinic_sigenes <- c(clinic_sigenes_up, clinic_sigenes_down)
tc_eosinophils_sigenes_up <- rownames(tc_eosinophils_clinic_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_eosinophils_sigenes_down <- rownames(tc_eosinophils_clinic_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_monocytes_sigenes_up <- rownames(tc_monocytes_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_monocytes_sigenes_down <- rownames(tc_monocytes_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_neutrophils_sigenes_up <- rownames(tc_neutrophils_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_neutrophils_sigenes_down <- rownames(tc_neutrophils_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_eosinophils_sigenes <- c(tc_eosinophils_sigenes_up,
tc_eosinophils_sigenes_down)
tc_monocytes_sigenes <- c(tc_monocytes_sigenes_up,
tc_monocytes_sigenes_down)
tc_neutrophils_sigenes <- c(tc_neutrophils_sigenes_up,
tc_neutrophils_sigenes_down)3.7 GSEA: gProfiler of genes deemed up/down when comparing Cali and Tumaco
I was curious to try to understand why the two clinics appear to be so different vis a vis their PCA/DE; so I thought that gProfiler might help boil those results down to something more digestible.
3.7.1 GSEA: Compare clinics, all samples
Note that in the following block I used the function simple_gprofiler(), but later in this document I will use all_gprofiler(). The first invocation limits the search to a single table, while the second will iterate over every result in a pairwise differential expression analysis.
In this instance, we are looking at the vector of gene IDs deemed significantly different between the two clinics in either the up or down direction.
One other thing worth noting, the new version of gProfiler provides some fun interactive plots. I will add an example here.
tc_eosinophil_gprofiler <- simple_gprofiler(
tc_eosinophils_sigenes_up,
excel = glue("{gsea_prefix}/eosinophil_clinics_tumaco_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_eosinophil_gprofiler## A set of ontologies produced by gprofiler using 777
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 20 MF
## 195 BP
## 0 KEGG
## 2 REAC
## 0 WP
## 540 TF
## 6 MIRNA
## 0 HPA
## 2 CORUM
## 0 HP hits.clinic_gp <- simple_gprofiler(
clinic_sigenes,
excel = glue("{gsea_prefix}/both_clinics_cali_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eeclinic_gp$pvalue_plots$REAC
clinic_gp$pvalue_plots$BP## NULLclinic_gp$pvalue_plots$TF
clinic_gp$interactive_plots$GO## NULL3.7.2 GSEA: Compare clinics, Eosinophil samples
In the following block, I am looking at the gProfiler over represented groups observed across clinics in only the Eosinophils. First I do so for all genes(up or down), followed by only the up and down groups. Each of the following will include only the Reactome and GO:BP plots. These searches did not have too many other hits, excepting the transcription factor database.
tc_eosinophils_gp <- simple_gprofiler(
tc_eosinophils_sigenes,
excel = glue("{gsea_prefix}/eosinophil_clinics-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_eosinophils_gp## A set of ontologies produced by gprofiler using 1585
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 39 MF
## 247 BP
## 0 KEGG
## 5 REAC
## 0 WP
## 563 TF
## 10 MIRNA
## 0 HPA
## 5 CORUM
## 0 HP hits.tc_eosinophils_gp$pvalue_plots$REAC
tc_eosinophils_gp$pvalue_plots$BP## NULLtc_eosinophils_up_gp <- simple_gprofiler(
tc_eosinophils_sigenes_up,
excel = glue("{gsea_prefix}/eosinophil_clinics_tumaco_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_eosinophils_up_gp## A set of ontologies produced by gprofiler using 777
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 20 MF
## 195 BP
## 0 KEGG
## 2 REAC
## 0 WP
## 540 TF
## 6 MIRNA
## 0 HPA
## 2 CORUM
## 0 HP hits.tc_eosinophils_up_gp$pvalue_plots$REAC
tc_eosinophils_down_gp <- simple_gprofiler(
tc_eosinophils_sigenes_down,
excel = glue("{gsea_prefix}/eosinophil_clinics_cali_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_eosinophils_down_gp## A set of ontologies produced by gprofiler using 808
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 14 MF
## 94 BP
## 0 KEGG
## 9 REAC
## 1 WP
## 77 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.tc_eosinophils_down_gp$pvalue_plots$REAC
3.7.3 GSEA: Compare clinics, Monocyte samples
In the following block I repeated the above query, but this time looking at the monocyte samples.
tc_monocytes_up_gp <- simple_gprofiler(
tc_monocytes_sigenes,
excel = glue("{gsea_prefix}/monocyte_clinics-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_monocytes_up_gp## A set of ontologies produced by gprofiler using 1493
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 53 MF
## 470 BP
## 0 KEGG
## 5 REAC
## 7 WP
## 495 TF
## 2 MIRNA
## 0 HPA
## 1 CORUM
## 0 HP hits.tc_monocytes_up_gp$pvalue_plots$REAC
tc_monocytes_up_gp$pvalue_plots$BP## NULLtc_monocytes_down_gp <- simple_gprofiler(
tc_monocytes_sigenes_down,
excel = glue("{gsea_prefix}/monocyte_clinics_cali_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_monocytes_down_gp$pvalue_plots$REAC
tc_monocytes_down_gp$pvalue_plots$BP## NULL3.7.3.1 GSEA: Compare clinics, Neutrophil samples
Ibid. This time looking at the Neutrophils. Thus the first two images should be a superset of the second and third pairs of images; assuming that the genes in the up/down list do not cause the groups to no longer be significant. Interestingly, the reactome search did not return any hits for the increased search.
tc_neutrophils_gp <- simple_gprofiler(
tc_neutrophils_sigenes,
excel = glue("{gsea_prefix}/neutrophil_clinics-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee## tc_neutrophils_gp$pvalue_plots$REAC ## no hits
tc_neutrophils_gp$pvalue_plots$BP## NULLtc_neutrophils_gp$pvalue_plots$TF
tc_neutrophils_up_gp <- simple_gprofiler(
tc_neutrophils_sigenes_up,
excel = glue("{gsea_prefix}/neutrophil_clinics_tumaco_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee## tc_neutrophils_up_gp$pvalue_plots$REAC ## No hits
tc_neutrophils_up_gp$pvalue_plots$BP## NULLtc_neutrophils_down_gp <- simple_gprofiler(
tc_neutrophils_sigenes_down,
excel = glue("{gsea_prefix}/neutrophil_clinics_cali_up-v{ver}.xlsx"))## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_neutrophils_down_gp$pvalue_plots$REAC
tc_neutrophils_down_gp$pvalue_plots$BP## NULL4 Compare DE: How similar are Tumaco C/F vs. Cali C/F
The following expands the cross-clinic query above to also test the neutrophils. Once again, I think it will pretty strongly support the hypothesis that the two clinics are not compatible.
We are concerned that the clinic-based batch effect may make our results essentially useless. One way to test this concern is to compare the set of genes observed different between the Cali Cure/Fail vs. the Tumaco Cure/Fail.
cali_table_nobatch <- tc_neutrophils_table_nobatch[["data"]][["cali"]]
tumaco_table_nobatch <- tc_neutrophils_table_nobatch[["data"]][["tumaco"]]
cali_merged_nobatch <- merge(cali_table_nobatch, tumaco_table_nobatch, by="row.names")
cor.test(cali_merged_nobatch[, "deseq_logfc.x"], cali_merged_nobatch[, "deseq_logfc.y"])##
## Pearson's product-moment correlation
##
## data: cali_merged_nobatch[, "deseq_logfc.x"] and cali_merged_nobatch[, "deseq_logfc.y"]
## t = -16, df = 9242, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.1798 -0.1401
## sample estimates:
## cor
## -0.16cali_aucc_nobatch <- calculate_aucc(cali_table_nobatch, tumaco_table_nobatch, px = "deseq_adjp",
py = "deseq_adjp", lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc_nobatch$plot
5 Tumaco and Cali, cure vs. fail
In all of the above, we are looking to understand the differences between the two location. Let us now step back and perform the original question: fail/cure without regard to location.
I performed this query with a few different parameters, notably with(out) sva and again using each cell type, including biopsies. The main reasion I am keeping these comparisons is in the relatively weak hope that there will be sufficient signal in the full dataset that it might be able to overcome the apparently ridiculous batch effect from the two clinics.
5.1 All cell types together, with(out) SVA
table(pData(tc_valid)[["condition"]])##
## cure failure
## 122 62tc_all_cf_de_sva <- all_pairwise(tc_valid, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 122 62## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_all_cf_table_sva <- combine_de_tables(
tc_all_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_table_sva-v{ver}.xlsx"))
tc_all_cf_sig_sva <- extract_significant_genes(
tc_all_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_sig_sva-v{ver}.xlsx"))
tc_all_cf_de_batch <- all_pairwise(tc_valid, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 122 62
##
## v3 v2 v1
## 51 50 83## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_all_cf_table_batch <- combine_de_tables(
tc_all_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_table_batch-v{ver}.xlsx"))
tc_all_cf_sig_batch <- extract_significant_genes(
tc_all_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_sig_batch-v{ver}.xlsx"))5.2 All cell types except biopsies
I am not sure if this is the best choice, but I call the set of all samples excluding biopsies ‘clinical’.
table(pData(tc_clinical_nobiop)[["condition"]])##
## cure failure
## 109 57tc_clinical_cf_de_sva <- all_pairwise(tc_clinical_nobiop, filter = TRUE,
model_batch = "svaseq",
methods = methods)##
## cure failure
## 109 57## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_clinical_cf_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## basic_vs_deseq 0.8865
## basic_vs_dream 0.9294
## basic_vs_ebseq 0.7583
## basic_vs_edger 0.9008
## basic_vs_limma 0.9413
## basic_vs_noiseq 0.9206
## deseq_vs_dream 0.9004
## deseq_vs_ebseq 0.8258
## deseq_vs_edger 0.9918
## deseq_vs_limma 0.8939
## deseq_vs_noiseq 0.9403
## dream_vs_ebseq 0.8097
## dream_vs_edger 0.9029
## dream_vs_limma 0.9855
## dream_vs_noiseq 0.8710
## ebseq_vs_edger 0.8175
## ebseq_vs_limma 0.8180
## ebseq_vs_noiseq 0.8311
## edger_vs_limma 0.8974
## edger_vs_noiseq 0.9512
## limma_vs_noiseq 0.8734tc_clinical_cf_table_sva <- combine_de_tables(
tc_clinical_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_table_sva-v{ver}.xlsx"))
tc_clinical_cf_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 186 96 214 93
## limma_sigup limma_sigdown
## 1 97 79## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_clinical_cf_sig_sva <- extract_significant_genes(
tc_clinical_cf_table_sva, according_to = "deseq",
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_sig_sva-v{ver}.xlsx"))
tc_clinical_cf_sig_sva## A set of genes deemed significant according to deseq.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## deseq_up deseq_down
## outcome 186 96
tc_clinical_cf_de_batch <- all_pairwise(tc_clinical_nobiop, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 109 57
##
## eosinophils monocytes neutrophils
## 41 63 62## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_clinical_cf_de_batch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: batch in model/limma.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## basic_vs_deseq 0.6416
## basic_vs_dream 0.7018
## basic_vs_ebseq 0.7583
## basic_vs_edger 0.6418
## basic_vs_limma 0.7121
## basic_vs_noiseq 0.9206
## deseq_vs_dream 0.8032
## deseq_vs_ebseq 0.7638
## deseq_vs_edger 0.9991
## deseq_vs_limma 0.8070
## deseq_vs_noiseq 0.7624
## dream_vs_ebseq 0.6724
## dream_vs_edger 0.8087
## dream_vs_limma 0.9718
## dream_vs_noiseq 0.6697
## ebseq_vs_edger 0.7635
## ebseq_vs_limma 0.6891
## ebseq_vs_noiseq 0.8311
## edger_vs_limma 0.8115
## edger_vs_noiseq 0.7625
## limma_vs_noiseq 0.6686tc_clinical_cf_table_batch <- combine_de_tables(
tc_clinical_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_table_batch-v{ver}.xlsx"))
tc_clinical_cf_table_batch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 106 68 116 74
## limma_sigup limma_sigdown
## 1 83 45## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_clinical_cf_sig_batch <- extract_significant_genes(
tc_clinical_cf_table_batch, according_to = "deseq",
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_sig_batch-v{ver}.xlsx"))
tc_clinical_cf_sig_batch## A set of genes deemed significant according to deseq.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## deseq_up deseq_down
## outcome 106 68
5.2.1 A portion of Supplemental Figure 11.
num_color <- color_choices[["cf"]][["cure"]]
den_color <- color_choices[["cf"]][["failure"]]
tc_clinical_cf_table <- tc_clinical_cf_table_sva[["data"]][["outcome"]]
tc_clinical_cf_volcano_top10 <- plot_volcano_condition_de(
tc_clinical_cf_table, "outcome", label = 10,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = "figures/s11c_tc_clinical_cf_volcano_labeled_top10.svg")
tc_clinical_cf_volcano_top10[["plot"]]
dev.off()## png
## 2tc_clinical_cf_volcano_top10[["plot"]]
5.3 Biopsies, with(out) SVA
In the following block, we repeat the same question, but using only the biopsy samples from both clinics.
tc_biopsies_cf <- set_expt_conditions(tc_biopsies, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 13 5tc_biopsies_cf_de_sva <- all_pairwise(tc_biopsies_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 13 5## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_biopsies_cf_table_sva <- combine_de_tables(
tc_biopsies_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Biopsies/tc_biopsies_cf_table_sva-v{ver}.xlsx"))
tc_biopsies_cf_sig_sva <- extract_significant_genes(
tc_biopsies_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_sig_sva-v{ver}.xlsx"))
tc_biopsies_cf_de_batch <- all_pairwise(tc_biopsies_cf, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 13 5
##
## v1
## 18## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_biopsies_cf_table_batch <- combine_de_tables(
tc_biopsies_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_table_batch-v{ver}.xlsx"))
tc_biopsies_cf_sig_batch <- extract_significant_genes(
tc_biopsies_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_sig_batch-v{ver}.xlsx"))5.4 Eosinophils, with(out) SVA
In the following block, we repeat the same question, but using only the Eosinophil samples from both clinics.
tc_eosinophils_cf <- set_expt_conditions(tc_eosinophils, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 32 9tc_eosinophils_cf_de_sva <- all_pairwise(tc_eosinophils_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 32 9## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_eosinophils_cf_table_sva <- combine_de_tables(
tc_eosinophils_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/tc_eosinophils_cf_table_sva-v{ver}.xlsx"))
tc_eosinophils_cf_sig_sva <- extract_significant_genes(
tc_eosinophils_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_sig_sva-v{ver}.xlsx"))
tc_eosinophils_cf_de_batch <- all_pairwise(tc_eosinophils_cf, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 32 9
##
## v3 v2 v1
## 13 14 14## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_eosinophils_cf_table_batch <- combine_de_tables(
tc_eosinophils_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_table_batch-v{ver}.xlsx"))
tc_eosinophils_cf_sig_batch <- extract_significant_genes(
tc_eosinophils_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_sig_batch-v{ver}.xlsx"))5.5 Monocytes, with(out) SVA
Repeat yet again, this time with the monocyte samples. The idea is to see if there is a cell type which is particularly good (or bad) at discriminating the two clinics.
tc_monocytes_cf <- set_expt_conditions(tc_monocytes, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 39 24tc_monocytes_cf_de_sva <- all_pairwise(tc_monocytes_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 39 24## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_monocytes_cf_table_sva <- combine_de_tables(
tc_monocytes_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Monocytes/tc_monocytes_cf_table_sva-v{ver}.xlsx"))
tc_monocytes_cf_sig_sva <- extract_significant_genes(
tc_monocytes_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_sig_sva-v{ver}.xlsx"))
tc_monocytes_cf_de_batch <- all_pairwise(tc_monocytes_cf, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 39 24
##
## v3 v2 v1
## 19 18 26## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_monocytes_cf_table_batch <- combine_de_tables(
tc_monocytes_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_table_batch-v{ver}.xlsx"))
tc_monocytes_cf_sig_batch <- extract_significant_genes(
tc_monocytes_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_sig_batch-v{ver}.xlsx"))5.6 Neutrophils, with(out) SVA
Last try, this time using the Neutrophil samples.
tc_neutrophils_cf <- set_expt_conditions(tc_neutrophils, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 38 24tc_neutrophils_cf_de_sva <- all_pairwise(tc_neutrophils_cf, parallel = parallel,
filter = TRUE, model_batch = "svaseq",
methods = methods)##
## cure failure
## 38 24## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_neutrophils_cf_table_sva <- combine_de_tables(
tc_neutrophils_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/tc_neutrophils_cf_table_sva-v{ver}.xlsx"))
tc_neutrophils_cf_sig_sva <- extract_significant_genes(
tc_neutrophils_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_sig_sva-v{ver}.xlsx"))
tc_neutrophils_cf_de_batch <- all_pairwise(tc_neutrophils_cf, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 38 24
##
## v3 v2 v1
## 19 18 25## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_neutrophils_cf_table_batch <- combine_de_tables(
tc_neutrophils_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_table_batch-v{ver}.xlsx"))
tc_neutrophils_cf_sig_batch <- extract_significant_genes(
tc_neutrophils_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_sig_batch-v{ver}.xlsx"))6 Visit comparisons
Later in this document I do a bunch of visit/cf comparisons. In this block I want to explicitly only compare v1 to other visits. This is something I did quite a lot in the 2019 datasets, but never actually moved to this document.
v1_vs_later <- all_pairwise(tc_v1vs, model_batch = "svaseq", methods = methods,
filter = TRUE)##
## first later
## 65 101## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.v1_vs_later_table <- combine_de_tables(
v1_vs_later, keepers = visit_v1later,
excel = glue("{visit_prefix}/v1_vs_later_tables-v{ver}.xlsx"))
v1_vs_later_sig <- extract_significant_genes(
v1_vs_later_table,
excel = glue("{visit_prefix}/v1_vs_later_sig-v{ver}.xlsx"))6.0.0.1 GSEA: V1 vs other visits.
v1later_gp <- all_gprofiler(v1_vs_later_sig)## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eev1later_gp[[1]]$pvalue_plots$REAC
v1later_gp[[2]]$pvalue_plots$REAC
7 Sex comparison
tc_sex_de <- all_pairwise(tc_sex, model_batch = "svaseq", methods = methods,
filter = TRUE)##
## female male
## 28 156## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_sex_table <- combine_de_tables(
tc_sex_de, excel = glue("{sex_prefix}/tc_sex_table-v{ver}.xlsx"))
tc_sex_sig <- extract_significant_genes(
tc_sex_table, excel = glue("{sex_prefix}/tc_sex_sig-v{ver}.xlsx"))
tc_sex_gp <- all_gprofiler(tc_sex_sig)## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_sex_cure <- subset_expt(tc_sex, subset = "finaloutcome=='cure'")## subset_expt(): There were 184, now there are 122 samples.tc_sex_cure_de <- all_pairwise(tc_sex_cure, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## female male
## 19 103## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_sex_cure_de## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## mal_vs_fml
## basic_vs_deseq 0.6740
## basic_vs_dream 0.9121
## basic_vs_ebseq 0.5398
## basic_vs_edger 0.8003
## basic_vs_limma 0.9099
## basic_vs_noiseq 0.8159
## deseq_vs_dream 0.6763
## deseq_vs_ebseq 0.6490
## deseq_vs_edger 0.8641
## deseq_vs_limma 0.6481
## deseq_vs_noiseq 0.7503
## dream_vs_ebseq 0.6292
## dream_vs_edger 0.8070
## dream_vs_limma 0.9653
## dream_vs_noiseq 0.7585
## ebseq_vs_edger 0.6887
## ebseq_vs_limma 0.5899
## ebseq_vs_noiseq 0.6346
## edger_vs_limma 0.7769
## edger_vs_noiseq 0.8670
## limma_vs_noiseq 0.7196tc_sex_cure_table <- combine_de_tables(
tc_sex_cure_de, excel = glue("{sex_prefix}/tc_sex_cure_table-v{ver}.xlsx"))
tc_sex_cure_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 male_vs_female 70 74 64 80
## limma_sigup limma_sigdown
## 1 40 74## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_sex_cure_sig <- extract_significant_genes(
tc_sex_cure_table, excel = glue("{sex_prefix}/tc_sex_cure_sig-v{ver}.xlsx"))
tc_sex_cure_sig## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## male_vs_female 40 74 64 80 70 74
## ebseq_up ebseq_down basic_up basic_down
## male_vs_female 10 8 13 0
7.0.0.1 GSEA: Sex comparisons both clinics
tc_sex_cure_gp <- all_gprofiler(tc_sex_cure_sig)## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eetc_sex_cure_gp## Running gProfiler on every set of significant genes found:## BP CORUM HP HPA KEGG MIRNA MF REAC TF WP
## male_vs_female_up 3 0 1 0 0 0 1 0 3 1
## male_vs_female_down 3 0 0 0 0 0 0 1 0 0tc_sex_cure_gp[[1]][["pvalue_plots"]][["BP"]]## NULLtc_sex_cure_gp[[2]][["pvalue_plots"]][["BP"]]## NULL8 Ethnicity comparisons
tc_ethnicity_de <- all_pairwise(tc_etnia_expt, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## afrocol indigena mestiza
## 91 46 47## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast mestiza is not in the results.## If this is not an extra contrast, then this is an error.## The contrast mestiza is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, mestiza_vs_afrocol and ebseq,
## mestiza_vs_afrocol failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, mestiza_vs_indigena and ebseq,
## mestiza_vs_indigena failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, mestiza_vs_afrocol and ebseq,
## mestiza_vs_afrocol failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, mestiza_vs_indigena and ebseq,
## mestiza_vs_indigena failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, mestiza_vs_afrocol and ebseq,
## mestiza_vs_afrocol failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, mestiza_vs_indigena and ebseq,
## mestiza_vs_indigena failed.tc_ethnicity_de## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_ethnicity_table <- combine_de_tables(
tc_ethnicity_de, keepers = ethnicity_contrasts,
excel = glue("{eth_prefix}/tc_ethnicity_table-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for mestizo_indigenous using ebseq does not appear in the pairwise
## data.## coefficient ebseq did not find indigena or mestiza.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for mestizo_afrocol using ebseq does not appear in the pairwise data.## coefficient ebseq did not find afrocol or mestiza.tc_ethnicity_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 mestiza_vs_indigena 48 22 53 23
## 2 mestiza_vs_afrocol 51 171 58 180
## 3 indigena_vs_afrocol 67 269 72 280
## limma_sigup limma_sigdown
## 1 24 14
## 2 44 90
## 3 78 144## Plot describing unique/shared genes in a differential expression table.
tc_ethnicity_table[["plots"]][["mestizo_indigenous"]][["deseq_ma_plots"]]
tc_ethnicity_table[["plots"]][["mestizo_afrocol"]][["deseq_ma_plots"]]
tc_ethnicity_table[["plots"]][["indigenous_afrocol"]][["deseq_ma_plots"]]
tc_ethnicity_sig <- extract_significant_genes(
tc_ethnicity_table, excel = glue("{eth_prefix}/tc_ethnicity_sig-v{ver}.xlsx"))
ethnicity_cure <- subset_expt(tc_etnia_expt, subset = "finaloutcome=='cure'")## subset_expt(): There were 184, now there are 122 samples.ethnicity_cure_de <- all_pairwise(ethnicity_cure, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## afrocol indigena mestiza
## 39 36 47## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## The contrast mestiza is not in the results.## If this is not an extra contrast, then this is an error.## The contrast mestiza is not in the results.## If this is not an extra contrast, then this is an error.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, mestiza_vs_afrocol and ebseq,
## mestiza_vs_afrocol failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of basic, mestiza_vs_indigena and ebseq,
## mestiza_vs_indigena failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, mestiza_vs_afrocol and ebseq,
## mestiza_vs_afrocol failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of deseq, mestiza_vs_indigena and ebseq,
## mestiza_vs_indigena failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, mestiza_vs_afrocol and ebseq,
## mestiza_vs_afrocol failed.## Warning in correlate_de_tables(results, annot_df = annot_df, extra_contrasts =
## extra_contrasts): The merge of dream, mestiza_vs_indigena and ebseq,
## mestiza_vs_indigena failed.
ethnicity_cure_table <- combine_de_tables(
ethnicity_cure_de, keepers = ethnicity_contrasts,
excel = glue("{eth_prefix}/ethnicity_cure_table-v{ver}.xlsx"))## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for mestizo_indigenous using ebseq does not appear in the pairwise
## data.## coefficient ebseq did not find indigena or mestiza.## Warning in extract_keepers(extracted, keepers, table_names, all_coefficients, :
## The table for mestizo_afrocol using ebseq does not appear in the pairwise data.## coefficient ebseq did not find afrocol or mestiza.ethnicity_cure_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 mestiza_vs_indigena 64 24 60 26
## 2 mestiza_vs_afrocol 68 168 78 167
## 3 indigena_vs_afrocol 87 352 97 340
## limma_sigup limma_sigdown
## 1 36 15
## 2 63 100
## 3 109 180## Plot describing unique/shared genes in a differential expression table.
ethnicity_cure_table[["plots"]][["mestizo_indigenous"]][["deseq_ma_plots"]]
ethnicity_cure_table[["plots"]][["mestizo_afrocol"]][["deseq_ma_plots"]]
ethnicity_cure_table[["plots"]][["indigenous_afrocol"]][["deseq_ma_plots"]]
ethnicity_cure_sig <- extract_significant_genes(
ethnicity_cure_table, excel = glue("{eth_prefix}/ethnicity_cure_sig-v{ver}.xlsx"))
ethnicity_cure_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## mestizo_indigenous 36 15 60 26 64 24
## mestizo_afrocol 63 100 78 167 68 168
## indigenous_afrocol 109 180 97 340 87 352
## basic_up basic_down
## mestizo_indigenous 6 0
## mestizo_afrocol 41 0
## indigenous_afrocol 439 0
8.0.0.1 GSEA: Ethnicity differences
Performed once with both clinics and again with only Tumaco.
tc_ethnicity_gp <- all_gprofiler(tc_ethnicity_sig)## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.ee
## Error in gprofiler_request(url, body) :
## There's an issue with your request to g:Profiler.
## Error code: 400. API message: No legal source provided. Saw ['KEGG']
## Please double check your input. If this doesn't help, then check your internet connection or contact us with a reproducible example on biit.support@ut.eepander::pander(sessionInfo())R version 4.4.1 (2024-06-14)
Platform: x86_64-conda-linux-gnu
locale: C
attached base packages: stats4, stats, graphics, grDevices, utils, datasets, methods and base
other attached packages: edgeR(v.4.0.16), ruv(v.0.9.7.1), DOSE(v.3.28.2), forcats(v.1.0.0), dplyr(v.1.1.4), hpgltools(v.1.0), Matrix(v.1.6-5), glue(v.1.7.0), SummarizedExperiment(v.1.32.0), GenomicRanges(v.1.54.1), GenomeInfoDb(v.1.38.6), IRanges(v.2.36.0), S4Vectors(v.0.40.2), MatrixGenerics(v.1.14.0), matrixStats(v.1.2.0), Biobase(v.2.62.0) and BiocGenerics(v.0.48.1)
loaded via a namespace (and not attached): fs(v.1.6.3), bitops(v.1.0-7), enrichplot(v.1.22.0), blockmodeling(v.1.1.5), HDO.db(v.0.99.1), httr(v.1.4.7), RColorBrewer(v.1.1-3), numDeriv(v.2016.8-1.1), tools(v.4.4.1), backports(v.1.4.1), utf8(v.1.2.4), R6(v.2.5.1), lazyeval(v.0.2.2), mgcv(v.1.9-1), withr(v.3.0.0), gridExtra(v.2.3), preprocessCore(v.1.64.0), fdrtool(v.1.2.18), cli(v.3.6.2), scatterpie(v.0.2.1), labeling(v.0.4.3), slam(v.0.1-53), EBSeq(v.2.0.0), sass(v.0.4.8), mvtnorm(v.1.2-4), robustbase(v.0.99-4), genefilter(v.1.84.0), yulab.utils(v.0.1.7), ggupset(v.0.4.0), gson(v.0.1.0), R.utils(v.2.12.3), limma(v.3.58.1), RSQLite(v.2.3.5), gridGraphics(v.0.5-1), generics(v.0.1.3), gtools(v.3.9.5), crosstalk(v.1.2.1), zip(v.2.3.1), GO.db(v.3.18.0), fansi(v.1.0.6), abind(v.1.4-5), R.methodsS3(v.1.8.2), lifecycle(v.1.0.4), yaml(v.2.3.8), gplots(v.3.1.3.1), qvalue(v.2.34.0), SparseArray(v.1.2.4), grid(v.4.4.1), blob(v.1.2.4), promises(v.1.2.1), crayon(v.1.5.2), lattice(v.0.22-5), cowplot(v.1.1.3), annotate(v.1.80.0), KEGGREST(v.1.42.0), pillar(v.1.9.0), knitr(v.1.45), varhandle(v.2.0.6), fgsea(v.1.28.0), boot(v.1.3-29), corpcor(v.1.6.10), codetools(v.0.2-19), fastmatch(v.1.1-4), ggfun(v.0.1.8), data.table(v.1.15.0), Vennerable(v.3.1.0.9000), treeio(v.1.29.1), vctrs(v.0.6.5), png(v.0.1-8), Rdpack(v.2.6), testthat(v.3.2.1), gtable(v.0.3.4), cachem(v.1.0.8), xfun(v.0.42), openxlsx(v.4.2.5.2), rbibutils(v.2.2.16), S4Arrays(v.1.2.0), mime(v.0.12), RcppEigen(v.0.3.3.9.4), tidygraph(v.1.3.1), survival(v.3.5-8), iterators(v.1.0.14), NOISeq(v.2.46.0), statmod(v.1.5.0), ellipsis(v.0.3.2), nlme(v.3.1-164), pbkrtest(v.0.5.2), ggtree(v.3.15.0), bit64(v.4.0.5), EnvStats(v.2.8.1), UpSetR(v.1.4.0), rprojroot(v.2.0.4), bslib(v.0.6.1), KernSmooth(v.2.23-22), colorspace(v.2.1-0), DBI(v.1.2.2), DESeq2(v.1.42.0), tidyselect(v.1.2.0), bit(v.4.0.5), compiler(v.4.4.1), graph(v.1.80.0), desc(v.1.4.3), DelayedArray(v.0.28.0), plotly(v.4.10.4), shadowtext(v.0.1.3), scales(v.1.3.0), caTools(v.1.18.2), DEoptimR(v.1.1-3), remaCor(v.0.0.18), RBGL(v.1.78.0), stringr(v.1.5.1), digest(v.0.6.34), minqa(v.1.2.6), variancePartition(v.1.32.5), rmarkdown(v.2.25), aod(v.1.3.3), XVector(v.0.42.0), RhpcBLASctl(v.0.23-42), htmltools(v.0.5.7), pkgconfig(v.2.0.3), lme4(v.1.1-35.1), lpsymphony(v.1.30.0), highr(v.0.10), fastmap(v.1.1.1), rlang(v.1.1.3), htmlwidgets(v.1.6.4), shiny(v.1.8.0), farver(v.2.1.1), jquerylib(v.0.1.4), IHW(v.1.30.0), jsonlite(v.1.8.8), BiocParallel(v.1.36.0), GOSemSim(v.2.28.1), R.oo(v.1.26.0), RCurl(v.1.98-1.14), magrittr(v.2.0.3), GenomeInfoDbData(v.1.2.11), ggplotify(v.0.1.2), patchwork(v.1.2.0), munsell(v.0.5.0), Rcpp(v.1.0.12), ape(v.5.8), viridis(v.0.6.5), stringi(v.1.8.3), ggraph(v.2.1.0), brio(v.1.1.4), zlibbioc(v.1.48.0), MASS(v.7.3-60.0.1), plyr(v.1.8.9), parallel(v.4.4.1), ggrepel(v.0.9.5), Biostrings(v.2.70.2), graphlayouts(v.1.1.0), splines(v.4.4.1), pander(v.0.6.5), locfit(v.1.5-9.8), igraph(v.2.0.2), reshape2(v.1.4.4), pkgload(v.1.3.4), gprofiler2(v.0.2.3), XML(v.3.99-0.16.1), evaluate(v.0.23), BiocManager(v.1.30.25), nloptr(v.2.0.3), foreach(v.1.5.2), tweenr(v.2.0.2), httpuv(v.1.6.14), tidyr(v.1.3.1), purrr(v.1.0.2), polyclip(v.1.10-6), ggplot2(v.3.5.0), ggforce(v.0.4.2), broom(v.1.0.5), xtable(v.1.8-4), tidytree(v.0.4.6), fANCOVA(v.0.6-1), later(v.1.3.2), viridisLite(v.0.4.2), tibble(v.3.2.1), lmerTest(v.3.1-3), clusterProfiler(v.4.10.1), aplot(v.0.2.2), memoise(v.2.0.1), AnnotationDbi(v.1.64.1), sva(v.3.50.0) and GSEABase(v.1.64.0)
message("This is hpgltools commit: ", get_git_commit())## If you wish to reproduce this exact build of hpgltools, invoke the following:## > git clone http://github.com/abelew/hpgltools.git## > git reset 7487d3d43d097405835980651b6e01166a05b0e1## This is hpgltools commit: Fri Jan 24 18:09:58 2025 -0500: 7487d3d43d097405835980651b6e01166a05b0e1message("Saving to ", savefile)## Saving to 03differential_expression_both.rda.xz# tmp <- sm(saveme(filename = savefile))tmp <- loadme(filename = savefile)LS0tCnRpdGxlOiAiVE1SQzMgYHIgU3lzLmdldGVudignVkVSU0lPTicpYDogRGlmZmVyZW50aWFsIEV4cHJlc3Npb24gYW5hbHlzZXMiCmF1dGhvcjogImF0YiBhYmVsZXdAZ21haWwuY29tIgpkYXRlOiAiYHIgU3lzLkRhdGUoKWAiCnJ1bnRpbWU6IHNoaW55Cm91dHB1dDoKICBodG1sX2RvY3VtZW50OgogICAgY29kZV9kb3dubG9hZDogdHJ1ZQogICAgY29kZV9mb2xkaW5nOiBzaG93CiAgICBmaWdfY2FwdGlvbjogdHJ1ZQogICAgZmlnX2hlaWdodDogNwogICAgZmlnX3dpZHRoOiA3CiAgICBoaWdobGlnaHQ6IHplbmJ1cm4KICAgIGtlZXBfbWQ6IGZhbHNlCiAgICBtb2RlOiBzZWxmY29udGFpbmVkCiAgICBudW1iZXJfc2VjdGlvbnM6IHRydWUKICAgIHNlbGZfY29udGFpbmVkOiB0cnVlCiAgICB0aGVtZTogcmVhZGFibGUKICAgIHRvYzogdHJ1ZQogICAgdG9jX2Zsb2F0OgogICAgICBjb2xsYXBzZWQ6IGZhbHNlCiAgICAgIHNtb290aF9zY3JvbGw6IGZhbHNlCi0tLQoKPHN0eWxlIHR5cGU9InRleHQvY3NzIj4KYm9keSAubWFpbi1jb250YWluZXIgewogIG1heC13aWR0aDogMTYwMHB4Owp9CmJvZHksIHRkIHsKICBmb250LXNpemU6IDE2cHg7Cn0KY29kZS5yewogIGZvbnQtc2l6ZTogMTZweDsKfQpwcmUgewogIGZvbnQtc2l6ZTogMTZweAp9Cjwvc3R5bGU+CgpgYGB7ciBvcHRpb25zLCBpbmNsdWRlPUZBTFNFfQpsaWJyYXJ5KGhwZ2x0b29scykKbGlicmFyeShkcGx5cikKbGlicmFyeShmb3JjYXRzKQpsaWJyYXJ5KGdsdWUpCmxpYnJhcnkoRE9TRSkKCmtuaXRyOjpvcHRzX2tuaXQkc2V0KHByb2dyZXNzID0gVFJVRSwgdmVyYm9zZSA9IFRSVUUsIHdpZHRoID0gOTAsIGVjaG8gPSBUUlVFKQprbml0cjo6b3B0c19jaHVuayRzZXQoCiAgZXJyb3IgPSBUUlVFLCBmaWcud2lkdGggPSA4LCBmaWcuaGVpZ2h0ID0gOCwgZmlnLnJldGluYSA9IDIsCiAgb3V0LndpZHRoID0gIjEwMCUiLCBkZXYgPSAicG5nIiwKICBkZXYuYXJncyA9IGxpc3QocG5nID0gbGlzdCh0eXBlID0gImNhaXJvLXBuZyIpKSkKb2xkX29wdGlvbnMgPC0gb3B0aW9ucyhkaWdpdHMgPSA0LCBzdHJpbmdzQXNGYWN0b3JzID0gRkFMU0UsIGtuaXRyLmR1cGxpY2F0ZS5sYWJlbCA9ICJhbGxvdyIpCmdncGxvdDI6OnRoZW1lX3NldChnZ3Bsb3QyOjp0aGVtZV9idyhiYXNlX3NpemUgPSAxMikpCnZlciA8LSBTeXMuZ2V0ZW52KCJWRVJTSU9OIikKcGFyYWxsZWwgPC0gdG91cHBlcihTeXMuZ2V0ZW52KCJQQVJBTExFTCIpKQppZiAocGFyYWxsZWwgPT0gIiIgfHwgcGFyYWxsZWwgPT0gIlRSVUUiKSB7CiAgcGFyYWxsZWwgPC0gVFJVRQp9IGVsc2UgewogIHBhcmFsbGVsIDwtIEZBTFNFCn0KcnVuZGF0ZSA8LSBmb3JtYXQoU3lzLkRhdGUoKSwgZm9ybWF0ID0gIiVZJW0lZCIpCgpybWRfZmlsZSA8LSBnbHVlKCIwM2RpZmZlcmVudGlhbF9leHByZXNzaW9uX2JvdGguUm1kIikKc2F2ZWZpbGUgPC0gZ3N1YihwYXR0ZXJuID0gIlxcLlJtZCIsIHJlcGxhY2UgPSAiXFwucmRhXFwueHoiLCB4ID0gcm1kX2ZpbGUpCmxvYWRlZCA8LSBsb2FkKGZpbGUgPSBnbHVlKCJyZGEvdG1yYzNfZGF0YV9zdHJ1Y3R1cmVzLXZ7dmVyfS5yZGEiKSkKeGxzeF9wcmVmaXggPC0gImFuYWx5c2VzLzNfY2FsaV9hbmRfdHVtYWNvIgpjbGluaWNfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vREVfQ2xpbmljIikKY2xpbmljX2NmX3ByZWZpeCA8LSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX0NsaW5pY19DdXJlX0ZhaWwiKQpjZl9wcmVmaXggPC0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9DdXJlX0ZhaWwiKQp2aXNpdF9wcmVmaXggPC0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMiKQpzZXhfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vU2V4IikKZXRoX3ByZWZpeCA8LSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0V0aG5pY2l0eSIpCmdzZWFfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vR1NFQSIpCmBgYAoKIyBDaGFuZ2Vsb2cKCiogMjAyMzA5OiBEaXNhYmxlZCBHU1ZBIGFuYWx5c2VzIHVudGlsL3VubGVzcyB3ZSBnZXQgcGVybWlzc2lvbiB0bwogIGluY2x1ZGUgdGhlIG1TaWdEQiA3LjUuMSByZWxlYXNlLiAgSSB3aWxsIHNpbXBsaWZ5IHRoZSBmaWxlbmFtZXMgc28KICB0aGF0IG9uZSBtYXkgZWFzaWx5IGRyb3AgaW4gYSBkb3dubG9hZGVkIGNvcHkgb2YgdGhlIGRhdGEgYW5kIHJ1bgogIHRob3NlIGJsb2Nrcy4gIFVudGlsIHRoZW4sIEkgZ3Vlc3MgeW91IHdpbGwgaGF2ZSB0byB0cnVzdCBtZSB3aGVuIEkKICBzYXkgdGhvc2UgYmxvY2tzIGFsbCB3b3JrPwoqIDIwMjMwOTogTW92ZWQgYWxsIEdTRUEgYW5hbHlzZXMgdG8gMDRscnRfZ3NlYV9nc3ZhLlJtZAoqIDIwMjMwOSBuZXh0IGRheTogTW92aW5nIEdTRUEgYmFjayBiZWNhdXNlIGl0IGFkZHMgdG9vIG11Y2gKICBjb21wbGV4aXR5IHRvIHNhdmUvcmVsb2FkIHRoZSBERSByZXN1bHRzIGZvciBnUHJvZmlsZXIgYW5kIGZyaWVuZHMuCiogU3RpbGwgaHVudGluZyBmb3IgbWVzc2VkIHVwIGNvbG9ycywgY2hhbmdlZCBpbnB1dCBkYXRhIHRvIG1hdGNoIG5ldyB2ZXJzaW9uLgoKIyBJbnRyb2R1Y3Rpb24KClRoZSB2YXJpb3VzIGRpZmZlcmVudGlhbCBleHByZXNzaW9uIGFuYWx5c2VzIG9mIHRoZSBkYXRhIGdlbmVyYXRlZCBpbiB0bXJjM19kYXRhc2V0cwp3aWxsIG9jY3VyIGluIHRoaXMgZG9jdW1lbnQuCgojIyBOYW1pbmcgY29udmVudGlvbnMKCkkgYW0gZ29pbmcgdG8gdHJ5IHRvIHN0YW5kYXJkaXplIGhvdyBJIG5hbWUgdGhlIHZhcmlvdXMgZGF0YQpzdHJ1Y3R1cmVzIGNyZWF0ZWQgaW4gdGhpcyBkb2N1bWVudC4gIE1vc3Qgb2YgdGhlIGxhcmdlIGRhdGEgY3JlYXRlZAphcmUgZWl0aGVyIHNldHMgb2YgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzZXMsIHRoZWlyIGNvbWJpbmVkCnJlc3VsdHMsIG9yIHRoZSBzZXQgb2YgcmVzdWx0cyBkZWVtZWQgJ3NpZ25pZmljYW50Jy4KCkhvcGVmdWxseSBieSBub3cgdGhleSBhbGwgZm9sbG93IHRoZXNlIGd1aWRlbGluZXM6Cgp7Y2xpbmljKHMpfV9zYW1wbGUtc3Vic2V0fV97cHJpbWFyeS1xdWVzdGlvbihzKX1fe2RhdGF0eXBlfV97YmF0Y2gtbWV0aG9kfQoKKiB7Y2xpbmljfTogVGhpcyBpcyBlaXRoZXIgdGMgb3IgdCBmb3IgVHVtYWNvIGFuZCBDYWxpLCBvciBqdXN0ClR1bWFjby4KKiB7c2FtcGxlLXN1YnNldH06IFRoaW5ncyBsaWtlICdhbGwnIG9yICdtb25vY3l0ZXMnLgoqIHtwcmltYXJ5LXF1ZXN0aW9ufTogU2hvcnRoYW5kIG5hbWUgZm9yIHRoZSBwcmltYXJ5IGNvbnRyYXN0cwpwZXJmb3JtZWQsIHRodXMgJ2NsaW5pY3MnIHdvdWxkIHN1Z2dlc3QgYSBjb21wYXJpc29uIG9mIFR1bWFjbwp2cy4gQ2FsaS4gICd2aXNpdHMnIHdvdWxkIGNvbXBhcmUgdjIvdjEsIGV0Yy4KKiB7ZGF0YXR5cGV9OiBkZSwgdGFibGUsIHNpZwoqIHtiYXRjaC10eXBlfTogbm9iYXRjaCwgYmF0Y2h7ZmFjdG9yfSwgc3ZhLiAge2ZhY3Rvcn0gaW4gdGhpcwppbnN0YW5jZSBzaG91bGQgYmUgYSBjb2x1bW4gZnJvbSB0aGUgbWV0YWRhdGEuCgpXaXRoIHRoaXMgaW4gbWluZCwgJ3RjX2Jpb3BzaWVzX2NsaW5pY19kZV9zdmEnIHNob3VsZCBiZSB0aGUgVHVtYWNvK0NhbGkKYmlvcHN5IGRhdGEgYWZ0ZXIgcGVyZm9ybWluZyB0aGUgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzZXMKY29tcGFyaW5nIHRoZSBjbGluaWNzIHVzaW5nIHN2YS4KCkkgc3VzcGVjdCB0aGVyZSByZW1haW4gc29tZSBleGNlcHRpb25zIGFuZC9vciBlcnJvcnMuCgojIyBEZWZpbmUgY29udHJhc3RzIGZvciBERSBhbmFseXNlcwoKRWFjaCBvZiB0aGUgZm9sbG93aW5nIGxpc3RzIGRlc2NyaWJlcyB0aGUgc2V0IG9mIGNvbnRyYXN0cyB0aGF0IEkKdGhpbmsgYXJlIGludGVyZXN0aW5nIGZvciB0aGUgdmFyaW91cyB3YXlzIG9uZSBtaWdodCBjb25zaWRlciB0aGUKVE1SQzMgZGF0YXNldC4gIFRoZSB2YXJpYWJsZXMgYXJlIG5hbWVkIGFjY29yZGluZyB0byB0aGUgYXNzdW1lZCBkYXRhCndpdGggd2hpY2ggdGhleSB3aWxsIGJlIHVzZWQsIHRodXMgdGNfY2ZfY29udHJhc3RzIGlzIGV4cGVjdGVkIHRvIGJlCnVzZWQgZm9yIHRoZSBUdW1hY28rQ2FsaSBkYXRhIGFuZCBwcm92aWRlIGEgc2VyaWVzIG9mIGN1cmUvZmFpbApjb21wYXJpc29ucyB3aGljaCAodG8gdGhlIGV4dGVudCBwb3NzaWJsZSkgYWNyb3NzIGJvdGggbG9jYXRpb25zLiAgSW4KZXZlcnkgY2FzZSwgdGhlIG5hbWUgb2YgdGhlIGxpc3QgZWxlbWVudCB3aWxsIGJlIHVzZWQgYXMgdGhlIGNvbnRyYXN0Cm5hbWUsIGFuZCB3aWxsIHRodXMgYmUgc2VlbiBhcyB0aGUgc2hlZXQgbmFtZSBpbiB0aGUgb3V0cHV0IHhsc3gKZmlsZShzKTsgdGhlIHR3byBwaWVjZXMgb2YgdGhlIGNoYXJhY3RlciB2ZWN0b3IgdmFsdWUgYXJlIHRoZQpudW1lcmF0b3IgYW5kIGRlbm9taW5hdG9yIG9mIHRoZSBhc3NvY2lhdGVkIGNvbnRyYXN0LgoKIyMgR1NFQQoKVGhlIEdTRUEgYW5hbHlzZXMgd2lsbCBmb2xsb3cgZWFjaCBERSBhbmFseXNpcyBkdXJpbmcgdGhpcyBkb2N1bWVudC4KCk1vc3QgKGFsbD8pIG9mIHRoZSBHU0VBIGFuYWx5c2VzIHVzZWQgaW4gdGhpcyBwYXBlciB3ZXJlIGRvbmUgdmlhCmdQcm9maWxlciByYXRoZXIgdGhhbiBnb3NlcS9jbHVzdGVyUHJvZmlsZXIvdG9wR08vR09zdGF0cy4gIFByaW1hcmlseQpiZWNhdXNlIGl0IGlzIHNvIGVhc3kgdG8gaW52b2tlIGdwcm9maWxlci4KCmBgYHtyfQpjbGluaWNfY29udHJhc3RzIDwtIGxpc3QoCiAgImNsaW5pY3MiID0gYygiY2FsaSIsICJ0dW1hY28iKSkKIyMgSW4gc29tZSBjYXNlcyB3ZSBoYXZlIG5vIENhbGkgZmFpbHVyZSBzYW1wbGVzLCBzbyB0aGVyZSByZW1haW4gb25seSAyCiMjIGNvbnRyYXN0cyB0aGF0IGFyZSBsaWtlbHkgb2YgaW50ZXJlc3QKdGNfY2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgInR1bWFjbyIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJ0dW1hY29fY3VyZSIpLAogICJjdXJlIiA9IGMoInR1bWFjb19jdXJlIiwgImNhbGlfY3VyZSIpKQojIyBJbiBvdGhlciBjYXNlcywgd2UgaGF2ZSBjdXJlL2ZhaWwgZm9yIGJvdGggcGxhY2VzLgpjbGluaWNfY2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgImNhbGkiID0gYygiY2FsaV9mYWlsdXJlIiwgImNhbGlfY3VyZSIpLAogICJ0dW1hY28iID0gYygidHVtYWNvX2ZhaWx1cmUiLCAidHVtYWNvX2N1cmUiKSwKICAiY3VyZSIgPSBjKCJ0dW1hY29fY3VyZSIsICJjYWxpX2N1cmUiKSwKICAiZmFpbCIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJjYWxpX2ZhaWx1cmUiKSkKY2ZfY29udHJhc3QgPC0gbGlzdCgKICAib3V0Y29tZSIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJ0dW1hY29fY3VyZSIpKQp0X2NmX2NvbnRyYXN0IDwtIGxpc3QoCiAgIm91dGNvbWUiID0gYygiZmFpbHVyZSIsICJjdXJlIikpCnZpc2l0Y2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgInYxY2YiID0gYygidjFfZmFpbHVyZSIsICJ2MV9jdXJlIiksCiAgInYyY2YiID0gYygidjJfZmFpbHVyZSIsICJ2Ml9jdXJlIiksCiAgInYzY2YiID0gYygidjNfZmFpbHVyZSIsICJ2M19jdXJlIikpCnZpc2l0X2NvbnRyYXN0cyA8LSBsaXN0KAogICJ2MnYxIiA9IGMoImMyIiwgImMxIiksCiAgInYzdjEiID0gYygiYzMiLCAiYzEiKSwKICAidjN2MiIgPSBjKCJjMyIsICJjMiIpKQp2aXNpdF92MWxhdGVyIDwtIGxpc3QoCiAgImxhdGVyX3ZzX2ZpcnN0IiA9IGMoImxhdGVyIiwgImZpcnN0IikpCmNlbGx0eXBlcyA8LSBsaXN0KAogICJlb19tb25vIiA9IGMoImVvc2lub3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJuZV9tb25vIiA9IGMoIm5ldXRyb3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJlb19uZSIgPSBjKCJlb3Npbm9waGlscyIsICJuZXV0cm9waGlscyIpKQpldGhuaWNpdHlfY29udHJhc3RzIDwtIGxpc3QoCiAgIm1lc3Rpem9faW5kaWdlbm91cyIgPSBjKCJtZXN0aXphIiwgImluZGlnZW5hIiksCiAgIm1lc3Rpem9fYWZyb2NvbCIgPSBjKCJtZXN0aXphIiwgImFmcm9jb2wiKSwKICAiaW5kaWdlbm91c19hZnJvY29sIiA9IGMoImluZGlnZW5hIiwgImFmcm9jb2wiKSkKYGBgCgojIENvbXBhcmUgc2FtcGxlcyBieSBjbGluaWMKCiMjIERFOiBDb21wYXJlIGNsaW5pY3MsIGFsbCBzYW1wbGVzCgpQZXJmb3JtIGEgc3Zhc2VxLWd1aWRlZCBjb21wYXJpc29uIG9mIHRoZSB0d28gY2xpbmljcy4gIElkZWFsbHkgdGhpcwp3aWxsIGdpdmUgc29tZSBjbHVlIGFib3V0IGp1c3QgaG93IHN0cm9uZyB0aGUgY2xpbmljLWJhc2VkIGJhdGNoCmVmZmVjdCByZWFsbHkgaXMgYW5kIHdoYXQgaXRzIGNhdXNlcyBhcmUuCgpgYGB7cn0KdGNfY2xpbmljX3R5cGUgPC0gdGNfdmFsaWQgJT4lCiAgc2V0X2V4cHRfY29uZGl0aW9ucyhmYWN0ID0gImNsaW5pYyIpICU+JQogIHNldF9leHB0X2JhdGNoZXMoZmFjdCA9ICJ0eXBlb2ZjZWxscyIpCgp0YWJsZShwRGF0YSh0Y19jbGluaWNfdHlwZSlbWyJjb25kaXRpb24iXV0pCnRjX2FsbF9jbGluaWNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19jbGluaWNfdHlwZSwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19hbGxfY2xpbmljX2RlX3N2YQp0Y19hbGxfY2xpbmljX2RlX3N2YVtbImRlc2VxIl1dW1siY29udHJhc3RzX3BlcmZvcm1lZCJdXQoKdGNfYWxsX2NsaW5pY190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYWxsX2NsaW5pY19kZV9zdmEsIGtlZXBlcnMgPSBjbGluaWNfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19wcmVmaXh9L3RjX2FsbF9jbGluaWNfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2FsbF9jbGluaWNfdGFibGVfc3ZhCnRjX2FsbF9jbGluaWNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2FsbF9jbGluaWNfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19wcmVmaXh9L2NvbXBhcmVfY2xpbmljcy90Y19jbGluaWNfdHlwZV9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2FsbF9jbGluaWNfc2lnX3N2YQpgYGAKCiMjIyBHU0VBOiBjb21wYXJpbmcgdGhlIGNsaW5pY3MKCmBgYHtyfQppbmNyZWFzZWRfdHVtYWNvX2NhdGVnb3JpZXNfdXAgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19hbGxfY2xpbmljX3NpZ19zdmFbWyJkZXNlcSJdXVtbInVwcyJdXVtbImNsaW5pY3MiXV0sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L3R1bWFjb19jYXRlb2dpZXNfdXAtdnt2ZXJ9Lnhsc3giKSkKaW5jcmVhc2VkX3R1bWFjb19jYXRlZ29yaWVzX3VwCmluY3JlYXNlZF90dW1hY29fY2F0ZWdvcmllc191cFtbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCgppbmNyZWFzZWRfY2FsaV9jYXRlZ29yaWVzIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfYWxsX2NsaW5pY19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImNsaW5pY3MiXV0sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2NhbGlfY2F0ZW9naWVzX3VwLXZ7dmVyfS54bHN4IikpCmluY3JlYXNlZF9jYWxpX2NhdGVnb3JpZXMKaW5jcmVhc2VkX2NhbGlfY2F0ZWdvcmllc1tbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCmBgYAoKIyMjIFZpc3VhbGl6ZSBjbGluaWMgZGlmZmVyZW5jZXMKCkxldCB1cyB0YWtlIGEgcXVpY2sgbG9vayBhdCB0aGUgcmVzdWx0cyBvZiB0aGUgY29tcGFyaXNvbiBvZgpUdW1hY28vQ2FsaQoKTm90ZTogSSBrZWVwIHJlLWludHJvZHVjaW5nIGFuIGVycm9yIHdoaWNoIGNhdXNlcyB0aGVzZSAodm9sY2FubyBhbmQgTUEpIHBsb3RzIHRvIGJlCnJldmVyc2VkIHdpdGggcmVzcGVjdCB0byB0aGUgbG9nRkMgdmFsdWVzLiAgUGF5IGNhcmVmdWwgYXR0ZW50aW9uIHRvCnRoZXNlIGFuZCBtYWtlIHN1cmUgdGhhdCB0aGV5IGFncmVlIHdpdGggdGhlIG51bWJlcnMgb2YgZ2VuZXMgb2JzZXJ2ZWQKaW4gdGhlIGNvbnRyYXN0LgoKYGBge3J9CiMjIENoZWNrIHRoYXQgdXAgaXMgdXAKc3VtbWFyeSh0Y19hbGxfY2xpbmljX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJjbGluaWNzIl1dW1siZGVzZXFfbG9nZmMiXV0pCiMjIEkgdGhpbmsgd2UgY2FuIGFzc3VtZSB0aGF0IG1vc3QgZ2VuZXMgYXJlIGRvd24gd2hlbiBjb25zaWRlcmluZyBUdW1hY28vQ2FsaS4Kc3VtKHRjX2FsbF9jbGluaWNfdGFibGVfc3ZhJGRhdGEkY2xpbmljcyRkZXNlcV9sb2dmYyA8IC0xLjAgJgogICAgICB0Y19hbGxfY2xpbmljX3RhYmxlX3N2YSRkYXRhJGNsaW5pY3MkZGVzZXFfYWRqcCA8IDAuMDUpCnRjX2FsbF9jbGluaWNfdGFibGVfc3ZhW1sicGxvdHMiXV1bWyJjbGluaWNzIl1dW1siZGVzZXFfdm9sX3Bsb3RzIl1dCiMjIE9rLCBzbyBpdCBzYXlzIDE3OTQgdXAsIGJ1dCB0aGF0IGlzIGNsZWFybHkgdGhlIGRvd24gc2lkZS4uLiAgU29tZXRoaW5nIGlzIGRlZmluaXRlbHkgbWVzc2VkIHVwLgojIyBUaGUgcG9pbnRzIGFyZSBvbiB0aGUgY29ycmVjdCBzaWRlcyBvZiB0aGUgcGxvdCwgYnV0IHRoZSBjYXRlZ29yaWVzIG9mIHVwL2Rvd24gYXJlIHJldmVyc2VkLgojIyBUaGVyZXNhIG5vdGVkIHRoYXQgc2hlIGNvbG9ycyBkaWZmZXJlbnRseSwgYW5kIEkgdGhpbmsgYmV0dGVyOiBsZWZ0IHNpZGUgZ2V0cyBjYWxsZWQKIyMgJ2luY3JlYXNlZCBpbiBkZW5vbWluYXRvcicsIHJpZ2h0IHNpZGUgZ2V0cyBjYWxsZWQgJ2luY3JlYXNlZCBpbiBudW1lcmF0b3InOwojIyB0aGVzZSB0d28gZ3JvdXBzIGFyZSBjb2xvcmVkIGFjY29yZGluZyB0byB0aGVpciBjb25kaXRpb24gY29sb3JzLCBhbmQgZXZlcnl0aGluZyBlbHNlIGlzIGdyYXkuCiMjIEkgYW0gY2hlY2tpbmcgb3V0IFRoZXJlc2EncyBoZWxwZXJfZnVuY3Rpb25zLlIgdG8gZ2V0IGEgc2Vuc2Ugb2YgaG93IHNoZSBoYW5kbGVzIHRoaXMsIEkgdGhpbmsKIyMgSSBjYW4gdXNlIGEgdmFyaWFudCBvZiBoZXIgaWRlYSBwcmV0dHkgZWFzaWx5OgojIyAgMS4gIEFkZCBhIGNvbHVtbiAnU2lnbmlmaWNhbmNlJywgd2hpY2ggaXMgYSBmYWN0b3IsIGFuZCBjb250YWlucyBlaXRoZXIgJ05vdCBlbnJpY2hlZCcsCiMjICAgICAgJ0VucmljaGVkIGluIHgnLCBvciAnRW5yaWNoZWQgaW4geScgYWNjb3JkaW5nIHRvIHRoZSBsb2dmYy9hZGpwLgojIyAgMi4gIHVzZSB0aGUgc2lnbmlmaWNhbmNlIGNvbHVtbiBmb3IgdGhlIGdlb21fcG9pbnQgY29sb3IvZmlsbCBpbiB0aGUgdm9sY2FubyBwbG90LgojIyBNeSBjaGFuZ2UgdG8gdGhpcyBpZGVhIHdvdWxkIGJlIHRvIGV4dHJhY3QgdGhlIGNvbG9ycyBmcm9tIHRoZSBpbnB1dCBleHByZXNzaW9uc2V0LgpgYGAKClRoZXJlIGFwcGVhciB0byBiZSBtYW55IG1vcmUgZ2VuZXMgd2hpY2ggYXJlIGluY3JlYXNlZCBpbiB0aGUgVHVtYWNvCnNhbXBsZXMgd2l0aCByZXNwZWN0IHRvIHRoZSBDYWxpIHNhbXBsZXMuCgojIyBERTogQ29tcGFyZSBjbGluaWNzLCBlb3Npbm9waGlsIHNhbXBsZXMKClRoZSByZW1haW5pbmcgY2VsbCB0eXBlcyBhbGwgaGF2ZSBwcmV0dHkgc3Ryb25nIGNsaW5pYy1iYXNlZCB2YXJpYW5jZTsKYnV0IEkgYW0gbm90IGNlcnRhaW4gaWYgaXQgaXMgY29uc2lzdGVudCBhY3Jvc3MgY2VsbCB0eXBlcy4KCmBgYHtyfQp0YWJsZShwRGF0YSh0Y19lb3Npbm9waGlscylbWyJjb25kaXRpb24iXV0pCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9ub2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19lb3Npbm9waGlscywgcGFyYWxsZWwgPSBwYXJhbGxlbCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gRkFMU0UsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfZW9zaW5vcGhpbHNfY2xpbmljX2RlX25vYmF0Y2gKdGNfZW9zaW5vcGhpbHNfY2xpbmljX2RlX25vYmF0Y2hbWyJkZXNlcSJdXVtbImNvbnRyYXN0c19wZXJmb3JtZWQiXV0KCnRjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9ub2JhdGNoLCBrZWVwZXJzID0gdGNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfbm9iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9ub2JhdGNoLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfbm9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX25vYmF0Y2gKCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX2Vvc2lub3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcykKdGNfZW9zaW5vcGhpbHNfY2xpbmljX2RlX3N2YQp0Y19lb3Npbm9waGlsc19jbGluaWNfZGVfc3ZhW1siZGVzZXEiXV1bWyJjb250cmFzdHNfcGVyZm9ybWVkIl1dCgp0Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9zdmEsIGtlZXBlcnMgPSB0Y19jZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdGNfZW9zaW5vcGhpbHNfY2xpbmljX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfc3ZhCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfZW9zaW5vcGhpbHNfY2xpbmljX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Fb3Npbm9waGlscy90Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YQpgYGAKCiMjIERFOiBDb21wYXJlIGNsaW5pY3MsIGJpb3BzeSBzYW1wbGVzCgpJbnRlcmVzdGluZ2x5IHRvIG1lLCB0aGUgYmlvcHN5IHNhbXBsZXMgYXBwZWFyIHRvIGhhdmUgdGhlIGxlYXN0CmxvY2F0aW9uLWJhc2VkIHZhcmlhbmNlLiAgQnV0IHdlIGNhbiBwZXJmb3JtIGFuIGV4cGxpY2l0IERFIGFuZCBzZWUKaG93IHdlbGwgdGhhdCBoeXBvdGhlc2lzIGhvbGRzIHVwLgoKTm90ZSB0aGF0IHRoZXNlIGRhdGEgaW5jbHVkZSBjdXJlIGFuZCBmYWlsIHNhbXBsZXMgZm9yCgpgYGB7cn0KdGFibGUocERhdGEodGNfYmlvcHNpZXMpW1siY29uZGl0aW9uIl1dKQp0Y19iaW9wc2llc19jbGluaWNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19iaW9wc2llcywgcGFyYWxsZWwgPSBwYXJhbGxlbCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2Jpb3BzaWVzX2NsaW5pY19kZV9zdmEKdGNfYmlvcHNpZXNfY2xpbmljX2RlX3N2YVtbImRlc2VxIl1dW1siY29udHJhc3RzX3BlcmZvcm1lZCJdXQoKdGNfYmlvcHNpZXNfY2xpbmljX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19iaW9wc2llc19jbGluaWNfZGVfc3ZhLCBrZWVwZXJzID0gdGNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Jpb3BzaWVzL3RjX2Jpb3BzaWVzX2NsaW5pY190YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfYmlvcHNpZXNfY2xpbmljX3RhYmxlX3N2YQp0Y19iaW9wc2llc19jbGluaWNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Jpb3BzaWVzX2NsaW5pY190YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vQmlvcHNpZXMvdGNfYmlvcHNpZXNfY2xpbmljX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfYmlvcHNpZXNfY2xpbmljX3NpZ19zdmEKYGBgCgojIyBERTogQ29tcGFyZSBjbGluaWNzLCBtb25vY3l0ZSBzYW1wbGVzCgpBdCBsZWFzdCBmb3IgdGhlIG1vbWVudCwgSSBhbSBvbmx5IGxvb2tpbmcgYXQgdGhlIGRpZmZlcmVuY2VzIGJldHdlZW4Kbm8tYmF0Y2ggdnMuIHN2YSBhY3Jvc3MgY2xpbmljcyBmb3IgdGhlIG1vbm9jeXRlIHNhbXBsZXMuICBUaGlzCndhcyBjaG9zZW4gbW9zdGx5IGFyYml0cmFyaWx5LgoKIyMjIERFOiBDb21wYXJlIGNsaW5pY3MsIG1vbm9jeXRlcyB3aXRob3V0IGJhdGNoIGVzdGltYXRpb24KCk91ciBiYXNlbGluZSBpcyB0aGUgY29tcGFyaXNvbiBvZiB0aGUgbW9ub2N5dGVzIHNhbXBsZXMgd2l0aG91dCBiYXRjaAppbiB0aGUgbW9kZWwgb3Igc3Vycm9nYXRlIGVzdGltYXRpb24uICBJbiB0aGVvcnkgYXQgbGVhc3QsIHRoaXMgc2hvdWxkCmNvcnJlc3BvbmQgdG8gdGhlIFBDQSBwbG90IGFib3ZlIHdoZW4gbm8gYmF0Y2ggZXN0aW1hdGlvbiB3YXMgcGVyZm9ybWVkLgoKYGBge3J9CnRhYmxlKHBEYXRhKHRjX21vbm9jeXRlcylbWyJjb25kaXRpb24iXV0pCnRjX21vbm9jeXRlc19kZV9ub2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19tb25vY3l0ZXMsIG1vZGVsX2JhdGNoID0gRkFMU0UsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX21vbm9jeXRlc19kZV9ub2JhdGNoCgp0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19tb25vY3l0ZXNfZGVfbm9iYXRjaCwga2VlcGVycyA9IGNsaW5pY19jZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTW9ub2N5dGVzL3RjX21vbm9jeXRlc19jbGluaWNfdGFibGVfbm9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaAp0Y19tb25vY3l0ZXNfc2lnX25vYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Nb25vY3l0ZXMvdGNfbW9ub2N5dGVzX2NsaW5pY19zaWdfbm9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfc2lnX25vYmF0Y2gKYGBgCgojIyMgREU6IENvbXBhcmUgY2xpbmljcywgbW9ub2N5dGVzIHdpdGggc3Zhc2VxCgpJbiBjb250cmFzdCwgdGhlIGZvbGxvd2luZyBjb21wYXJpc29uIHNob3VsZCBnaXZlIGEgdmlldyBvZiB0aGUgZGF0YQpjb3JyZXNwb25kaW5nIHRvIHRoZSBzdmFzZXEgUENBIHBsb3QgYWJvdmUuICBJbiB0aGUgYmVzdCBjYXNlCnNjZW5hcmlvLCB3ZSBzaG91bGQgdGhlcmVmb3JlIGJlIGFibGUgdG8gc2VlIHNvbWUgc2lnbmlmaWNhbmUKZGlmZmVyZW5jZXMgYmV0d2VlbiB0aGUgVHVtYWNvIGN1cmUgYW5kIGZhaWwgc2FtcGxlcy4KCmBgYHtyfQp0Y19tb25vY3l0ZXNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19tb25vY3l0ZXMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19tb25vY3l0ZXNfZGVfc3ZhCgp0Y19tb25vY3l0ZXNfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX21vbm9jeXRlc19kZV9zdmEsIGtlZXBlcnMgPSBjbGluaWNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L01vbm9jeXRlcy90Y19tb25vY3l0ZXNfY2xpbmljX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfdGFibGVfc3ZhCnRjX21vbm9jeXRlc19zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfbW9ub2N5dGVzX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Nb25vY3l0ZXMvdGNfbW9ub2N5dGVzX2NsaW5pY19zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX21vbm9jeXRlc19zaWdfc3ZhCmBgYAoKIyMjIERFIENvbXBhcmU6IEhvdyBzaW1pbGFyIGFyZSB0aGUgbm8tYmF0Y2ggdnMuIFNWQSByZXN1bHRzPwoKVGhlIGZvbGxvd2luZyBibG9jayBzaG93cyB0aGF0IHRoZXNlIHR3byByZXN1bHRzIGFyZSBleGNlZWRpbmdseQpkaWZmZXJlbnQsIHN1Z2VzdGluZyB0aGF0IHRoZSBDYWxpIGN1cmUvZmFpbCBhbmQgVHVtYWNvIGN1cmUvZmFpbApjYW5ub3QgZWFzaWx5IGJlIGNvbnNpZGVyZWQgaW4gdGhlIHNhbWUgYW5hbHlzaXMuICBJIGRpZCBzb21lIHBsYXlpbmcKYXJvdW5kIHdpdGggbXkgY2FsY3VsYXRlX2F1Y2MgZnVuY3Rpb24gaW4gdGhpcyBibG9jayBhbmQgZm91bmQgdGhhdCBpdAppcyBpbiBzb21lIGltcG9ydGFudCB3YXkgYnJva2VuLCBhdCBsZWFzdCBpZiBvbmUgZXhwYW5kcyB0aGUgdG9wLW4KZ2VuZXMgdG8gbW9yZSB0aGFuIDIwJSBvZiB0aGUgbnVtYmVyIG9mIGdlbmVzIGluIHRoZSBkYXRhLgoKYGBge3J9CmNhbGlfdGFibGUgPC0gdGNfbW9ub2N5dGVzX3RhYmxlX25vYmF0Y2hbWyJkYXRhIl1dW1siY2FsaSJdXQp0YWJsZSA8LSB0Y19tb25vY3l0ZXNfdGFibGVfbm9iYXRjaFtbImRhdGEiXV1bWyJ0dW1hY28iXV0KCmNhbGlfYXVjYyA8LSBjYWxjdWxhdGVfYXVjYyhjYWxpX3RhYmxlLCB0YWJsZSwgcHggPSAiZGVzZXFfYWRqcCIsIHB5ID0gImRlc2VxX2FkanAiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgbHggPSAiZGVzZXFfbG9nZmMiLCBseSA9ICJkZXNlcV9sb2dmYyIpCmNhbGlfYXVjYwoKY2FsaV90YWJsZV9zdmEgPC0gdGNfbW9ub2N5dGVzX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJjYWxpIl1dCnR1bWFjb190YWJsZV9zdmEgPC0gdGNfbW9ub2N5dGVzX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJ0dW1hY28iXV0KY2FsaV9hdWNjX3N2YSA8LSBjYWxjdWxhdGVfYXVjYyhjYWxpX3RhYmxlX3N2YSwgdHVtYWNvX3RhYmxlX3N2YSwgcHggPSAiZGVzZXFfYWRqcCIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcHkgPSAiZGVzZXFfYWRqcCIsIGx4ID0gImRlc2VxX2xvZ2ZjIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQpjYWxpX2F1Y2Nfc3ZhCmBgYAoKIyMgREU6IENvbXBhcmUgY2xpbmljcywgbmV1dHJvcGhpbCBzYW1wbGVzCgpgYGB7cn0KdGNfbmV1dHJvcGhpbHNfZGVfbm9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfbmV1dHJvcGhpbHMsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gRkFMU0UsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19uZXV0cm9waGlsc19kZV9ub2JhdGNoCgp0Y19uZXV0cm9waGlsc190YWJsZV9ub2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX25ldXRyb3BoaWxzX2RlX25vYmF0Y2gsIGtlZXBlcnMgPSBjbGluaWNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfdGFibGVfbm9iYXRjaAp0Y19uZXV0cm9waGlsc19zaWdfbm9iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2gsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdGNfbmV1dHJvcGhpbHNfc2lnX25vYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfc2lnX25vYmF0Y2gKCnRjX25ldXRyb3BoaWxzX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfbmV1dHJvcGhpbHMsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfbmV1dHJvcGhpbHNfZGVfc3ZhCgp0Y19uZXV0cm9waGlsc190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfbmV1dHJvcGhpbHNfZGVfc3ZhLCBrZWVwZXJzID0gY2xpbmljX2NmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9OZXV0cm9waGlscy90Y19uZXV0cm9waGlsc190YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfdGFibGVfc3ZhCnRjX25ldXRyb3BoaWxzX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19uZXV0cm9waGlsc190YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdGNfbmV1dHJvcGhpbHNfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19uZXV0cm9waGlsc19zaWdfc3ZhCmBgYAoKIyMgR1NFQTogRXh0cmFjdCBjbGluaWMtc3BlY2lmaWMgZ2VuZXMKCkdpdmVuIHRoZSBhYm92ZSBjb21wYXJpc29ucywgd2UgY2FuIGV4dHJhY3Qgc29tZSBnZW5lIHNldHMgd2hpY2gKcmVzdWx0ZWQgZnJvbSB0aG9zZSBERSBhbmFseXNlcyBhbmQgZXZlbnR1YWxseSBwZXJmb3JtIHNvbWUKb250b2xvZ3kvS0VHRy9yZWFjdG9tZS9ldGMgc2VhcmNoZXMuICBUaGlzIHJlbWluZHMgbWUsIEkgd2FudCB0byBtYWtlCm15IGV4dHJhY3Rfc2lnbmlmaWNhbnRfIGZ1bmN0aW9ucyB0byByZXR1cm4gZ2VuZS1zZXQgZGF0YSBzdHJ1Y3R1cmVzCmFuZCBteSB2YXJpb3VzIG9udG9sb2d5IHNlYXJjaGVzIHRvIHRha2UgdGhlbSBhcyBpbnB1dHMuICBUaGlzIHNob3VsZApoZWxwIGF2b2lkIHBvdGVudGlhbCBlcnJvcnMgd2hlbiBleHRyYWN0aW5nIHVwL2Rvd24gZ2VuZXMuCgpgYGB7cn0KY2xpbmljX3NpZ2VuZXNfdXAgPC0gcm93bmFtZXModGNfYWxsX2NsaW5pY19zaWdfc3ZhW1siZGVzZXEiXV1bWyJ1cHMiXV1bWyJjbGluaWNzIl1dKQpjbGluaWNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX2FsbF9jbGluaWNfc2lnX3N2YVtbImRlc2VxIl1dW1siZG93bnMiXV1bWyJjbGluaWNzIl1dKQpjbGluaWNfc2lnZW5lcyA8LSBjKGNsaW5pY19zaWdlbmVzX3VwLCBjbGluaWNfc2lnZW5lc19kb3duKQoKdGNfZW9zaW5vcGhpbHNfc2lnZW5lc191cCA8LSByb3duYW1lcyh0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YVtbImRlc2VxIl1dW1sidXBzIl1dW1siY3VyZSJdXSkKdGNfZW9zaW5vcGhpbHNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX2Vvc2lub3BoaWxzX2NsaW5pY19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImN1cmUiXV0pCnRjX21vbm9jeXRlc19zaWdlbmVzX3VwIDwtIHJvd25hbWVzKHRjX21vbm9jeXRlc19zaWdfc3ZhW1siZGVzZXEiXV1bWyJ1cHMiXV1bWyJjdXJlIl1dKQp0Y19tb25vY3l0ZXNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX21vbm9jeXRlc19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImN1cmUiXV0pCnRjX25ldXRyb3BoaWxzX3NpZ2VuZXNfdXAgPC0gcm93bmFtZXModGNfbmV1dHJvcGhpbHNfc2lnX3N2YVtbImRlc2VxIl1dW1sidXBzIl1dW1siY3VyZSJdXSkKdGNfbmV1dHJvcGhpbHNfc2lnZW5lc19kb3duIDwtIHJvd25hbWVzKHRjX25ldXRyb3BoaWxzX3NpZ19zdmFbWyJkZXNlcSJdXVtbImRvd25zIl1dW1siY3VyZSJdXSkKCnRjX2Vvc2lub3BoaWxzX3NpZ2VuZXMgPC0gYyh0Y19lb3Npbm9waGlsc19zaWdlbmVzX3VwLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgdGNfZW9zaW5vcGhpbHNfc2lnZW5lc19kb3duKQp0Y19tb25vY3l0ZXNfc2lnZW5lcyA8LSBjKHRjX21vbm9jeXRlc19zaWdlbmVzX3VwLAogICAgICAgICAgICAgICAgICAgICAgICAgIHRjX21vbm9jeXRlc19zaWdlbmVzX2Rvd24pCnRjX25ldXRyb3BoaWxzX3NpZ2VuZXMgPC0gYyh0Y19uZXV0cm9waGlsc19zaWdlbmVzX3VwLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgdGNfbmV1dHJvcGhpbHNfc2lnZW5lc19kb3duKQpgYGAKCiMjIEdTRUE6IGdQcm9maWxlciBvZiBnZW5lcyBkZWVtZWQgdXAvZG93biB3aGVuIGNvbXBhcmluZyBDYWxpIGFuZCBUdW1hY28KCkkgd2FzIGN1cmlvdXMgdG8gdHJ5IHRvIHVuZGVyc3RhbmQgd2h5IHRoZSB0d28gY2xpbmljcyBhcHBlYXIgdG8gYmUgc28KZGlmZmVyZW50IHZpcyBhIHZpcyB0aGVpciBQQ0EvREU7IHNvIEkgdGhvdWdodCB0aGF0IGdQcm9maWxlciBtaWdodApoZWxwIGJvaWwgdGhvc2UgcmVzdWx0cyBkb3duIHRvIHNvbWV0aGluZyBtb3JlIGRpZ2VzdGlibGUuCgojIyMgR1NFQTogQ29tcGFyZSBjbGluaWNzLCBhbGwgc2FtcGxlcwoKTm90ZSB0aGF0IGluIHRoZSBmb2xsb3dpbmcgYmxvY2sgSSB1c2VkIHRoZSBmdW5jdGlvbgpzaW1wbGVfZ3Byb2ZpbGVyKCksIGJ1dCBsYXRlciBpbiB0aGlzIGRvY3VtZW50IEkgd2lsbCB1c2UKYWxsX2dwcm9maWxlcigpLiAgVGhlIGZpcnN0IGludm9jYXRpb24gbGltaXRzIHRoZSBzZWFyY2ggdG8gYSBzaW5nbGUKdGFibGUsIHdoaWxlIHRoZSBzZWNvbmQgd2lsbCBpdGVyYXRlIG92ZXIgZXZlcnkgcmVzdWx0IGluIGEgcGFpcndpc2UKZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzaXMuCgpJbiB0aGlzIGluc3RhbmNlLCB3ZSBhcmUgbG9va2luZyBhdCB0aGUgdmVjdG9yIG9mIGdlbmUgSURzIGRlZW1lZApzaWduaWZpY2FudGx5IGRpZmZlcmVudCBiZXR3ZWVuIHRoZSB0d28gY2xpbmljcyBpbiBlaXRoZXIgdGhlIHVwIG9yCmRvd24gZGlyZWN0aW9uLgoKT25lIG90aGVyIHRoaW5nIHdvcnRoIG5vdGluZywgdGhlIG5ldyB2ZXJzaW9uIG9mIGdQcm9maWxlciBwcm92aWRlcwpzb21lIGZ1biBpbnRlcmFjdGl2ZSBwbG90cy4gIEkgd2lsbCBhZGQgYW4gZXhhbXBsZSBoZXJlLgoKYGBge3J9CnRjX2Vvc2lub3BoaWxfZ3Byb2ZpbGVyIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfZW9zaW5vcGhpbHNfc2lnZW5lc191cCwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vZW9zaW5vcGhpbF9jbGluaWNzX3R1bWFjb191cC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsX2dwcm9maWxlcgoKY2xpbmljX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgY2xpbmljX3NpZ2VuZXMsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2JvdGhfY2xpbmljc19jYWxpX3VwLXZ7dmVyfS54bHN4IikpCmNsaW5pY19ncCRwdmFsdWVfcGxvdHMkUkVBQwpjbGluaWNfZ3AkcHZhbHVlX3Bsb3RzJEJQCmNsaW5pY19ncCRwdmFsdWVfcGxvdHMkVEYKY2xpbmljX2dwJGludGVyYWN0aXZlX3Bsb3RzJEdPCmBgYAoKIyMjIEdTRUE6IENvbXBhcmUgY2xpbmljcywgRW9zaW5vcGhpbCBzYW1wbGVzCgpJbiB0aGUgZm9sbG93aW5nIGJsb2NrLCBJIGFtIGxvb2tpbmcgYXQgdGhlIGdQcm9maWxlciBvdmVyIHJlcHJlc2VudGVkCmdyb3VwcyBvYnNlcnZlZCBhY3Jvc3MgY2xpbmljcyBpbiBvbmx5IHRoZSBFb3Npbm9waGlscy4gIEZpcnN0IEkgZG8gc28KZm9yIGFsbCBnZW5lcyh1cCBvciBkb3duKSwgZm9sbG93ZWQgYnkgb25seSB0aGUgdXAgYW5kIGRvd24gZ3JvdXBzLgpFYWNoIG9mIHRoZSBmb2xsb3dpbmcgd2lsbCBpbmNsdWRlIG9ubHkgdGhlIFJlYWN0b21lIGFuZCBHTzpCUCBwbG90cy4KVGhlc2Ugc2VhcmNoZXMgZGlkIG5vdCBoYXZlIHRvbyBtYW55IG90aGVyIGhpdHMsIGV4Y2VwdGluZyB0aGUKdHJhbnNjcmlwdGlvbiBmYWN0b3IgZGF0YWJhc2UuCgpgYGB7cn0KdGNfZW9zaW5vcGhpbHNfZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19lb3Npbm9waGlsc19zaWdlbmVzLAogIGV4Y2VsID0gZ2x1ZSgie2dzZWFfcHJlZml4fS9lb3Npbm9waGlsX2NsaW5pY3Mtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfZ3AKdGNfZW9zaW5vcGhpbHNfZ3AkcHZhbHVlX3Bsb3RzJFJFQUMKdGNfZW9zaW5vcGhpbHNfZ3AkcHZhbHVlX3Bsb3RzJEJQCgp0Y19lb3Npbm9waGlsc191cF9ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX2Vvc2lub3BoaWxzX3NpZ2VuZXNfdXAsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2Vvc2lub3BoaWxfY2xpbmljc190dW1hY29fdXAtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfdXBfZ3AKdGNfZW9zaW5vcGhpbHNfdXBfZ3AkcHZhbHVlX3Bsb3RzJFJFQUMKCnRjX2Vvc2lub3BoaWxzX2Rvd25fZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19lb3Npbm9waGlsc19zaWdlbmVzX2Rvd24sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2Vvc2lub3BoaWxfY2xpbmljc19jYWxpX3VwLXZ7dmVyfS54bHN4IikpCnRjX2Vvc2lub3BoaWxzX2Rvd25fZ3AKdGNfZW9zaW5vcGhpbHNfZG93bl9ncCRwdmFsdWVfcGxvdHMkUkVBQwpgYGAKCiMjIyBHU0VBOiBDb21wYXJlIGNsaW5pY3MsIE1vbm9jeXRlIHNhbXBsZXMKCkluIHRoZSBmb2xsb3dpbmcgYmxvY2sgSSByZXBlYXRlZCB0aGUgYWJvdmUgcXVlcnksIGJ1dCB0aGlzIHRpbWUKbG9va2luZyBhdCB0aGUgbW9ub2N5dGUgc2FtcGxlcy4KCmBgYHtyfQp0Y19tb25vY3l0ZXNfdXBfZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19tb25vY3l0ZXNfc2lnZW5lcywKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbW9ub2N5dGVfY2xpbmljcy12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfdXBfZ3AKdGNfbW9ub2N5dGVzX3VwX2dwJHB2YWx1ZV9wbG90cyRSRUFDCnRjX21vbm9jeXRlc191cF9ncCRwdmFsdWVfcGxvdHMkQlAKCnRjX21vbm9jeXRlc19kb3duX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfbW9ub2N5dGVzX3NpZ2VuZXNfZG93biwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbW9ub2N5dGVfY2xpbmljc19jYWxpX3VwLXZ7dmVyfS54bHN4IikpCnRjX21vbm9jeXRlc19kb3duX2dwJHB2YWx1ZV9wbG90cyRSRUFDCnRjX21vbm9jeXRlc19kb3duX2dwJHB2YWx1ZV9wbG90cyRCUApgYGAKCiMjIyMgR1NFQTogQ29tcGFyZSBjbGluaWNzLCBOZXV0cm9waGlsIHNhbXBsZXMKCkliaWQuICBUaGlzIHRpbWUgbG9va2luZyBhdCB0aGUgTmV1dHJvcGhpbHMuICBUaHVzIHRoZSBmaXJzdCB0d28KaW1hZ2VzIHNob3VsZCBiZSBhIHN1cGVyc2V0IG9mIHRoZSBzZWNvbmQgYW5kIHRoaXJkIHBhaXJzIG9mIGltYWdlczsKYXNzdW1pbmcgdGhhdCB0aGUgZ2VuZXMgaW4gdGhlIHVwL2Rvd24gbGlzdCBkbyBub3QgY2F1c2UgdGhlIGdyb3VwcyB0bwpubyBsb25nZXIgYmUgc2lnbmlmaWNhbnQuICBJbnRlcmVzdGluZ2x5LCB0aGUgcmVhY3RvbWUgc2VhcmNoIGRpZCBub3QKcmV0dXJuIGFueSBoaXRzIGZvciB0aGUgaW5jcmVhc2VkIHNlYXJjaC4KCmBgYHtyfQp0Y19uZXV0cm9waGlsc19ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX25ldXRyb3BoaWxzX3NpZ2VuZXMsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L25ldXRyb3BoaWxfY2xpbmljcy12e3Zlcn0ueGxzeCIpKQojIyB0Y19uZXV0cm9waGlsc19ncCRwdmFsdWVfcGxvdHMkUkVBQyAjIyBubyBoaXRzCnRjX25ldXRyb3BoaWxzX2dwJHB2YWx1ZV9wbG90cyRCUAp0Y19uZXV0cm9waGlsc19ncCRwdmFsdWVfcGxvdHMkVEYKCnRjX25ldXRyb3BoaWxzX3VwX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfbmV1dHJvcGhpbHNfc2lnZW5lc191cCwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbmV1dHJvcGhpbF9jbGluaWNzX3R1bWFjb191cC12e3Zlcn0ueGxzeCIpKQojIyB0Y19uZXV0cm9waGlsc191cF9ncCRwdmFsdWVfcGxvdHMkUkVBQyAjIyBObyBoaXRzCnRjX25ldXRyb3BoaWxzX3VwX2dwJHB2YWx1ZV9wbG90cyRCUAoKdGNfbmV1dHJvcGhpbHNfZG93bl9ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX25ldXRyb3BoaWxzX3NpZ2VuZXNfZG93biwKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vbmV1dHJvcGhpbF9jbGluaWNzX2NhbGlfdXAtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfZG93bl9ncCRwdmFsdWVfcGxvdHMkUkVBQwp0Y19uZXV0cm9waGlsc19kb3duX2dwJHB2YWx1ZV9wbG90cyRCUApgYGAKCiMgQ29tcGFyZSBERTogSG93IHNpbWlsYXIgYXJlIFR1bWFjbyBDL0YgdnMuIENhbGkgQy9GCgpUaGUgZm9sbG93aW5nIGV4cGFuZHMgdGhlIGNyb3NzLWNsaW5pYyBxdWVyeSBhYm92ZSB0byBhbHNvIHRlc3QgdGhlCm5ldXRyb3BoaWxzLiAgT25jZSBhZ2FpbiwgSSB0aGluayBpdCB3aWxsIHByZXR0eSBzdHJvbmdseSBzdXBwb3J0IHRoZQpoeXBvdGhlc2lzIHRoYXQgdGhlIHR3byBjbGluaWNzIGFyZSBub3QgY29tcGF0aWJsZS4KCldlIGFyZSBjb25jZXJuZWQgdGhhdCB0aGUgY2xpbmljLWJhc2VkIGJhdGNoIGVmZmVjdCBtYXkgbWFrZSBvdXIKcmVzdWx0cyBlc3NlbnRpYWxseSB1c2VsZXNzLiAgT25lIHdheSB0byB0ZXN0IHRoaXMgY29uY2VybiBpcyB0bwpjb21wYXJlIHRoZSBzZXQgb2YgZ2VuZXMgb2JzZXJ2ZWQgZGlmZmVyZW50IGJldHdlZW4gdGhlIENhbGkgQ3VyZS9GYWlsCnZzLiB0aGUgVHVtYWNvIEN1cmUvRmFpbC4KCmBgYHtyfQpjYWxpX3RhYmxlX25vYmF0Y2ggPC0gdGNfbmV1dHJvcGhpbHNfdGFibGVfbm9iYXRjaFtbImRhdGEiXV1bWyJjYWxpIl1dCnR1bWFjb190YWJsZV9ub2JhdGNoIDwtIHRjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2hbWyJkYXRhIl1dW1sidHVtYWNvIl1dCgpjYWxpX21lcmdlZF9ub2JhdGNoIDwtIG1lcmdlKGNhbGlfdGFibGVfbm9iYXRjaCwgdHVtYWNvX3RhYmxlX25vYmF0Y2gsIGJ5PSJyb3cubmFtZXMiKQpjb3IudGVzdChjYWxpX21lcmdlZF9ub2JhdGNoWywgImRlc2VxX2xvZ2ZjLngiXSwgY2FsaV9tZXJnZWRfbm9iYXRjaFssICJkZXNlcV9sb2dmYy55Il0pCmNhbGlfYXVjY19ub2JhdGNoIDwtIGNhbGN1bGF0ZV9hdWNjKGNhbGlfdGFibGVfbm9iYXRjaCwgdHVtYWNvX3RhYmxlX25vYmF0Y2gsIHB4ID0gImRlc2VxX2FkanAiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBweSA9ICJkZXNlcV9hZGpwIiwgbHggPSAiZGVzZXFfbG9nZmMiLCBseSA9ICJkZXNlcV9sb2dmYyIpCmNhbGlfYXVjY19ub2JhdGNoJHBsb3QKYGBgCgojIFR1bWFjbyBhbmQgQ2FsaSwgY3VyZSB2cy4gZmFpbAoKSW4gYWxsIG9mIHRoZSBhYm92ZSwgd2UgYXJlIGxvb2tpbmcgdG8gdW5kZXJzdGFuZCB0aGUgZGlmZmVyZW5jZXMgYmV0d2VlbiB0aGUgdHdvIGxvY2F0aW9uLgpMZXQgdXMgbm93IHN0ZXAgYmFjayBhbmQgcGVyZm9ybSB0aGUgb3JpZ2luYWwgcXVlc3Rpb246IGZhaWwvY3VyZSB3aXRob3V0IHJlZ2FyZCB0byBsb2NhdGlvbi4KCkkgcGVyZm9ybWVkIHRoaXMgcXVlcnkgd2l0aCBhIGZldyBkaWZmZXJlbnQgcGFyYW1ldGVycywgbm90YWJseSB3aXRoKG91dCkKc3ZhIGFuZCBhZ2FpbiB1c2luZyBlYWNoIGNlbGwgdHlwZSwgaW5jbHVkaW5nIGJpb3BzaWVzLiBUaGUgbWFpbgpyZWFzaW9uIEkgYW0ga2VlcGluZyB0aGVzZSBjb21wYXJpc29ucyBpcyBpbiB0aGUgcmVsYXRpdmVseSB3ZWFrIGhvcGUKdGhhdCB0aGVyZSB3aWxsIGJlIHN1ZmZpY2llbnQgc2lnbmFsIGluIHRoZSBmdWxsIGRhdGFzZXQgdGhhdCBpdCBtaWdodApiZSBhYmxlIHRvIG92ZXJjb21lIHRoZSBhcHBhcmVudGx5IHJpZGljdWxvdXMgYmF0Y2ggZWZmZWN0IGZyb20gdGhlCnR3byBjbGluaWNzLgoKIyMgQWxsIGNlbGwgdHlwZXMgdG9nZXRoZXIsIHdpdGgob3V0KSBTVkEKCmBgYHtyfQp0YWJsZShwRGF0YSh0Y192YWxpZClbWyJjb25kaXRpb24iXV0pCnRjX2FsbF9jZl9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX3ZhbGlkLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIikKdGNfYWxsX2NmX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19hbGxfY2ZfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX3ZhbGlkX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19hbGxfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2FsbF9jZl90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y192YWxpZF9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCgp0Y19hbGxfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX3ZhbGlkLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9IFRSVUUpCnRjX2FsbF9jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19hbGxfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfdmFsaWRfY2ZfdGFibGVfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfYWxsX2NmX3NpZ19iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2FsbF9jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX3ZhbGlkX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIEFsbCBjZWxsIHR5cGVzIGV4Y2VwdCBiaW9wc2llcwoKSSBhbSBub3Qgc3VyZSBpZiB0aGlzIGlzIHRoZSBiZXN0IGNob2ljZSwgYnV0IEkgY2FsbCB0aGUgc2V0IG9mIGFsbApzYW1wbGVzIGV4Y2x1ZGluZyBiaW9wc2llcyAnY2xpbmljYWwnLgoKYGBge3J9CnRhYmxlKHBEYXRhKHRjX2NsaW5pY2FsX25vYmlvcClbWyJjb25kaXRpb24iXV0pCnRjX2NsaW5pY2FsX2NmX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfY2xpbmljYWxfbm9iaW9wLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2NsaW5pY2FsX2NmX2RlX3N2YQoKdGNfY2xpbmljYWxfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2NsaW5pY2FsX2NmX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9DbGluaWNhbF9TYW1wbGVzL3RjX2NsaW5pY2FsX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19jbGluaWNhbF9jZl90YWJsZV9zdmEKCnRjX2NsaW5pY2FsX2NmX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19jbGluaWNhbF9jZl90YWJsZV9zdmEsIGFjY29yZGluZ190byA9ICJkZXNlcSIsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9DbGluaWNhbF9TYW1wbGVzL3RjX2NsaW5pY2FsX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfY2xpbmljYWxfY2Zfc2lnX3N2YQoKdGNfY2xpbmljYWxfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX2NsaW5pY2FsX25vYmlvcCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19jbGluaWNhbF9jZl9kZV9iYXRjaAoKdGNfY2xpbmljYWxfY2ZfdGFibGVfYmF0Y2ggPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfY2xpbmljYWxfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQ2xpbmljYWxfU2FtcGxlcy90Y19jbGluaWNhbF9jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19jbGluaWNhbF9jZl90YWJsZV9iYXRjaAoKdGNfY2xpbmljYWxfY2Zfc2lnX2JhdGNoIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfY2xpbmljYWxfY2ZfdGFibGVfYmF0Y2gsIGFjY29yZGluZ190byA9ICJkZXNlcSIsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9DbGluaWNhbF9TYW1wbGVzL3RjX2NsaW5pY2FsX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19jbGluaWNhbF9jZl9zaWdfYmF0Y2gKYGBgCgojIyMgQSBwb3J0aW9uIG9mIFN1cHBsZW1lbnRhbCBGaWd1cmUgMTEuCgpgYGB7cn0KbnVtX2NvbG9yIDwtIGNvbG9yX2Nob2ljZXNbWyJjZiJdXVtbImN1cmUiXV0KZGVuX2NvbG9yIDwtIGNvbG9yX2Nob2ljZXNbWyJjZiJdXVtbImZhaWx1cmUiXV0KdGNfY2xpbmljYWxfY2ZfdGFibGUgPC0gdGNfY2xpbmljYWxfY2ZfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0KdGNfY2xpbmljYWxfY2Zfdm9sY2Fub190b3AxMCA8LSBwbG90X3ZvbGNhbm9fY29uZGl0aW9uX2RlKAogIHRjX2NsaW5pY2FsX2NmX3RhYmxlLCAib3V0Y29tZSIsIGxhYmVsID0gMTAsCiAgZmNfY29sID0gImRlc2VxX2xvZ2ZjIiwgcF9jb2wgPSAiZGVzZXFfYWRqcCIsIGxpbmVfcG9zaXRpb24gPSBOVUxMLAogIGNvbG9yX2hpZ2ggPSBudW1fY29sb3IsIGNvbG9yX2xvdyA9IGRlbl9jb2xvciwgbGFiZWxfc2l6ZSA9IDYpCnBwKGZpbGUgPSAiZmlndXJlcy9zMTFjX3RjX2NsaW5pY2FsX2NmX3ZvbGNhbm9fbGFiZWxlZF90b3AxMC5zdmciKQp0Y19jbGluaWNhbF9jZl92b2xjYW5vX3RvcDEwW1sicGxvdCJdXQpkZXYub2ZmKCkKdGNfY2xpbmljYWxfY2Zfdm9sY2Fub190b3AxMFtbInBsb3QiXV0KYGBgCgojIyBCaW9wc2llcywgd2l0aChvdXQpIFNWQQoKSW4gdGhlIGZvbGxvd2luZyBibG9jaywgd2UgcmVwZWF0IHRoZSBzYW1lIHF1ZXN0aW9uLCBidXQgdXNpbmcgb25seQp0aGUgYmlvcHN5IHNhbXBsZXMgZnJvbSBib3RoIGNsaW5pY3MuCgpgYGB7cn0KdGNfYmlvcHNpZXNfY2YgPC0gc2V0X2V4cHRfY29uZGl0aW9ucyh0Y19iaW9wc2llcywgZmFjdCA9ICJmaW5hbG91dGNvbWUiKQp0Y19iaW9wc2llc19jZl9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX2Jpb3BzaWVzX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiKQp0Y19iaW9wc2llc19jZl90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYmlvcHNpZXNfY2ZfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0Jpb3BzaWVzL3RjX2Jpb3BzaWVzX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19iaW9wc2llc19jZl9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfYmlvcHNpZXNfY2ZfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfYmlvcHNpZXNfY2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQoKdGNfYmlvcHNpZXNfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX2Jpb3BzaWVzX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSkKdGNfYmlvcHNpZXNfY2ZfdGFibGVfYmF0Y2ggPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYmlvcHNpZXNfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfYmlvcHNpZXNfY2ZfdGFibGVfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfYmlvcHNpZXNfY2Zfc2lnX2JhdGNoIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfYmlvcHNpZXNfY2ZfdGFibGVfYmF0Y2gsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19iaW9wc2llc19jZl9zaWdfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKYGBgCgojIyBFb3Npbm9waGlscywgd2l0aChvdXQpIFNWQQoKSW4gdGhlIGZvbGxvd2luZyBibG9jaywgd2UgcmVwZWF0IHRoZSBzYW1lIHF1ZXN0aW9uLCBidXQgdXNpbmcgb25seQp0aGUgRW9zaW5vcGhpbCBzYW1wbGVzIGZyb20gYm90aCBjbGluaWNzLgoKYGBge3J9CnRjX2Vvc2lub3BoaWxzX2NmIDwtIHNldF9leHB0X2NvbmRpdGlvbnModGNfZW9zaW5vcGhpbHMsIGZhY3QgPSAiZmluYWxvdXRjb21lIikKdGNfZW9zaW5vcGhpbHNfY2ZfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19lb3Npbm9waGlsc19jZiwgZmlsdGVyID0gVFJVRSwgbWV0aG9kcyA9IG1ldGhvZHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIikKdGNfZW9zaW5vcGhpbHNfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2Vvc2lub3BoaWxzX2NmX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Fb3Npbm9waGlscy90Y19lb3Npbm9waGlsc19jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Vvc2lub3BoaWxzX2NmX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX2Vvc2lub3BoaWxzX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKCnRjX2Vvc2lub3BoaWxzX2NmX2RlX2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19lb3Npbm9waGlsc19jZiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19lb3Npbm9waGlsc19jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19lb3Npbm9waGlsc19jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19lb3Npbm9waGlsc19jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19lb3Npbm9waGlsc19jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX2Vvc2lub3BoaWxzX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIE1vbm9jeXRlcywgd2l0aChvdXQpIFNWQQoKUmVwZWF0IHlldCBhZ2FpbiwgdGhpcyB0aW1lIHdpdGggdGhlIG1vbm9jeXRlIHNhbXBsZXMuICBUaGUgaWRlYSBpcyB0bwpzZWUgaWYgdGhlcmUgaXMgYSBjZWxsIHR5cGUgd2hpY2ggaXMgcGFydGljdWxhcmx5IGdvb2QgKG9yIGJhZCkgYXQKZGlzY3JpbWluYXRpbmcgdGhlIHR3byBjbGluaWNzLgoKYGBge3J9CnRjX21vbm9jeXRlc19jZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRjX21vbm9jeXRlcywgZmFjdCA9ICJmaW5hbG91dGNvbWUiKQp0Y19tb25vY3l0ZXNfY2ZfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19tb25vY3l0ZXNfY2YsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiKQp0Y19tb25vY3l0ZXNfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX21vbm9jeXRlc19jZl9kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vTW9ub2N5dGVzL3RjX21vbm9jeXRlc19jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbW9ub2N5dGVzX2NmX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19tb25vY3l0ZXNfY2ZfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfbW9ub2N5dGVzX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKCnRjX21vbm9jeXRlc19jZl9kZV9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfbW9ub2N5dGVzX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9IFRSVUUpCnRjX21vbm9jeXRlc19jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19tb25vY3l0ZXNfY2ZfZGVfYmF0Y2gsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfbW9ub2N5dGVzX2NmX3RhYmxlX2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX21vbm9jeXRlc19jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19tb25vY3l0ZXNfY2ZfdGFibGVfYmF0Y2gsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19tb25vY3l0ZXNfY2Zfc2lnX2JhdGNoLXZ7dmVyfS54bHN4IikpCmBgYAoKIyMgTmV1dHJvcGhpbHMsIHdpdGgob3V0KSBTVkEKCkxhc3QgdHJ5LCB0aGlzIHRpbWUgdXNpbmcgdGhlIE5ldXRyb3BoaWwgc2FtcGxlcy4KCmBgYHtyfQp0Y19uZXV0cm9waGlsc19jZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRjX25ldXRyb3BoaWxzLCBmYWN0ID0gImZpbmFsb3V0Y29tZSIpCnRjX25ldXRyb3BoaWxzX2NmX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfbmV1dHJvcGhpbHNfY2YsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfbmV1dHJvcGhpbHNfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX25ldXRyb3BoaWxzX2NmX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9OZXV0cm9waGlscy90Y19uZXV0cm9waGlsc19jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX25ldXRyb3BoaWxzX2NmX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX25ldXRyb3BoaWxzX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKCnRjX25ldXRyb3BoaWxzX2NmX2RlX2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19uZXV0cm9waGlsc19jZiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19uZXV0cm9waGlsc19jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19uZXV0cm9waGlsc19jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19uZXV0cm9waGlsc19jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19uZXV0cm9waGlsc19jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19uZXV0cm9waGlsc19jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX25ldXRyb3BoaWxzX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQpgYGAKCiMgVmlzaXQgY29tcGFyaXNvbnMKCkxhdGVyIGluIHRoaXMgZG9jdW1lbnQgSSBkbyBhIGJ1bmNoIG9mIHZpc2l0L2NmIGNvbXBhcmlzb25zLiAgSW4gdGhpcwpibG9jayBJIHdhbnQgdG8gZXhwbGljaXRseSBvbmx5IGNvbXBhcmUgdjEgdG8gb3RoZXIgdmlzaXRzLiAgVGhpcyBpcwpzb21ldGhpbmcgSSBkaWQgcXVpdGUgYSBsb3QgaW4gdGhlIDIwMTkgZGF0YXNldHMsIGJ1dCBuZXZlciBhY3R1YWxseQptb3ZlZCB0byB0aGlzIGRvY3VtZW50LgoKYGBge3J9CnYxX3ZzX2xhdGVyIDwtIGFsbF9wYWlyd2lzZSh0Y192MXZzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUpCnYxX3ZzX2xhdGVyX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHYxX3ZzX2xhdGVyLCBrZWVwZXJzID0gdmlzaXRfdjFsYXRlciwKICBleGNlbCA9IGdsdWUoInt2aXNpdF9wcmVmaXh9L3YxX3ZzX2xhdGVyX3RhYmxlcy12e3Zlcn0ueGxzeCIpKQp2MV92c19sYXRlcl9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB2MV92c19sYXRlcl90YWJsZSwKICBleGNlbCA9IGdsdWUoInt2aXNpdF9wcmVmaXh9L3YxX3ZzX2xhdGVyX3NpZy12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIyMgR1NFQTogVjEgdnMgb3RoZXIgdmlzaXRzLgoKYGBge3J9CnYxbGF0ZXJfZ3AgPC0gYWxsX2dwcm9maWxlcih2MV92c19sYXRlcl9zaWcpCnYxbGF0ZXJfZ3BbWzFdXSRwdmFsdWVfcGxvdHMkUkVBQwp2MWxhdGVyX2dwW1syXV0kcHZhbHVlX3Bsb3RzJFJFQUMKYGBgCgojIFNleCBjb21wYXJpc29uCgpgYGB7cn0KdGNfc2V4X2RlIDwtIGFsbF9wYWlyd2lzZSh0Y19zZXgsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUpCnRjX3NleF90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19zZXhfZGUsIGV4Y2VsID0gZ2x1ZSgie3NleF9wcmVmaXh9L3RjX3NleF90YWJsZS12e3Zlcn0ueGxzeCIpKQp0Y19zZXhfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfc2V4X3RhYmxlLCBleGNlbCA9IGdsdWUoIntzZXhfcHJlZml4fS90Y19zZXhfc2lnLXZ7dmVyfS54bHN4IikpCnRjX3NleF9ncCA8LSBhbGxfZ3Byb2ZpbGVyKHRjX3NleF9zaWcpCmBgYAoKYGBge3J9CnRjX3NleF9jdXJlIDwtIHN1YnNldF9leHB0KHRjX3NleCwgc3Vic2V0ID0gImZpbmFsb3V0Y29tZT09J2N1cmUnIikKdGNfc2V4X2N1cmVfZGUgPC0gYWxsX3BhaXJ3aXNlKHRjX3NleF9jdXJlLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19zZXhfY3VyZV9kZQp0Y19zZXhfY3VyZV90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19zZXhfY3VyZV9kZSwgZXhjZWwgPSBnbHVlKCJ7c2V4X3ByZWZpeH0vdGNfc2V4X2N1cmVfdGFibGUtdnt2ZXJ9Lnhsc3giKSkKdGNfc2V4X2N1cmVfdGFibGUKdGNfc2V4X2N1cmVfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfc2V4X2N1cmVfdGFibGUsIGV4Y2VsID0gZ2x1ZSgie3NleF9wcmVmaXh9L3RjX3NleF9jdXJlX3NpZy12e3Zlcn0ueGxzeCIpKQp0Y19zZXhfY3VyZV9zaWcKYGBgCgojIyMjIEdTRUE6IFNleCBjb21wYXJpc29ucyBib3RoIGNsaW5pY3MKCmBgYHtyfQp0Y19zZXhfY3VyZV9ncCA8LSBhbGxfZ3Byb2ZpbGVyKHRjX3NleF9jdXJlX3NpZykKdGNfc2V4X2N1cmVfZ3AKdGNfc2V4X2N1cmVfZ3BbWzFdXVtbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCnRjX3NleF9jdXJlX2dwW1syXV1bWyJwdmFsdWVfcGxvdHMiXV1bWyJCUCJdXQpgYGAKCiMgRXRobmljaXR5IGNvbXBhcmlzb25zCgpgYGB7cn0KdGNfZXRobmljaXR5X2RlIDwtIGFsbF9wYWlyd2lzZSh0Y19ldG5pYV9leHB0LCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2V0aG5pY2l0eV9kZQp0Y19ldGhuaWNpdHlfdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfZXRobmljaXR5X2RlLCBrZWVwZXJzID0gZXRobmljaXR5X2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntldGhfcHJlZml4fS90Y19ldGhuaWNpdHlfdGFibGUtdnt2ZXJ9Lnhsc3giKSkKdGNfZXRobmljaXR5X3RhYmxlCnRjX2V0aG5pY2l0eV90YWJsZVtbInBsb3RzIl1dW1sibWVzdGl6b19pbmRpZ2Vub3VzIl1dW1siZGVzZXFfbWFfcGxvdHMiXV0KdGNfZXRobmljaXR5X3RhYmxlW1sicGxvdHMiXV1bWyJtZXN0aXpvX2Fmcm9jb2wiXV1bWyJkZXNlcV9tYV9wbG90cyJdXQp0Y19ldGhuaWNpdHlfdGFibGVbWyJwbG90cyJdXVtbImluZGlnZW5vdXNfYWZyb2NvbCJdXVtbImRlc2VxX21hX3Bsb3RzIl1dCgp0Y19ldGhuaWNpdHlfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfZXRobmljaXR5X3RhYmxlLCBleGNlbCA9IGdsdWUoIntldGhfcHJlZml4fS90Y19ldGhuaWNpdHlfc2lnLXZ7dmVyfS54bHN4IikpCgpldGhuaWNpdHlfY3VyZSA8LSBzdWJzZXRfZXhwdCh0Y19ldG5pYV9leHB0LCBzdWJzZXQgPSAiZmluYWxvdXRjb21lPT0nY3VyZSciKQpldGhuaWNpdHlfY3VyZV9kZSA8LSBhbGxfcGFpcndpc2UoZXRobmljaXR5X2N1cmUsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCmV0aG5pY2l0eV9jdXJlX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIGV0aG5pY2l0eV9jdXJlX2RlLCBrZWVwZXJzID0gZXRobmljaXR5X2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntldGhfcHJlZml4fS9ldGhuaWNpdHlfY3VyZV90YWJsZS12e3Zlcn0ueGxzeCIpKQpldGhuaWNpdHlfY3VyZV90YWJsZQpldGhuaWNpdHlfY3VyZV90YWJsZVtbInBsb3RzIl1dW1sibWVzdGl6b19pbmRpZ2Vub3VzIl1dW1siZGVzZXFfbWFfcGxvdHMiXV0KZXRobmljaXR5X2N1cmVfdGFibGVbWyJwbG90cyJdXVtbIm1lc3Rpem9fYWZyb2NvbCJdXVtbImRlc2VxX21hX3Bsb3RzIl1dCmV0aG5pY2l0eV9jdXJlX3RhYmxlW1sicGxvdHMiXV1bWyJpbmRpZ2Vub3VzX2Fmcm9jb2wiXV1bWyJkZXNlcV9tYV9wbG90cyJdXQpldGhuaWNpdHlfY3VyZV9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICBldGhuaWNpdHlfY3VyZV90YWJsZSwgZXhjZWwgPSBnbHVlKCJ7ZXRoX3ByZWZpeH0vZXRobmljaXR5X2N1cmVfc2lnLXZ7dmVyfS54bHN4IikpCmV0aG5pY2l0eV9jdXJlX3NpZwpgYGAKCiMjIyMgR1NFQTogRXRobmljaXR5IGRpZmZlcmVuY2VzCgpQZXJmb3JtZWQgb25jZSB3aXRoIGJvdGggY2xpbmljcyBhbmQgYWdhaW4gd2l0aCBvbmx5IFR1bWFjby4KCmBgYHtyfQp0Y19ldGhuaWNpdHlfZ3AgPC0gYWxsX2dwcm9maWxlcih0Y19ldGhuaWNpdHlfc2lnKQpgYGAKCmBgYHtyfQpwYW5kZXI6OnBhbmRlcihzZXNzaW9uSW5mbygpKQptZXNzYWdlKCJUaGlzIGlzIGhwZ2x0b29scyBjb21taXQ6ICIsIGdldF9naXRfY29tbWl0KCkpCm1lc3NhZ2UoIlNhdmluZyB0byAiLCBzYXZlZmlsZSkKIyB0bXAgPC0gc20oc2F2ZW1lKGZpbGVuYW1lID0gc2F2ZWZpbGUpKQpgYGAKCmBgYHtyIGxvYWRtZV9hZnRlciwgZXZhbD1GQUxTRX0KdG1wIDwtIGxvYWRtZShmaWxlbmFtZSA9IHNhdmVmaWxlKQpgYGAK