1 Changelog
- 202309: Disabled GSVA analyses until/unless we get permission to include the mSigDB 7.5.1 release. I will simplify the filenames so that one may easily drop in a downloaded copy of the data and run those blocks. Until then, I guess you will have to trust me when I say those blocks all work?
- 202309: Moved all GSEA analyses to 04lrt_gsea_gsva.Rmd
- 202309 next day: Moving GSEA back because it adds too much complexity to save/reload the DE results for gProfiler and friends.
- Still hunting for messed up colors, changed input data to match new version.
2 Introduction
The various differential expression analyses of the data generated in tmrc3_datasets will occur in this document.
2.1 Naming conventions
I am going to try to standardize how I name the various data structures created in this document. Most of the large data created are either sets of differential expression analyses, their combined results, or the set of results deemed ‘significant’.
Hopefully by now they all follow these guidelines:
{clinic(s)}sample-subset}{primary-question(s)}{datatype}{batch-method}
- {clinic}: This is either tc or t for Tumaco and Cali, or just Tumaco.
- {sample-subset}: Things like ‘all’ or ‘monocytes’.
- {primary-question}: Shorthand name for the primary contrasts performed, thus ‘clinics’ would suggest a comparison of Tumaco vs. Cali. ‘visits’ would compare v2/v1, etc.
- {datatype}: de, table, sig
- {batch-type}: nobatch, batch{factor}, sva. {factor} in this instance should be a column from the metadata.
With this in mind, ‘tc_biopsies_clinic_de_sva’ should be the Tumaco+Cali biopsy data after performing the differential expression analyses comparing the clinics using sva.
I suspect there remain some exceptions and/or errors.
2.2 Define contrasts for DE analyses
Each of the following lists describes the set of contrasts that I think are interesting for the various ways one might consider the TMRC3 dataset. The variables are named according to the assumed data with which they will be used, thus tc_cf_contrasts is expected to be used for the Tumaco+Cali data and provide a series of cure/fail comparisons which (to the extent possible) across both locations. In every case, the name of the list element will be used as the contrast name, and will thus be seen as the sheet name in the output xlsx file(s); the two pieces of the character vector value are the numerator and denominator of the associated contrast.
2.3 GSEA
Most (all?) of the overenrichment/GSEA analyses used in this paper were done via gProfiler and clusterProfiler rather than goseq/topGO/GOstats. Primarily because it is so easy to invoke gprofiler and because clusterProfiler makes it very easy to invoke the GSEA analyses. One fun thing I did relatively recently is coerce the results from all methods into the clusterProfiler enrichment object type, thus you may pass any result directly to the various enrichplot functions.
clinic_contrasts <- list(
"clinics" = c("cali", "tumaco"))
## In some cases we have no Cali failure samples, so there remain only 2
## contrasts that are likely of interest
tc_cf_contrasts <- list(
"tumaco" = c("tumaco_failure", "tumaco_cure"),
"cure" = c("tumaco_cure", "cali_cure"))
## In other cases, we have cure/fail for both places.
clinic_cf_contrasts <- list(
"cali" = c("cali_failure", "cali_cure"),
"tumaco" = c("tumaco_failure", "tumaco_cure"),
"cure" = c("tumaco_cure", "cali_cure"),
"fail" = c("tumaco_failure", "cali_failure"))
cf_contrast <- list(
"outcome" = c("tumaco_failure", "tumaco_cure"))
t_cf_contrast <- list(
"outcome" = c("failure", "cure"))
visitcf_contrasts <- list(
"v1cf" = c("v1_failure", "v1_cure"),
"v2cf" = c("v2_failure", "v2_cure"),
"v3cf" = c("v3_failure", "v3_cure"))
visit_contrasts <- list(
"v2v1" = c("c2", "c1"),
"v3v1" = c("c3", "c1"),
"v3v2" = c("c3", "c2"))
visit_v1later <- list(
"later_vs_first" = c("later", "first"))
celltypes <- list(
"eo_mono" = c("eosinophils", "monocytes"),
"ne_mono" = c("neutrophils", "monocytes"),
"eo_ne" = c("eosinophils", "neutrophils"))
ethnicity_contrasts <- list(
"mestizo_indigenous" = c("mestiza", "indigena"),
"mestizo_afrocol" = c("mestiza", "afrocol"),
"indigenous_afrocol" = c("indigena", "afrocol"))3 Compare samples by clinic
3.1 DE: Compare clinics, all samples
Perform a svaseq-guided comparison of the two clinics. Ideally this will give some clue about just how strong the clinic-based batch effect really is and what its causes are.
tc_clinic_type <- tc_valid %>%
set_expt_conditions(fact = "clinic") %>%
set_expt_batches(fact = "typeofcells")## The numbers of samples by condition are:##
## cali tumaco
## 61 123## The number of samples by batch are:##
## biopsy eosinophils monocytes neutrophils
## 18 41 63 62table(pData(tc_clinic_type)[["condition"]])##
## cali tumaco
## 61 123tc_all_clinic_de_sva <- all_pairwise(tc_clinic_type, model_batch = "svaseq",
filter = TRUE, methods = methods)##
## cali tumaco
## 61 123## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_all_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## tumc_vs_cl
## basic_vs_deseq 0.7977
## basic_vs_dream 0.9210
## basic_vs_ebseq 0.7545
## basic_vs_edger 0.8733
## basic_vs_limma 0.9696
## basic_vs_noiseq 0.9114
## deseq_vs_dream 0.8696
## deseq_vs_ebseq 0.8431
## deseq_vs_edger 0.9262
## deseq_vs_limma 0.7895
## deseq_vs_noiseq 0.8657
## dream_vs_ebseq 0.8550
## dream_vs_edger 0.9442
## dream_vs_limma 0.9372
## dream_vs_noiseq 0.9353
## ebseq_vs_edger 0.8612
## ebseq_vs_limma 0.7772
## ebseq_vs_noiseq 0.8376
## edger_vs_limma 0.8623
## edger_vs_noiseq 0.9364
## limma_vs_noiseq 0.8900tc_all_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_vs_cali"tc_all_clinic_table_sva <- combine_de_tables(
tc_all_clinic_de_sva, keepers = clinic_contrasts,
excel = glue("{clinic_prefix}/tc_all_clinic_table_sva-v{ver}.xlsx"))
tc_all_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 tumaco_vs_cali-inverted 270 1788 322 1660
## limma_sigup limma_sigdown
## 1 388 604## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_all_clinic_sig_sva <- extract_significant_genes(
tc_all_clinic_table_sva,
excel = glue("{clinic_prefix}/compare_clinics/tc_clinic_type_sig_sva-v{ver}.xlsx"))
tc_all_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## clinics 388 604 322 1660 270 1788 222
## ebseq_down basic_up basic_down
## clinics 420 0 5902
3.1.1 GSEA: comparing the clinics
increased_tumaco_categories_up <- simple_gprofiler(
tc_all_clinic_sig_sva[["deseq"]][["ups"]][["clinics"]],
excel = glue("{gsea_prefix}/tumaco_cateogies_up-v{ver}.xlsx"))
increased_tumaco_categories_up## A set of ontologies produced by gprofiler using 270
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 17 MF
## 5 BP
## 1 CC
## 1 KEGG
## 1 REAC
## 0 WP
## 105 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.increased_tumaco_categories_up[["pvalue_plots"]][["BP"]]## NULLincreased_cali_categories <- simple_gprofiler(
tc_all_clinic_sig_sva[["deseq"]][["downs"]][["clinics"]],
excel = glue("{gsea_prefix}/cali_cateogies_up-v{ver}.xlsx"))
increased_cali_categories## A set of ontologies produced by gprofiler using 1788
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 59 MF
## 689 BP
## 89 CC
## 2 KEGG
## 20 REAC
## 8 WP
## 356 TF
## 2 MIRNA
## 18 HPA
## 0 CORUM
## 15 HP hits.increased_cali_categories[["pvalue_plots"]][["BP"]]## NULL3.1.2 Visualize clinic differences
Let us take a quick look at the results of the comparison of Tumaco/Cali.
Note: I keep re-introducing an error which causes these (volcano and MA) plots to be reversed with respect to the logFC values. Pay careful attention to these and make sure that they agree with the numbers of genes observed in the contrast.
I eventually took some code from Theresa which more intelligently colors the sides of MA/volcano plots to be the same colors as their corresponding numerator/denominator.
## Check that up is up
summary(tc_all_clinic_table_sva[["data"]][["clinics"]][["deseq_logfc"]])## Min. 1st Qu. Median Mean 3rd Qu. Max.
## -25.270 -0.583 -0.156 -0.255 0.171 3.483## I think we can assume that most genes are down when considering Tumaco/Cali.
sum(tc_all_clinic_table_sva$data$clinics$deseq_logfc < -1.0 &
tc_all_clinic_table_sva$data$clinics$deseq_adjp < 0.05)## [1] 1788tc_all_clinic_table_sva[["plots"]][["clinics"]][["deseq_vol_plots"]]
There appear to be many more genes which are increased in the Tumaco samples with respect to the Cali samples.
3.2 DE: Compare clinics, eosinophil samples
The remaining cell types all have pretty strong clinic-based variance; but I am not certain if it is consistent across cell types.
table(pData(tc_eosinophils)[["condition"]])##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9tc_eosinophils_clinic_de_nobatch <- all_pairwise(tc_eosinophils, parallel = parallel,
model_batch = FALSE, filter = TRUE,
methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_eosinophils_clinic_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_eosinophils_clinic_de_nobatch[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_eosinophils_clinic_table_nobatch <- combine_de_tables(
tc_eosinophils_clinic_de_nobatch, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_table_nobatch-v{ver}.xlsx"))
tc_eosinophils_clinic_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 102 35 114
## 2 tumaco_cure_vs_cali_cure 828 811 778
## edger_sigdown limma_sigup limma_sigdown
## 1 31 61 17
## 2 885 711 700## Plot describing unique/shared genes in a differential expression table.
tc_eosinophils_clinic_sig_nobatch <- extract_significant_genes(
tc_eosinophils_clinic_table_nobatch,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_sig_nobatch-v{ver}.xlsx"))
tc_eosinophils_clinic_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## tumaco 61 17 114 31 102 35 7
## cure 711 700 778 885 828 811 694
## ebseq_down basic_up basic_down
## tumaco 36 10 0
## cure 596 5543 0
tc_eosinophils_clinic_de_sva <- all_pairwise(tc_eosinophils, model_batch = "svaseq",
filter = TRUE, methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 15 17 9## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.
tc_eosinophils_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_eosinophils_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_eosinophils_clinic_table_sva <- combine_de_tables(
tc_eosinophils_clinic_de_sva, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_table_sva-v{ver}.xlsx"))
tc_eosinophils_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 111 61 114
## 2 tumaco_cure_vs_cali_cure 785 861 716
## edger_sigdown limma_sigup limma_sigdown
## 1 36 74 35
## 2 925 734 672## Plot describing unique/shared genes in a differential expression table.
tc_eosinophils_clinic_sig_sva <- extract_significant_genes(
tc_eosinophils_clinic_table_sva,
excel = glue("{clinic_cf_prefix}/Eosinophils/tc_eosinophils_clinic_sig_sva-v{ver}.xlsx"))
tc_eosinophils_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## tumaco 74 35 114 36 111 61 7
## cure 734 672 716 925 785 861 694
## ebseq_down basic_up basic_down
## tumaco 36 10 0
## cure 596 5543 0
3.3 DE: Compare clinics, biopsy samples
Interestingly to me, the biopsy samples appear to have the least location-based variance. But we can perform an explicit DE and see how well that hypothesis holds up.
Note that these data include cure and fail samples for
table(pData(tc_biopsies)[["condition"]])##
## cali_cure tumaco_cure tumaco_failure
## 4 9 5tc_biopsies_clinic_de_sva <- all_pairwise(tc_biopsies, parallel = parallel,
model_batch = "svaseq", filter = TRUE,
methods = methods)##
## cali_cure tumaco_cure tumaco_failure
## 4 9 5## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_biopsies_clinic_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_biopsies_clinic_de_sva[["deseq"]][["contrasts_performed"]]## [1] "tumaco_failure_vs_tumaco_cure" "tumaco_failure_vs_cali_cure"
## [3] "tumaco_cure_vs_cali_cure"tc_biopsies_clinic_table_sva <- combine_de_tables(
tc_biopsies_clinic_de_sva, keepers = tc_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Biopsies/tc_biopsies_clinic_table_sva-v{ver}.xlsx"))
tc_biopsies_clinic_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 14 11 18
## 2 tumaco_cure_vs_cali_cure 1 0 0
## edger_sigdown limma_sigup limma_sigdown
## 1 6 0 0
## 2 0 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_biopsies_clinic_sig_sva <- extract_significant_genes(
tc_biopsies_clinic_table_sva,
excel = glue("{clinic_cf_prefix}/Biopsies/tc_biopsies_clinic_sig_sva-v{ver}.xlsx"))
tc_biopsies_clinic_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## tumaco 0 0 18 6 14 11 11
## cure 0 0 0 0 1 0 27
## ebseq_down basic_up basic_down
## tumaco 60 0 0
## cure 1 0 0
3.4 DE: Compare clinics, monocyte samples
At least for the moment, I am only looking at the differences between no-batch vs. sva across clinics for the monocyte samples. This was chosen mostly arbitrarily.
3.4.1 DE: Compare clinics, monocytes without batch estimation
Our baseline is the comparison of the monocytes samples without batch in the model or surrogate estimation. In theory at least, this should correspond to the PCA plot above when no batch estimation was performed.
table(pData(tc_monocytes)[["condition"]])##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21tc_monocytes_de_nobatch <- all_pairwise(tc_monocytes, model_batch = FALSE,
filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_monocytes_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_monocytes_table_nobatch <- combine_de_tables(
tc_monocytes_de_nobatch, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_table_nobatch-v{ver}.xlsx"))
tc_monocytes_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 16 20 32
## 2 tumaco_failure_vs_tumaco_cure 48 120 60
## 3 tumaco_cure_vs_cali_cure 781 724 773
## 4 tumaco_failure_vs_cali_failure 633 488 515
## edger_sigdown limma_sigup limma_sigdown
## 1 13 38 5
## 2 138 23 37
## 3 779 644 713
## 4 535 395 564## Plot describing unique/shared genes in a differential expression table.
tc_monocytes_sig_nobatch <- extract_significant_genes(
tc_monocytes_table_nobatch,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_sig_nobatch-v{ver}.xlsx"))
tc_monocytes_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 38 5 32 13 16 20 92
## tumaco 23 37 60 138 48 120 0
## cure 644 713 773 779 781 724 642
## fail 395 564 515 535 633 488 166
## ebseq_down basic_up basic_down
## cali 23 0 0
## tumaco 23 339 0
## cure 660 6378 0
## fail 525 2160 0
3.4.2 DE: Compare clinics, monocytes with svaseq
In contrast, the following comparison should give a view of the data corresponding to the svaseq PCA plot above. In the best case scenario, we should therefore be able to see some differences between the Tumaco cure and fail samples.
tc_monocytes_de_sva <- all_pairwise(tc_monocytes, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 21 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_monocytes_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_monocytes_table_sva <- combine_de_tables(
tc_monocytes_de_sva, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_table_sva-v{ver}.xlsx"))
tc_monocytes_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 27 36 40
## 2 tumaco_failure_vs_tumaco_cure 34 88 29
## 3 tumaco_cure_vs_cali_cure 763 728 711
## 4 tumaco_failure_vs_cali_failure 684 583 576
## edger_sigdown limma_sigup limma_sigdown
## 1 17 51 7
## 2 71 15 57
## 3 758 640 663
## 4 615 430 553## Plot describing unique/shared genes in a differential expression table.
tc_monocytes_sig_sva <- extract_significant_genes(
tc_monocytes_table_sva,
excel = glue("{clinic_cf_prefix}/Monocytes/tc_monocytes_clinic_sig_sva-v{ver}.xlsx"))
tc_monocytes_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 51 7 40 17 27 36 92
## tumaco 15 57 29 71 34 88 0
## cure 640 663 711 758 763 728 642
## fail 430 553 576 615 684 583 166
## ebseq_down basic_up basic_down
## cali 23 0 0
## tumaco 23 339 0
## cure 660 6378 0
## fail 525 2160 0
3.4.3 DE Compare: How similar are the no-batch vs. SVA results?
The following block shows that these two results are exceedingly different, sugesting that the Cali cure/fail and Tumaco cure/fail cannot easily be considered in the same analysis. I did some playing around with my calculate_aucc function in this block and found that it is in some important way broken, at least if one expands the top-n genes to more than 20% of the number of genes in the data.
cali_table <- tc_monocytes_table_nobatch[["data"]][["cali"]]
table <- tc_monocytes_table_nobatch[["data"]][["tumaco"]]
cali_aucc <- calculate_aucc(cali_table, table, px = "deseq_adjp", py = "deseq_adjp",
lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc## These two tables have an aucc value of: 0.0659989114452595 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 1.3, df = 11084, p-value = 0.2
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.005944 0.031280
## sample estimates:
## cor
## 0.01267
cali_table_sva <- tc_monocytes_table_sva[["data"]][["cali"]]
tumaco_table_sva <- tc_monocytes_table_sva[["data"]][["tumaco"]]
cali_aucc_sva <- calculate_aucc(cali_table_sva, tumaco_table_sva, px = "deseq_adjp",
py = "deseq_adjp", lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc_sva## These two tables have an aucc value of: 0.0846505658047588 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 17, df = 11084, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.1396 0.1759
## sample estimates:
## cor
## 0.1578
3.5 DE: Compare clinics, neutrophil samples
tc_neutrophils_de_nobatch <- all_pairwise(tc_neutrophils, parallel = parallel,
model_batch = FALSE, filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_neutrophils_de_nobatch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: none.## The primary analysis performed 21 comparisons.tc_neutrophils_table_nobatch <- combine_de_tables(
tc_neutrophils_de_nobatch, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_table_nobatch-v{ver}.xlsx"))
tc_neutrophils_table_nobatch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 33 85 42
## 2 tumaco_failure_vs_tumaco_cure 95 49 112
## 3 tumaco_cure_vs_cali_cure 905 337 913
## 4 tumaco_failure_vs_cali_failure 983 256 803
## edger_sigdown limma_sigup limma_sigdown
## 1 33 37 10
## 2 55 7 12
## 3 355 627 520
## 4 281 380 460## Plot describing unique/shared genes in a differential expression table.
tc_neutrophils_sig_nobatch <- extract_significant_genes(
tc_neutrophils_table_nobatch,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_sig_nobatch-v{ver}.xlsx"))
tc_neutrophils_sig_nobatch## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 37 10 42 33 33 85 90
## tumaco 7 12 112 55 95 49 7
## cure 627 520 913 355 905 337 683
## fail 380 460 803 281 983 256 113
## ebseq_down basic_up basic_down
## cali 39 0 0
## tumaco 7 8 0
## cure 299 4589 0
## fail 310 1652 0
tc_neutrophils_de_sva <- all_pairwise(tc_neutrophils, parallel = parallel,
model_batch = "svaseq", filter = TRUE,
methods = methods)##
## cali_cure cali_failure tumaco_cure tumaco_failure
## 18 3 20 21## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.
tc_neutrophils_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_neutrophils_table_sva <- combine_de_tables(
tc_neutrophils_de_sva, keepers = clinic_cf_contrasts,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_table_sva-v{ver}.xlsx"))
tc_neutrophils_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 cali_failure_vs_cali_cure 88 183 102
## 2 tumaco_failure_vs_tumaco_cure 92 42 80
## 3 tumaco_cure_vs_cali_cure 853 379 831
## 4 tumaco_failure_vs_cali_failure 704 201 611
## edger_sigdown limma_sigup limma_sigdown
## 1 121 76 49
## 2 24 44 51
## 3 384 650 486
## 4 220 312 332## Plot describing unique/shared genes in a differential expression table.
tc_neutrophils_sig_sva <- extract_significant_genes(
tc_neutrophils_table_sva,
excel = glue("{clinic_cf_prefix}/Neutrophils/tc_neutrophils_sig_sva-v{ver}.xlsx"))
tc_neutrophils_sig_sva## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down ebseq_up
## cali 76 49 102 121 88 183 90
## tumaco 44 51 80 24 92 42 7
## cure 650 486 831 384 853 379 683
## fail 312 332 611 220 704 201 113
## ebseq_down basic_up basic_down
## cali 39 0 0
## tumaco 7 8 0
## cure 299 4589 0
## fail 310 1652 0
3.6 GSEA: Extract clinic-specific genes
Given the above comparisons, we can extract some gene sets which resulted from those DE analyses and eventually perform some ontology/KEGG/reactome/etc searches. This reminds me, I want to make my extract_significant_ functions to return gene-set data structures and my various ontology searches to take them as inputs. This should help avoid potential errors when extracting up/down genes.
clinic_sigenes_up <- rownames(tc_all_clinic_sig_sva[["deseq"]][["ups"]][["clinics"]])
clinic_sigenes_down <- rownames(tc_all_clinic_sig_sva[["deseq"]][["downs"]][["clinics"]])
clinic_sigenes <- c(clinic_sigenes_up, clinic_sigenes_down)
tc_eosinophils_sigenes_up <- rownames(tc_eosinophils_clinic_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_eosinophils_sigenes_down <- rownames(tc_eosinophils_clinic_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_monocytes_sigenes_up <- rownames(tc_monocytes_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_monocytes_sigenes_down <- rownames(tc_monocytes_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_neutrophils_sigenes_up <- rownames(tc_neutrophils_sig_sva[["deseq"]][["ups"]][["cure"]])
tc_neutrophils_sigenes_down <- rownames(tc_neutrophils_sig_sva[["deseq"]][["downs"]][["cure"]])
tc_eosinophils_sigenes <- c(tc_eosinophils_sigenes_up,
tc_eosinophils_sigenes_down)
tc_monocytes_sigenes <- c(tc_monocytes_sigenes_up,
tc_monocytes_sigenes_down)
tc_neutrophils_sigenes <- c(tc_neutrophils_sigenes_up,
tc_neutrophils_sigenes_down)3.7 GSEA: gProfiler of genes deemed up/down when comparing Cali and Tumaco
I was curious to try to understand why the two clinics appear to be so different vis a vis their PCA/DE; so I thought that gProfiler might help boil those results down to something more digestible.
3.7.1 GSEA: Compare clinics, all samples
Note that in the following block I used the function simple_gprofiler(), but later in this document I will use all_gprofiler(). The first invocation limits the search to a single table, while the second will iterate over every result in a pairwise differential expression analysis.
In this instance, we are looking at the vector of gene IDs deemed significantly different between the two clinics in either the up or down direction.
One other thing worth noting, the new version of gProfiler provides some fun interactive plots. I will add an example here.
tc_eosinophil_gprofiler <- simple_gprofiler(
tc_eosinophils_sigenes_up,
excel = glue("{gsea_prefix}/eosinophil_clinics_tumaco_up-v{ver}.xlsx"))
tc_eosinophil_gprofiler## A set of ontologies produced by gprofiler using 785
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 21 MF
## 213 BP
## 16 CC
## 0 KEGG
## 3 REAC
## 0 WP
## 549 TF
## 11 MIRNA
## 0 HPA
## 4 CORUM
## 0 HP hits.clinic_gp <- simple_gprofiler(
clinic_sigenes,
excel = glue("{gsea_prefix}/both_clinics_cali_up-v{ver}.xlsx"))
clinic_gp$pvalue_plots$REAC
clinic_gp$pvalue_plots$BP## NULLclinic_gp$pvalue_plots$TF
clinic_gp$interactive_plots$GO## NULL3.7.2 GSEA: Compare clinics, Eosinophil samples
In the following block, I am looking at the gProfiler over represented groups observed across clinics in only the Eosinophils. First I do so for all genes(up or down), followed by only the up and down groups. Each of the following will include only the Reactome and GO:BP plots. These searches did not have too many other hits, excepting the transcription factor database.
tc_eosinophils_gp <- simple_gprofiler(
tc_eosinophils_sigenes,
excel = glue("{gsea_prefix}/eosinophil_clinics-v{ver}.xlsx"))
tc_eosinophils_gp## A set of ontologies produced by gprofiler using 1646
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 39 MF
## 281 BP
## 50 CC
## 0 KEGG
## 0 REAC
## 0 WP
## 582 TF
## 13 MIRNA
## 0 HPA
## 5 CORUM
## 0 HP hits.tc_eosinophils_gp$pvalue_plots$REAC## NULLtc_eosinophils_gp$pvalue_plots$BP## NULLtc_eosinophils_up_gp <- simple_gprofiler(
tc_eosinophils_sigenes_up,
excel = glue("{gsea_prefix}/eosinophil_clinics_tumaco_up-v{ver}.xlsx"))
tc_eosinophils_up_gp## A set of ontologies produced by gprofiler using 785
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 21 MF
## 213 BP
## 16 CC
## 0 KEGG
## 3 REAC
## 0 WP
## 549 TF
## 11 MIRNA
## 0 HPA
## 4 CORUM
## 0 HP hits.tc_eosinophils_up_gp$pvalue_plots$REAC
tc_eosinophils_down_gp <- simple_gprofiler(
tc_eosinophils_sigenes_down,
excel = glue("{gsea_prefix}/eosinophil_clinics_cali_up-v{ver}.xlsx"))
tc_eosinophils_down_gp## A set of ontologies produced by gprofiler using 861
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 12 MF
## 126 BP
## 70 CC
## 3 KEGG
## 10 REAC
## 3 WP
## 70 TF
## 1 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.tc_eosinophils_down_gp$pvalue_plots$REAC
3.7.3 GSEA: Compare clinics, Monocyte samples
In the following block I repeated the above query, but this time looking at the monocyte samples.
tc_monocytes_up_gp <- simple_gprofiler(
tc_monocytes_sigenes,
excel = glue("{gsea_prefix}/monocyte_clinics-v{ver}.xlsx"))
tc_monocytes_up_gp## A set of ontologies produced by gprofiler using 1491
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 57 MF
## 480 BP
## 29 CC
## 0 KEGG
## 5 REAC
## 6 WP
## 545 TF
## 4 MIRNA
## 0 HPA
## 1 CORUM
## 0 HP hits.tc_monocytes_up_gp$pvalue_plots$REAC
tc_monocytes_up_gp$pvalue_plots$BP## NULLtc_monocytes_down_gp <- simple_gprofiler(
tc_monocytes_sigenes_down,
excel = glue("{gsea_prefix}/monocyte_clinics_cali_up-v{ver}.xlsx"))
tc_monocytes_down_gp$pvalue_plots$REAC
tc_monocytes_down_gp$pvalue_plots$BP## NULL3.7.3.1 GSEA: Compare clinics, Neutrophil samples
Ibid. This time looking at the Neutrophils. Thus the first two images should be a superset of the second and third pairs of images; assuming that the genes in the up/down list do not cause the groups to no longer be significant. Interestingly, the reactome search did not return any hits for the increased search.
tc_neutrophils_gp <- simple_gprofiler(
tc_neutrophils_sigenes,
excel = glue("{gsea_prefix}/neutrophil_clinics-v{ver}.xlsx"))
## tc_neutrophils_gp$pvalue_plots$REAC ## no hits
tc_neutrophils_gp$pvalue_plots$BP## NULLtc_neutrophils_gp$pvalue_plots$TF
tc_neutrophils_up_gp <- simple_gprofiler(
tc_neutrophils_sigenes_up,
excel = glue("{gsea_prefix}/neutrophil_clinics_tumaco_up-v{ver}.xlsx"))
## tc_neutrophils_up_gp$pvalue_plots$REAC ## No hits
tc_neutrophils_up_gp$pvalue_plots$BP## NULLtc_neutrophils_down_gp <- simple_gprofiler(
tc_neutrophils_sigenes_down,
excel = glue("{gsea_prefix}/neutrophil_clinics_cali_up-v{ver}.xlsx"))
tc_neutrophils_down_gp$pvalue_plots$REAC
tc_neutrophils_down_gp$pvalue_plots$BP## NULL4 Compare DE: How similar are Tumaco C/F vs. Cali C/F
The following expands the cross-clinic query above to also test the neutrophils. Once again, I think it will pretty strongly support the hypothesis that the two clinics are not compatible.
We are concerned that the clinic-based batch effect may make our results essentially useless. One way to test this concern is to compare the set of genes observed different between the Cali Cure/Fail vs. the Tumaco Cure/Fail.
cali_table_nobatch <- tc_neutrophils_table_nobatch[["data"]][["cali"]]
tumaco_table_nobatch <- tc_neutrophils_table_nobatch[["data"]][["tumaco"]]
cali_merged_nobatch <- merge(cali_table_nobatch, tumaco_table_nobatch, by="row.names")
cor.test(cali_merged_nobatch[, "deseq_logfc.x"], cali_merged_nobatch[, "deseq_logfc.y"])##
## Pearson's product-moment correlation
##
## data: cali_merged_nobatch[, "deseq_logfc.x"] and cali_merged_nobatch[, "deseq_logfc.y"]
## t = -16, df = 9229, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## -0.1821 -0.1423
## sample estimates:
## cor
## -0.1623cali_aucc_nobatch <- calculate_aucc(cali_table_nobatch, tumaco_table_nobatch, px = "deseq_adjp",
py = "deseq_adjp", lx = "deseq_logfc", ly = "deseq_logfc")
cali_aucc_nobatch$plot
5 Tumaco and Cali, cure vs. fail
In all of the above, we are looking to understand the differences between the two locations. Let us now step back and perform the original question: fail/cure without regard to location.
I performed this query with a few different parameters, notably with(out) sva and again using each cell type, including biopsies. The main reasion I am keeping these comparisons is in the relatively weak hope that there will be sufficient signal in the full dataset that it might be able to overcome the apparently ridiculous batch effect from the two clinics.
5.1 All cell types together, with(out) SVA
table(pData(tc_valid)[["condition"]])##
## cure failure
## 122 62tc_all_cf_de_sva <- all_pairwise(tc_valid, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 122 62## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_all_cf_table_sva <- combine_de_tables(
tc_all_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_table_sva-v{ver}.xlsx"))
tc_all_cf_sig_sva <- extract_significant_genes(
tc_all_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_sig_sva-v{ver}.xlsx"))
tc_all_cf_de_batch <- all_pairwise(tc_valid, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 122 62
##
## v3 v2 v1
## 51 50 83## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_all_cf_table_batch <- combine_de_tables(
tc_all_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_table_batch-v{ver}.xlsx"))
tc_all_cf_sig_batch <- extract_significant_genes(
tc_all_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_valid_cf_sig_batch-v{ver}.xlsx"))5.2 All cell types except biopsies
I am not sure if this is the best choice, but I call the set of all samples excluding biopsies ‘clinical’.
table(pData(tc_clinical_nobiop)[["condition"]])##
## cure failure
## 109 57tc_clinical_cf_de_sva <- all_pairwise(tc_clinical_nobiop, filter = TRUE,
model_batch = "svaseq",
methods = methods)##
## cure failure
## 109 57## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_clinical_cf_de_sva## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## basic_vs_deseq 0.8865
## basic_vs_dream 0.9294
## basic_vs_ebseq 0.7595
## basic_vs_edger 0.9007
## basic_vs_limma 0.9415
## basic_vs_noiseq 0.9213
## deseq_vs_dream 0.8999
## deseq_vs_ebseq 0.8271
## deseq_vs_edger 0.9919
## deseq_vs_limma 0.8936
## deseq_vs_noiseq 0.9409
## dream_vs_ebseq 0.8102
## dream_vs_edger 0.9024
## dream_vs_limma 0.9855
## dream_vs_noiseq 0.8709
## ebseq_vs_edger 0.8188
## ebseq_vs_limma 0.8184
## ebseq_vs_noiseq 0.8312
## edger_vs_limma 0.8971
## edger_vs_noiseq 0.9517
## limma_vs_noiseq 0.8733tc_clinical_cf_table_sva <- combine_de_tables(
tc_clinical_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_table_sva-v{ver}.xlsx"))
tc_clinical_cf_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 181 93 209 92
## limma_sigup limma_sigdown
## 1 96 78## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_clinical_cf_sig_sva <- extract_significant_genes(
tc_clinical_cf_table_sva, according_to = "deseq",
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_sig_sva-v{ver}.xlsx"))
tc_clinical_cf_sig_sva## A set of genes deemed significant according to deseq.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## deseq_up deseq_down
## outcome 181 93
tc_clinical_cf_de_batch <- all_pairwise(tc_clinical_nobiop, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 109 57
##
## eosinophils monocytes neutrophils
## 41 63 62## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_clinical_cf_de_batch## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: batch in model/limma.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## basic_vs_deseq 0.6444
## basic_vs_dream 0.7017
## basic_vs_ebseq 0.7595
## basic_vs_edger 0.6445
## basic_vs_limma 0.7122
## basic_vs_noiseq 0.9213
## deseq_vs_dream 0.8060
## deseq_vs_ebseq 0.7628
## deseq_vs_edger 0.9991
## deseq_vs_limma 0.8096
## deseq_vs_noiseq 0.7631
## dream_vs_ebseq 0.6730
## dream_vs_edger 0.8114
## dream_vs_limma 0.9716
## dream_vs_noiseq 0.6695
## ebseq_vs_edger 0.7626
## ebseq_vs_limma 0.6897
## ebseq_vs_noiseq 0.8312
## edger_vs_limma 0.8140
## edger_vs_noiseq 0.7631
## limma_vs_noiseq 0.6685tc_clinical_cf_table_batch <- combine_de_tables(
tc_clinical_cf_de_batch, keepers = t_cf_contrast, label_column = "hgnc_symbol",
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_table_batch-v{ver}.xlsx"))
tc_clinical_cf_table_batch## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 104 68 114 73
## limma_sigup limma_sigdown
## 1 81 45## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_clinical_cf_sig_batch <- extract_significant_genes(
tc_clinical_cf_table_batch, according_to = "deseq",
excel = glue("{cf_prefix}/Clinical_Samples/tc_clinical_cf_sig_batch-v{ver}.xlsx"))
tc_clinical_cf_sig_batch## A set of genes deemed significant according to deseq.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## deseq_up deseq_down
## outcome 104 68
5.2.1 A portion of Supplemental Figure 11.
num_color <- color_choices[["cf"]][["cure"]]
den_color <- color_choices[["cf"]][["failure"]]
tc_clinical_cf_table <- tc_clinical_cf_table_sva[["data"]][["outcome"]]
tc_clinical_cf_volcano_top10 <- plot_volcano_condition_de(
tc_clinical_cf_table, "outcome", label = 10,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = "figures/s11c_tc_clinical_cf_volcano_labeled_top10.svg")
tc_clinical_cf_volcano_top10[["plot"]]
dev.off()## png
## 2tc_clinical_cf_volcano_top10[["plot"]]
5.3 Biopsies, with(out) SVA
In the following block, we repeat the same question, but using only the biopsy samples from both clinics.
tc_biopsies_cf <- set_expt_conditions(tc_biopsies, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 13 5tc_biopsies_cf_de_sva <- all_pairwise(tc_biopsies_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 13 5## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_biopsies_cf_table_sva <- combine_de_tables(
tc_biopsies_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Biopsies/tc_biopsies_cf_table_sva-v{ver}.xlsx"))
tc_biopsies_cf_sig_sva <- extract_significant_genes(
tc_biopsies_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_sig_sva-v{ver}.xlsx"))
tc_biopsies_cf_de_batch <- all_pairwise(tc_biopsies_cf, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 13 5
##
## v1
## 18## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_biopsies_cf_table_batch <- combine_de_tables(
tc_biopsies_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_table_batch-v{ver}.xlsx"))
tc_biopsies_cf_sig_batch <- extract_significant_genes(
tc_biopsies_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_biopsies_cf_sig_batch-v{ver}.xlsx"))5.4 Eosinophils, with(out) SVA
In the following block, we repeat the same question, but using only the Eosinophil samples from both clinics.
tc_eosinophils_cf <- set_expt_conditions(tc_eosinophils, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 32 9tc_eosinophils_cf_de_sva <- all_pairwise(tc_eosinophils_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 32 9## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_eosinophils_cf_table_sva <- combine_de_tables(
tc_eosinophils_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/tc_eosinophils_cf_table_sva-v{ver}.xlsx"))
tc_eosinophils_cf_sig_sva <- extract_significant_genes(
tc_eosinophils_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_sig_sva-v{ver}.xlsx"))
tc_eosinophils_cf_de_batch <- all_pairwise(tc_eosinophils_cf, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 32 9
##
## v3 v2 v1
## 13 14 14## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_eosinophils_cf_table_batch <- combine_de_tables(
tc_eosinophils_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_table_batch-v{ver}.xlsx"))
tc_eosinophils_cf_sig_batch <- extract_significant_genes(
tc_eosinophils_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_eosinophils_cf_sig_batch-v{ver}.xlsx"))5.5 Monocytes, with(out) SVA
Repeat yet again, this time with the monocyte samples. The idea is to see if there is a cell type which is particularly good (or bad) at discriminating the two clinics.
tc_monocytes_cf <- set_expt_conditions(tc_monocytes, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 39 24tc_monocytes_cf_de_sva <- all_pairwise(tc_monocytes_cf, filter = TRUE, methods = methods,
model_batch = "svaseq")##
## cure failure
## 39 24## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_monocytes_cf_table_sva <- combine_de_tables(
tc_monocytes_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Monocytes/tc_monocytes_cf_table_sva-v{ver}.xlsx"))
tc_monocytes_cf_sig_sva <- extract_significant_genes(
tc_monocytes_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_sig_sva-v{ver}.xlsx"))
tc_monocytes_cf_de_batch <- all_pairwise(tc_monocytes_cf, filter = TRUE, methods = methods,
model_batch = TRUE)##
## cure failure
## 39 24
##
## v3 v2 v1
## 19 18 26## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_monocytes_cf_table_batch <- combine_de_tables(
tc_monocytes_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_table_batch-v{ver}.xlsx"))
tc_monocytes_cf_sig_batch <- extract_significant_genes(
tc_monocytes_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_monocytes_cf_sig_batch-v{ver}.xlsx"))5.6 Neutrophils, with(out) SVA
Last try, this time using the Neutrophil samples.
tc_neutrophils_cf <- set_expt_conditions(tc_neutrophils, fact = "finaloutcome")## The numbers of samples by condition are:##
## cure failure
## 38 24tc_neutrophils_cf_de_sva <- all_pairwise(tc_neutrophils_cf, parallel = parallel,
filter = TRUE, model_batch = "svaseq",
methods = methods)##
## cure failure
## 38 24## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_neutrophils_cf_table_sva <- combine_de_tables(
tc_neutrophils_cf_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/tc_neutrophils_cf_table_sva-v{ver}.xlsx"))
tc_neutrophils_cf_sig_sva <- extract_significant_genes(
tc_neutrophils_cf_table_sva,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_sig_sva-v{ver}.xlsx"))
tc_neutrophils_cf_de_batch <- all_pairwise(tc_neutrophils_cf, filter = TRUE,
model_batch = TRUE,
methods = methods)##
## cure failure
## 38 24
##
## v3 v2 v1
## 19 18 25## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties
## Warning in wilcox.test.default(x = as.numeric(xdata[j, ]), y =
## as.numeric(ydata[j, : cannot compute exact p-value with ties## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_neutrophils_cf_table_batch <- combine_de_tables(
tc_neutrophils_cf_de_batch, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_table_batch-v{ver}.xlsx"))
tc_neutrophils_cf_sig_batch <- extract_significant_genes(
tc_neutrophils_cf_table_batch,
excel = glue("{cf_prefix}/All_Samples/tc_neutrophils_cf_sig_batch-v{ver}.xlsx"))6 Visit comparisons
Later in this document I do a bunch of visit/cf comparisons. In this block I want to explicitly only compare v1 to other visits. This is something I did quite a lot in the 2019 datasets, but never actually moved to this document.
v1_vs_later <- all_pairwise(tc_v1vs, model_batch = "svaseq", methods = methods,
filter = TRUE)##
## first later
## 65 101## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.v1_vs_later_table <- combine_de_tables(
v1_vs_later, keepers = visit_v1later,
excel = glue("{visit_prefix}/v1_vs_later_tables-v{ver}.xlsx"))
v1_vs_later_sig <- extract_significant_genes(
v1_vs_later_table,
excel = glue("{visit_prefix}/v1_vs_later_sig-v{ver}.xlsx"))6.0.0.1 GSEA: V1 vs other visits.
v1later_gp <- all_gprofiler(v1_vs_later_sig)
v1later_gp[[1]]$pvalue_plots$REAC
v1later_gp[[2]]$pvalue_plots$REAC
7 Sex comparison
tc_sex_de <- all_pairwise(tc_sex, model_batch = "svaseq", methods = methods,
filter = TRUE)##
## female male
## 28 156## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_sex_table <- combine_de_tables(
tc_sex_de, excel = glue("{sex_prefix}/tc_sex_table-v{ver}.xlsx"))
tc_sex_sig <- extract_significant_genes(
tc_sex_table, excel = glue("{sex_prefix}/tc_sex_sig-v{ver}.xlsx"))
tc_sex_gp <- all_gprofiler(tc_sex_sig)tc_sex_cure <- subset_expt(tc_sex, subset = "finaloutcome=='cure'")## subset_expt(): There were 184, now there are 122 samples.tc_sex_cure_de <- all_pairwise(tc_sex_cure, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## female male
## 19 103## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_sex_cure_de## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.## The logFC agreement among the methods follows:## mal_vs_fml
## basic_vs_deseq 0.6829
## basic_vs_dream 0.9094
## basic_vs_ebseq 0.5372
## basic_vs_edger 0.7974
## basic_vs_limma 0.9066
## basic_vs_noiseq 0.8141
## deseq_vs_dream 0.6847
## deseq_vs_ebseq 0.6539
## deseq_vs_edger 0.8760
## deseq_vs_limma 0.6556
## deseq_vs_noiseq 0.7614
## dream_vs_ebseq 0.6272
## dream_vs_edger 0.8040
## dream_vs_limma 0.9643
## dream_vs_noiseq 0.7544
## ebseq_vs_edger 0.6871
## ebseq_vs_limma 0.5873
## ebseq_vs_noiseq 0.6317
## edger_vs_limma 0.7733
## edger_vs_noiseq 0.8654
## limma_vs_noiseq 0.7144tc_sex_cure_table <- combine_de_tables(
tc_sex_cure_de, excel = glue("{sex_prefix}/tc_sex_cure_table-v{ver}.xlsx"))
tc_sex_cure_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 male_vs_female 68 74 62 80
## limma_sigup limma_sigdown
## 1 37 73## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tc_sex_cure_sig <- extract_significant_genes(
tc_sex_cure_table, excel = glue("{sex_prefix}/tc_sex_cure_sig-v{ver}.xlsx"))
tc_sex_cure_sig## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## male_vs_female 37 73 62 80 68 74
## ebseq_up ebseq_down basic_up basic_down
## male_vs_female 9 8 11 0
7.0.0.1 GSEA: Sex comparisons both clinics
tc_sex_cure_gp <- all_gprofiler(tc_sex_cure_sig)
tc_sex_cure_gp## Running gProfiler on every set of significant genes found:## BP CC CORUM HP HPA KEGG MIRNA MF REAC TF WP
## male_vs_female_up 3 2 0 1 0 1 0 1 0 4 1
## male_vs_female_down 3 0 0 0 0 0 0 0 1 0 0tc_sex_cure_gp[[1]][["pvalue_plots"]][["BP"]]## NULLtc_sex_cure_gp[[2]][["pvalue_plots"]][["BP"]]## NULL8 Ethnicity comparisons
tc_ethnicity_de <- all_pairwise(tc_etnia_expt, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## afrocol indigena mestiza
## 91 46 47## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.tc_ethnicity_de## A pairwise differential expression with results from: basic, deseq, ebseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 21 comparisons.tc_ethnicity_table <- combine_de_tables(
tc_ethnicity_de, keepers = ethnicity_contrasts,
excel = glue("{eth_prefix}/tc_ethnicity_table-v{ver}.xlsx"))
tc_ethnicity_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 mestiza_vs_indigena 47 22 54 23
## 2 mestiza_vs_afrocol 53 165 53 180
## 3 indigena_vs_afrocol 66 269 71 279
## limma_sigup limma_sigdown
## 1 23 14
## 2 41 90
## 3 75 143## Plot describing unique/shared genes in a differential expression table.
tc_ethnicity_table[["plots"]][["mestizo_indigenous"]][["deseq_ma_plots"]]
tc_ethnicity_table[["plots"]][["mestizo_afrocol"]][["deseq_ma_plots"]]
tc_ethnicity_table[["plots"]][["indigenous_afrocol"]][["deseq_ma_plots"]]
tc_ethnicity_sig <- extract_significant_genes(
tc_ethnicity_table, excel = glue("{eth_prefix}/tc_ethnicity_sig-v{ver}.xlsx"))
ethnicity_cure <- subset_expt(tc_etnia_expt, subset = "finaloutcome=='cure'")## subset_expt(): There were 184, now there are 122 samples.ethnicity_cure_de <- all_pairwise(ethnicity_cure, model_batch = "svaseq",
filter = TRUE,
methods = methods)##
## afrocol indigena mestiza
## 39 36 47## Basic step 0/3: Normalizing data.## Basic step 0/3: Converting data.## Basic step 0/3: Transforming data.## converting counts to integer mode## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.## Warning in createContrastL(objFlt$formula, objFlt$data, L): Contrasts with only
## a single non-zero term are already evaluated by default.## libsize was not specified, this parameter has profound effects on limma's result.## Using the libsize from expt$best_libsize.
ethnicity_cure_table <- combine_de_tables(
ethnicity_cure_de, keepers = ethnicity_contrasts,
excel = glue("{eth_prefix}/ethnicity_cure_table-v{ver}.xlsx"))
ethnicity_cure_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 mestiza_vs_indigena 63 24 59 26
## 2 mestiza_vs_afrocol 66 167 76 165
## 3 indigena_vs_afrocol 86 350 94 340
## limma_sigup limma_sigdown
## 1 36 16
## 2 61 101
## 3 108 177## Plot describing unique/shared genes in a differential expression table.
ethnicity_cure_table[["plots"]][["mestizo_indigenous"]][["deseq_ma_plots"]]
ethnicity_cure_table[["plots"]][["mestizo_afrocol"]][["deseq_ma_plots"]]
ethnicity_cure_table[["plots"]][["indigenous_afrocol"]][["deseq_ma_plots"]]
ethnicity_cure_sig <- extract_significant_genes(
ethnicity_cure_table, excel = glue("{eth_prefix}/ethnicity_cure_sig-v{ver}.xlsx"))
ethnicity_cure_sig## A set of genes deemed significant according to limma, edger, deseq, ebseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## mestizo_indigenous 36 16 59 26 63 24
## mestizo_afrocol 61 101 76 165 66 167
## indigenous_afrocol 108 177 94 340 86 350
## ebseq_up ebseq_down basic_up basic_down
## mestizo_indigenous 10 0 6 0
## mestizo_afrocol 5 16 44 0
## indigenous_afrocol 9 38 433 0
8.0.0.1 GSEA: Ethnicity differences
Performed once with both clinics and again with only Tumaco.
tc_ethnicity_gp <- all_gprofiler(tc_ethnicity_sig)pander::pander(sessionInfo())R version 4.4.1 (2024-06-14)
Platform: x86_64-conda-linux-gnu
locale: C
attached base packages: stats4, stats, graphics, grDevices, utils, datasets, methods and base
other attached packages: edgeR(v.4.0.16), ruv(v.0.9.7.1), DOSE(v.3.28.2), forcats(v.1.0.0), dplyr(v.1.1.4), hpgltools(v.1.0), Matrix(v.1.6-5), glue(v.1.7.0), SummarizedExperiment(v.1.32.0), GenomicRanges(v.1.54.1), GenomeInfoDb(v.1.38.6), IRanges(v.2.36.0), S4Vectors(v.0.40.2), MatrixGenerics(v.1.14.0), matrixStats(v.1.2.0), Biobase(v.2.62.0) and BiocGenerics(v.0.48.1)
loaded via a namespace (and not attached): fs(v.1.6.3), bitops(v.1.0-7), enrichplot(v.1.22.0), blockmodeling(v.1.1.5), HDO.db(v.0.99.1), httr(v.1.4.7), RColorBrewer(v.1.1-3), numDeriv(v.2016.8-1.1), tools(v.4.4.1), backports(v.1.4.1), utf8(v.1.2.4), R6(v.2.5.1), lazyeval(v.0.2.2), mgcv(v.1.9-1), withr(v.3.0.0), gridExtra(v.2.3), preprocessCore(v.1.64.0), fdrtool(v.1.2.18), cli(v.3.6.2), scatterpie(v.0.2.1), labeling(v.0.4.3), slam(v.0.1-53), EBSeq(v.2.0.0), sass(v.0.4.8), mvtnorm(v.1.2-4), robustbase(v.0.99-4), genefilter(v.1.84.0), yulab.utils(v.0.1.7), ggupset(v.0.4.0), gson(v.0.1.0), R.utils(v.2.12.3), limma(v.3.58.1), RSQLite(v.2.3.5), gridGraphics(v.0.5-1), generics(v.0.1.3), gtools(v.3.9.5), crosstalk(v.1.2.1), zip(v.2.3.1), GO.db(v.3.18.0), fansi(v.1.0.6), abind(v.1.4-5), R.methodsS3(v.1.8.2), lifecycle(v.1.0.4), yaml(v.2.3.8), gplots(v.3.1.3.1), qvalue(v.2.34.0), SparseArray(v.1.2.4), grid(v.4.4.1), blob(v.1.2.4), promises(v.1.2.1), crayon(v.1.5.2), lattice(v.0.22-5), cowplot(v.1.1.3), annotate(v.1.80.0), KEGGREST(v.1.42.0), pillar(v.1.9.0), knitr(v.1.45), varhandle(v.2.0.6), fgsea(v.1.28.0), boot(v.1.3-29), corpcor(v.1.6.10), codetools(v.0.2-19), fastmatch(v.1.1-4), ggfun(v.0.1.8), data.table(v.1.15.0), Vennerable(v.3.1.0.9000), treeio(v.1.29.1), vctrs(v.0.6.5), png(v.0.1-8), Rdpack(v.2.6), testthat(v.3.2.1), gtable(v.0.3.4), cachem(v.1.0.8), xfun(v.0.42), openxlsx(v.4.2.5.2), rbibutils(v.2.2.16), S4Arrays(v.1.2.0), mime(v.0.12), RcppEigen(v.0.3.3.9.4), tidygraph(v.1.3.1), survival(v.3.5-8), iterators(v.1.0.14), NOISeq(v.2.46.0), statmod(v.1.5.0), ellipsis(v.0.3.2), nlme(v.3.1-164), pbkrtest(v.0.5.2), ggtree(v.3.15.0), bit64(v.4.0.5), EnvStats(v.2.8.1), UpSetR(v.1.4.0), rprojroot(v.2.0.4), bslib(v.0.6.1), KernSmooth(v.2.23-22), colorspace(v.2.1-0), DBI(v.1.2.2), DESeq2(v.1.42.0), tidyselect(v.1.2.0), bit(v.4.0.5), compiler(v.4.4.1), graph(v.1.80.0), desc(v.1.4.3), DelayedArray(v.0.28.0), plotly(v.4.10.4), shadowtext(v.0.1.3), scales(v.1.3.0), caTools(v.1.18.2), DEoptimR(v.1.1-3), remaCor(v.0.0.18), RBGL(v.1.78.0), stringr(v.1.5.1), digest(v.0.6.34), minqa(v.1.2.6), variancePartition(v.1.32.5), rmarkdown(v.2.25), aod(v.1.3.3), XVector(v.0.42.0), RhpcBLASctl(v.0.23-42), htmltools(v.0.5.7), pkgconfig(v.2.0.3), lme4(v.1.1-35.1), lpsymphony(v.1.30.0), highr(v.0.10), fastmap(v.1.1.1), rlang(v.1.1.3), htmlwidgets(v.1.6.4), shiny(v.1.8.0), farver(v.2.1.1), jquerylib(v.0.1.4), IHW(v.1.30.0), jsonlite(v.1.8.8), BiocParallel(v.1.36.0), GOSemSim(v.2.28.1), R.oo(v.1.26.0), RCurl(v.1.98-1.14), magrittr(v.2.0.3), GenomeInfoDbData(v.1.2.11), ggplotify(v.0.1.2), patchwork(v.1.2.0), munsell(v.0.5.0), Rcpp(v.1.0.12), ape(v.5.8), viridis(v.0.6.5), stringi(v.1.8.3), ggraph(v.2.1.0), brio(v.1.1.4), zlibbioc(v.1.48.0), MASS(v.7.3-60.0.1), plyr(v.1.8.9), parallel(v.4.4.1), ggrepel(v.0.9.5), Biostrings(v.2.70.2), graphlayouts(v.1.1.0), splines(v.4.4.1), pander(v.0.6.5), locfit(v.1.5-9.8), igraph(v.2.0.2), reshape2(v.1.4.4), pkgload(v.1.3.4), gprofiler2(v.0.2.3), XML(v.3.99-0.16.1), evaluate(v.0.23), BiocManager(v.1.30.25), nloptr(v.2.0.3), foreach(v.1.5.2), tweenr(v.2.0.2), httpuv(v.1.6.14), tidyr(v.1.3.1), purrr(v.1.0.2), polyclip(v.1.10-6), ggplot2(v.3.5.0), ggforce(v.0.4.2), broom(v.1.0.5), xtable(v.1.8-4), tidytree(v.0.4.6), fANCOVA(v.0.6-1), later(v.1.3.2), viridisLite(v.0.4.2), tibble(v.3.2.1), lmerTest(v.3.1-3), clusterProfiler(v.4.10.1), aplot(v.0.2.2), memoise(v.2.0.1), AnnotationDbi(v.1.64.1), sva(v.3.50.0) and GSEABase(v.1.64.0)
message("This is hpgltools commit: ", get_git_commit())## If you wish to reproduce this exact build of hpgltools, invoke the following:## > git clone http://github.com/abelew/hpgltools.git## > git reset 4664b0b9440028c89307a154494579648c639ae8the## This is hpgltools commit: Fri Mar 7 10:26:11 2025 -0500: 4664b0b9440028c89307a154494579648c639ae8Fri Mar 7 10:26:11 2025 -0500: themessage("Saving to ", savefile)## Saving to 03differential_expression_both.rda.xz# tmp <- sm(saveme(filename = savefile))tmp <- loadme(filename = savefile)LS0tCnRpdGxlOiAiVE1SQzMgYHIgU3lzLmdldGVudignVkVSU0lPTicpYDogRGlmZmVyZW50aWFsIEV4cHJlc3Npb24gYW5hbHlzZXMiCmF1dGhvcjogImF0YiBhYmVsZXdAZ21haWwuY29tIgpkYXRlOiAiYHIgU3lzLkRhdGUoKWAiCnJ1bnRpbWU6IHNoaW55Cm91dHB1dDoKICBodG1sX2RvY3VtZW50OgogICAgY29kZV9kb3dubG9hZDogdHJ1ZQogICAgY29kZV9mb2xkaW5nOiBzaG93CiAgICBmaWdfY2FwdGlvbjogdHJ1ZQogICAgZmlnX2hlaWdodDogNwogICAgZmlnX3dpZHRoOiA3CiAgICBoaWdobGlnaHQ6IHplbmJ1cm4KICAgIGtlZXBfbWQ6IGZhbHNlCiAgICBtb2RlOiBzZWxmY29udGFpbmVkCiAgICBudW1iZXJfc2VjdGlvbnM6IHRydWUKICAgIHNlbGZfY29udGFpbmVkOiB0cnVlCiAgICB0aGVtZTogcmVhZGFibGUKICAgIHRvYzogdHJ1ZQogICAgdG9jX2Zsb2F0OgogICAgICBjb2xsYXBzZWQ6IGZhbHNlCiAgICAgIHNtb290aF9zY3JvbGw6IGZhbHNlCi0tLQoKPHN0eWxlIHR5cGU9InRleHQvY3NzIj4KYm9keSAubWFpbi1jb250YWluZXIgewogIG1heC13aWR0aDogMTYwMHB4Owp9CmJvZHksIHRkIHsKICBmb250LXNpemU6IDE2cHg7Cn0KY29kZS5yewogIGZvbnQtc2l6ZTogMTZweDsKfQpwcmUgewogIGZvbnQtc2l6ZTogMTZweAp9Cjwvc3R5bGU+CgpgYGB7ciBvcHRpb25zLCBpbmNsdWRlPUZBTFNFfQpsaWJyYXJ5KGhwZ2x0b29scykKbGlicmFyeShkcGx5cikKbGlicmFyeShmb3JjYXRzKQpsaWJyYXJ5KGdsdWUpCmxpYnJhcnkoRE9TRSkKCmtuaXRyOjpvcHRzX2tuaXQkc2V0KHByb2dyZXNzID0gVFJVRSwgdmVyYm9zZSA9IFRSVUUsIHdpZHRoID0gOTAsIGVjaG8gPSBUUlVFKQprbml0cjo6b3B0c19jaHVuayRzZXQoCiAgZXJyb3IgPSBUUlVFLCBmaWcud2lkdGggPSA4LCBmaWcuaGVpZ2h0ID0gOCwgZmlnLnJldGluYSA9IDIsCiAgb3V0LndpZHRoID0gIjEwMCUiLCBkZXYgPSAicG5nIiwKICBkZXYuYXJncyA9IGxpc3QocG5nID0gbGlzdCh0eXBlID0gImNhaXJvLXBuZyIpKSkKb2xkX29wdGlvbnMgPC0gb3B0aW9ucyhkaWdpdHMgPSA0LCBzdHJpbmdzQXNGYWN0b3JzID0gRkFMU0UsIGtuaXRyLmR1cGxpY2F0ZS5sYWJlbCA9ICJhbGxvdyIpCmdncGxvdDI6OnRoZW1lX3NldChnZ3Bsb3QyOjp0aGVtZV9idyhiYXNlX3NpemUgPSAxMikpCnZlciA8LSBTeXMuZ2V0ZW52KCJWRVJTSU9OIikKcGFyYWxsZWwgPC0gdG91cHBlcihTeXMuZ2V0ZW52KCJQQVJBTExFTCIpKQppZiAocGFyYWxsZWwgPT0gIiIgfHwgcGFyYWxsZWwgPT0gIlRSVUUiKSB7CiAgcGFyYWxsZWwgPC0gVFJVRQp9IGVsc2UgewogIHBhcmFsbGVsIDwtIEZBTFNFCn0KcnVuZGF0ZSA8LSBmb3JtYXQoU3lzLkRhdGUoKSwgZm9ybWF0ID0gIiVZJW0lZCIpCgpybWRfZmlsZSA8LSBnbHVlKCIwM2RpZmZlcmVudGlhbF9leHByZXNzaW9uX2JvdGguUm1kIikKc2F2ZWZpbGUgPC0gZ3N1YihwYXR0ZXJuID0gIlxcLlJtZCIsIHJlcGxhY2UgPSAiXFwucmRhXFwueHoiLCB4ID0gcm1kX2ZpbGUpCmxvYWRlZCA8LSBsb2FkKGZpbGUgPSBnbHVlKCJyZGEvdG1yYzNfZGF0YV9zdHJ1Y3R1cmVzLXZ7dmVyfS5yZGEiKSkKeGxzeF9wcmVmaXggPC0gImFuYWx5c2VzLzNfY2FsaV9hbmRfdHVtYWNvIgpjbGluaWNfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vREVfQ2xpbmljIikKY2xpbmljX2NmX3ByZWZpeCA8LSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX0NsaW5pY19DdXJlX0ZhaWwiKQpjZl9wcmVmaXggPC0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9DdXJlX0ZhaWwiKQp2aXNpdF9wcmVmaXggPC0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMiKQpzZXhfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vU2V4IikKZXRoX3ByZWZpeCA8LSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0V0aG5pY2l0eSIpCmdzZWFfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vR1NFQSIpCmBgYAoKIyBDaGFuZ2Vsb2cKCiogMjAyMzA5OiBEaXNhYmxlZCBHU1ZBIGFuYWx5c2VzIHVudGlsL3VubGVzcyB3ZSBnZXQgcGVybWlzc2lvbiB0bwogIGluY2x1ZGUgdGhlIG1TaWdEQiA3LjUuMSByZWxlYXNlLiAgSSB3aWxsIHNpbXBsaWZ5IHRoZSBmaWxlbmFtZXMgc28KICB0aGF0IG9uZSBtYXkgZWFzaWx5IGRyb3AgaW4gYSBkb3dubG9hZGVkIGNvcHkgb2YgdGhlIGRhdGEgYW5kIHJ1bgogIHRob3NlIGJsb2Nrcy4gIFVudGlsIHRoZW4sIEkgZ3Vlc3MgeW91IHdpbGwgaGF2ZSB0byB0cnVzdCBtZSB3aGVuIEkKICBzYXkgdGhvc2UgYmxvY2tzIGFsbCB3b3JrPwoqIDIwMjMwOTogTW92ZWQgYWxsIEdTRUEgYW5hbHlzZXMgdG8gMDRscnRfZ3NlYV9nc3ZhLlJtZAoqIDIwMjMwOSBuZXh0IGRheTogTW92aW5nIEdTRUEgYmFjayBiZWNhdXNlIGl0IGFkZHMgdG9vIG11Y2gKICBjb21wbGV4aXR5IHRvIHNhdmUvcmVsb2FkIHRoZSBERSByZXN1bHRzIGZvciBnUHJvZmlsZXIgYW5kIGZyaWVuZHMuCiogU3RpbGwgaHVudGluZyBmb3IgbWVzc2VkIHVwIGNvbG9ycywgY2hhbmdlZCBpbnB1dCBkYXRhIHRvIG1hdGNoIG5ldyB2ZXJzaW9uLgoKIyBJbnRyb2R1Y3Rpb24KClRoZSB2YXJpb3VzIGRpZmZlcmVudGlhbCBleHByZXNzaW9uIGFuYWx5c2VzIG9mIHRoZSBkYXRhIGdlbmVyYXRlZCBpbiB0bXJjM19kYXRhc2V0cwp3aWxsIG9jY3VyIGluIHRoaXMgZG9jdW1lbnQuCgojIyBOYW1pbmcgY29udmVudGlvbnMKCkkgYW0gZ29pbmcgdG8gdHJ5IHRvIHN0YW5kYXJkaXplIGhvdyBJIG5hbWUgdGhlIHZhcmlvdXMgZGF0YQpzdHJ1Y3R1cmVzIGNyZWF0ZWQgaW4gdGhpcyBkb2N1bWVudC4gIE1vc3Qgb2YgdGhlIGxhcmdlIGRhdGEgY3JlYXRlZAphcmUgZWl0aGVyIHNldHMgb2YgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzZXMsIHRoZWlyIGNvbWJpbmVkCnJlc3VsdHMsIG9yIHRoZSBzZXQgb2YgcmVzdWx0cyBkZWVtZWQgJ3NpZ25pZmljYW50Jy4KCkhvcGVmdWxseSBieSBub3cgdGhleSBhbGwgZm9sbG93IHRoZXNlIGd1aWRlbGluZXM6Cgp7Y2xpbmljKHMpfV9zYW1wbGUtc3Vic2V0fV97cHJpbWFyeS1xdWVzdGlvbihzKX1fe2RhdGF0eXBlfV97YmF0Y2gtbWV0aG9kfQoKKiB7Y2xpbmljfTogVGhpcyBpcyBlaXRoZXIgdGMgb3IgdCBmb3IgVHVtYWNvIGFuZCBDYWxpLCBvciBqdXN0ClR1bWFjby4KKiB7c2FtcGxlLXN1YnNldH06IFRoaW5ncyBsaWtlICdhbGwnIG9yICdtb25vY3l0ZXMnLgoqIHtwcmltYXJ5LXF1ZXN0aW9ufTogU2hvcnRoYW5kIG5hbWUgZm9yIHRoZSBwcmltYXJ5IGNvbnRyYXN0cwpwZXJmb3JtZWQsIHRodXMgJ2NsaW5pY3MnIHdvdWxkIHN1Z2dlc3QgYSBjb21wYXJpc29uIG9mIFR1bWFjbwp2cy4gQ2FsaS4gICd2aXNpdHMnIHdvdWxkIGNvbXBhcmUgdjIvdjEsIGV0Yy4KKiB7ZGF0YXR5cGV9OiBkZSwgdGFibGUsIHNpZwoqIHtiYXRjaC10eXBlfTogbm9iYXRjaCwgYmF0Y2h7ZmFjdG9yfSwgc3ZhLiAge2ZhY3Rvcn0gaW4gdGhpcwppbnN0YW5jZSBzaG91bGQgYmUgYSBjb2x1bW4gZnJvbSB0aGUgbWV0YWRhdGEuCgpXaXRoIHRoaXMgaW4gbWluZCwgJ3RjX2Jpb3BzaWVzX2NsaW5pY19kZV9zdmEnIHNob3VsZCBiZSB0aGUgVHVtYWNvK0NhbGkKYmlvcHN5IGRhdGEgYWZ0ZXIgcGVyZm9ybWluZyB0aGUgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzZXMKY29tcGFyaW5nIHRoZSBjbGluaWNzIHVzaW5nIHN2YS4KCkkgc3VzcGVjdCB0aGVyZSByZW1haW4gc29tZSBleGNlcHRpb25zIGFuZC9vciBlcnJvcnMuCgojIyBEZWZpbmUgY29udHJhc3RzIGZvciBERSBhbmFseXNlcwoKRWFjaCBvZiB0aGUgZm9sbG93aW5nIGxpc3RzIGRlc2NyaWJlcyB0aGUgc2V0IG9mIGNvbnRyYXN0cyB0aGF0IEkKdGhpbmsgYXJlIGludGVyZXN0aW5nIGZvciB0aGUgdmFyaW91cyB3YXlzIG9uZSBtaWdodCBjb25zaWRlciB0aGUKVE1SQzMgZGF0YXNldC4gIFRoZSB2YXJpYWJsZXMgYXJlIG5hbWVkIGFjY29yZGluZyB0byB0aGUgYXNzdW1lZCBkYXRhCndpdGggd2hpY2ggdGhleSB3aWxsIGJlIHVzZWQsIHRodXMgdGNfY2ZfY29udHJhc3RzIGlzIGV4cGVjdGVkIHRvIGJlCnVzZWQgZm9yIHRoZSBUdW1hY28rQ2FsaSBkYXRhIGFuZCBwcm92aWRlIGEgc2VyaWVzIG9mIGN1cmUvZmFpbApjb21wYXJpc29ucyB3aGljaCAodG8gdGhlIGV4dGVudCBwb3NzaWJsZSkgYWNyb3NzIGJvdGggbG9jYXRpb25zLiAgSW4KZXZlcnkgY2FzZSwgdGhlIG5hbWUgb2YgdGhlIGxpc3QgZWxlbWVudCB3aWxsIGJlIHVzZWQgYXMgdGhlIGNvbnRyYXN0Cm5hbWUsIGFuZCB3aWxsIHRodXMgYmUgc2VlbiBhcyB0aGUgc2hlZXQgbmFtZSBpbiB0aGUgb3V0cHV0IHhsc3gKZmlsZShzKTsgdGhlIHR3byBwaWVjZXMgb2YgdGhlIGNoYXJhY3RlciB2ZWN0b3IgdmFsdWUgYXJlIHRoZQpudW1lcmF0b3IgYW5kIGRlbm9taW5hdG9yIG9mIHRoZSBhc3NvY2lhdGVkIGNvbnRyYXN0LgoKIyMgR1NFQQoKTW9zdCAoYWxsPykgb2YgdGhlIG92ZXJlbnJpY2htZW50L0dTRUEgYW5hbHlzZXMgdXNlZCBpbiB0aGlzIHBhcGVyCndlcmUgZG9uZSB2aWEgZ1Byb2ZpbGVyIGFuZCBjbHVzdGVyUHJvZmlsZXIgcmF0aGVyIHRoYW4KZ29zZXEvdG9wR08vR09zdGF0cy4gIFByaW1hcmlseSBiZWNhdXNlIGl0IGlzIHNvIGVhc3kgdG8gaW52b2tlCmdwcm9maWxlciBhbmQgYmVjYXVzZSBjbHVzdGVyUHJvZmlsZXIgbWFrZXMgaXQgdmVyeSBlYXN5IHRvIGludm9rZSB0aGUKR1NFQSBhbmFseXNlcy4gIE9uZSBmdW4gdGhpbmcgSSBkaWQgcmVsYXRpdmVseSByZWNlbnRseSBpcyBjb2VyY2UgdGhlCnJlc3VsdHMgZnJvbSBhbGwgbWV0aG9kcyBpbnRvIHRoZSBjbHVzdGVyUHJvZmlsZXIgZW5yaWNobWVudCBvYmplY3QKdHlwZSwgdGh1cyB5b3UgbWF5IHBhc3MgYW55IHJlc3VsdCBkaXJlY3RseSB0byB0aGUgdmFyaW91cyBlbnJpY2hwbG90CmZ1bmN0aW9ucy4KCmBgYHtyfQpjbGluaWNfY29udHJhc3RzIDwtIGxpc3QoCiAgImNsaW5pY3MiID0gYygiY2FsaSIsICJ0dW1hY28iKSkKIyMgSW4gc29tZSBjYXNlcyB3ZSBoYXZlIG5vIENhbGkgZmFpbHVyZSBzYW1wbGVzLCBzbyB0aGVyZSByZW1haW4gb25seSAyCiMjIGNvbnRyYXN0cyB0aGF0IGFyZSBsaWtlbHkgb2YgaW50ZXJlc3QKdGNfY2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgInR1bWFjbyIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJ0dW1hY29fY3VyZSIpLAogICJjdXJlIiA9IGMoInR1bWFjb19jdXJlIiwgImNhbGlfY3VyZSIpKQojIyBJbiBvdGhlciBjYXNlcywgd2UgaGF2ZSBjdXJlL2ZhaWwgZm9yIGJvdGggcGxhY2VzLgpjbGluaWNfY2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgImNhbGkiID0gYygiY2FsaV9mYWlsdXJlIiwgImNhbGlfY3VyZSIpLAogICJ0dW1hY28iID0gYygidHVtYWNvX2ZhaWx1cmUiLCAidHVtYWNvX2N1cmUiKSwKICAiY3VyZSIgPSBjKCJ0dW1hY29fY3VyZSIsICJjYWxpX2N1cmUiKSwKICAiZmFpbCIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJjYWxpX2ZhaWx1cmUiKSkKY2ZfY29udHJhc3QgPC0gbGlzdCgKICAib3V0Y29tZSIgPSBjKCJ0dW1hY29fZmFpbHVyZSIsICJ0dW1hY29fY3VyZSIpKQp0X2NmX2NvbnRyYXN0IDwtIGxpc3QoCiAgIm91dGNvbWUiID0gYygiZmFpbHVyZSIsICJjdXJlIikpCnZpc2l0Y2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgInYxY2YiID0gYygidjFfZmFpbHVyZSIsICJ2MV9jdXJlIiksCiAgInYyY2YiID0gYygidjJfZmFpbHVyZSIsICJ2Ml9jdXJlIiksCiAgInYzY2YiID0gYygidjNfZmFpbHVyZSIsICJ2M19jdXJlIikpCnZpc2l0X2NvbnRyYXN0cyA8LSBsaXN0KAogICJ2MnYxIiA9IGMoImMyIiwgImMxIiksCiAgInYzdjEiID0gYygiYzMiLCAiYzEiKSwKICAidjN2MiIgPSBjKCJjMyIsICJjMiIpKQp2aXNpdF92MWxhdGVyIDwtIGxpc3QoCiAgImxhdGVyX3ZzX2ZpcnN0IiA9IGMoImxhdGVyIiwgImZpcnN0IikpCmNlbGx0eXBlcyA8LSBsaXN0KAogICJlb19tb25vIiA9IGMoImVvc2lub3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJuZV9tb25vIiA9IGMoIm5ldXRyb3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJlb19uZSIgPSBjKCJlb3Npbm9waGlscyIsICJuZXV0cm9waGlscyIpKQpldGhuaWNpdHlfY29udHJhc3RzIDwtIGxpc3QoCiAgIm1lc3Rpem9faW5kaWdlbm91cyIgPSBjKCJtZXN0aXphIiwgImluZGlnZW5hIiksCiAgIm1lc3Rpem9fYWZyb2NvbCIgPSBjKCJtZXN0aXphIiwgImFmcm9jb2wiKSwKICAiaW5kaWdlbm91c19hZnJvY29sIiA9IGMoImluZGlnZW5hIiwgImFmcm9jb2wiKSkKYGBgCgojIENvbXBhcmUgc2FtcGxlcyBieSBjbGluaWMKCiMjIERFOiBDb21wYXJlIGNsaW5pY3MsIGFsbCBzYW1wbGVzCgpQZXJmb3JtIGEgc3Zhc2VxLWd1aWRlZCBjb21wYXJpc29uIG9mIHRoZSB0d28gY2xpbmljcy4gIElkZWFsbHkgdGhpcwp3aWxsIGdpdmUgc29tZSBjbHVlIGFib3V0IGp1c3QgaG93IHN0cm9uZyB0aGUgY2xpbmljLWJhc2VkIGJhdGNoCmVmZmVjdCByZWFsbHkgaXMgYW5kIHdoYXQgaXRzIGNhdXNlcyBhcmUuCgpgYGB7cn0KdGNfY2xpbmljX3R5cGUgPC0gdGNfdmFsaWQgJT4lCiAgc2V0X2V4cHRfY29uZGl0aW9ucyhmYWN0ID0gImNsaW5pYyIpICU+JQogIHNldF9leHB0X2JhdGNoZXMoZmFjdCA9ICJ0eXBlb2ZjZWxscyIpCgp0YWJsZShwRGF0YSh0Y19jbGluaWNfdHlwZSlbWyJjb25kaXRpb24iXV0pCnRjX2FsbF9jbGluaWNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19jbGluaWNfdHlwZSwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19hbGxfY2xpbmljX2RlX3N2YQp0Y19hbGxfY2xpbmljX2RlX3N2YVtbImRlc2VxIl1dW1siY29udHJhc3RzX3BlcmZvcm1lZCJdXQoKdGNfYWxsX2NsaW5pY190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYWxsX2NsaW5pY19kZV9zdmEsIGtlZXBlcnMgPSBjbGluaWNfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19wcmVmaXh9L3RjX2FsbF9jbGluaWNfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2FsbF9jbGluaWNfdGFibGVfc3ZhCnRjX2FsbF9jbGluaWNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2FsbF9jbGluaWNfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19wcmVmaXh9L2NvbXBhcmVfY2xpbmljcy90Y19jbGluaWNfdHlwZV9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2FsbF9jbGluaWNfc2lnX3N2YQpgYGAKCiMjIyBHU0VBOiBjb21wYXJpbmcgdGhlIGNsaW5pY3MKCmBgYHtyfQppbmNyZWFzZWRfdHVtYWNvX2NhdGVnb3JpZXNfdXAgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19hbGxfY2xpbmljX3NpZ19zdmFbWyJkZXNlcSJdXVtbInVwcyJdXVtbImNsaW5pY3MiXV0sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L3R1bWFjb19jYXRlb2dpZXNfdXAtdnt2ZXJ9Lnhsc3giKSkKaW5jcmVhc2VkX3R1bWFjb19jYXRlZ29yaWVzX3VwCmluY3JlYXNlZF90dW1hY29fY2F0ZWdvcmllc191cFtbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCgppbmNyZWFzZWRfY2FsaV9jYXRlZ29yaWVzIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfYWxsX2NsaW5pY19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImNsaW5pY3MiXV0sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2NhbGlfY2F0ZW9naWVzX3VwLXZ7dmVyfS54bHN4IikpCmluY3JlYXNlZF9jYWxpX2NhdGVnb3JpZXMKaW5jcmVhc2VkX2NhbGlfY2F0ZWdvcmllc1tbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCmBgYAoKIyMjIFZpc3VhbGl6ZSBjbGluaWMgZGlmZmVyZW5jZXMKCkxldCB1cyB0YWtlIGEgcXVpY2sgbG9vayBhdCB0aGUgcmVzdWx0cyBvZiB0aGUgY29tcGFyaXNvbiBvZgpUdW1hY28vQ2FsaS4KCk5vdGU6IEkga2VlcCByZS1pbnRyb2R1Y2luZyBhbiBlcnJvciB3aGljaCBjYXVzZXMgdGhlc2UgKHZvbGNhbm8gYW5kCk1BKSBwbG90cyB0byBiZSByZXZlcnNlZCB3aXRoIHJlc3BlY3QgdG8gdGhlIGxvZ0ZDIHZhbHVlcy4gIFBheQpjYXJlZnVsIGF0dGVudGlvbiB0byB0aGVzZSBhbmQgbWFrZSBzdXJlIHRoYXQgdGhleSBhZ3JlZSB3aXRoIHRoZQpudW1iZXJzIG9mIGdlbmVzIG9ic2VydmVkIGluIHRoZSBjb250cmFzdC4KCkkgZXZlbnR1YWxseSB0b29rIHNvbWUgY29kZSBmcm9tIFRoZXJlc2Egd2hpY2ggbW9yZSBpbnRlbGxpZ2VudGx5CmNvbG9ycyB0aGUgc2lkZXMgb2YgTUEvdm9sY2FubyBwbG90cyB0byBiZSB0aGUgc2FtZSBjb2xvcnMgYXMgdGhlaXIKY29ycmVzcG9uZGluZyBudW1lcmF0b3IvZGVub21pbmF0b3IuCgpgYGB7cn0KIyMgQ2hlY2sgdGhhdCB1cCBpcyB1cApzdW1tYXJ5KHRjX2FsbF9jbGluaWNfdGFibGVfc3ZhW1siZGF0YSJdXVtbImNsaW5pY3MiXV1bWyJkZXNlcV9sb2dmYyJdXSkKIyMgSSB0aGluayB3ZSBjYW4gYXNzdW1lIHRoYXQgbW9zdCBnZW5lcyBhcmUgZG93biB3aGVuIGNvbnNpZGVyaW5nIFR1bWFjby9DYWxpLgpzdW0odGNfYWxsX2NsaW5pY190YWJsZV9zdmEkZGF0YSRjbGluaWNzJGRlc2VxX2xvZ2ZjIDwgLTEuMCAmCiAgICAgIHRjX2FsbF9jbGluaWNfdGFibGVfc3ZhJGRhdGEkY2xpbmljcyRkZXNlcV9hZGpwIDwgMC4wNSkKdGNfYWxsX2NsaW5pY190YWJsZV9zdmFbWyJwbG90cyJdXVtbImNsaW5pY3MiXV1bWyJkZXNlcV92b2xfcGxvdHMiXV0KYGBgCgpUaGVyZSBhcHBlYXIgdG8gYmUgbWFueSBtb3JlIGdlbmVzIHdoaWNoIGFyZSBpbmNyZWFzZWQgaW4gdGhlIFR1bWFjbwpzYW1wbGVzIHdpdGggcmVzcGVjdCB0byB0aGUgQ2FsaSBzYW1wbGVzLgoKIyMgREU6IENvbXBhcmUgY2xpbmljcywgZW9zaW5vcGhpbCBzYW1wbGVzCgpUaGUgcmVtYWluaW5nIGNlbGwgdHlwZXMgYWxsIGhhdmUgcHJldHR5IHN0cm9uZyBjbGluaWMtYmFzZWQgdmFyaWFuY2U7CmJ1dCBJIGFtIG5vdCBjZXJ0YWluIGlmIGl0IGlzIGNvbnNpc3RlbnQgYWNyb3NzIGNlbGwgdHlwZXMuCgpgYGB7cn0KdGFibGUocERhdGEodGNfZW9zaW5vcGhpbHMpW1siY29uZGl0aW9uIl1dKQp0Y19lb3Npbm9waGlsc19jbGluaWNfZGVfbm9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfZW9zaW5vcGhpbHMsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9IEZBTFNFLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9ub2JhdGNoCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9ub2JhdGNoW1siZGVzZXEiXV1bWyJjb250cmFzdHNfcGVyZm9ybWVkIl1dCgp0Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfbm9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19lb3Npbm9waGlsc19jbGluaWNfZGVfbm9iYXRjaCwga2VlcGVycyA9IHRjX2NmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Fb3Npbm9waGlscy90Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfbm9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfbm9iYXRjaAp0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX25vYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19lb3Npbm9waGlsc19jbGluaWNfdGFibGVfbm9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Fb3Npbm9waGlscy90Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX25vYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfY2xpbmljX3NpZ19ub2JhdGNoCgp0Y19lb3Npbm9waGlsc19jbGluaWNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19lb3Npbm9waGlscywgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2Vvc2lub3BoaWxzX2NsaW5pY19kZV9zdmEKdGNfZW9zaW5vcGhpbHNfY2xpbmljX2RlX3N2YVtbImRlc2VxIl1dW1siY29udHJhc3RzX3BlcmZvcm1lZCJdXQoKdGNfZW9zaW5vcGhpbHNfY2xpbmljX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19lb3Npbm9waGlsc19jbGluaWNfZGVfc3ZhLCBrZWVwZXJzID0gdGNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfY2xpbmljX3RhYmxlX3N2YQp0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Vvc2lub3BoaWxzX2NsaW5pY190YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdGNfZW9zaW5vcGhpbHNfY2xpbmljX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbHNfY2xpbmljX3NpZ19zdmEKYGBgCgojIyBERTogQ29tcGFyZSBjbGluaWNzLCBiaW9wc3kgc2FtcGxlcwoKSW50ZXJlc3RpbmdseSB0byBtZSwgdGhlIGJpb3BzeSBzYW1wbGVzIGFwcGVhciB0byBoYXZlIHRoZSBsZWFzdApsb2NhdGlvbi1iYXNlZCB2YXJpYW5jZS4gIEJ1dCB3ZSBjYW4gcGVyZm9ybSBhbiBleHBsaWNpdCBERSBhbmQgc2VlCmhvdyB3ZWxsIHRoYXQgaHlwb3RoZXNpcyBob2xkcyB1cC4KCk5vdGUgdGhhdCB0aGVzZSBkYXRhIGluY2x1ZGUgY3VyZSBhbmQgZmFpbCBzYW1wbGVzIGZvcgoKYGBge3J9CnRhYmxlKHBEYXRhKHRjX2Jpb3BzaWVzKVtbImNvbmRpdGlvbiJdXSkKdGNfYmlvcHNpZXNfY2xpbmljX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfYmlvcHNpZXMsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19iaW9wc2llc19jbGluaWNfZGVfc3ZhCnRjX2Jpb3BzaWVzX2NsaW5pY19kZV9zdmFbWyJkZXNlcSJdXVtbImNvbnRyYXN0c19wZXJmb3JtZWQiXV0KCnRjX2Jpb3BzaWVzX2NsaW5pY190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfYmlvcHNpZXNfY2xpbmljX2RlX3N2YSwga2VlcGVycyA9IHRjX2NmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9CaW9wc2llcy90Y19iaW9wc2llc19jbGluaWNfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2Jpb3BzaWVzX2NsaW5pY190YWJsZV9zdmEKdGNfYmlvcHNpZXNfY2xpbmljX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19iaW9wc2llc19jbGluaWNfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L0Jpb3BzaWVzL3RjX2Jpb3BzaWVzX2NsaW5pY19zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2Jpb3BzaWVzX2NsaW5pY19zaWdfc3ZhCmBgYAoKIyMgREU6IENvbXBhcmUgY2xpbmljcywgbW9ub2N5dGUgc2FtcGxlcwoKQXQgbGVhc3QgZm9yIHRoZSBtb21lbnQsIEkgYW0gb25seSBsb29raW5nIGF0IHRoZSBkaWZmZXJlbmNlcyBiZXR3ZWVuCm5vLWJhdGNoIHZzLiBzdmEgYWNyb3NzIGNsaW5pY3MgZm9yIHRoZSBtb25vY3l0ZSBzYW1wbGVzLiAgVGhpcwp3YXMgY2hvc2VuIG1vc3RseSBhcmJpdHJhcmlseS4KCiMjIyBERTogQ29tcGFyZSBjbGluaWNzLCBtb25vY3l0ZXMgd2l0aG91dCBiYXRjaCBlc3RpbWF0aW9uCgpPdXIgYmFzZWxpbmUgaXMgdGhlIGNvbXBhcmlzb24gb2YgdGhlIG1vbm9jeXRlcyBzYW1wbGVzIHdpdGhvdXQgYmF0Y2gKaW4gdGhlIG1vZGVsIG9yIHN1cnJvZ2F0ZSBlc3RpbWF0aW9uLiAgSW4gdGhlb3J5IGF0IGxlYXN0LCB0aGlzIHNob3VsZApjb3JyZXNwb25kIHRvIHRoZSBQQ0EgcGxvdCBhYm92ZSB3aGVuIG5vIGJhdGNoIGVzdGltYXRpb24gd2FzIHBlcmZvcm1lZC4KCmBgYHtyfQp0YWJsZShwRGF0YSh0Y19tb25vY3l0ZXMpW1siY29uZGl0aW9uIl1dKQp0Y19tb25vY3l0ZXNfZGVfbm9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfbW9ub2N5dGVzLCBtb2RlbF9iYXRjaCA9IEZBTFNFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19tb25vY3l0ZXNfZGVfbm9iYXRjaAoKdGNfbW9ub2N5dGVzX3RhYmxlX25vYmF0Y2ggPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfbW9ub2N5dGVzX2RlX25vYmF0Y2gsIGtlZXBlcnMgPSBjbGluaWNfY2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L01vbm9jeXRlcy90Y19tb25vY3l0ZXNfY2xpbmljX3RhYmxlX25vYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfbW9ub2N5dGVzX3RhYmxlX25vYmF0Y2gKdGNfbW9ub2N5dGVzX3NpZ19ub2JhdGNoIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfbW9ub2N5dGVzX3RhYmxlX25vYmF0Y2gsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTW9ub2N5dGVzL3RjX21vbm9jeXRlc19jbGluaWNfc2lnX25vYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfbW9ub2N5dGVzX3NpZ19ub2JhdGNoCmBgYAoKIyMjIERFOiBDb21wYXJlIGNsaW5pY3MsIG1vbm9jeXRlcyB3aXRoIHN2YXNlcQoKSW4gY29udHJhc3QsIHRoZSBmb2xsb3dpbmcgY29tcGFyaXNvbiBzaG91bGQgZ2l2ZSBhIHZpZXcgb2YgdGhlIGRhdGEKY29ycmVzcG9uZGluZyB0byB0aGUgc3Zhc2VxIFBDQSBwbG90IGFib3ZlLiAgSW4gdGhlIGJlc3QgY2FzZQpzY2VuYXJpbywgd2Ugc2hvdWxkIHRoZXJlZm9yZSBiZSBhYmxlIHRvIHNlZSBzb21lIGRpZmZlcmVuY2VzIGJldHdlZW4KdGhlIFR1bWFjbyBjdXJlIGFuZCBmYWlsIHNhbXBsZXMuCgpgYGB7cn0KdGNfbW9ub2N5dGVzX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfbW9ub2N5dGVzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfbW9ub2N5dGVzX2RlX3N2YQoKdGNfbW9ub2N5dGVzX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19tb25vY3l0ZXNfZGVfc3ZhLCBrZWVwZXJzID0gY2xpbmljX2NmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9Nb25vY3l0ZXMvdGNfbW9ub2N5dGVzX2NsaW5pY190YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbW9ub2N5dGVzX3RhYmxlX3N2YQp0Y19tb25vY3l0ZXNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX21vbm9jeXRlc190YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTW9ub2N5dGVzL3RjX21vbm9jeXRlc19jbGluaWNfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfc2lnX3N2YQpgYGAKCiMjIyBERSBDb21wYXJlOiBIb3cgc2ltaWxhciBhcmUgdGhlIG5vLWJhdGNoIHZzLiBTVkEgcmVzdWx0cz8KClRoZSBmb2xsb3dpbmcgYmxvY2sgc2hvd3MgdGhhdCB0aGVzZSB0d28gcmVzdWx0cyBhcmUgZXhjZWVkaW5nbHkKZGlmZmVyZW50LCBzdWdlc3RpbmcgdGhhdCB0aGUgQ2FsaSBjdXJlL2ZhaWwgYW5kIFR1bWFjbyBjdXJlL2ZhaWwKY2Fubm90IGVhc2lseSBiZSBjb25zaWRlcmVkIGluIHRoZSBzYW1lIGFuYWx5c2lzLiAgSSBkaWQgc29tZSBwbGF5aW5nCmFyb3VuZCB3aXRoIG15IGNhbGN1bGF0ZV9hdWNjIGZ1bmN0aW9uIGluIHRoaXMgYmxvY2sgYW5kIGZvdW5kIHRoYXQgaXQKaXMgaW4gc29tZSBpbXBvcnRhbnQgd2F5IGJyb2tlbiwgYXQgbGVhc3QgaWYgb25lIGV4cGFuZHMgdGhlIHRvcC1uCmdlbmVzIHRvIG1vcmUgdGhhbiAyMCUgb2YgdGhlIG51bWJlciBvZiBnZW5lcyBpbiB0aGUgZGF0YS4KCmBgYHtyfQpjYWxpX3RhYmxlIDwtIHRjX21vbm9jeXRlc190YWJsZV9ub2JhdGNoW1siZGF0YSJdXVtbImNhbGkiXV0KdGFibGUgPC0gdGNfbW9ub2N5dGVzX3RhYmxlX25vYmF0Y2hbWyJkYXRhIl1dW1sidHVtYWNvIl1dCgpjYWxpX2F1Y2MgPC0gY2FsY3VsYXRlX2F1Y2MoY2FsaV90YWJsZSwgdGFibGUsIHB4ID0gImRlc2VxX2FkanAiLCBweSA9ICJkZXNlcV9hZGpwIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGx4ID0gImRlc2VxX2xvZ2ZjIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQpjYWxpX2F1Y2MKCmNhbGlfdGFibGVfc3ZhIDwtIHRjX21vbm9jeXRlc190YWJsZV9zdmFbWyJkYXRhIl1dW1siY2FsaSJdXQp0dW1hY29fdGFibGVfc3ZhIDwtIHRjX21vbm9jeXRlc190YWJsZV9zdmFbWyJkYXRhIl1dW1sidHVtYWNvIl1dCmNhbGlfYXVjY19zdmEgPC0gY2FsY3VsYXRlX2F1Y2MoY2FsaV90YWJsZV9zdmEsIHR1bWFjb190YWJsZV9zdmEsIHB4ID0gImRlc2VxX2FkanAiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHB5ID0gImRlc2VxX2FkanAiLCBseCA9ICJkZXNlcV9sb2dmYyIsIGx5ID0gImRlc2VxX2xvZ2ZjIikKY2FsaV9hdWNjX3N2YQpgYGAKCiMjIERFOiBDb21wYXJlIGNsaW5pY3MsIG5ldXRyb3BoaWwgc2FtcGxlcwoKYGBge3J9CnRjX25ldXRyb3BoaWxzX2RlX25vYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX25ldXRyb3BoaWxzLCBwYXJhbGxlbCA9IHBhcmFsbGVsLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9IEZBTFNFLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfbmV1dHJvcGhpbHNfZGVfbm9iYXRjaAoKdGNfbmV1dHJvcGhpbHNfdGFibGVfbm9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19uZXV0cm9waGlsc19kZV9ub2JhdGNoLCBrZWVwZXJzID0gY2xpbmljX2NmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjbGluaWNfY2ZfcHJlZml4fS9OZXV0cm9waGlscy90Y19uZXV0cm9waGlsc190YWJsZV9ub2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2gKdGNfbmV1dHJvcGhpbHNfc2lnX25vYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19uZXV0cm9waGlsc190YWJsZV9ub2JhdGNoLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RjX25ldXRyb3BoaWxzX3NpZ19ub2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX25ldXRyb3BoaWxzX3NpZ19ub2JhdGNoCgp0Y19uZXV0cm9waGlsc19kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX25ldXRyb3BoaWxzLCBwYXJhbGxlbCA9IHBhcmFsbGVsLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX25ldXRyb3BoaWxzX2RlX3N2YQoKdGNfbmV1dHJvcGhpbHNfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX25ldXRyb3BoaWxzX2RlX3N2YSwga2VlcGVycyA9IGNsaW5pY19jZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2xpbmljX2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdGNfbmV1dHJvcGhpbHNfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX25ldXRyb3BoaWxzX3RhYmxlX3N2YQp0Y19uZXV0cm9waGlsc19zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfbmV1dHJvcGhpbHNfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NsaW5pY19jZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RjX25ldXRyb3BoaWxzX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdGNfbmV1dHJvcGhpbHNfc2lnX3N2YQpgYGAKCiMjIEdTRUE6IEV4dHJhY3QgY2xpbmljLXNwZWNpZmljIGdlbmVzCgpHaXZlbiB0aGUgYWJvdmUgY29tcGFyaXNvbnMsIHdlIGNhbiBleHRyYWN0IHNvbWUgZ2VuZSBzZXRzIHdoaWNoCnJlc3VsdGVkIGZyb20gdGhvc2UgREUgYW5hbHlzZXMgYW5kIGV2ZW50dWFsbHkgcGVyZm9ybSBzb21lCm9udG9sb2d5L0tFR0cvcmVhY3RvbWUvZXRjIHNlYXJjaGVzLiAgVGhpcyByZW1pbmRzIG1lLCBJIHdhbnQgdG8gbWFrZQpteSBleHRyYWN0X3NpZ25pZmljYW50XyBmdW5jdGlvbnMgdG8gcmV0dXJuIGdlbmUtc2V0IGRhdGEgc3RydWN0dXJlcwphbmQgbXkgdmFyaW91cyBvbnRvbG9neSBzZWFyY2hlcyB0byB0YWtlIHRoZW0gYXMgaW5wdXRzLiAgVGhpcyBzaG91bGQKaGVscCBhdm9pZCBwb3RlbnRpYWwgZXJyb3JzIHdoZW4gZXh0cmFjdGluZyB1cC9kb3duIGdlbmVzLgoKYGBge3J9CmNsaW5pY19zaWdlbmVzX3VwIDwtIHJvd25hbWVzKHRjX2FsbF9jbGluaWNfc2lnX3N2YVtbImRlc2VxIl1dW1sidXBzIl1dW1siY2xpbmljcyJdXSkKY2xpbmljX3NpZ2VuZXNfZG93biA8LSByb3duYW1lcyh0Y19hbGxfY2xpbmljX3NpZ19zdmFbWyJkZXNlcSJdXVtbImRvd25zIl1dW1siY2xpbmljcyJdXSkKY2xpbmljX3NpZ2VuZXMgPC0gYyhjbGluaWNfc2lnZW5lc191cCwgY2xpbmljX3NpZ2VuZXNfZG93bikKCnRjX2Vvc2lub3BoaWxzX3NpZ2VuZXNfdXAgPC0gcm93bmFtZXModGNfZW9zaW5vcGhpbHNfY2xpbmljX3NpZ19zdmFbWyJkZXNlcSJdXVtbInVwcyJdXVtbImN1cmUiXV0pCnRjX2Vvc2lub3BoaWxzX3NpZ2VuZXNfZG93biA8LSByb3duYW1lcyh0Y19lb3Npbm9waGlsc19jbGluaWNfc2lnX3N2YVtbImRlc2VxIl1dW1siZG93bnMiXV1bWyJjdXJlIl1dKQp0Y19tb25vY3l0ZXNfc2lnZW5lc191cCA8LSByb3duYW1lcyh0Y19tb25vY3l0ZXNfc2lnX3N2YVtbImRlc2VxIl1dW1sidXBzIl1dW1siY3VyZSJdXSkKdGNfbW9ub2N5dGVzX3NpZ2VuZXNfZG93biA8LSByb3duYW1lcyh0Y19tb25vY3l0ZXNfc2lnX3N2YVtbImRlc2VxIl1dW1siZG93bnMiXV1bWyJjdXJlIl1dKQp0Y19uZXV0cm9waGlsc19zaWdlbmVzX3VwIDwtIHJvd25hbWVzKHRjX25ldXRyb3BoaWxzX3NpZ19zdmFbWyJkZXNlcSJdXVtbInVwcyJdXVtbImN1cmUiXV0pCnRjX25ldXRyb3BoaWxzX3NpZ2VuZXNfZG93biA8LSByb3duYW1lcyh0Y19uZXV0cm9waGlsc19zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbImN1cmUiXV0pCgp0Y19lb3Npbm9waGlsc19zaWdlbmVzIDwtIGModGNfZW9zaW5vcGhpbHNfc2lnZW5lc191cCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRjX2Vvc2lub3BoaWxzX3NpZ2VuZXNfZG93bikKdGNfbW9ub2N5dGVzX3NpZ2VuZXMgPC0gYyh0Y19tb25vY3l0ZXNfc2lnZW5lc191cCwKICAgICAgICAgICAgICAgICAgICAgICAgICB0Y19tb25vY3l0ZXNfc2lnZW5lc19kb3duKQp0Y19uZXV0cm9waGlsc19zaWdlbmVzIDwtIGModGNfbmV1dHJvcGhpbHNfc2lnZW5lc191cCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRjX25ldXRyb3BoaWxzX3NpZ2VuZXNfZG93bikKYGBgCgojIyBHU0VBOiBnUHJvZmlsZXIgb2YgZ2VuZXMgZGVlbWVkIHVwL2Rvd24gd2hlbiBjb21wYXJpbmcgQ2FsaSBhbmQgVHVtYWNvCgpJIHdhcyBjdXJpb3VzIHRvIHRyeSB0byB1bmRlcnN0YW5kIHdoeSB0aGUgdHdvIGNsaW5pY3MgYXBwZWFyIHRvIGJlIHNvCmRpZmZlcmVudCB2aXMgYSB2aXMgdGhlaXIgUENBL0RFOyBzbyBJIHRob3VnaHQgdGhhdCBnUHJvZmlsZXIgbWlnaHQKaGVscCBib2lsIHRob3NlIHJlc3VsdHMgZG93biB0byBzb21ldGhpbmcgbW9yZSBkaWdlc3RpYmxlLgoKIyMjIEdTRUE6IENvbXBhcmUgY2xpbmljcywgYWxsIHNhbXBsZXMKCk5vdGUgdGhhdCBpbiB0aGUgZm9sbG93aW5nIGJsb2NrIEkgdXNlZCB0aGUgZnVuY3Rpb24Kc2ltcGxlX2dwcm9maWxlcigpLCBidXQgbGF0ZXIgaW4gdGhpcyBkb2N1bWVudCBJIHdpbGwgdXNlCmFsbF9ncHJvZmlsZXIoKS4gIFRoZSBmaXJzdCBpbnZvY2F0aW9uIGxpbWl0cyB0aGUgc2VhcmNoIHRvIGEgc2luZ2xlCnRhYmxlLCB3aGlsZSB0aGUgc2Vjb25kIHdpbGwgaXRlcmF0ZSBvdmVyIGV2ZXJ5IHJlc3VsdCBpbiBhIHBhaXJ3aXNlCmRpZmZlcmVudGlhbCBleHByZXNzaW9uIGFuYWx5c2lzLgoKSW4gdGhpcyBpbnN0YW5jZSwgd2UgYXJlIGxvb2tpbmcgYXQgdGhlIHZlY3RvciBvZiBnZW5lIElEcyBkZWVtZWQKc2lnbmlmaWNhbnRseSBkaWZmZXJlbnQgYmV0d2VlbiB0aGUgdHdvIGNsaW5pY3MgaW4gZWl0aGVyIHRoZSB1cCBvcgpkb3duIGRpcmVjdGlvbi4KCk9uZSBvdGhlciB0aGluZyB3b3J0aCBub3RpbmcsIHRoZSBuZXcgdmVyc2lvbiBvZiBnUHJvZmlsZXIgcHJvdmlkZXMKc29tZSBmdW4gaW50ZXJhY3RpdmUgcGxvdHMuICBJIHdpbGwgYWRkIGFuIGV4YW1wbGUgaGVyZS4KCmBgYHtyfQp0Y19lb3Npbm9waGlsX2dwcm9maWxlciA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX2Vvc2lub3BoaWxzX3NpZ2VuZXNfdXAsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L2Vvc2lub3BoaWxfY2xpbmljc190dW1hY29fdXAtdnt2ZXJ9Lnhsc3giKSkKdGNfZW9zaW5vcGhpbF9ncHJvZmlsZXIKCmNsaW5pY19ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIGNsaW5pY19zaWdlbmVzLAogIGV4Y2VsID0gZ2x1ZSgie2dzZWFfcHJlZml4fS9ib3RoX2NsaW5pY3NfY2FsaV91cC12e3Zlcn0ueGxzeCIpKQpjbGluaWNfZ3AkcHZhbHVlX3Bsb3RzJFJFQUMKY2xpbmljX2dwJHB2YWx1ZV9wbG90cyRCUApjbGluaWNfZ3AkcHZhbHVlX3Bsb3RzJFRGCmNsaW5pY19ncCRpbnRlcmFjdGl2ZV9wbG90cyRHTwpgYGAKCiMjIyBHU0VBOiBDb21wYXJlIGNsaW5pY3MsIEVvc2lub3BoaWwgc2FtcGxlcwoKSW4gdGhlIGZvbGxvd2luZyBibG9jaywgSSBhbSBsb29raW5nIGF0IHRoZSBnUHJvZmlsZXIgb3ZlciByZXByZXNlbnRlZApncm91cHMgb2JzZXJ2ZWQgYWNyb3NzIGNsaW5pY3MgaW4gb25seSB0aGUgRW9zaW5vcGhpbHMuICBGaXJzdCBJIGRvIHNvCmZvciBhbGwgZ2VuZXModXAgb3IgZG93biksIGZvbGxvd2VkIGJ5IG9ubHkgdGhlIHVwIGFuZCBkb3duIGdyb3Vwcy4KRWFjaCBvZiB0aGUgZm9sbG93aW5nIHdpbGwgaW5jbHVkZSBvbmx5IHRoZSBSZWFjdG9tZSBhbmQgR086QlAgcGxvdHMuClRoZXNlIHNlYXJjaGVzIGRpZCBub3QgaGF2ZSB0b28gbWFueSBvdGhlciBoaXRzLCBleGNlcHRpbmcgdGhlCnRyYW5zY3JpcHRpb24gZmFjdG9yIGRhdGFiYXNlLgoKYGBge3J9CnRjX2Vvc2lub3BoaWxzX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfZW9zaW5vcGhpbHNfc2lnZW5lcywKICBleGNlbCA9IGdsdWUoIntnc2VhX3ByZWZpeH0vZW9zaW5vcGhpbF9jbGluaWNzLXZ7dmVyfS54bHN4IikpCnRjX2Vvc2lub3BoaWxzX2dwCnRjX2Vvc2lub3BoaWxzX2dwJHB2YWx1ZV9wbG90cyRSRUFDCnRjX2Vvc2lub3BoaWxzX2dwJHB2YWx1ZV9wbG90cyRCUAoKdGNfZW9zaW5vcGhpbHNfdXBfZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19lb3Npbm9waGlsc19zaWdlbmVzX3VwLAogIGV4Y2VsID0gZ2x1ZSgie2dzZWFfcHJlZml4fS9lb3Npbm9waGlsX2NsaW5pY3NfdHVtYWNvX3VwLXZ7dmVyfS54bHN4IikpCnRjX2Vvc2lub3BoaWxzX3VwX2dwCnRjX2Vvc2lub3BoaWxzX3VwX2dwJHB2YWx1ZV9wbG90cyRSRUFDCgp0Y19lb3Npbm9waGlsc19kb3duX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfZW9zaW5vcGhpbHNfc2lnZW5lc19kb3duLAogIGV4Y2VsID0gZ2x1ZSgie2dzZWFfcHJlZml4fS9lb3Npbm9waGlsX2NsaW5pY3NfY2FsaV91cC12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19kb3duX2dwCnRjX2Vvc2lub3BoaWxzX2Rvd25fZ3AkcHZhbHVlX3Bsb3RzJFJFQUMKYGBgCgojIyMgR1NFQTogQ29tcGFyZSBjbGluaWNzLCBNb25vY3l0ZSBzYW1wbGVzCgpJbiB0aGUgZm9sbG93aW5nIGJsb2NrIEkgcmVwZWF0ZWQgdGhlIGFib3ZlIHF1ZXJ5LCBidXQgdGhpcyB0aW1lCmxvb2tpbmcgYXQgdGhlIG1vbm9jeXRlIHNhbXBsZXMuCgpgYGB7cn0KdGNfbW9ub2N5dGVzX3VwX2dwIDwtIHNpbXBsZV9ncHJvZmlsZXIoCiAgdGNfbW9ub2N5dGVzX3NpZ2VuZXMsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L21vbm9jeXRlX2NsaW5pY3Mtdnt2ZXJ9Lnhsc3giKSkKdGNfbW9ub2N5dGVzX3VwX2dwCnRjX21vbm9jeXRlc191cF9ncCRwdmFsdWVfcGxvdHMkUkVBQwp0Y19tb25vY3l0ZXNfdXBfZ3AkcHZhbHVlX3Bsb3RzJEJQCgp0Y19tb25vY3l0ZXNfZG93bl9ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX21vbm9jeXRlc19zaWdlbmVzX2Rvd24sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L21vbm9jeXRlX2NsaW5pY3NfY2FsaV91cC12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfZG93bl9ncCRwdmFsdWVfcGxvdHMkUkVBQwp0Y19tb25vY3l0ZXNfZG93bl9ncCRwdmFsdWVfcGxvdHMkQlAKYGBgCgojIyMjIEdTRUE6IENvbXBhcmUgY2xpbmljcywgTmV1dHJvcGhpbCBzYW1wbGVzCgpJYmlkLiAgVGhpcyB0aW1lIGxvb2tpbmcgYXQgdGhlIE5ldXRyb3BoaWxzLiAgVGh1cyB0aGUgZmlyc3QgdHdvCmltYWdlcyBzaG91bGQgYmUgYSBzdXBlcnNldCBvZiB0aGUgc2Vjb25kIGFuZCB0aGlyZCBwYWlycyBvZiBpbWFnZXM7CmFzc3VtaW5nIHRoYXQgdGhlIGdlbmVzIGluIHRoZSB1cC9kb3duIGxpc3QgZG8gbm90IGNhdXNlIHRoZSBncm91cHMgdG8Kbm8gbG9uZ2VyIGJlIHNpZ25pZmljYW50LiAgSW50ZXJlc3RpbmdseSwgdGhlIHJlYWN0b21lIHNlYXJjaCBkaWQgbm90CnJldHVybiBhbnkgaGl0cyBmb3IgdGhlIGluY3JlYXNlZCBzZWFyY2guCgpgYGB7cn0KdGNfbmV1dHJvcGhpbHNfZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19uZXV0cm9waGlsc19zaWdlbmVzLAogIGV4Y2VsID0gZ2x1ZSgie2dzZWFfcHJlZml4fS9uZXV0cm9waGlsX2NsaW5pY3Mtdnt2ZXJ9Lnhsc3giKSkKIyMgdGNfbmV1dHJvcGhpbHNfZ3AkcHZhbHVlX3Bsb3RzJFJFQUMgIyMgbm8gaGl0cwp0Y19uZXV0cm9waGlsc19ncCRwdmFsdWVfcGxvdHMkQlAKdGNfbmV1dHJvcGhpbHNfZ3AkcHZhbHVlX3Bsb3RzJFRGCgp0Y19uZXV0cm9waGlsc191cF9ncCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKAogIHRjX25ldXRyb3BoaWxzX3NpZ2VuZXNfdXAsCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L25ldXRyb3BoaWxfY2xpbmljc190dW1hY29fdXAtdnt2ZXJ9Lnhsc3giKSkKIyMgdGNfbmV1dHJvcGhpbHNfdXBfZ3AkcHZhbHVlX3Bsb3RzJFJFQUMgIyMgTm8gaGl0cwp0Y19uZXV0cm9waGlsc191cF9ncCRwdmFsdWVfcGxvdHMkQlAKCnRjX25ldXRyb3BoaWxzX2Rvd25fZ3AgPC0gc2ltcGxlX2dwcm9maWxlcigKICB0Y19uZXV0cm9waGlsc19zaWdlbmVzX2Rvd24sCiAgZXhjZWwgPSBnbHVlKCJ7Z3NlYV9wcmVmaXh9L25ldXRyb3BoaWxfY2xpbmljc19jYWxpX3VwLXZ7dmVyfS54bHN4IikpCnRjX25ldXRyb3BoaWxzX2Rvd25fZ3AkcHZhbHVlX3Bsb3RzJFJFQUMKdGNfbmV1dHJvcGhpbHNfZG93bl9ncCRwdmFsdWVfcGxvdHMkQlAKYGBgCgojIENvbXBhcmUgREU6IEhvdyBzaW1pbGFyIGFyZSBUdW1hY28gQy9GIHZzLiBDYWxpIEMvRgoKVGhlIGZvbGxvd2luZyBleHBhbmRzIHRoZSBjcm9zcy1jbGluaWMgcXVlcnkgYWJvdmUgdG8gYWxzbyB0ZXN0IHRoZQpuZXV0cm9waGlscy4gIE9uY2UgYWdhaW4sIEkgdGhpbmsgaXQgd2lsbCBwcmV0dHkgc3Ryb25nbHkgc3VwcG9ydCB0aGUKaHlwb3RoZXNpcyB0aGF0IHRoZSB0d28gY2xpbmljcyBhcmUgbm90IGNvbXBhdGlibGUuCgpXZSBhcmUgY29uY2VybmVkIHRoYXQgdGhlIGNsaW5pYy1iYXNlZCBiYXRjaCBlZmZlY3QgbWF5IG1ha2Ugb3VyCnJlc3VsdHMgZXNzZW50aWFsbHkgdXNlbGVzcy4gIE9uZSB3YXkgdG8gdGVzdCB0aGlzIGNvbmNlcm4gaXMgdG8KY29tcGFyZSB0aGUgc2V0IG9mIGdlbmVzIG9ic2VydmVkIGRpZmZlcmVudCBiZXR3ZWVuIHRoZSBDYWxpIEN1cmUvRmFpbAp2cy4gdGhlIFR1bWFjbyBDdXJlL0ZhaWwuCgpgYGB7cn0KY2FsaV90YWJsZV9ub2JhdGNoIDwtIHRjX25ldXRyb3BoaWxzX3RhYmxlX25vYmF0Y2hbWyJkYXRhIl1dW1siY2FsaSJdXQp0dW1hY29fdGFibGVfbm9iYXRjaCA8LSB0Y19uZXV0cm9waGlsc190YWJsZV9ub2JhdGNoW1siZGF0YSJdXVtbInR1bWFjbyJdXQoKY2FsaV9tZXJnZWRfbm9iYXRjaCA8LSBtZXJnZShjYWxpX3RhYmxlX25vYmF0Y2gsIHR1bWFjb190YWJsZV9ub2JhdGNoLCBieT0icm93Lm5hbWVzIikKY29yLnRlc3QoY2FsaV9tZXJnZWRfbm9iYXRjaFssICJkZXNlcV9sb2dmYy54Il0sIGNhbGlfbWVyZ2VkX25vYmF0Y2hbLCAiZGVzZXFfbG9nZmMueSJdKQpjYWxpX2F1Y2Nfbm9iYXRjaCA8LSBjYWxjdWxhdGVfYXVjYyhjYWxpX3RhYmxlX25vYmF0Y2gsIHR1bWFjb190YWJsZV9ub2JhdGNoLCBweCA9ICJkZXNlcV9hZGpwIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcHkgPSAiZGVzZXFfYWRqcCIsIGx4ID0gImRlc2VxX2xvZ2ZjIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQpjYWxpX2F1Y2Nfbm9iYXRjaCRwbG90CmBgYAoKIyBUdW1hY28gYW5kIENhbGksIGN1cmUgdnMuIGZhaWwKCkluIGFsbCBvZiB0aGUgYWJvdmUsIHdlIGFyZSBsb29raW5nIHRvIHVuZGVyc3RhbmQgdGhlIGRpZmZlcmVuY2VzCmJldHdlZW4gdGhlIHR3byBsb2NhdGlvbnMuIExldCB1cyBub3cgc3RlcCBiYWNrIGFuZCBwZXJmb3JtIHRoZQpvcmlnaW5hbCBxdWVzdGlvbjogZmFpbC9jdXJlIHdpdGhvdXQgcmVnYXJkIHRvIGxvY2F0aW9uLgoKSSBwZXJmb3JtZWQgdGhpcyBxdWVyeSB3aXRoIGEgZmV3IGRpZmZlcmVudCBwYXJhbWV0ZXJzLCBub3RhYmx5CndpdGgob3V0KSBzdmEgYW5kIGFnYWluIHVzaW5nIGVhY2ggY2VsbCB0eXBlLCBpbmNsdWRpbmcgYmlvcHNpZXMuIFRoZQptYWluIHJlYXNpb24gSSBhbSBrZWVwaW5nIHRoZXNlIGNvbXBhcmlzb25zIGlzIGluIHRoZSByZWxhdGl2ZWx5IHdlYWsKaG9wZSB0aGF0IHRoZXJlIHdpbGwgYmUgc3VmZmljaWVudCBzaWduYWwgaW4gdGhlIGZ1bGwgZGF0YXNldCB0aGF0IGl0Cm1pZ2h0IGJlIGFibGUgdG8gb3ZlcmNvbWUgdGhlIGFwcGFyZW50bHkgcmlkaWN1bG91cyBiYXRjaCBlZmZlY3QgZnJvbQp0aGUgdHdvIGNsaW5pY3MuCgojIyBBbGwgY2VsbCB0eXBlcyB0b2dldGhlciwgd2l0aChvdXQpIFNWQQoKYGBge3J9CnRhYmxlKHBEYXRhKHRjX3ZhbGlkKVtbImNvbmRpdGlvbiJdXSkKdGNfYWxsX2NmX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfdmFsaWQsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiKQp0Y19hbGxfY2ZfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2FsbF9jZl9kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfdmFsaWRfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2FsbF9jZl9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfYWxsX2NmX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX3ZhbGlkX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKCnRjX2FsbF9jZl9kZV9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfdmFsaWQsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSkKdGNfYWxsX2NmX3RhYmxlX2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2FsbF9jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y192YWxpZF9jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19hbGxfY2Zfc2lnX2JhdGNoIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfYWxsX2NmX3RhYmxlX2JhdGNoLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfdmFsaWRfY2Zfc2lnX2JhdGNoLXZ7dmVyfS54bHN4IikpCmBgYAoKIyMgQWxsIGNlbGwgdHlwZXMgZXhjZXB0IGJpb3BzaWVzCgpJIGFtIG5vdCBzdXJlIGlmIHRoaXMgaXMgdGhlIGJlc3QgY2hvaWNlLCBidXQgSSBjYWxsIHRoZSBzZXQgb2YgYWxsCnNhbXBsZXMgZXhjbHVkaW5nIGJpb3BzaWVzICdjbGluaWNhbCcuCgpgYGB7cn0KdGFibGUocERhdGEodGNfY2xpbmljYWxfbm9iaW9wKVtbImNvbmRpdGlvbiJdXSkKdGNfY2xpbmljYWxfY2ZfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19jbGluaWNhbF9ub2Jpb3AsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfY2xpbmljYWxfY2ZfZGVfc3ZhCgp0Y19jbGluaWNhbF9jZl90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfY2xpbmljYWxfY2ZfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0NsaW5pY2FsX1NhbXBsZXMvdGNfY2xpbmljYWxfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2NsaW5pY2FsX2NmX3RhYmxlX3N2YQoKdGNfY2xpbmljYWxfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2NsaW5pY2FsX2NmX3RhYmxlX3N2YSwgYWNjb3JkaW5nX3RvID0gImRlc2VxIiwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0NsaW5pY2FsX1NhbXBsZXMvdGNfY2xpbmljYWxfY2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19jbGluaWNhbF9jZl9zaWdfc3ZhCgp0Y19jbGluaWNhbF9jZl9kZV9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfY2xpbmljYWxfbm9iaW9wLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2NsaW5pY2FsX2NmX2RlX2JhdGNoCgp0Y19jbGluaWNhbF9jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19jbGluaWNhbF9jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsIGxhYmVsX2NvbHVtbiA9ICJoZ25jX3N5bWJvbCIsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9DbGluaWNhbF9TYW1wbGVzL3RjX2NsaW5pY2FsX2NmX3RhYmxlX2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX2NsaW5pY2FsX2NmX3RhYmxlX2JhdGNoCgp0Y19jbGluaWNhbF9jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19jbGluaWNhbF9jZl90YWJsZV9iYXRjaCwgYWNjb3JkaW5nX3RvID0gImRlc2VxIiwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0NsaW5pY2FsX1NhbXBsZXMvdGNfY2xpbmljYWxfY2Zfc2lnX2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX2NsaW5pY2FsX2NmX3NpZ19iYXRjaApgYGAKCiMjIyBBIHBvcnRpb24gb2YgU3VwcGxlbWVudGFsIEZpZ3VyZSAxMS4KCmBgYHtyfQpudW1fY29sb3IgPC0gY29sb3JfY2hvaWNlc1tbImNmIl1dW1siY3VyZSJdXQpkZW5fY29sb3IgPC0gY29sb3JfY2hvaWNlc1tbImNmIl1dW1siZmFpbHVyZSJdXQp0Y19jbGluaWNhbF9jZl90YWJsZSA8LSB0Y19jbGluaWNhbF9jZl90YWJsZV9zdmFbWyJkYXRhIl1dW1sib3V0Y29tZSJdXQp0Y19jbGluaWNhbF9jZl92b2xjYW5vX3RvcDEwIDwtIHBsb3Rfdm9sY2Fub19jb25kaXRpb25fZGUoCiAgdGNfY2xpbmljYWxfY2ZfdGFibGUsICJvdXRjb21lIiwgbGFiZWwgPSAxMCwKICBmY19jb2wgPSAiZGVzZXFfbG9nZmMiLCBwX2NvbCA9ICJkZXNlcV9hZGpwIiwgbGluZV9wb3NpdGlvbiA9IE5VTEwsCiAgY29sb3JfaGlnaCA9IG51bV9jb2xvciwgY29sb3JfbG93ID0gZGVuX2NvbG9yLCBsYWJlbF9zaXplID0gNikKcHAoZmlsZSA9ICJmaWd1cmVzL3MxMWNfdGNfY2xpbmljYWxfY2Zfdm9sY2Fub19sYWJlbGVkX3RvcDEwLnN2ZyIpCnRjX2NsaW5pY2FsX2NmX3ZvbGNhbm9fdG9wMTBbWyJwbG90Il1dCmRldi5vZmYoKQp0Y19jbGluaWNhbF9jZl92b2xjYW5vX3RvcDEwW1sicGxvdCJdXQpgYGAKCiMjIEJpb3BzaWVzLCB3aXRoKG91dCkgU1ZBCgpJbiB0aGUgZm9sbG93aW5nIGJsb2NrLCB3ZSByZXBlYXQgdGhlIHNhbWUgcXVlc3Rpb24sIGJ1dCB1c2luZyBvbmx5CnRoZSBiaW9wc3kgc2FtcGxlcyBmcm9tIGJvdGggY2xpbmljcy4KCmBgYHtyfQp0Y19iaW9wc2llc19jZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRjX2Jpb3BzaWVzLCBmYWN0ID0gImZpbmFsb3V0Y29tZSIpCnRjX2Jpb3BzaWVzX2NmX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodGNfYmlvcHNpZXNfY2YsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gInN2YXNlcSIpCnRjX2Jpb3BzaWVzX2NmX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19iaW9wc2llc19jZl9kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQmlvcHNpZXMvdGNfYmlvcHNpZXNfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRjX2Jpb3BzaWVzX2NmX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19iaW9wc2llc19jZl90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19iaW9wc2llc19jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCgp0Y19iaW9wc2llc19jZl9kZV9iYXRjaCA8LSBhbGxfcGFpcndpc2UodGNfYmlvcHNpZXNfY2YsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSBUUlVFKQp0Y19iaW9wc2llc19jZl90YWJsZV9iYXRjaCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19iaW9wc2llc19jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19iaW9wc2llc19jZl90YWJsZV9iYXRjaC12e3Zlcn0ueGxzeCIpKQp0Y19iaW9wc2llc19jZl9zaWdfYmF0Y2ggPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19iaW9wc2llc19jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX2Jpb3BzaWVzX2NmX3NpZ19iYXRjaC12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIEVvc2lub3BoaWxzLCB3aXRoKG91dCkgU1ZBCgpJbiB0aGUgZm9sbG93aW5nIGJsb2NrLCB3ZSByZXBlYXQgdGhlIHNhbWUgcXVlc3Rpb24sIGJ1dCB1c2luZyBvbmx5CnRoZSBFb3Npbm9waGlsIHNhbXBsZXMgZnJvbSBib3RoIGNsaW5pY3MuCgpgYGB7cn0KdGNfZW9zaW5vcGhpbHNfY2YgPC0gc2V0X2V4cHRfY29uZGl0aW9ucyh0Y19lb3Npbm9waGlscywgZmFjdCA9ICJmaW5hbG91dGNvbWUiKQp0Y19lb3Npbm9waGlsc19jZl9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX2Vvc2lub3BoaWxzX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiKQp0Y19lb3Npbm9waGlsc19jZl90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfZW9zaW5vcGhpbHNfY2ZfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RjX2Vvc2lub3BoaWxzX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19lb3Npbm9waGlsc19jZl9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfZW9zaW5vcGhpbHNfY2ZfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfZW9zaW5vcGhpbHNfY2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQoKdGNfZW9zaW5vcGhpbHNfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX2Vvc2lub3BoaWxzX2NmLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX2Vvc2lub3BoaWxzX2NmX3RhYmxlX2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX2Vvc2lub3BoaWxzX2NmX2RlX2JhdGNoLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX2Vvc2lub3BoaWxzX2NmX3RhYmxlX2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX2Vvc2lub3BoaWxzX2NmX3NpZ19iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX2Vvc2lub3BoaWxzX2NmX3RhYmxlX2JhdGNoLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfZW9zaW5vcGhpbHNfY2Zfc2lnX2JhdGNoLXZ7dmVyfS54bHN4IikpCmBgYAoKIyMgTW9ub2N5dGVzLCB3aXRoKG91dCkgU1ZBCgpSZXBlYXQgeWV0IGFnYWluLCB0aGlzIHRpbWUgd2l0aCB0aGUgbW9ub2N5dGUgc2FtcGxlcy4gIFRoZSBpZGVhIGlzIHRvCnNlZSBpZiB0aGVyZSBpcyBhIGNlbGwgdHlwZSB3aGljaCBpcyBwYXJ0aWN1bGFybHkgZ29vZCAob3IgYmFkKSBhdApkaXNjcmltaW5hdGluZyB0aGUgdHdvIGNsaW5pY3MuCgpgYGB7cn0KdGNfbW9ub2N5dGVzX2NmIDwtIHNldF9leHB0X2NvbmRpdGlvbnModGNfbW9ub2N5dGVzLCBmYWN0ID0gImZpbmFsb3V0Y29tZSIpCnRjX21vbm9jeXRlc19jZl9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRjX21vbm9jeXRlc19jZiwgZmlsdGVyID0gVFJVRSwgbWV0aG9kcyA9IG1ldGhvZHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gInN2YXNlcSIpCnRjX21vbm9jeXRlc19jZl90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfbW9ub2N5dGVzX2NmX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Nb25vY3l0ZXMvdGNfbW9ub2N5dGVzX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19tb25vY3l0ZXNfY2Zfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX21vbm9jeXRlc19jZl90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19tb25vY3l0ZXNfY2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQoKdGNfbW9ub2N5dGVzX2NmX2RlX2JhdGNoIDwtIGFsbF9wYWlyd2lzZSh0Y19tb25vY3l0ZXNfY2YsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gVFJVRSkKdGNfbW9ub2N5dGVzX2NmX3RhYmxlX2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX21vbm9jeXRlc19jZl9kZV9iYXRjaCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90Y19tb25vY3l0ZXNfY2ZfdGFibGVfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKdGNfbW9ub2N5dGVzX2NmX3NpZ19iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX21vbm9jeXRlc19jZl90YWJsZV9iYXRjaCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX21vbm9jeXRlc19jZl9zaWdfYmF0Y2gtdnt2ZXJ9Lnhsc3giKSkKYGBgCgojIyBOZXV0cm9waGlscywgd2l0aChvdXQpIFNWQQoKTGFzdCB0cnksIHRoaXMgdGltZSB1c2luZyB0aGUgTmV1dHJvcGhpbCBzYW1wbGVzLgoKYGBge3J9CnRjX25ldXRyb3BoaWxzX2NmIDwtIHNldF9leHB0X2NvbmRpdGlvbnModGNfbmV1dHJvcGhpbHMsIGZhY3QgPSAiZmluYWxvdXRjb21lIikKdGNfbmV1dHJvcGhpbHNfY2ZfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0Y19uZXV0cm9waGlsc19jZiwgcGFyYWxsZWwgPSBwYXJhbGxlbCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0Y19uZXV0cm9waGlsc19jZl90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdGNfbmV1dHJvcGhpbHNfY2ZfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RjX25ldXRyb3BoaWxzX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0Y19uZXV0cm9waGlsc19jZl9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdGNfbmV1dHJvcGhpbHNfY2ZfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfbmV1dHJvcGhpbHNfY2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQoKdGNfbmV1dHJvcGhpbHNfY2ZfZGVfYmF0Y2ggPC0gYWxsX3BhaXJ3aXNlKHRjX25ldXRyb3BoaWxzX2NmLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbW9kZWxfYmF0Y2ggPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX25ldXRyb3BoaWxzX2NmX3RhYmxlX2JhdGNoIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX25ldXRyb3BoaWxzX2NmX2RlX2JhdGNoLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RjX25ldXRyb3BoaWxzX2NmX3RhYmxlX2JhdGNoLXZ7dmVyfS54bHN4IikpCnRjX25ldXRyb3BoaWxzX2NmX3NpZ19iYXRjaCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRjX25ldXRyb3BoaWxzX2NmX3RhYmxlX2JhdGNoLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQWxsX1NhbXBsZXMvdGNfbmV1dHJvcGhpbHNfY2Zfc2lnX2JhdGNoLXZ7dmVyfS54bHN4IikpCmBgYAoKIyBWaXNpdCBjb21wYXJpc29ucwoKTGF0ZXIgaW4gdGhpcyBkb2N1bWVudCBJIGRvIGEgYnVuY2ggb2YgdmlzaXQvY2YgY29tcGFyaXNvbnMuICBJbiB0aGlzCmJsb2NrIEkgd2FudCB0byBleHBsaWNpdGx5IG9ubHkgY29tcGFyZSB2MSB0byBvdGhlciB2aXNpdHMuICBUaGlzIGlzCnNvbWV0aGluZyBJIGRpZCBxdWl0ZSBhIGxvdCBpbiB0aGUgMjAxOSBkYXRhc2V0cywgYnV0IG5ldmVyIGFjdHVhbGx5Cm1vdmVkIHRvIHRoaXMgZG9jdW1lbnQuCgpgYGB7cn0KdjFfdnNfbGF0ZXIgPC0gYWxsX3BhaXJ3aXNlKHRjX3YxdnMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSkKdjFfdnNfbGF0ZXJfdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdjFfdnNfbGF0ZXIsIGtlZXBlcnMgPSB2aXNpdF92MWxhdGVyLAogIGV4Y2VsID0gZ2x1ZSgie3Zpc2l0X3ByZWZpeH0vdjFfdnNfbGF0ZXJfdGFibGVzLXZ7dmVyfS54bHN4IikpCnYxX3ZzX2xhdGVyX3NpZyA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHYxX3ZzX2xhdGVyX3RhYmxlLAogIGV4Y2VsID0gZ2x1ZSgie3Zpc2l0X3ByZWZpeH0vdjFfdnNfbGF0ZXJfc2lnLXZ7dmVyfS54bHN4IikpCmBgYAoKIyMjIyBHU0VBOiBWMSB2cyBvdGhlciB2aXNpdHMuCgpgYGB7cn0KdjFsYXRlcl9ncCA8LSBhbGxfZ3Byb2ZpbGVyKHYxX3ZzX2xhdGVyX3NpZykKdjFsYXRlcl9ncFtbMV1dJHB2YWx1ZV9wbG90cyRSRUFDCnYxbGF0ZXJfZ3BbWzJdXSRwdmFsdWVfcGxvdHMkUkVBQwpgYGAKCiMgU2V4IGNvbXBhcmlzb24KCmBgYHtyfQp0Y19zZXhfZGUgPC0gYWxsX3BhaXJ3aXNlKHRjX3NleCwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwgbWV0aG9kcyA9IG1ldGhvZHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSkKdGNfc2V4X3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX3NleF9kZSwgZXhjZWwgPSBnbHVlKCJ7c2V4X3ByZWZpeH0vdGNfc2V4X3RhYmxlLXZ7dmVyfS54bHN4IikpCnRjX3NleF9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19zZXhfdGFibGUsIGV4Y2VsID0gZ2x1ZSgie3NleF9wcmVmaXh9L3RjX3NleF9zaWctdnt2ZXJ9Lnhsc3giKSkKdGNfc2V4X2dwIDwtIGFsbF9ncHJvZmlsZXIodGNfc2V4X3NpZykKYGBgCgpgYGB7cn0KdGNfc2V4X2N1cmUgPC0gc3Vic2V0X2V4cHQodGNfc2V4LCBzdWJzZXQgPSAiZmluYWxvdXRjb21lPT0nY3VyZSciKQp0Y19zZXhfY3VyZV9kZSA8LSBhbGxfcGFpcndpc2UodGNfc2V4X2N1cmUsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRjX3NleF9jdXJlX2RlCnRjX3NleF9jdXJlX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRjX3NleF9jdXJlX2RlLCBleGNlbCA9IGdsdWUoIntzZXhfcHJlZml4fS90Y19zZXhfY3VyZV90YWJsZS12e3Zlcn0ueGxzeCIpKQp0Y19zZXhfY3VyZV90YWJsZQp0Y19zZXhfY3VyZV9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19zZXhfY3VyZV90YWJsZSwgZXhjZWwgPSBnbHVlKCJ7c2V4X3ByZWZpeH0vdGNfc2V4X2N1cmVfc2lnLXZ7dmVyfS54bHN4IikpCnRjX3NleF9jdXJlX3NpZwpgYGAKCiMjIyMgR1NFQTogU2V4IGNvbXBhcmlzb25zIGJvdGggY2xpbmljcwoKYGBge3J9CnRjX3NleF9jdXJlX2dwIDwtIGFsbF9ncHJvZmlsZXIodGNfc2V4X2N1cmVfc2lnKQp0Y19zZXhfY3VyZV9ncAp0Y19zZXhfY3VyZV9ncFtbMV1dW1sicHZhbHVlX3Bsb3RzIl1dW1siQlAiXV0KdGNfc2V4X2N1cmVfZ3BbWzJdXVtbInB2YWx1ZV9wbG90cyJdXVtbIkJQIl1dCmBgYAoKIyBFdGhuaWNpdHkgY29tcGFyaXNvbnMKCmBgYHtyfQp0Y19ldGhuaWNpdHlfZGUgPC0gYWxsX3BhaXJ3aXNlKHRjX2V0bmlhX2V4cHQsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGNfZXRobmljaXR5X2RlCnRjX2V0aG5pY2l0eV90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0Y19ldGhuaWNpdHlfZGUsIGtlZXBlcnMgPSBldGhuaWNpdHlfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2V0aF9wcmVmaXh9L3RjX2V0aG5pY2l0eV90YWJsZS12e3Zlcn0ueGxzeCIpKQp0Y19ldGhuaWNpdHlfdGFibGUKdGNfZXRobmljaXR5X3RhYmxlW1sicGxvdHMiXV1bWyJtZXN0aXpvX2luZGlnZW5vdXMiXV1bWyJkZXNlcV9tYV9wbG90cyJdXQp0Y19ldGhuaWNpdHlfdGFibGVbWyJwbG90cyJdXVtbIm1lc3Rpem9fYWZyb2NvbCJdXVtbImRlc2VxX21hX3Bsb3RzIl1dCnRjX2V0aG5pY2l0eV90YWJsZVtbInBsb3RzIl1dW1siaW5kaWdlbm91c19hZnJvY29sIl1dW1siZGVzZXFfbWFfcGxvdHMiXV0KCnRjX2V0aG5pY2l0eV9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0Y19ldGhuaWNpdHlfdGFibGUsIGV4Y2VsID0gZ2x1ZSgie2V0aF9wcmVmaXh9L3RjX2V0aG5pY2l0eV9zaWctdnt2ZXJ9Lnhsc3giKSkKCmV0aG5pY2l0eV9jdXJlIDwtIHN1YnNldF9leHB0KHRjX2V0bmlhX2V4cHQsIHN1YnNldCA9ICJmaW5hbG91dGNvbWU9PSdjdXJlJyIpCmV0aG5pY2l0eV9jdXJlX2RlIDwtIGFsbF9wYWlyd2lzZShldGhuaWNpdHlfY3VyZSwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKZXRobmljaXR5X2N1cmVfdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgZXRobmljaXR5X2N1cmVfZGUsIGtlZXBlcnMgPSBldGhuaWNpdHlfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2V0aF9wcmVmaXh9L2V0aG5pY2l0eV9jdXJlX3RhYmxlLXZ7dmVyfS54bHN4IikpCmV0aG5pY2l0eV9jdXJlX3RhYmxlCmV0aG5pY2l0eV9jdXJlX3RhYmxlW1sicGxvdHMiXV1bWyJtZXN0aXpvX2luZGlnZW5vdXMiXV1bWyJkZXNlcV9tYV9wbG90cyJdXQpldGhuaWNpdHlfY3VyZV90YWJsZVtbInBsb3RzIl1dW1sibWVzdGl6b19hZnJvY29sIl1dW1siZGVzZXFfbWFfcGxvdHMiXV0KZXRobmljaXR5X2N1cmVfdGFibGVbWyJwbG90cyJdXVtbImluZGlnZW5vdXNfYWZyb2NvbCJdXVtbImRlc2VxX21hX3Bsb3RzIl1dCmV0aG5pY2l0eV9jdXJlX3NpZyA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIGV0aG5pY2l0eV9jdXJlX3RhYmxlLCBleGNlbCA9IGdsdWUoIntldGhfcHJlZml4fS9ldGhuaWNpdHlfY3VyZV9zaWctdnt2ZXJ9Lnhsc3giKSkKZXRobmljaXR5X2N1cmVfc2lnCmBgYAoKIyMjIyBHU0VBOiBFdGhuaWNpdHkgZGlmZmVyZW5jZXMKClBlcmZvcm1lZCBvbmNlIHdpdGggYm90aCBjbGluaWNzIGFuZCBhZ2FpbiB3aXRoIG9ubHkgVHVtYWNvLgoKYGBge3J9CnRjX2V0aG5pY2l0eV9ncCA8LSBhbGxfZ3Byb2ZpbGVyKHRjX2V0aG5pY2l0eV9zaWcpCmBgYAoKYGBge3J9CnBhbmRlcjo6cGFuZGVyKHNlc3Npb25JbmZvKCkpCm1lc3NhZ2UoIlRoaXMgaXMgaHBnbHRvb2xzIGNvbW1pdDogIiwgZ2V0X2dpdF9jb21taXQoKSkKbWVzc2FnZSgiU2F2aW5nIHRvICIsIHNhdmVmaWxlKQojIHRtcCA8LSBzbShzYXZlbWUoZmlsZW5hbWUgPSBzYXZlZmlsZSkpCmBgYAoKYGBge3IgbG9hZG1lX2FmdGVyLCBldmFsPUZBTFNFfQp0bXAgPC0gbG9hZG1lKGZpbGVuYW1lID0gc2F2ZWZpbGUpCmBgYAo=