1 Changelog
- 202406: Added an explicit comparison of different model constructions using our most variable cell type, the neutrophils.
- 202406: Working entirely out of the container now, separated GSE/GSEA analyses, added a full treatment with clusterProfiler; I am not currently writing the cp results out as xlsx files until/unless someone expresses interest in them.
- 202309: Disabled GSVA analyses until/unless we get permission to include the mSigDB 7.5.1 release. I will simplify the filenames so that one may easily drop in a downloaded copy of the data and run those blocks. Until then, I guess you (fictitious reader) will have to trust me when I say those blocks all work? (Also, GSVA was moved to a separate document)
- 202309: Moved all gene set enrichment analyses to 04lrt_gsea_gsva.Rmd
- 202309 next day: Moving gene set enrichment back because it adds too much complexity to save/reload the DE results for gProfiler and friends.
- Still hunting for messed up colors, changed input data to match new version.
2 Introduction
The various differential expression analyses of the data generated in tmrc3_datasets will occur in this document. Most of the actual work is via the function ‘all_pairwise()’; the word ‘all’ in the name does a lot of work; it is responsible for performing all possible pairwise contrasts using all possible methods for which I have sufficient understanding to be able to write a reasonably robust pairwise function. Currently this is limited to:
- DESeq2 (Love, Huber, and Anders (2014)): Our ‘default’
- edgeR (McCarthy, Chen, and Smyth (2012)): shares a close conceptual lineage with DESeq2 I think.
- limma (Ritchie et al. (2015)): along with voom this provides a nicely robust set of tools.
- EBseq (Leng et al. (2013)): I think it is not as robust as the previous entries, but I like using it because it is an almost purely bayesian method and as such provides a different perspective on any dataset.
- Noiseq (Tarazona et al. (2015)): I noticed this method relatively recently and was sufficiently intrigued that I threw a method together using it. The authors appear to me to be looking to understand a lot of the questions on which I spend a lot of time.
- Dream (Hoffman and Roussos (2020)): I mostly like this because it uses variancePartition, which I think is a really nice toy when trying to understand what is going on in a dataset.
- basic is my own, explicitly uninformed analysis. It is my ‘negative control’ method because, if something agrees entirely with it, then I know that all the fancy math and statistics performed by that method worked out just the same as some doofus (me) just log2 subtracting the expression values. It is not quite that basic, but pretty close.
The first 3 methods allow one to add surrogate variable estimates to the model when performing the differential expression analyses. Noiseq and Dream handle surrogates using their own heuristics, EBSeq is inimicable to that kind of model, and I explicitly chose to not make that possible for basic. With that in mind, in most instances I usually deal with surrogates/batches in one of a few ways:
- If the data is absurdly pretty, do nothing (pretty much only for well-controlled bacterial data).
- Add a known batch factor to the model (the default).
- Try to ensure the data is suitable and invoke sva
- to acquire estimates and add them to the model.
- If the data has a known batch factor and it is particularly pathological, use the combat implementation in sva. As a general rule I do not like this option because it is data destructive.
The last two options are handled via a function named ‘all_adjusters’ in hpgltools which is responsible for ensuring that the data is sane for the assumptions made by each method and invokes each method (hopefully) properly. It returns both modified counts and model estimates when possible and has implementations for a fair number of methods in this realm. sva is my favorite by a pretty big margin, though I do sometimes use RUV (Risso et al. (2014)) and of course, in writing this document I stumbled into another interesting contender: (Molania et al. (2023)) all_adjusters() also has implementations of every example/method I got out of the papers for sva (e.g. ssva/fsva), isva, smartsva, and some others.
2.1 Define contrasts for DE analyses
Each of the following lists describes the set of contrasts that I think are interesting for the various ways one might consider the TMRC3 dataset. The variables are named according to the assumed data with which they will be used, thus tc_cf_contrasts is expected to be used for the Tumaco+Cali data and provide a series of cure/fail comparisons which (to the extent possible) across both locations. In every case, the name of the list element will be used as the contrast name, and will thus be seen as the sheet name in the output xlsx file(s); the two pieces of the character vector value are the numerator and denominator of the associated contrast.
- Our primary question: fail/cure: Any excel file written using this contrast will get a single worksheet comparing fail/cure.
- Compare fail/cure for each visit: This takes a more granular view of the previous contrast. If one is so-inclined, one could compare results from the following contrast against the previous and following contrast to learn about the dynamics of the healing (or not) process.
- All samples by visit: This is effectively the opposite of the previous and compares all samples of visit x against visit y.
- Visit 1 vs everything else: When I first did the previous set of contrasts I quickly realized that visits 2 and 3 are relatively similar and that it may be possible to gain a little power and learn a little more by combining them.
- Directly compare celltypes: We have three clinical cell types in the data and the differences among them are quite interesting.
- Ethnicities: We also have three ethnic groups in the data, though there are some wacky confounded variables when considering them through the lense of cure/fail; so any results comparing them should be treated with caution.
- Powerless visits+celltype+cf: This is a last-minute addition requested by Maria Adelaida. I assume it was suggested by a reviewer, though I do not recall seeing anything in the reviews which made this request. The number of samples we have in the data just barely supports these contrasts, and given the strength of all the various surrogates, I would be somewhat reluctant to trust any genes deemed DE in them without some other evidence. It should be noted that this is the intellectual counterpoint to the critique from a different reviewer, that artifically merging factors like this is problematic (I personally tend to agree with the later argument more than the former with the caveat that the added complexity (with respect to what is actually typed by the person (me)) can be a problem. Thus I tend to do the thing which is explicitly less statistically correct (but I can also show pretty definitively that the results are very nearly identical) in order to make it easier to show that no mistakes were made. E.g. tension between ‘correctness’ and ‘robustness’.
t_cf_contrast <- list(
"outcome" = c("tumaco_failure", "tumaco_cure"))
cf_contrast <- list(
"outcome" = c("failure", "cure"))
visitcf_contrasts <- list(
"v1cf" = c("v1_failure", "v1_cure"),
"v2cf" = c("v2_failure", "v2_cure"),
"v3cf" = c("v3_failure", "v3_cure"))
visit_contrasts <- list(
"v2v1" = c("c2", "c1"),
"v3v1" = c("c3", "c1"),
"v3v2" = c("c3", "c2"))
visit_v1later <- list(
"later_vs_first" = c("later", "first"))
celltypes <- list(
"eo_mono" = c("eosinophils", "monocytes"),
"ne_mono" = c("neutrophils", "monocytes"),
"eo_ne" = c("eosinophils", "neutrophils"))
ethnicity_contrasts <- list(
"mestizo_indigenous" = c("mestiza", "indigena"),
"mestizo_afrocol" = c("mestiza", "afrocol"),
"indigenous_afrocol" = c("indigena", "afrocol"))
visittype_contrasts_mono <- list(
"v2v1_mono_cure" = c("monocytes_2_cure", "monocytes_1_cure"),
"v2v1_mono_failure" = c("monocytes_2_failure", "monocytes_1_failure"),
"v3v1_mono_cure" = c("monocytes_3_cure", "monocytes_1_cure"),
"v3v1_mono_failure" = c("monocytes_3_failure", "monocytes_1_failure"))
visittype_contrasts_eo <- list(
"v2v1_eo_cure" = c("eosinophils_2_cure", "eosinophils_1_cure"),
"v2v1_eo_failure" = c("eosinophils_2_failure", "eosinophils_1_failure"),
"v3v1_eo_cure" = c("eosinophils_3_cure", "eosinophils_1_cure"),
"v3v1_eo_failure" = c("eosinophils_3_failure", "eosinophils_1_failure"))
visittype_contrasts_ne <- list(
"v2v1_ne_cure" = c("neutrophils_2_cure", "neutrophils_1_cure"),
"v2v1_ne_failure" = c("neutrophils_2_failure", "neutrophils_1_failure"),
"v3v1_ne_cure" = c("neutrophils_3_cure", "neutrophils_1_cure"),
"v3v1_ne_failure" = c("neutrophils_3_failure", "neutrophils_1_failure"))
visittype_contrasts <- c(visittype_contrasts_mono,
visittype_contrasts_eo,
visittype_contrasts_ne)2.2 Gene Set Enrichment
Previously, the gene set enrichment will followed each DE analysis during this document. I am adding a series of explicitly GSEA analyses in this most recent iteration, in these I will pass the full DE table and check the distribution of logFC values against the genes in each category as opposed to the simpler over-enrichment of the high/low DE genes.
However, I moved those analyses to a separate document in the hopes of improving their organization.
3 Only Tumaco samples
Start over, this time with only the samples from Tumaco. We currently are assuming these will prove to be the only analyses used for final interpretation. This is primarily because we have insufficient failed treatment samples from Cali. There is one disadvantage when using these samples: they had to travel further than the samples taken in Cali and there is significant variance observed between the two locations and we cannot discern its source. In the worst case scenario (one which I think unlikely), the variance is caused by degraded RNA during transit. We do know that the samples were well-stored in RNALater and frozen/etc, so I am inclined to discount that possibility. I think a more compelling difference lies in the different population demographics observed in the two locations. Actually, now that I have typed these sentences out, I think I can semi-test this hypothesis by looking at the set of DE genes between the two locations and compare that result to the Tumaco (and/or Cali) ethnicity comparison which is most representative of the ethnicity differences between them. If I get it into my head to try this, I will need to load the DE tables from the 03differential_expression_both.Rmd document; so I am most likely to try it out in the 07var_coef document, which was mostly written by Theresa and is already examining some similar questions.
3.1 All samples
Start by considering all Tumaco cell types. Note that in this case we only use SVA, primarily because I am not certain what would be an appropriate batch factor, perhaps visit?
t_cf_clinical_de_sva <- all_pairwise(t_clinical, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## cure failure
## 67 56## Removing 0 low-count genes (14156 remaining).## Setting 17331 low elements to zero.## transform_counts: Found 17331 values equal to 0, adding 1 to the matrix.t_cf_clinical_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## limma_vs_deseq 0.8063
## limma_vs_edger 0.8177
## limma_vs_basic 0.8704
## limma_vs_noiseq -0.7287
## deseq_vs_edger 0.9845
## deseq_vs_basic 0.8242
## deseq_vs_noiseq -0.7318
## edger_vs_basic 0.8285
## edger_vs_noiseq -0.7370
## basic_vs_noiseq -0.7978t_cf_clinical_table_sva <- combine_de_tables(
t_cf_clinical_de_sva, keepers = cf_contrast,
excel = glue("{cf_prefix}/All_Samples/t_clinical_cf_table_sva-v{ver}.xlsx"))
t_cf_clinical_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 94 183 103 159
## limma_sigup limma_sigdown
## 1 50 38## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_clinical_table_sva[["plots"]][["outcome"]][["deseq_ma_plots"]]
t_cf_clinical_sig_sva <- extract_significant_genes(
t_cf_clinical_table_sva,
excel = glue("{cf_prefix}/All_Samples/t_clinical_cf_sig_sva-v{ver}.xlsx"))
t_cf_clinical_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 50 38 103 159 94 183 16
## basic_down
## outcome 4
dim(t_cf_clinical_sig_sva$deseq$ups[[1]])## [1] 94 59dim(t_cf_clinical_sig_sva$deseq$downs[[1]])## [1] 183 59Repeat without the biopsies.
t_cf_clinicalnb_de_sva <- all_pairwise(t_clinical_nobiop, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## cure failure
## 58 51## Removing 0 low-count genes (11910 remaining).## Setting 9605 low elements to zero.## transform_counts: Found 9605 values equal to 0, adding 1 to the matrix.t_cf_clinicalnb_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## limma_vs_deseq 0.8463
## limma_vs_edger 0.8506
## limma_vs_basic 0.8571
## limma_vs_noiseq -0.7532
## deseq_vs_edger 0.9964
## deseq_vs_basic 0.8266
## deseq_vs_noiseq -0.7746
## edger_vs_basic 0.8367
## edger_vs_noiseq -0.7818
## basic_vs_noiseq -0.8524t_cf_clinicalnb_table_sva <- combine_de_tables(
t_cf_clinicalnb_de_sva, keepers = cf_contrast,
excel = glue("{cf_prefix}/All_Samples/t_clinical_nobiop_cf_table_sva-v{ver}.xlsx"))
t_cf_clinicalnb_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 140 75 142 67
## limma_sigup limma_sigdown
## 1 54 46## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_clinicalnb_table_sva[["plots"]][["outcome"]][["deseq_ma_plots"]]
t_cf_clinicalnb_sig_sva <- extract_significant_genes(
t_cf_clinicalnb_table_sva,
excel = glue("{cf_prefix}/All_Samples/t_clinical_nobiop_cf_sig_sva-v{ver}.xlsx"))
t_cf_clinicalnb_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 54 46 142 67 140 75 29
## basic_down
## outcome 7
dim(t_cf_clinicalnb_sig_sva$deseq$ups[[1]])## [1] 140 59dim(t_cf_clinicalnb_sig_sva$deseq$downs[[1]])## [1] 75 59As the data structure’s name suggests, the above comparison seeks to learn if there are fail/cure differences discernable across all clinical celltypes in samples taken in Tumaco.
The set of steps taken in this previous block will be essentially repeated for every set of contrasts and way of mixing/matching the data and follows the path:
- Run all_pairwise to run deseq and friends using surogate estimates provided by sva when appropriate/possible. This creates an unwieldy datastructure containing the results from all methods and all contrasts as a series of nested lists.
- Mash them together with combine_de_tables, use the ‘keepers’ argument to define the desired numerators/denominators, and write the tables to the file provided in the ‘excel’ argument.
- Yank out the ‘significant’ genes and send them to a separate excel document. In all cases, ‘significant’ is the set with a |log2FC| >= 1.0 and adjusted p-value <= 0.05. This reminds me, one of the reviewers mentioned a set of international guidelines for significant genes, I thought I basically know what I am doing, but this caught me completely unaware. If anyone ever reads this (no one will, let us be honest) I would love to know. The closest thing I found is: (Chung et al. (2021)), but I do not think it really addresses this idea (I have not yet read it carefully).
These datastructures are all exposed to various functions in hpgltools which allow one to poke/compare them; I am not a fan of Excel, but I think the xlsx documents creates are pretty decent, too.
4 Visit comparisons
Later in this document I do a bunch of visit/cf comparisons. In this block I want to explicitly only compare v1 to other visits. This is something I did quite a lot in the 2019 datasets, but never actually moved to this document.
tv1_vs_later <- all_pairwise(t_v1vs, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## first later
## 40 69## Removing 0 low-count genes (11910 remaining).## Setting 9640 low elements to zero.## transform_counts: Found 9640 values equal to 0, adding 1 to the matrix.tv1_vs_later## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## ltr_vs_frs
## limma_vs_deseq 0.8394
## limma_vs_edger 0.8457
## limma_vs_basic 0.8133
## limma_vs_noiseq -0.7094
## deseq_vs_edger 0.9983
## deseq_vs_basic 0.7946
## deseq_vs_noiseq -0.7474
## edger_vs_basic 0.7983
## edger_vs_noiseq -0.7524
## basic_vs_noiseq -0.8068tv1_vs_later_table <- combine_de_tables(
tv1_vs_later, keepers = visit_v1later,
excel = glue("{xlsx_prefix}/DE_Visits/tv1_vs_later_tables-v{ver}.xlsx"))
tv1_vs_later_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 later_vs_first 24 7 22 7
## limma_sigup limma_sigdown
## 1 23 7## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
tv1_vs_later_sig <- extract_significant_genes(
tv1_vs_later_table,
excel = glue("{xlsx_prefix}/DE_Visits/tv1_vs_later_sig-v{ver}.xlsx"))
tv1_vs_later_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## later_vs_first 23 7 22 7 24 7
## basic_up basic_down
## later_vs_first 0 0
5 Sex comparison
t_sex <- subset_expt(tc_sex, subset = "clinic == 'tumaco'")## subset_expt(): There were 184, now there are 123 samples.t_sex## A modified expressionSet containing 19952 and 123 sample. There are 164 metadata columns and 15 annotation columns.
## The primary condition is comprised of:
## female, male.
## Its current state is: raw(data).t_sex_de <- all_pairwise(t_sex, model_batch = "svaseq", methods = methods,
parallel = parallel, filter = TRUE)##
## female male
## 22 101## Removing 0 low-count genes (14156 remaining).## Setting 17311 low elements to zero.## transform_counts: Found 17311 values equal to 0, adding 1 to the matrix.t_sex_de## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## mal_vs_fml
## limma_vs_deseq 0.8596
## limma_vs_edger 0.8663
## limma_vs_basic 0.9481
## limma_vs_noiseq -0.7351
## deseq_vs_edger 0.9909
## deseq_vs_basic 0.8703
## deseq_vs_noiseq -0.7263
## edger_vs_basic 0.8748
## edger_vs_noiseq -0.7283
## basic_vs_noiseq -0.7498t_sex_table <- combine_de_tables(
t_sex_de, excel = glue("{xlsx_prefix}/Gene_Set_Enrichment/t_sex_table-v{ver}.xlsx"))
t_sex_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 male_vs_female 129 96 116 95
## limma_sigup limma_sigdown
## 1 54 74## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_sex_sig <- extract_significant_genes(
t_sex_table, excel = glue("{xlsx_prefix}/Gene_Set_Enrichment/t_sex_sig-v{ver}.xlsx"))
t_sex_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## male_vs_female 54 74 116 95 129 96
## basic_up basic_down
## male_vs_female 15 10
tc_sex_cure <- subset_expt(tc_sex, subset = "finaloutcome=='cure'")## subset_expt(): There were 184, now there are 122 samples.t_sex_cure <- subset_expt(tc_sex_cure, subset = "clinic == 'tumaco'")## subset_expt(): There were 122, now there are 67 samples.t_sex_cure_de <- all_pairwise(t_sex_cure, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## female male
## 13 54## Removing 0 low-count genes (13971 remaining).## Setting 8998 low elements to zero.## transform_counts: Found 8998 values equal to 0, adding 1 to the matrix.t_sex_cure_de## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## mal_vs_fml
## limma_vs_deseq 0.7804
## limma_vs_edger 0.8380
## limma_vs_basic 0.9284
## limma_vs_noiseq -0.7515
## deseq_vs_edger 0.9294
## deseq_vs_basic 0.7995
## deseq_vs_noiseq -0.6524
## edger_vs_basic 0.8474
## edger_vs_noiseq -0.6952
## basic_vs_noiseq -0.7882t_sex_cure_table <- combine_de_tables(
t_sex_cure_de, excel = glue("{xlsx_prefix}/DE_Sex/t_sex_cure_table-v{ver}.xlsx"))
t_sex_cure_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 male_vs_female 176 134 162 143
## limma_sigup limma_sigdown
## 1 64 108## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_sex_cure_sig <- extract_significant_genes(
t_sex_cure_table, excel = glue("{xlsx_prefix}/DE_Sex/t_sex_cure_sig-v{ver}.xlsx"))
t_sex_cure_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## male_vs_female 64 108 162 143 176 134
## basic_up basic_down
## male_vs_female 13 5
6 Ethnicity comparisons
t_ethnicity_de <- all_pairwise(t_etnia_expt, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## afrocol indigena mestiza
## 76 19 28## Removing 0 low-count genes (14156 remaining).## Setting 15870 low elements to zero.## transform_counts: Found 15870 values equal to 0, adding 1 to the matrix.t_ethnicity_de## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_ethnicity_table <- combine_de_tables(
t_ethnicity_de, keepers = ethnicity_contrasts,
excel = glue("{xlsx_prefix}/DE_Ethnicity/t_ethnicity_table-v{ver}.xlsx"))
t_ethnicity_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 mestiza_vs_indigena 83 97 67 108
## 2 mestiza_vs_afrocol 57 92 52 96
## 3 indigena_vs_afrocol 165 236 187 216
## limma_sigup limma_sigdown
## 1 58 56
## 2 42 53
## 3 165 147## Plot describing unique/shared genes in a differential expression table.
t_ethnicity_sig <- extract_significant_genes(
t_ethnicity_table, according_to = "deseq",
excel = glue("{xlsx_prefix}/DE_Ethnicity/t_ethnicity_sig-v{ver}.xlsx"))
t_ethnicity_sig## A set of genes deemed significant according to deseq.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## deseq_up deseq_down
## mestizo_indigenous 83 97
## mestizo_afrocol 57 92
## indigenous_afrocol 165 236
6.0.1 Separate the Tumaco data by visit
One of the most compelling ideas in the data is the opportunity to find genes in the first visit which may help predict the likelihood that a person will respond well to treatment. The following block will therefore look at cure/fail from Tumaco at visit 1.
6.0.1.1 Cure/Fail, Tumaco Visit 1
t_cf_clinical_v1_de_sva <- all_pairwise(tv1_samples, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## cure failure
## 30 24## Removing 0 low-count genes (14023 remaining).## Setting 7655 low elements to zero.## transform_counts: Found 7655 values equal to 0, adding 1 to the matrix.t_cf_clinical_v1_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## limma_vs_deseq 0.7398
## limma_vs_edger 0.7829
## limma_vs_basic 0.6886
## limma_vs_noiseq -0.5605
## deseq_vs_edger 0.9537
## deseq_vs_basic 0.6955
## deseq_vs_noiseq -0.6068
## edger_vs_basic 0.7228
## edger_vs_noiseq -0.6303
## basic_vs_noiseq -0.7772t_cf_clinical_v1_table_sva <- combine_de_tables(
t_cf_clinical_v1_de_sva, keepers = cf_contrast,
excel = glue("{cf_prefix}/Visits/t_clinical_v1_cf_table_sva-v{ver}.xlsx"))
t_cf_clinical_v1_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 27 75 28 55
## limma_sigup limma_sigdown
## 1 3 3## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_clinical_v1_sig_sva <- extract_significant_genes(
t_cf_clinical_v1_table_sva,
excel = glue("{cf_prefix}/Visits/t_clinical_v1_cf_sig_sva-v{ver}.xlsx"))
t_cf_clinical_v1_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 3 3 28 55 27 75 0
## basic_down
## outcome 0
dim(t_cf_clinical_v1_sig_sva$deseq$ups[[1]])## [1] 27 59dim(t_cf_clinical_v1_sig_sva$deseq$downs[[1]])## [1] 75 596.0.1.2 Cure/Fail, Tumaco Visit 2
The visit 2 and visit 3 samples are interesting because they provide an opportunity to see if we can observe changes in response in the middle and end of treatment…
t_cf_clinical_v2_de_sva <- all_pairwise(tv2_samples, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## cure failure
## 20 15## Removing 0 low-count genes (11562 remaining).## Setting 2857 low elements to zero.## transform_counts: Found 2857 values equal to 0, adding 1 to the matrix.t_cf_clinical_v2_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## limma_vs_deseq 0.8138
## limma_vs_edger 0.8162
## limma_vs_basic 0.7404
## limma_vs_noiseq -0.6360
## deseq_vs_edger 0.9986
## deseq_vs_basic 0.7689
## deseq_vs_noiseq -0.7586
## edger_vs_basic 0.7701
## edger_vs_noiseq -0.7602
## basic_vs_noiseq -0.8078t_cf_clinical_v2_table_sva <- combine_de_tables(
t_cf_clinical_v2_de_sva, keepers = cf_contrast,
excel = glue("{cf_prefix}/Visits/t_clinical_v2_cf_table_sva-v{ver}.xlsx"))
t_cf_clinical_v2_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 51 15 50 11
## limma_sigup limma_sigdown
## 1 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_clinical_v2_sig_sva <- extract_significant_genes(
t_cf_clinical_v2_table_sva,
excel = glue("{cf_prefix}/Visits/t_clinical_v2_cf_sig_sva-v{ver}.xlsx"))
t_cf_clinical_v2_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 50 11 51 15 0
## basic_down
## outcome 0
dim(t_cf_clinical_v2_sig_sva$deseq$ups[[1]])## [1] 51 59dim(t_cf_clinical_v2_sig_sva$deseq$downs[[1]])## [1] 15 596.0.2 By cell type
Now let us switch our view to each individual cell type collected. The hope here is that we will be able to learn some cell-specific differences in the response for people who did(not) respond well.
6.0.2.1 Cure/Fail, Biopsies
t_cf_biopsy_de_sva <- all_pairwise(t_biopsies, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 9 5## Removing 0 low-count genes (13513 remaining).## Setting 146 low elements to zero.## transform_counts: Found 146 values equal to 0, adding 1 to the matrix.t_cf_biopsy_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.7927
## limma_vs_edger 0.8628
## limma_vs_basic 0.8497
## limma_vs_noiseq -0.7628
## deseq_vs_edger 0.9516
## deseq_vs_basic 0.8164
## deseq_vs_noiseq -0.7927
## edger_vs_basic 0.8809
## edger_vs_noiseq -0.8535
## basic_vs_noiseq -0.8819t_cf_biopsy_table_sva <- combine_de_tables(
t_cf_biopsy_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Biopsies/t_biopsy_cf_table_sva-v{ver}.xlsx"))
t_cf_biopsy_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 17 11 19
## edger_sigdown limma_sigup limma_sigdown
## 1 15 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_biopsy_sig_sva <- extract_significant_genes(
t_cf_biopsy_table_sva,
excel = glue("{cf_prefix}/Biopsies/t_cf_biopsy_sig_sva-v{ver}.xlsx"))
t_cf_biopsy_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 19 15 17 11 0
## basic_down
## outcome 0
dim(t_cf_biopsy_sig_sva$deseq$ups[[1]])## [1] 17 59dim(t_cf_biopsy_sig_sva$deseq$downs[[1]])## [1] 11 596.0.2.2 Cure/Fail, Monocytes
Same question, but this time looking at monocytes. In addition, this comparison was done twice, once using SVA and once using visit as a batch factor.
t_cf_monocyte_de_sva <- all_pairwise(t_monocytes, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 21 21## Removing 0 low-count genes (10862 remaining).## Setting 736 low elements to zero.## transform_counts: Found 736 values equal to 0, adding 1 to the matrix.t_cf_monocyte_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8614
## limma_vs_edger 0.8663
## limma_vs_basic 0.9210
## limma_vs_noiseq -0.8064
## deseq_vs_edger 0.9989
## deseq_vs_basic 0.8506
## deseq_vs_noiseq -0.7947
## edger_vs_basic 0.8560
## edger_vs_noiseq -0.8011
## basic_vs_noiseq -0.8949t_cf_monocyte_table_sva <- combine_de_tables(
t_cf_monocyte_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_cf_table_sva-v{ver}.xlsx"))
t_cf_monocyte_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 60 52 56
## edger_sigdown limma_sigup limma_sigdown
## 1 51 11 34## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_monocyte_sig_sva <- extract_significant_genes(
t_cf_monocyte_table_sva,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_cf_sig_sva-v{ver}.xlsx"))
t_cf_monocyte_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 11 34 56 51 60 52 8
## basic_down
## outcome 21
dim(t_cf_monocyte_sig_sva$deseq$ups[[1]])## [1] 60 59dim(t_cf_monocyte_sig_sva$deseq$downs[[1]])## [1] 52 59t_cf_monocyte_de_batchvisit <- all_pairwise(t_monocytes, model_batch = TRUE,
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 21 21
##
## 3 2 1
## 13 13 16t_cf_monocyte_de_batchvisit## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: batch in model/limma.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8120
## limma_vs_edger 0.8150
## limma_vs_basic 0.9509
## limma_vs_noiseq -0.8326
## deseq_vs_edger 0.9998
## deseq_vs_basic 0.8505
## deseq_vs_noiseq -0.7807
## edger_vs_basic 0.8540
## edger_vs_noiseq -0.7852
## basic_vs_noiseq -0.8949t_cf_monocyte_table_batchvisit <- combine_de_tables(
t_cf_monocyte_de_batchvisit, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_cf_table_batchvisit-v{ver}.xlsx"))
t_cf_monocyte_table_batchvisit## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 43 93 47
## edger_sigdown limma_sigup limma_sigdown
## 1 105 6 13## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_monocyte_sig_batchvisit <- extract_significant_genes(
t_cf_monocyte_table_batchvisit,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_cf_sig_batchvisit-v{ver}.xlsx"))
t_cf_monocyte_sig_batchvisit## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 6 13 47 105 43 93 8
## basic_down
## outcome 21
dim(t_cf_monocyte_sig_batchvisit$deseq$ups[[1]])## [1] 43 59dim(t_cf_monocyte_sig_batchvisit$deseq$downs[[1]])## [1] 93 596.0.2.2.1 Repeat test of different models: Monocytes
Either above or below this section I have a nearly identical block which seeks to demonstrate the similarities/difference observed between my preferred/simplified model vs. a more explicitly correct and complex model. If the trend holds from what we observed with the eosinophils and neutrophils, I would expect to see that the results are marginally ‘better’ (as defined by the strength of the perceived interleukin response and raw number of ‘significant’ genes); but I remain worried that this will prove a more brittle and error-prone analysis.
## The original pairwise invocation with sva:
##t_cf_monocyte_de_sva <- all_pairwise(t_monocyte, model_batch = "svaseq",
## filter = TRUE, parallel = FALSE,
## methods = methods)
test_monocytes <- normalize_expt(t_monocytes, filter = "simple")## Removing 2619 low-count genes (17333 remaining).test_mono_design <- pData(test_monocytes)
test_formula <- as.formula("~ finaloutcome + visitnumber")
test_model <- model.matrix(test_formula, data = test_mono_design)
null_formula <- as.formula("~ visitnumber")
null_model <- model.matrix(null_formula, data = test_mono_design)
linear_mtrx <- exprs(test_monocytes)
l2_mtrx <- log2(linear_mtrx + 1)
chosen_surrogates <- sva::num.sv(dat = l2_mtrx, mod = test_model)
chosen_surrogates## [1] 3surrogate_result <- sva::svaseq(
dat = linear_mtrx, n.sv = chosen_surrogates, mod = test_model, mod0 = null_model)## Number of significant surrogate variables is: 3
## Iteration (out of 5 ):1 2 3 4 5model_adjust <- as.matrix(surrogate_result[["sv"]])
colnames(model_adjust) <- c("SV1", "SV2", "SV3")
rownames(model_adjust) <- rownames(pData(test_monocytes))
longer_model <- as.formula("~ finaloutcome + visitnumber + SV1 + SV2 + SV3")
mono_design_svs <- cbind(test_mono_design, model_adjust)
summarized <- DESeq2::DESeqDataSetFromMatrix(countData = linear_mtrx,
colData = mono_design_svs,
design = longer_model)## converting counts to integer modedeseq_run <- DESeq2::DESeq(summarized)## estimating size factors## estimating dispersions## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## fitting model and testingdeseq_table <- as.data.frame(DESeq2::results(object = deseq_run,
contrast = c("finaloutcome", "failure", "cure"),
format = "DataFrame"))
big_table <- t_cf_monocyte_table_sva[["data"]][["outcome"]]
only_deseq <- big_table[, c("deseq_logfc", "deseq_adjp")]
merged <- merge(deseq_table, only_deseq, by = "row.names")
rownames(merged) <- merged[["Row.names"]]
merged[["Row.names"]] <- NULL
cor_value <- cor.test(merged[["log2FoldChange"]], merged[["deseq_logfc"]])
cor_value##
## Pearson's product-moment correlation
##
## data: merged[["log2FoldChange"]] and merged[["deseq_logfc"]]
## t = 300, df = 10860, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.9426 0.9466
## sample estimates:
## cor
## 0.9446logfc_plotter <- plot_linear_scatter(merged[, c("log2FoldChange", "deseq_logfc")])
logfc_plot <- logfc_plotter[["scatter"]] +
xlab("DESeq2 log2FC: Visit explicitly in model") +
ylab("DESeq2 log2FC: Default pairwise comparison") +
ggtitle(glue("Comparing results from models: {prettyNum(cor_value[['estimate']])} (pearson)"))
pp(file = "figures/compare_cf_and_visit_in_model_monocyte_logfc.svg")
logfc_plot
dev.off()## png
## 2logfc_plot
cor_value <- cor.test(merged[["padj"]], merged[["deseq_adjp"]], method = "spearman")## Warning in cor.test.default(merged[["padj"]], merged[["deseq_adjp"]], method =
## "spearman"): Cannot compute exact p-value with tiescor_value##
## Spearman's rank correlation rho
##
## data: merged[["padj"]] and merged[["deseq_adjp"]]
## S = 2.9e+10, p-value <2e-16
## alternative hypothesis: true rho is not equal to 0
## sample estimates:
## rho
## 0.8642adjp_plotter <- plot_linear_scatter(merged[, c("padj", "deseq_adjp")])
adjp_plot <- adjp_plotter[["scatter"]] +
xlab("DESeq2 adjp: Visit explicitly in model") +
ylab("DESeq2 adjp: Default pairwise comparison") +
ggtitle(glue("Comparing results from models: {prettyNum(cor_value[['estimate']])} (spearman)"))
pp(file = "images/compare_cf_and_visit_in_model_monocyte_adjp.svg")
adjp_plot
dev.off()## png
## 2adjp_plot
previous_sig_idx <- big_table[["deseq_adjp"]] <= 0.05 & abs(big_table[["deseq_logfc"]] >= 1.0)
summary(previous_sig_idx)## Mode FALSE TRUE
## logical 10802 60previous_genes <- rownames(big_table)[previous_sig_idx]
new_sig_idx <- abs(deseq_table[["log2FoldChange"]]) >= 1.0 & deseq_table[["padj"]] < 0.05
new_genes <- rownames(deseq_table)[new_sig_idx]
na_idx <- is.na(new_genes)
new_genes <- new_genes[!na_idx]
Vennerable::Venn(list("previous" = previous_genes, "new" = new_genes))## A Venn object on 2 sets named
## previous,new
## 00 10 01 11
## 0 28 156 32test_new <- simple_gprofiler(new_genes)
test_new## A set of ontologies produced by gprofiler using 188
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 13 MF
## 36 BP
## 3 KEGG
## 4 REAC
## 2 WP
## 3 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.test_old <- simple_gprofiler(previous_genes)
test_old## A set of ontologies produced by gprofiler using 60
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 0 MF
## 44 BP
## 3 KEGG
## 0 REAC
## 2 WP
## 0 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.new_annotated <- merge(fData(t_monocytes), deseq_table, by = "row.names")
rownames(new_annotated) <- new_annotated[["Row.names"]]
new_annotated[["Row.names"]] <- NULL
write_xlsx(data = new_annotated, excel = "excel/monocyte_visit_in_model_sva_cf_new.xlsx")## write_xlsx() wrote excel/monocyte_visit_in_model_sva_cf_new.xlsx.
## The cursor is on sheet first, row: 17336 column: 23.old_annotated <- merge(fData(t_eosinophils), big_table, by = "row.names")
rownames(old_annotated) <- old_annotated[["Row.names"]]
old_annotated[["Row.names"]] <- NULL
write_xlsx(data = old_annotated, excel = "excel/monocyte_visit_in_model_sva_cf_old.xlsx")## write_xlsx() wrote excel/monocyte_visit_in_model_sva_cf_old.xlsx.
## The cursor is on sheet first, row: 10865 column: 76.The previous couple of blocks I think are not approaching this problem correctly. In our discussions with Neal, he suggested that a mixed linear model is the most appropriate method for this type of query. I think I can perform that with limma, via voom. Let us try and see what happens. After doing some reading, I think the most appropriate way to perform this is to use dream() from varianceParition, which is cool because I really like it.
I have already written a skeleton function ‘dream_pairwise()’ as a sibling to my other *_pairwise() functions. I think that with some minor modifications (or maybe none at all, when I wrote it I was thinking about fun models that variancePartition supports) it can accept the mixed linear model of interest.
mixed_model <- "~ 0 + finaloutcome + visitnumber + (1|donor)"
mixed_fstring <- as.formula(mixed_model)
get_formula_factors(mixed_model)
mixed_eosinophil_de <- dream_pairwise(t_eosinophils, alt_model = mixed_fstring)
mixed_monocyte_de <- dream_pairwise(t_monocytes, alt_model = mixed_fstring)
mixed_neutrophil_de <- dream_pairwise(t_neutrophils, alt_model = mixed_fstring)6.1 Compare monocytes
dream_result <- mixed_monocyte_de[["all_tables"]][["contrasts"]][[1]]## Error in eval(expr, envir, enclos): object 'mixed_monocyte_de' not foundbig_table <- t_cf_monocyte_table_sva[["data"]][["outcome"]]
merged <- merge(big_table, dream_result, by = "row.names")## Error in h(simpleError(msg, call)): error in evaluating the argument 'y' in selecting a method for function 'merge': object 'dream_result' not foundrownames(merged) <- merged[["Row.names"]]
merged[["Row.names"]] <- NULL
cor_value <- cor.test(merged[["logFC"]], merged[["deseq_logfc"]])## Error in cor.test.default(merged[["logFC"]], merged[["deseq_logfc"]]): 'x' must be a numeric vectorcor_value##
## Spearman's rank correlation rho
##
## data: merged[["padj"]] and merged[["deseq_adjp"]]
## S = 2.9e+10, p-value <2e-16
## alternative hypothesis: true rho is not equal to 0
## sample estimates:
## rho
## 0.8642t_cf_monocyte_de_sva[["dream"]] <- mixed_monocyte_de## Error in eval(expr, envir, enclos): object 'mixed_monocyte_de' not foundtest <- combine_de_tables(t_cf_monocyte_de_sva, excel = "/tmp/test_combined.xlsx")
test_aucc <- calculate_aucc(big_table, tbl2 = dream_result, px = "deseq_adjp", py = "adj.P.Val", lx = "deseq_logfc", ly = "logFC")## Error in eval(expr, envir, enclos): object 'dream_result' not foundlogfc_plotter <- plot_linear_scatter(merged[, c("logFC", "deseq_logfc")])## Error in `[.data.frame`(merged, , c("logFC", "deseq_logfc")): undefined columns selectedlogfc_plot <- logfc_plotter[["scatter"]] +
xlab("Dream log2FC with (1|donor) and visit in model") +
ylab("DESeq2 log2FC: Default pairwise comparison") +
ggtitle(glue("Comparing results from models: {prettyNum(cor_value[['estimate']])} (pearson)"))
pp(file = "figures/compare_cf_and_visit_in_model_monocyte_logfc.svg")
logfc_plot
dev.off()## png
## 2logfc_plot
previous_sig_idx <- merged[["deseq_adjp"]] <= 0.05 & abs(merged[["deseq_logfc"]] >= 1.0)
summary(previous_sig_idx)## Mode FALSE TRUE
## logical 10802 60previous_genes <- rownames(merged)[previous_sig_idx]
new_sig_idx <- abs(merged[["logFC"]]) >= 1.0 & merged[["P.Value"]] < 0.05## Error in abs(merged[["logFC"]]): non-numeric argument to mathematical functionsummary(new_sig_idx)## Mode FALSE TRUE NA's
## logical 16603 188 542new_genes <- rownames(merged)[new_sig_idx]
na_idx <- is.na(new_genes)
new_genes <- new_genes[!na_idx]
annot <- fData(t_monocytes)
compare <- Vennerable::Venn(list("previous" = previous_genes, "new" = new_genes))
shared_genes <- compare@IntersectionSets[["11"]]
name_idx <- rownames(annot) %in% shared_genes
annot[name_idx, ]## [1] ensembl_gene_id ensembl_transcript_id version
## [4] transcript_version description gene_biotype
## [7] cds_length chromosome_name strand
## [10] start_position end_position hgnc_symbol
## [13] uniprot_gn_symbol transcript mean_cds_len
## <0 rows> (or 0-length row.names)7 TODO
- Repeat this process, clean it up for: monocytes/neutrophils
- Repeat this process and compare the results when using models which
are:
- ~ finaloutcome + visitnumber + (1|donor)
- ~ finaloutcome + visitnumber
- Compare the results from limma for a,b
- Extract the set of ‘significant’ genes via logFC/pvalue for all of the above and see the shared/unique genes.
8 Test some code to do this automagically
I think I implemented some changes to my toys which make them able to set up appropriate models and contrasts for arbitrarily chosen models instead of only my simplified version. Let us test that here!
tt = normalize_expt(t_monocytes, transform = "log2", convert = "cpm",
filter = TRUE, batch = "svaseq")
t_monocyte_cf_visit_sva_de <- all_pairwise(t_monocytes, model_batch = "svaseq",
alt_model = "~ 0 + finaloutcome + visitnumber",
null_model = "~ 0 + visitnumber", filter = TRUE,
parallel = FALSE, methods = methods)8.0.1 Individual visits, Monocytes
Now focus in on the monocyte samples on a per-visit basis.
8.0.1.1 Visit 1
t_cf_monocyte_v1_de_sva <- all_pairwise(tv1_monocytes, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 8 8## Removing 0 low-count genes (10482 remaining).## Setting 190 low elements to zero.## transform_counts: Found 190 values equal to 0, adding 1 to the matrix.t_cf_monocyte_v1_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8902
## limma_vs_edger 0.8905
## limma_vs_basic 0.9440
## limma_vs_noiseq -0.8547
## deseq_vs_edger 0.9999
## deseq_vs_basic 0.8866
## deseq_vs_noiseq -0.8760
## edger_vs_basic 0.8870
## edger_vs_noiseq -0.8766
## basic_vs_noiseq -0.9062t_cf_monocyte_v1_table_sva <- combine_de_tables(
t_cf_monocyte_v1_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_v1_cf_table_sva-v{ver}.xlsx"))
t_cf_monocyte_v1_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 14 52 15
## edger_sigdown limma_sigup limma_sigdown
## 1 57 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_monocyte_v1_sig_sva <- extract_significant_genes(
t_cf_monocyte_v1_table_sva,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_v1_cf_sig_sva-v{ver}.xlsx"))
t_cf_monocyte_v1_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 15 57 14 52 0
## basic_down
## outcome 0
dim(t_cf_monocyte_v1_sig_sva$deseq$ups[[1]])## [1] 14 59dim(t_cf_monocyte_v1_sig_sva$deseq$downs[[1]])## [1] 52 598.0.1.2 Monocytes: Compare sva to batch-in-model
sva_aucc <- calculate_aucc(t_cf_monocyte_table_sva[["data"]][[1]],
tbl2 = t_cf_monocyte_table_batchvisit[["data"]][[1]],
py = "deseq_adjp", ly = "deseq_logfc")
sva_aucc## These two tables have an aucc value of: 0.694200173169544 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 182, df = 10860, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.8633 0.8726
## sample estimates:
## cor
## 0.8681
shared_ids <- rownames(t_cf_monocyte_table_sva[["data"]][[1]]) %in%
rownames(t_cf_monocyte_table_batchvisit[["data"]][[1]])
first <- t_cf_monocyte_table_sva[["data"]][[1]][shared_ids, ]
second <- t_cf_monocyte_table_batchvisit[["data"]][[1]][rownames(first), ]
cor.test(first[["deseq_logfc"]], second[["deseq_logfc"]])##
## Pearson's product-moment correlation
##
## data: first[["deseq_logfc"]] and second[["deseq_logfc"]]
## t = 182, df = 10860, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.8633 0.8726
## sample estimates:
## cor
## 0.86818.0.2 Neutrophil samples
Switch context to the Neutrophils, once again repeat the analysis using SVA and visit as a batch factor.
t_cf_neutrophil_de_sva <- all_pairwise(t_neutrophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 20 21## Removing 0 low-count genes (9101 remaining).## Setting 754 low elements to zero.## transform_counts: Found 754 values equal to 0, adding 1 to the matrix.t_cf_neutrophil_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8742
## limma_vs_edger 0.8784
## limma_vs_basic 0.9321
## limma_vs_noiseq -0.8237
## deseq_vs_edger 0.9994
## deseq_vs_basic 0.8754
## deseq_vs_noiseq -0.8196
## edger_vs_basic 0.8812
## edger_vs_noiseq -0.8268
## basic_vs_noiseq -0.8903t_cf_neutrophil_table_sva <- combine_de_tables(
t_cf_neutrophil_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_cf_table_sva-v{ver}.xlsx"))
t_cf_neutrophil_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 130 30 120
## edger_sigdown limma_sigup limma_sigdown
## 1 27 12 12## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_neutrophil_sig_sva <- extract_significant_genes(
t_cf_neutrophil_table_sva,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_cf_sig_sva-v{ver}.xlsx"))
t_cf_neutrophil_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 12 12 120 27 130 30 4
## basic_down
## outcome 2
dim(t_cf_neutrophil_sig_sva$deseq$ups[[1]])## [1] 130 59dim(t_cf_neutrophil_sig_sva$deseq$downs[[1]])## [1] 30 59t_cf_neutrophil_de_batchvisit <- all_pairwise(t_neutrophils, model_batch = TRUE,
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 20 21
##
## 3 2 1
## 12 13 16t_cf_neutrophil_de_batchvisit## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: batch in model/limma.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8380
## limma_vs_edger 0.8401
## limma_vs_basic 0.9658
## limma_vs_noiseq -0.8544
## deseq_vs_edger 0.9999
## deseq_vs_basic 0.8644
## deseq_vs_noiseq -0.8164
## edger_vs_basic 0.8671
## edger_vs_noiseq -0.8202
## basic_vs_noiseq -0.8903t_cf_neutrophil_table_batchvisit <- combine_de_tables(
t_cf_neutrophil_de_batchvisit, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_cf_table_batchvisit-v{ver}.xlsx"))
t_cf_neutrophil_table_batchvisit## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 92 47 101
## edger_sigdown limma_sigup limma_sigdown
## 1 44 3 1## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_neutrophil_sig_batchvisit <- extract_significant_genes(
t_cf_neutrophil_table_batchvisit,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_cf_sig_batchvisit-v{ver}.xlsx"))
t_cf_neutrophil_sig_batchvisit## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 3 1 101 44 92 47 4
## basic_down
## outcome 2
dim(t_cf_neutrophil_sig_batchvisit$deseq$ups[[1]])## [1] 92 59dim(t_cf_neutrophil_sig_batchvisit$deseq$downs[[1]])## [1] 47 59Let us add a new block in which we test a concern: if we explicitly add visit to the model (with sva, potentially without too), will that change the results we observe? My assumption is that it should change the results very minimally; but we should make absolutely certain that this is true. The neutrophils are the place to test this first because they have some of the most variance observed in the data.
Therefore I want to have an instance of the pairwise contrast that has a model of ~ finaloutcome + visitnumber + SVs where the SVs come from an invocation of sva which also has finaloutcome + visitnumber before the null model.
In theory, all_pairwise() is able to do this via the argument alt_model, but it may be safer to do it manually in order to absolutely ensure that nothing unintended happens.
## The original pairwise invocation with sva:
## t_cf_neutrophil_de_sva <- all_pairwise(t_neutrophils, model_batch = "svaseq",
## parallel = parallel, filter = TRUE,
## methods = methods)
test_neutrophils <- normalize_expt(t_neutrophils, filter = "simple")## Removing 2652 low-count genes (17300 remaining).test_neut_design <- pData(test_neutrophils)
test_formula <- as.formula("~ 0 + finaloutcome + visitnumber")
test_model <- model.matrix(test_formula, data = test_neut_design)
## Note to self: double-check that the following line is correct.
null_formula <- as.formula("~ 0 + visitnumber")
## null_model <- test_model[, c(1, 2)]
null_model <- model.matrix(null_formula, data = test_neut_design)
linear_mtrx <- exprs(test_neutrophils)
l2_mtrx <- log2(linear_mtrx + 1)
chosen_surrogates <- sva::num.sv(dat = l2_mtrx, mod = test_model)
surrogate_result <- sva::svaseq(
dat = linear_mtrx, n.sv = chosen_surrogates, mod = test_model, mod0 = null_model)## Number of significant surrogate variables is: 4
## Iteration (out of 5 ):1 2 3 4 5model_adjust <- as.matrix(surrogate_result[["sv"]])
## I don't think the following is actually required, but it is weird to just have this
## unnamed matrix hangingout.
## Set the columns to the SV#s
colnames(model_adjust) <- c("SV1", "SV2", "SV3", "SV4")
## Set the rows the sample IDs
rownames(model_adjust) <- rownames(pData(test_neutrophils))
longer_model <- as.formula("~ finaloutcome + visitnumber + SV1 + SV2 + SV3 + SV4")
neut_design_svs <- cbind(test_neut_design, model_adjust)
summarized <- DESeq2::DESeqDataSetFromMatrix(countData = linear_mtrx,
colData = neut_design_svs,
design = longer_model)## converting counts to integer modedeseq_run <- DESeq2::DESeq(summarized)## estimating size factors## estimating dispersions## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## fitting model and testingdeseq_table <- as.data.frame(DESeq2::results(object = deseq_run,
contrast = c("finaloutcome", "failure", "cure"),
format = "DataFrame"))
## We should be able to directly compare this to the the deseq columns from the above
## data structure named: t_cf_neutrophil_table_sva
big_table <- t_cf_neutrophil_table_sva[["data"]][["outcome"]]
only_deseq <- big_table[, c("deseq_logfc", "deseq_adjp")]
merged <- merge(deseq_table, only_deseq, by = "row.names")
rownames(merged) <- merged[["Row.names"]]
merged[["Row.names"]] <- NULL
cor_value <- cor.test(merged[["log2FoldChange"]], merged[["deseq_logfc"]])
cor_value##
## Pearson's product-moment correlation
##
## data: merged[["log2FoldChange"]] and merged[["deseq_logfc"]]
## t = 393, df = 9099, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.9706 0.9729
## sample estimates:
## cor
## 0.9718logfc_plotter <- plot_linear_scatter(merged[, c("log2FoldChange", "deseq_logfc")])
logfc_plot <- logfc_plotter[["scatter"]] +
xlab("DESeq2 log2FC: Visit explicitly in model") +
ylab("DESeq2 log2FC: Default pairwise comparison") +
ggtitle(glue("Comparing results from models: {prettyNum(cor_value[['estimate']])} (pearson)"))
pp(file = "figures/compare_cf_and_visit_in_model_neutrophil_logfc.svg")
logfc_plot
dev.off()## png
## 2logfc_plot
cor_value <- cor.test(merged[["padj"]], merged[["deseq_adjp"]], method = "spearman")## Warning in cor.test.default(merged[["padj"]], merged[["deseq_adjp"]], method =
## "spearman"): Cannot compute exact p-value with tiescor_value##
## Spearman's rank correlation rho
##
## data: merged[["padj"]] and merged[["deseq_adjp"]]
## S = 1e+10, p-value <2e-16
## alternative hypothesis: true rho is not equal to 0
## sample estimates:
## rho
## 0.9202adjp_plotter <- plot_linear_scatter(merged[, c("padj", "deseq_adjp")])
adjp_plot <- adjp_plotter[["scatter"]] +
xlab("DESeq2 adjp: Visit explicitly in model") +
ylab("DESeq2 adjp: Default pairwise comparison") +
ggtitle(glue("Comparing results from models: {prettyNum(cor_value[['estimate']])} (spearman)"))
pp(file = "images/compare_cf_and_visit_in_model_neutrophil_adjp.svg")
adjp_plot
dev.off()## png
## 2adjp_plot
previous_sig_idx <- big_table[["deseq_adjp"]] <= 0.05 & abs(big_table[["deseq_logfc"]] >= 1.0)
summary(previous_sig_idx)## Mode FALSE TRUE
## logical 8971 130previous_genes <- rownames(big_table)[previous_sig_idx]
new_sig_idx <- abs(deseq_table[["log2FoldChange"]]) >= 1.0 & deseq_table[["padj"]] < 0.05
new_genes <- rownames(deseq_table)[new_sig_idx]
na_idx <- is.na(new_genes)
new_genes <- new_genes[!na_idx]
Vennerable::Venn(list("previous" = previous_genes, "new" = new_genes))## A Venn object on 2 sets named
## previous,new
## 00 10 01 11
## 0 51 92 79test_new <- simple_gprofiler(new_genes)
test_new## A set of ontologies produced by gprofiler using 171
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 1 MF
## 12 BP
## 0 KEGG
## 2 REAC
## 0 WP
## 3 TF
## 2 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.test_old <- simple_gprofiler(previous_genes)
test_old## A set of ontologies produced by gprofiler using 130
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 4 MF
## 67 BP
## 0 KEGG
## 5 REAC
## 2 WP
## 57 TF
## 0 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.new_annotated <- merge(fData(t_neutrophils), deseq_table, by = "row.names")
rownames(new_annotated) <- new_annotated[["Row.names"]]
new_annotated[["Row.names"]] <- NULL
write_xlsx(data = new_annotated, excel = "excel/neutrophil_visit_in_model_sva_cf_new.xlsx")## write_xlsx() wrote excel/neutrophil_visit_in_model_sva_cf_new.xlsx.
## The cursor is on sheet first, row: 17303 column: 23.old_annotated <- merge(fData(t_neutrophils), big_table, by = "row.names")
rownames(old_annotated) <- old_annotated[["Row.names"]]
old_annotated[["Row.names"]] <- NULL
write_xlsx(data = old_annotated, excel = "excel/neutrophil_visit_in_model_sva_cf_old.xlsx")## write_xlsx() wrote excel/neutrophil_visit_in_model_sva_cf_old.xlsx.
## The cursor is on sheet first, row: 9104 column: 76.8.0.2.1 Neutrophils by visit
When I did this with the monocytes, I split it up into multiple blocks for each visit. This time I am just going to run them all together.
visitcf_factor <- paste0("v", pData(t_neutrophils)[["visitnumber"]],
pData(t_neutrophils)[["finaloutcome"]])
t_neutrophil_visitcf <- set_expt_conditions(t_neutrophils, fact=visitcf_factor)## The numbers of samples by condition are:##
## v1cure v1failure v2cure v2failure v3cure v3failure
## 8 8 7 6 5 7t_cf_neutrophil_visits_de_sva <- all_pairwise(t_neutrophil_visitcf, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## v1cure v1failure v2cure v2failure v3cure v3failure
## 8 8 7 6 5 7## Removing 0 low-count genes (9101 remaining).## Setting 685 low elements to zero.## transform_counts: Found 685 values equal to 0, adding 1 to the matrix.
t_cf_neutrophil_visits_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_cf_neutrophil_visits_table_sva <- combine_de_tables(
t_cf_neutrophil_visits_de_sva, keepers = visitcf_contrasts,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_visitcf_table_sva-v{ver}.xlsx"))## The keepers has no elements in the coefficients.## Here are the keepers: v1_failure, v1_cure, v2_failure, v2_cure, v3_failure, v3_cure## Here are the coefficients: v1failure, v1cure, v2cure, v1cure, v2failure, v1cure, v3cure, v1cure, v3failure, v1cure, v2cure, v1failure, v2failure, v1failure, v3cure, v1failure, v3failure, v1failure, v2failure, v2cure, v3cure, v2cure, v3failure, v2cure, v3cure, v2failure, v3failure, v2failure, v3failure, v3cure## Error in extract_keepers(extracted, keepers, table_names, all_coefficients, : Unable to find the set of contrasts to keep, fix this and try again.t_cf_neutrophil_visits_table_sva## Error in eval(expr, envir, enclos): object 't_cf_neutrophil_visits_table_sva' not foundt_cf_neutrophil_visits_sig_sva <- extract_significant_genes(
t_cf_neutrophil_visits_table_sva,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_visitcf_sig_sva-v{ver}.xlsx"))## Error in eval(expr, envir, enclos): object 't_cf_neutrophil_visits_table_sva' not foundt_cf_neutrophil_visits_sig_sva## Error in eval(expr, envir, enclos): object 't_cf_neutrophil_visits_sig_sva' not founddim(t_cf_neutrophil_visits_sig_sva$deseq$ups[[1]])## Error in eval(expr, envir, enclos): object 't_cf_neutrophil_visits_sig_sva' not founddim(t_cf_neutrophil_visits_sig_sva$deseq$downs[[1]])## Error in eval(expr, envir, enclos): object 't_cf_neutrophil_visits_sig_sva' not foundNow V1
t_cf_neutrophil_v1_de_sva <- all_pairwise(tv1_neutrophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 8 8## Removing 0 low-count genes (8717 remaining).## Setting 145 low elements to zero.## transform_counts: Found 145 values equal to 0, adding 1 to the matrix.t_cf_neutrophil_v1_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8180
## limma_vs_edger 0.8319
## limma_vs_basic 0.8909
## limma_vs_noiseq -0.8084
## deseq_vs_edger 0.9946
## deseq_vs_basic 0.8627
## deseq_vs_noiseq -0.8288
## edger_vs_basic 0.8792
## edger_vs_noiseq -0.8474
## basic_vs_noiseq -0.9014t_cf_neutrophil_v1_table_sva <- combine_de_tables(
t_cf_neutrophil_v1_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_v1_cf_table_sva-v{ver}.xlsx"))
t_cf_neutrophil_v1_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 5 8 5
## edger_sigdown limma_sigup limma_sigdown
## 1 11 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_neutrophil_v1_sig_sva <- extract_significant_genes(
t_cf_neutrophil_v1_table_sva,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_v1_cf_sig_sva-v{ver}.xlsx"))
t_cf_neutrophil_v1_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 5 11 5 8 0
## basic_down
## outcome 0
dim(t_cf_neutrophil_v1_sig_sva$deseq$ups[[1]])## [1] 5 59dim(t_cf_neutrophil_v1_sig_sva$deseq$downs[[1]])## [1] 8 59t_cf_neutrophil_v2_de_sva <- all_pairwise(tv2_neutrophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 7 6## Removing 0 low-count genes (8452 remaining).## Setting 78 low elements to zero.## transform_counts: Found 78 values equal to 0, adding 1 to the matrix.t_cf_neutrophil_v2_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8893
## limma_vs_edger 0.8880
## limma_vs_basic 0.9485
## limma_vs_noiseq -0.8394
## deseq_vs_edger 0.9986
## deseq_vs_basic 0.9021
## deseq_vs_noiseq -0.9024
## edger_vs_basic 0.9026
## edger_vs_noiseq -0.9009
## basic_vs_noiseq -0.8742t_cf_neutrophil_v2_table_sva <- combine_de_tables(
t_cf_neutrophil_v2_de_sva,
keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_v2_cf_table_sva-v{ver}.xlsx"))
t_cf_neutrophil_v2_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 9 3 20
## edger_sigdown limma_sigup limma_sigdown
## 1 6 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_neutrophil_v2_sig_sva <- extract_significant_genes(
t_cf_neutrophil_v2_table_sva,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_v2_cf_sig_sva-v{ver}.xlsx"))
t_cf_neutrophil_v2_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 20 6 9 3 0
## basic_down
## outcome 0
dim(t_cf_neutrophil_v2_sig_sva$deseq$ups[[1]])## [1] 9 59dim(t_cf_neutrophil_v2_sig_sva$deseq$downs[[1]])## [1] 3 59t_cf_neutrophil_v3_de_sva <- all_pairwise(tv3_neutrophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 5 7## Removing 0 low-count genes (8505 remaining).## Setting 83 low elements to zero.## transform_counts: Found 83 values equal to 0, adding 1 to the matrix.t_cf_neutrophil_v3_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8849
## limma_vs_edger 0.8859
## limma_vs_basic 0.7952
## limma_vs_noiseq -0.7095
## deseq_vs_edger 0.9993
## deseq_vs_basic 0.7528
## deseq_vs_noiseq -0.7574
## edger_vs_basic 0.7514
## edger_vs_noiseq -0.7563
## basic_vs_noiseq -0.8892t_cf_neutrophil_v3_table_sva <- combine_de_tables(
t_cf_neutrophil_v3_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_v3_cf_table_sva-v{ver}.xlsx"))
t_cf_neutrophil_v3_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 5 1 5
## edger_sigdown limma_sigup limma_sigdown
## 1 1 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_neutrophil_v3_sig_sva <- extract_significant_genes(
t_cf_neutrophil_v3_table_sva,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_v3_cf_sig_sva-v{ver}.xlsx"))
t_cf_neutrophil_v3_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 5 1 5 1 0
## basic_down
## outcome 0
dim(t_cf_neutrophil_v3_sig_sva$deseq$ups[[1]])## [1] 5 59dim(t_cf_neutrophil_v3_sig_sva$deseq$downs[[1]])## [1] 1 598.0.2.2 Neutrophils: Compare sva to batch-in-model
sva_aucc <- calculate_aucc(t_cf_neutrophil_table_sva[["data"]][[1]],
tbl2 = t_cf_neutrophil_table_batchvisit[["data"]][[1]],
py = "deseq_adjp", ly = "deseq_logfc")
sva_aucc## These two tables have an aucc value of: 0.673209505652166 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 209, df = 9099, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.9060 0.9131
## sample estimates:
## cor
## 0.9096
shared_ids <- rownames(t_cf_neutrophil_table_sva[["data"]][[1]]) %in%
rownames(t_cf_neutrophil_table_batchvisit[["data"]][[1]])
first <- t_cf_neutrophil_table_sva[["data"]][[1]][shared_ids, ]
second <- t_cf_neutrophil_table_batchvisit[["data"]][[1]][rownames(first), ]
cor.test(first[["deseq_logfc"]], second[["deseq_logfc"]])##
## Pearson's product-moment correlation
##
## data: first[["deseq_logfc"]] and second[["deseq_logfc"]]
## t = 209, df = 9099, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.9060 0.9131
## sample estimates:
## cor
## 0.90968.0.3 Eosinophils
This time, with feeling! Repeating the same set of tasks with the eosinophil samples.
t_cf_eosinophil_de_sva <- all_pairwise(t_eosinophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 17 9## Removing 0 low-count genes (10532 remaining).## Setting 327 low elements to zero.## transform_counts: Found 327 values equal to 0, adding 1 to the matrix.t_cf_eosinophil_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.9099
## limma_vs_edger 0.9174
## limma_vs_basic 0.8756
## limma_vs_noiseq -0.7909
## deseq_vs_edger 0.9973
## deseq_vs_basic 0.8488
## deseq_vs_noiseq -0.7864
## edger_vs_basic 0.8546
## edger_vs_noiseq -0.7964
## basic_vs_noiseq -0.8713t_cf_eosinophil_table_sva <- combine_de_tables(
t_cf_eosinophil_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_cf_table_sva-v{ver}.xlsx"))
t_cf_eosinophil_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 116 75 112
## edger_sigdown limma_sigup limma_sigdown
## 1 63 57 34## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_eosinophil_sig_sva <- extract_significant_genes(
t_cf_eosinophil_table_sva,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_cf_sig_sva-v{ver}.xlsx"))
t_cf_eosinophil_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 57 34 112 63 116 75 0
## basic_down
## outcome 0
dim(t_cf_eosinophil_sig_sva$deseq$ups[[1]])## [1] 116 59dim(t_cf_eosinophil_sig_sva$deseq$downs[[1]])## [1] 75 59knitr::kable(head(t_cf_eosinophil_sig_sva$deseq$ups[[1]]))| ensembl_gene_id | ensembl_transcript_id | version | transcript_version | description | gene_biotype | cds_length | chromosome_name | strand | start_position | end_position | hgnc_symbol | uniprot_gn_symbol | transcript | mean_cds_len | deseq_logfc | deseq_adjp | edger_logfc | edger_adjp | limma_logfc | limma_adjp | noiseq_logfc | noiseq_adjp | basic_num | basic_den | basic_numvar | basic_denvar | basic_logfc | basic_t | basic_p | basic_adjp | deseq_basemean | deseq_lfcse | deseq_stat | deseq_p | deseq_num | deseq_den | edger_logcpm | edger_lr | edger_p | limma_ave | limma_t | limma_b | limma_p | noiseq_num | noiseq_den | noiseq_theta | noiseq_prob | noiseq_p | limma_adjp_fdr | deseq_adjp_fdr | edger_adjp_fdr | basic_adjp_fdr | noiseq_adjp_fdr | lfc_meta | lfc_var | lfc_varbymed | p_meta | p_var | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ENSG00000198178 | ENSG00000198178 | ENST00000537530 | 10 | 1 | C-type lectin domain family 4 member C [Source:HGNC Symbol;Acc:HGNC:13258] | protein_coding | 267 | 12 | - | 7729415 | 7751605 | CLEC4C | CLEC4C | ENSG00000198178.1 | 510.5 | 5.537 | 2e-03 | 5.152 | 0.1934 | 4.225 | 0.0191 | -1.4675 | 1 | 2.0400 | -2.764 | 8.784 | 8.946 | 4.804 | 3.920 | 0.0012 | 0.1398 | 193.80 | 1.3030 | 4.249 | 0e+00 | 9.617 | 4.0806 | 2.2170 | 5.953 | 0.0147 | -1.4190 | 4.4420 | 0.1256 | 0.0002 | 3.580 | 9.899 | -1.445 | 0.9473 | 0.0527 | 0.0191 | 0.0020 | 0.1934 | 0.1398 | 0.8357 | 4.982 | 4.880e-03 | 9.796e-04 | 4.956e-03 | 7.107e-05 |
| ENSG00000187569 | ENSG00000187569 | ENST00000345088 | 3 | 3 | developmental pluripotency associated 3 [Source:HGNC Symbol;Acc:HGNC:19199] | protein_coding | 480 | 12 | + | 7711433 | 7717559 | DPPA3 | DPPA3 | ENSG00000187569.3 | 480 | 5.448 | 7e-03 | 4.721 | 0.0547 | 3.504 | 0.0470 | -0.6819 | 1 | -0.6872 | -4.301 | 7.263 | 2.839 | 3.614 | 3.662 | 0.0035 | 0.1989 | 23.10 | 1.4300 | 3.810 | 1e-04 | 5.866 | 0.4183 | -0.5913 | 9.779 | 0.0018 | -3.3720 | 3.6990 | -1.6550 | 0.0011 | 2.088 | 3.349 | -1.177 | 0.9103 | 0.0897 | 0.0470 | 0.0069 | 0.0547 | 0.1989 | 0.8357 | 4.443 | 4.098e-01 | 9.225e-02 | 9.866e-04 | 6.647e-07 |
| ENSG00000136235 | ENSG00000136235 | ENST00000479625 | 16 | 1 | glycoprotein nmb [Source:HGNC Symbol;Acc:HGNC:4462] | protein_coding | undefined | 7 | + | 23235967 | 23275108 | GPNMB | GPNMB | ENSG00000136235.1 | 1447.5 | 5.410 | 4e-04 | 5.374 | 0.0001 | 3.867 | 0.1754 | -1.2238 | 1 | -1.1190 | -3.695 | 12.101 | 2.665 | 2.576 | 2.102 | 0.0621 | 0.4987 | 53.03 | 1.1380 | 4.752 | 0e+00 | 6.906 | 1.4965 | 0.4580 | 25.540 | 0.0000 | -3.2370 | 2.5210 | -3.2570 | 0.0184 | 2.100 | 4.905 | -1.087 | 0.9259 | 0.0741 | 0.1754 | 0.0004 | 0.0001 | 0.4987 | 0.8357 | 4.798 | 5.245e-02 | 1.093e-02 | 6.124e-03 | 1.125e-04 |
| ENSG00000089012 | ENSG00000089012 | ENST00000497407 | 14 | 2 | signal regulatory protein gamma [Source:HGNC Symbol;Acc:HGNC:15757] | protein_coding | undefined | 20 | - | 1629152 | 1657779 | SIRPG | SIRPG | ENSG00000089012.2 | 880.8 | 4.040 | 0e+00 | 4.018 | 0.0000 | 1.598 | 0.6625 | -2.7349 | 1 | 0.8317 | -1.681 | 13.876 | 1.355 | 2.513 | 1.974 | 0.0805 | 0.5427 | 272.50 | 0.7310 | 5.526 | 0e+00 | 7.574 | 3.5336 | 2.7060 | 32.750 | 0.0000 | -1.1480 | 0.9807 | -5.0020 | 0.3360 | 2.385 | 15.874 | -2.097 | 0.9883 | 0.0117 | 0.6624 | 0.0000 | 0.0000 | 0.5427 | 0.8357 | 3.148 | 1.579e+00 | 5.016e-01 | 1.120e-01 | 3.763e-02 |
| ENSG00000089127 | ENSG00000089127 | ENST00000540589 | 13 | 2 | 2’-5’-oligoadenylate synthetase 1 [Source:HGNC Symbol;Acc:HGNC:8086] | protein_coding | 68 | 12 | + | 112906783 | 112933222 | OAS1 | OAS1 | ENSG00000089127.2 | 682.8 | 3.933 | 0e+00 | 3.943 | 0.0000 | 3.339 | 0.0596 | -2.1220 | 1 | 1.9510 | -1.301 | 8.237 | 1.116 | 3.252 | 3.284 | 0.0092 | 0.2669 | 184.60 | 0.5478 | 7.180 | 0e+00 | 7.841 | 3.9081 | 2.1560 | 44.580 | 0.0000 | -0.4596 | 3.4950 | -1.3000 | 0.0018 | 2.522 | 10.978 | -2.205 | 0.9849 | 0.0151 | 0.0596 | 0.0000 | 0.0000 | 0.2669 | 0.8357 | 3.722 | 1.794e-02 | 4.820e-03 | 5.900e-04 | 1.044e-06 |
| ENSG00000137959 | ENSG00000137959 | ENST00000450498 | 16 | 1 | interferon induced protein 44 like [Source:HGNC Symbol;Acc:HGNC:17817] | protein_coding | 699 | 1 | + | 78619922 | 78646145 | IFI44L | IFI44L | ENSG00000137959.1 | 783.333333333333 | 3.828 | 0e+00 | 3.831 | 0.0000 | 3.443 | 0.0123 | -3.6168 | 0 | 5.5560 | 1.793 | 6.584 | 3.318 | 3.763 | 3.909 | 0.0020 | 0.1645 | 1932.00 | 0.5401 | 7.087 | 0e+00 | 11.304 | 7.4755 | 5.4900 | 57.400 | 0.0000 | 3.0090 | 4.7380 | 1.6850 | 0.0001 | 7.837 | 96.140 | -3.316 | 1.0000 | 0.0000 | 0.0123 | 0.0000 | 0.0000 | 0.1645 | 0.0000 | 3.691 | 2.660e-03 | 7.207e-04 | 2.392e-05 | 1.716e-09 |
knitr::kable(head(t_cf_eosinophil_sig_sva$deseq$downs[[1]]))| ensembl_gene_id | ensembl_transcript_id | version | transcript_version | description | gene_biotype | cds_length | chromosome_name | strand | start_position | end_position | hgnc_symbol | uniprot_gn_symbol | transcript | mean_cds_len | deseq_logfc | deseq_adjp | edger_logfc | edger_adjp | limma_logfc | limma_adjp | noiseq_logfc | noiseq_adjp | basic_num | basic_den | basic_numvar | basic_denvar | basic_logfc | basic_t | basic_p | basic_adjp | deseq_basemean | deseq_lfcse | deseq_stat | deseq_p | deseq_num | deseq_den | edger_logcpm | edger_lr | edger_p | limma_ave | limma_t | limma_b | limma_p | noiseq_num | noiseq_den | noiseq_theta | noiseq_prob | noiseq_p | limma_adjp_fdr | deseq_adjp_fdr | edger_adjp_fdr | basic_adjp_fdr | noiseq_adjp_fdr | lfc_meta | lfc_var | lfc_varbymed | p_meta | p_var | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ENSG00000179344 | ENSG00000179344 | ENST00000399084 | 16 | 5 | major histocompatibility complex, class II, DQ beta 1 [Source:HGNC Symbol;Acc:HGNC:4944] | protein_coding | 786 | 6 | - | 32659467 | 32668383 | HLA-DQB1 | HLA-DQB1 | ENSG00000179344.5 | 645.5 | -5.676 | 0.0000 | -5.668 | 0.0000 | -7.612 | 0.0155 | 4.4060 | 0 | 0.0597 | 5.6120 | 5.9251 | 7.993 | -5.552 | -5.227 | 0.0001 | 0.0515 | 4151.00 | 0.8485 | -6.689 | 0.0000 | 6.782 | 12.458 | 6.575 | 36.280 | 0.0000 | 3.5810 | -4.604 | 1.291 | 0.0001 | 104.486 | 4.928 | 4.5901 | 1.0000 | 0.0000 | 0.0155 | 0.0000 | 0.0000 | 0.0515 | 0.0000 | -5.952 | 1.301e+00 | -2.186e-01 | 3.393e-05 | 3.454e-09 |
| ENSG00000112139 | ENSG00000112139 | ENST00000515437 | 16 | 5 | MAM domain containing glycosylphosphatidylinositol anchor 1 [Source:HGNC Symbol;Acc:HGNC:19267] | protein_coding | 388 | 6 | - | 37630679 | 37699306 | MDGA1 | MDGA1 | ENSG00000112139.5 | 1438.71428571429 | -5.037 | 0.0015 | -4.942 | 0.0398 | -2.844 | 0.2584 | 0.7507 | 1 | -3.3850 | -0.1629 | 10.6461 | 14.783 | -3.222 | -2.249 | 0.0366 | 0.4206 | 149.80 | 1.1640 | -4.327 | 0.0000 | 2.708 | 7.744 | 1.813 | 10.640 | 0.0011 | -1.5710 | -2.141 | -3.687 | 0.0421 | 5.239 | 3.114 | 0.7443 | 0.8075 | 0.1925 | 0.2584 | 0.0015 | 0.0398 | 0.4206 | 0.8357 | -3.895 | 9.304e-01 | -2.389e-01 | 1.440e-02 | 5.749e-04 |
| ENSG00000203972 | ENSG00000203972 | ENST00000545705 | 10 | 1 | glycine-N-acyltransferase like 3 [Source:HGNC Symbol;Acc:HGNC:21349] | protein_coding | 468 | 6 | + | 49499923 | 49528078 | GLYATL3 | GLYATL3 | ENSG00000203972.1 | 667.5 | -4.718 | 0.0498 | -4.599 | 0.0363 | -2.962 | 0.1916 | 0.4092 | 1 | -5.7280 | -3.3770 | 0.5218 | 6.712 | -2.351 | -3.493 | 0.0023 | 0.1675 | 27.99 | 1.5560 | -3.032 | 0.0024 | -1.881 | 2.837 | -0.443 | 10.870 | 0.0010 | -4.5450 | -2.444 | -3.577 | 0.0218 | 2.711 | 2.042 | 0.5496 | 0.6925 | 0.3075 | 0.1915 | 0.0498 | 0.0363 | 0.1675 | 0.9068 | -3.901 | 8.898e-02 | -2.281e-02 | 8.413e-03 | 1.355e-04 |
| ENSG00000196526 | ENSG00000196526 | ENST00000358461 | 10 | 6 | actin filament associated protein 1 [Source:HGNC Symbol;Acc:HGNC:24017] | protein_coding | 2193 | 4 | - | 7758714 | 7939926 | AFAP1 | AFAP1 | ENSG00000196526.6 | 1911 | -3.294 | 0.0252 | -3.293 | 0.0574 | -2.538 | 0.2974 | 2.2170 | 1 | 0.5888 | 2.6700 | 2.1638 | 11.578 | -2.081 | -2.168 | 0.0405 | 0.4335 | 982.20 | 0.9856 | -3.342 | 0.0008 | 6.891 | 10.185 | 4.492 | 9.604 | 0.0019 | 1.8040 | -1.999 | -4.138 | 0.0565 | 23.858 | 5.131 | 2.1394 | 0.9761 | 0.0239 | 0.2974 | 0.0252 | 0.0574 | 0.4335 | 0.8357 | -2.956 | 1.507e-01 | -5.097e-02 | 1.976e-02 | 1.013e-03 |
| ENSG00000175592 | ENSG00000175592 | ENST00000312562 | 9 | 7 | FOS like 1, AP-1 transcription factor subunit [Source:HGNC Symbol;Acc:HGNC:13718] | protein_coding | 816 | 11 | - | 65892049 | 65900573 | FOSL1 | FOSL1 | ENSG00000175592.7 | 496 | -3.097 | 0.0000 | -3.081 | 0.0000 | -2.221 | 0.1738 | 0.7531 | 1 | 0.1522 | 1.8020 | 3.6253 | 4.212 | -1.650 | -2.045 | 0.0561 | 0.4818 | 267.80 | 0.5692 | -5.441 | 0.0000 | 5.087 | 8.184 | 2.640 | 30.640 | 0.0000 | 1.0720 | -2.528 | -3.082 | 0.0181 | 6.345 | 3.764 | 1.1519 | 0.9081 | 0.0919 | 0.1738 | 0.0000 | 0.0000 | 0.4818 | 0.8357 | -2.752 | 2.007e-01 | -7.295e-02 | 6.027e-03 | 1.090e-04 |
| ENSG00000122877 | ENSG00000122877 | ENST00000637191 | 16 | 1 | early growth response 2 [Source:HGNC Symbol;Acc:HGNC:3239] | protein_coding | 418 | 10 | - | 62811996 | 62919900 | EGR2 | EGR2 | ENSG00000122877.1 | 1140.25 | -2.789 | 0.0117 | -2.779 | 0.0110 | -2.011 | 0.2749 | 0.6118 | 1 | -1.2330 | -0.0550 | 0.8328 | 5.118 | -1.178 | -1.878 | 0.0731 | 0.5187 | 96.53 | 0.7679 | -3.632 | 0.0003 | 3.932 | 6.721 | 1.188 | 14.120 | 0.0002 | -0.7511 | -2.078 | -3.767 | 0.0480 | 3.917 | 2.563 | 0.7938 | 0.8090 | 0.1910 | 0.2749 | 0.0117 | 0.0110 | 0.5187 | 0.8357 | -2.514 | 2.515e-01 | -1.000e-01 | 1.616e-02 | 7.617e-04 |
Repeat with batch in the model.
t_cf_eosinophil_de_batchvisit <- all_pairwise(t_eosinophils, model_batch = TRUE,
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 17 9
##
## 3 2 1
## 9 9 8t_cf_eosinophil_de_batchvisit## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: batch in model/limma.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8678
## limma_vs_edger 0.8696
## limma_vs_basic 0.9676
## limma_vs_noiseq -0.8444
## deseq_vs_edger 0.9998
## deseq_vs_basic 0.8961
## deseq_vs_noiseq -0.8351
## edger_vs_basic 0.8977
## edger_vs_noiseq -0.8396
## basic_vs_noiseq -0.8713t_cf_eosinophil_table_batchvisit <- combine_de_tables(
t_cf_eosinophil_de_batchvisit, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_cf_table_batchvisit-v{ver}.xlsx"))
t_cf_eosinophil_table_batchvisit## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 99 35 103
## edger_sigdown limma_sigup limma_sigdown
## 1 24 35 15## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_eosinophil_sig_batchvisit <- extract_significant_genes(
t_cf_eosinophil_table_batchvisit,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_cf_sig_batchvisit-v{ver}.xlsx"))
t_cf_eosinophil_sig_batchvisit## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 35 15 103 24 99 35 0
## basic_down
## outcome 0
dim(t_cf_eosinophil_sig_batchvisit$deseq$ups[[1]])## [1] 99 59dim(t_cf_eosinophil_sig_batchvisit$deseq$downs[[1]])## [1] 35 59knitr::kable(head(t_cf_eosinophil_sig_batchvisit$deseq$ups[[1]]))| ensembl_gene_id | ensembl_transcript_id | version | transcript_version | description | gene_biotype | cds_length | chromosome_name | strand | start_position | end_position | hgnc_symbol | uniprot_gn_symbol | transcript | mean_cds_len | deseq_logfc | deseq_adjp | edger_logfc | edger_adjp | limma_logfc | limma_adjp | noiseq_logfc | noiseq_adjp | basic_num | basic_den | basic_numvar | basic_denvar | basic_logfc | basic_t | basic_p | basic_adjp | deseq_basemean | deseq_lfcse | deseq_stat | deseq_p | deseq_num | deseq_den | edger_logcpm | edger_lr | edger_p | limma_ave | limma_t | limma_b | limma_p | noiseq_num | noiseq_den | noiseq_theta | noiseq_prob | noiseq_p | limma_adjp_fdr | deseq_adjp_fdr | edger_adjp_fdr | basic_adjp_fdr | noiseq_adjp_fdr | lfc_meta | lfc_var | lfc_varbymed | p_meta | p_var | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ENSG00000165949 | ENSG00000165949 | ENST00000611954 | 12 | 4 | interferon alpha inducible protein 27 [Source:HGNC Symbol;Acc:HGNC:5397] | protein_coding | 180 | 14 | + | 94104836 | 94116698 | IFI27 | IFI27 | ENSG00000165949.4 | 287.454545454545 | 5.668 | 0e+00 | 5.624 | 0e+00 | 4.397 | 0.0591 | -1.2302 | 1 | -0.1291 | -3.3160 | 7.379 | 1.696 | 3.186 | 3.323 | 0.0077 | 0.2504 | 54.63 | 0.8188 | 6.923 | 0 | 7.505 | 1.8370 | 0.4882 | 47.95 | 0 | -2.6550 | 3.858 | -1.1070 | 0.0007 | 2.125 | 4.985 | -1.156 | 0.9137 | 0.0863 | 0.0591 | 0e+00 | 0e+00 | 0.2504 | 0.8357 | 5.230 | 0.000e+00 | 0.000e+00 | 2.264e-04 | 1.537e-07 |
| ENSG00000187569 | ENSG00000187569 | ENST00000345088 | 3 | 3 | developmental pluripotency associated 3 [Source:HGNC Symbol;Acc:HGNC:19199] | protein_coding | 480 | 12 | + | 7711433 | 7717559 | DPPA3 | DPPA3 | ENSG00000187569.3 | 480 | 5.537 | 4e-04 | 5.386 | 1e-04 | 4.404 | 0.0351 | -0.6819 | 1 | -0.6872 | -4.3010 | 7.263 | 2.839 | 3.614 | 3.662 | 0.0035 | 0.1989 | 23.10 | 1.1660 | 4.747 | 0 | 5.915 | 0.3782 | -0.6406 | 25.31 | 0 | -3.3720 | 4.263 | -0.7244 | 0.0002 | 2.088 | 3.349 | -1.177 | 0.9103 | 0.0897 | 0.0351 | 4e-04 | 1e-04 | 0.1989 | 0.8357 | 5.088 | 3.906e-02 | 7.677e-03 | 7.965e-05 | 1.843e-08 |
| ENSG00000136235 | ENSG00000136235 | ENST00000479625 | 16 | 1 | glycoprotein nmb [Source:HGNC Symbol;Acc:HGNC:4462] | protein_coding | undefined | 7 | + | 23235967 | 23275108 | GPNMB | GPNMB | ENSG00000136235.1 | 1447.5 | 5.426 | 2e-04 | 5.360 | 0e+00 | 2.104 | 0.5947 | -1.2238 | 1 | -1.1190 | -3.6950 | 12.101 | 2.665 | 2.576 | 2.102 | 0.0621 | 0.4987 | 53.03 | 1.0740 | 5.053 | 0 | 7.515 | 2.0897 | 0.4259 | 29.50 | 0 | -3.2370 | 1.413 | -4.4990 | 0.1695 | 2.100 | 4.905 | -1.087 | 0.9259 | 0.0741 | 0.5947 | 2e-04 | 0e+00 | 0.4987 | 0.8357 | 4.060 | 2.227e+00 | 5.485e-01 | 5.650e-02 | 9.577e-03 |
| ENSG00000089127 | ENSG00000089127 | ENST00000540589 | 13 | 2 | 2’-5’-oligoadenylate synthetase 1 [Source:HGNC Symbol;Acc:HGNC:8086] | protein_coding | 68 | 12 | + | 112906783 | 112933222 | OAS1 | OAS1 | ENSG00000089127.2 | 682.8 | 4.820 | 0e+00 | 4.830 | 0e+00 | 3.978 | 0.1341 | -2.1220 | 1 | 1.9510 | -1.3010 | 8.237 | 1.116 | 3.252 | 3.284 | 0.0092 | 0.2669 | 184.60 | 0.7144 | 6.746 | 0 | 8.840 | 4.0197 | 2.1430 | 56.76 | 0 | -0.4596 | 3.160 | -1.9060 | 0.0040 | 2.522 | 10.978 | -2.205 | 0.9849 | 0.0151 | 0.1341 | 0e+00 | 0e+00 | 0.2669 | 0.8357 | 4.652 | 5.441e-02 | 1.170e-02 | 1.328e-03 | 5.293e-06 |
| ENSG00000111335 | ENSG00000111335 | ENST00000551603 | 12 | 1 | 2’-5’-oligoadenylate synthetase 2 [Source:HGNC Symbol;Acc:HGNC:8087] | protein_coding | 183 | 12 | + | 112978395 | 113011723 | OAS2 | OAS2 | ENSG00000111335.1 | 1319.5 | 4.447 | 0e+00 | 4.461 | 0e+00 | 3.601 | 0.2035 | -3.0969 | 0 | 4.0180 | 0.8398 | 12.517 | 3.025 | 3.178 | 2.537 | 0.0293 | 0.3953 | 1028.00 | 0.8157 | 5.451 | 0 | 11.444 | 6.9971 | 4.5830 | 38.11 | 0 | 1.7970 | 2.779 | -2.7210 | 0.0100 | 5.227 | 44.719 | -2.937 | 1.0000 | 0.0000 | 0.2035 | 0e+00 | 0e+00 | 0.3953 | 0.0000 | 4.110 | 6.269e-02 | 1.525e-02 | 3.340e-03 | 3.347e-05 |
| ENSG00000137959 | ENSG00000137959 | ENST00000450498 | 16 | 1 | interferon induced protein 44 like [Source:HGNC Symbol;Acc:HGNC:17817] | protein_coding | 699 | 1 | + | 78619922 | 78646145 | IFI44L | IFI44L | ENSG00000137959.1 | 783.333333333333 | 4.200 | 0e+00 | 4.213 | 0e+00 | 3.902 | 0.0422 | -3.6168 | 0 | 5.5560 | 1.7930 | 6.584 | 3.318 | 3.763 | 3.909 | 0.0020 | 0.1645 | 1932.00 | 0.7590 | 5.534 | 0 | 12.253 | 8.0528 | 5.4890 | 40.52 | 0 | 3.0090 | 4.118 | 0.2407 | 0.0003 | 7.837 | 96.140 | -3.316 | 1.0000 | 0.0000 | 0.0422 | 0e+00 | 0e+00 | 0.1645 | 0.0000 | 4.204 | 7.374e-02 | 1.754e-02 | 1.151e-04 | 3.976e-08 |
knitr::kable(head(t_cf_eosinophil_sig_batchvisit$deseq$downs[[1]]))| ensembl_gene_id | ensembl_transcript_id | version | transcript_version | description | gene_biotype | cds_length | chromosome_name | strand | start_position | end_position | hgnc_symbol | uniprot_gn_symbol | transcript | mean_cds_len | deseq_logfc | deseq_adjp | edger_logfc | edger_adjp | limma_logfc | limma_adjp | noiseq_logfc | noiseq_adjp | basic_num | basic_den | basic_numvar | basic_denvar | basic_logfc | basic_t | basic_p | basic_adjp | deseq_basemean | deseq_lfcse | deseq_stat | deseq_p | deseq_num | deseq_den | edger_logcpm | edger_lr | edger_p | limma_ave | limma_t | limma_b | limma_p | noiseq_num | noiseq_den | noiseq_theta | noiseq_prob | noiseq_p | limma_adjp_fdr | deseq_adjp_fdr | edger_adjp_fdr | basic_adjp_fdr | noiseq_adjp_fdr | lfc_meta | lfc_var | lfc_varbymed | p_meta | p_var | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ENSG00000189430 | ENSG00000189430 | ENST00000338835 | 13 | 9 | natural cytotoxicity triggering receptor 1 [Source:HGNC Symbol;Acc:HGNC:6731] | protein_coding | 864 | 19 | + | 54906148 | 54916140 | NCR1 | NCR1 | ENSG00000189430.9 | 798.5 | -5.820 | 0.0002 | -5.752 | 0.0019 | -3.214 | 0.2894 | 0.7731 | 1 | -4.4710 | -1.0630 | 1.835 | 11.567 | -3.408 | -3.624 | 0.0014 | 0.1472 | 93.09 | 1.1550 | -5.038 | 0e+00 | 1.4989 | 7.319 | 1.0570 | 19.19 | 0e+00 | -2.621 | -2.436 | -3.3850 | 0.0220 | 3.639 | 2.130 | 1.1623 | 0.9112 | 0.0888 | 0.2894 | 0.0002 | 0.0019 | 0.1472 | 0.8357 | -5.110 | 1.583e+00 | -3.098e-01 | 7.344e-03 | 1.615e-04 |
| ENSG00000179344 | ENSG00000179344 | ENST00000399084 | 16 | 5 | major histocompatibility complex, class II, DQ beta 1 [Source:HGNC Symbol;Acc:HGNC:4944] | protein_coding | 786 | 6 | - | 32659467 | 32668383 | HLA-DQB1 | HLA-DQB1 | ENSG00000179344.5 | 645.5 | -5.667 | 0.0000 | -5.653 | 0.0006 | -5.936 | 0.0332 | 4.4060 | 0 | 0.0597 | 5.6120 | 5.925 | 7.993 | -5.552 | -5.227 | 0.0001 | 0.0515 | 4151.00 | 0.8879 | -6.382 | 0e+00 | 8.4098 | 14.076 | 6.5750 | 21.99 | 0e+00 | 3.581 | -4.357 | 0.8177 | 0.0002 | 104.486 | 4.928 | 4.5901 | 1.0000 | 0.0000 | 0.0332 | 0.0000 | 0.0006 | 0.0515 | 0.0000 | -5.464 | 1.039e-01 | -1.902e-02 | 6.255e-05 | 1.123e-08 |
| ENSG00000162669 | ENSG00000162669 | ENST00000427444 | 16 | 1 | helicase for meiosis 1 [Source:HGNC Symbol;Acc:HGNC:20193] | protein_coding | 589 | 1 | - | 91260766 | 91404856 | HFM1 | HFM1 | ENSG00000162669.1 | 1528.4 | -4.617 | 0.0012 | -4.588 | 0.0054 | -2.665 | 0.1784 | 1.2318 | 1 | -3.0190 | -0.0765 | 2.110 | 8.425 | -2.942 | -3.444 | 0.0021 | 0.1672 | 207.70 | 1.0200 | -4.526 | 0e+00 | 4.2354 | 8.853 | 2.1480 | 16.51 | 0e+00 | -1.450 | -2.912 | -2.4740 | 0.0073 | 5.418 | 2.307 | 1.1461 | 0.9059 | 0.0941 | 0.1784 | 0.0012 | 0.0054 | 0.1672 | 0.8357 | -3.922 | 2.638e-01 | -6.727e-02 | 2.452e-03 | 1.764e-05 |
| ENSG00000167634 | ENSG00000167634 | ENST00000328092 | 12 | 9 | NLR family pyrin domain containing 7 [Source:HGNC Symbol;Acc:HGNC:22947] | protein_coding | 3030 | 19 | - | 54923509 | 54966312 | NLRP7 | NLRP7 | ENSG00000167634.9 | 2077.44444444444 | -4.061 | 0.0071 | -4.004 | 0.0317 | -1.875 | 0.4968 | 0.3273 | 1 | -4.1970 | -2.2500 | 0.258 | 8.472 | -1.947 | -2.682 | 0.0153 | 0.3229 | 27.08 | 1.0170 | -3.995 | 1e-04 | 0.8671 | 4.928 | -0.7663 | 12.24 | 5e-04 | -3.363 | -1.721 | -4.2100 | 0.0971 | 2.616 | 2.085 | 0.6656 | 0.7700 | 0.2300 | 0.4968 | 0.0071 | 0.0317 | 0.3229 | 0.8626 | -3.179 | 1.172e+00 | -3.687e-01 | 3.255e-02 | 3.126e-03 |
| ENSG00000196526 | ENSG00000196526 | ENST00000358461 | 10 | 6 | actin filament associated protein 1 [Source:HGNC Symbol;Acc:HGNC:24017] | protein_coding | 2193 | 4 | - | 7758714 | 7939926 | AFAP1 | AFAP1 | ENSG00000196526.6 | 1911 | -3.879 | 0.0038 | -3.877 | 0.0088 | -2.357 | 0.3886 | 2.2170 | 1 | 0.5888 | 2.6700 | 2.164 | 11.578 | -2.081 | -2.168 | 0.0405 | 0.4335 | 982.20 | 0.9252 | -4.192 | 0e+00 | 6.7815 | 10.660 | 4.4950 | 15.42 | 1e-04 | 1.804 | -2.067 | -4.0740 | 0.0489 | 23.858 | 5.131 | 2.1394 | 0.9761 | 0.0239 | 0.3886 | 0.0038 | 0.0088 | 0.4335 | 0.8357 | -3.320 | 3.403e-01 | -1.025e-01 | 1.633e-02 | 7.942e-04 |
| ENSG00000277150 | ENSG00000277150 | ENST00000622749 | 1 | 1 | coagulation factor VIII associated 3 [Source:HGNC Symbol;Acc:HGNC:31850] | protein_coding | 1116 | X | - | 155456914 | 155458672 | F8A3 | F8A1 | ENSG00000277150.1 | 1116 | -3.788 | 0.0153 | -3.704 | 0.0589 | -1.712 | 0.3848 | 0.3180 | 1 | -4.5610 | -2.3170 | 1.574 | 6.415 | -2.244 | -3.020 | 0.0059 | 0.2249 | 21.72 | 1.0170 | -3.724 | 2e-04 | 1.9848 | 5.772 | -1.5770 | 10.78 | 1e-03 | -3.506 | -2.080 | -3.8470 | 0.0476 | 2.591 | 2.078 | 0.5401 | 0.6847 | 0.3153 | 0.3849 | 0.0154 | 0.0588 | 0.2249 | 0.9109 | -2.842 | 9.067e-01 | -3.191e-01 | 1.628e-02 | 7.364e-04 |
Repeat with visit in the condition contrast.
visitcf_factor <- paste0("v", pData(t_eosinophils)[["visitnumber"]],
pData(t_eosinophils)[["finaloutcome"]])
t_eosinophil_visitcf <- set_expt_conditions(t_eosinophils, fact = visitcf_factor)## The numbers of samples by condition are:##
## v1cure v1failure v2cure v2failure v3cure v3failure
## 5 3 6 3 6 3t_cf_eosinophil_visits_de_sva <- all_pairwise(t_eosinophil_visitcf, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## v1cure v1failure v2cure v2failure v3cure v3failure
## 5 3 6 3 6 3## Removing 0 low-count genes (10532 remaining).## Setting 373 low elements to zero.## transform_counts: Found 373 values equal to 0, adding 1 to the matrix.
t_cf_eosinophil_visits_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_cf_eosinophil_visits_table_sva <- combine_de_tables(
t_cf_eosinophil_visits_de_sva, keepers = visitcf_contrasts,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_visitcf_table_sva-v{ver}.xlsx"))## The keepers has no elements in the coefficients.## Here are the keepers: v1_failure, v1_cure, v2_failure, v2_cure, v3_failure, v3_cure## Here are the coefficients: v1failure, v1cure, v2cure, v1cure, v2failure, v1cure, v3cure, v1cure, v3failure, v1cure, v2cure, v1failure, v2failure, v1failure, v3cure, v1failure, v3failure, v1failure, v2failure, v2cure, v3cure, v2cure, v3failure, v2cure, v3cure, v2failure, v3failure, v2failure, v3failure, v3cure## Error in extract_keepers(extracted, keepers, table_names, all_coefficients, : Unable to find the set of contrasts to keep, fix this and try again.t_cf_eosinophil_visits_table_sva## Error in eval(expr, envir, enclos): object 't_cf_eosinophil_visits_table_sva' not foundt_cf_eosinophil_visits_sig_sva <- extract_significant_genes(
t_cf_eosinophil_visits_table_sva,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_visitcf_sig_sva-v{ver}.xlsx"))## Error in eval(expr, envir, enclos): object 't_cf_eosinophil_visits_table_sva' not foundt_cf_eosinophil_visits_sig_sva## Error in eval(expr, envir, enclos): object 't_cf_eosinophil_visits_sig_sva' not founddim(t_cf_eosinophil_visits_sig_sva$deseq$ups[[1]])## Error in eval(expr, envir, enclos): object 't_cf_eosinophil_visits_sig_sva' not founddim(t_cf_eosinophil_visits_sig_sva$deseq$downs[[1]])## Error in eval(expr, envir, enclos): object 't_cf_eosinophil_visits_sig_sva' not foundknitr::kable(head(t_cf_eosinophil_visits_sig_sva$deseq$ups[[1]]))## Error in h(simpleError(msg, call)): error in evaluating the argument 'x' in selecting a method for function 'head': object 't_cf_eosinophil_visits_sig_sva' not foundknitr::kable(head(t_cf_eosinophil_visits_sig_sva$deseq$downs[[1]]))## Error in h(simpleError(msg, call)): error in evaluating the argument 'x' in selecting a method for function 'head': object 't_cf_eosinophil_visits_sig_sva' not found8.0.3.0.1 Repeat test of different models: Eosinophils
We wish to ensure that my model simplification did not do anything incorrect to the data for all three cell types, I already did this for the neutrophils, let us repeat for the eosinophils. I am therefore (mostly) copy/pasting the neutrophil section here.a
## The original pairwise invocation with sva:
#t_cf_eosinophil_de_sva <- all_pairwise(t_eosinophils, model_batch = "svaseq",
# filter = TRUE, parallel=FALSE, methods = methods)
test_eosinophils <- normalize_expt(t_eosinophils, filter = "simple")## Removing 2652 low-count genes (17300 remaining).test_eo_design <- pData(test_eosinophils)
test_formula <- as.formula("~ 0 + finaloutcome + visitnumber")
test_model <- model.matrix(test_formula, data = test_eo_design)
null_formula <- as.formula("~ 0 + visitnumber")
null_model <- model.matrix(null_formula, data = test_eo_design)
linear_mtrx <- exprs(test_eosinophils)
l2_mtrx <- log2(linear_mtrx + 1)
chosen_surrogates <- sva::num.sv(dat = l2_mtrx, mod = test_model)
surrogate_result <- sva::svaseq(
dat = linear_mtrx, n.sv = chosen_surrogates, mod = test_model, mod0 = null_model)## Number of significant surrogate variables is: 3
## Iteration (out of 5 ):1 2 3 4 5model_adjust <- as.matrix(surrogate_result[["sv"]])
colnames(model_adjust) <- c("SV1", "SV2", "SV3")
rownames(model_adjust) <- rownames(pData(test_eosinophils))
longer_model <- as.formula("~ finaloutcome + visitnumber + SV1 + SV2 + SV3")
eo_design_svs <- cbind(test_eo_design, model_adjust)
summarized <- DESeq2::DESeqDataSetFromMatrix(countData = linear_mtrx,
colData = eo_design_svs,
design = longer_model)## converting counts to integer modedeseq_run <- DESeq2::DESeq(summarized)## estimating size factors## estimating dispersions## gene-wise dispersion estimates## mean-dispersion relationship## final dispersion estimates## fitting model and testingdeseq_table <- as.data.frame(DESeq2::results(object = deseq_run,
contrast = c("finaloutcome", "failure", "cure"),
format = "DataFrame"))
big_table <- t_cf_eosinophil_table_sva[["data"]][["outcome"]]
only_deseq <- big_table[, c("deseq_logfc", "deseq_adjp")]
merged <- merge(deseq_table, only_deseq, by = "row.names")
rownames(merged) <- merged[["Row.names"]]
merged[["Row.names"]] <- NULL
cor_value <- cor.test(merged[["log2FoldChange"]], merged[["deseq_logfc"]])
cor_value##
## Pearson's product-moment correlation
##
## data: merged[["log2FoldChange"]] and merged[["deseq_logfc"]]
## t = 228, df = 10530, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.9084 0.9149
## sample estimates:
## cor
## 0.9117logfc_plotter <- plot_linear_scatter(merged[, c("log2FoldChange", "deseq_logfc")])
logfc_plot <- logfc_plotter[["scatter"]] +
xlab("DESeq2 log2FC: Visit explicitly in model") +
ylab("DESeq2 log2FC: Default pairwise comparison") +
ggtitle(glue("Comparing results from models: {prettyNum(cor_value[['estimate']])} (pearson)"))
pp(file = "figures/compare_cf_and_visit_in_model_eosinophil_logfc.svg")
logfc_plot
dev.off()## png
## 2logfc_plot
cor_value <- cor.test(merged[["padj"]], merged[["deseq_adjp"]], method = "spearman")## Warning in cor.test.default(merged[["padj"]], merged[["deseq_adjp"]], method =
## "spearman"): Cannot compute exact p-value with tiescor_value##
## Spearman's rank correlation rho
##
## data: merged[["padj"]] and merged[["deseq_adjp"]]
## S = 3.5e+10, p-value <2e-16
## alternative hypothesis: true rho is not equal to 0
## sample estimates:
## rho
## 0.8214adjp_plotter <- plot_linear_scatter(merged[, c("padj", "deseq_adjp")])
adjp_plot <- adjp_plotter[["scatter"]] +
xlab("DESeq2 adjp: Visit explicitly in model") +
ylab("DESeq2 adjp: Default pairwise comparison") +
ggtitle(glue("Comparing results from models: {prettyNum(cor_value[['estimate']])} (spearman)"))
pp(file = "images/compare_cf_and_visit_in_model_eosinophil_adjp.svg")
adjp_plot
dev.off()## png
## 2adjp_plot
previous_sig_idx <- big_table[["deseq_adjp"]] <= 0.05 & abs(big_table[["deseq_logfc"]] >= 1.0)
summary(previous_sig_idx)## Mode FALSE TRUE
## logical 10416 116previous_genes <- rownames(big_table)[previous_sig_idx]
new_sig_idx <- abs(deseq_table[["log2FoldChange"]]) >= 1.0 & deseq_table[["padj"]] < 0.05
new_genes <- rownames(deseq_table)[new_sig_idx]
na_idx <- is.na(new_genes)
new_genes <- new_genes[!na_idx]
Vennerable::Venn(list("previous" = previous_genes, "new" = new_genes))## A Venn object on 2 sets named
## previous,new
## 00 10 01 11
## 0 38 193 78test_new <- simple_gprofiler(new_genes)
test_new## A set of ontologies produced by gprofiler using 271
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 11 MF
## 186 BP
## 4 KEGG
## 6 REAC
## 5 WP
## 7 TF
## 0 MIRNA
## 1 HPA
## 0 CORUM
## 0 HP hits.test_old <- simple_gprofiler(previous_genes)
test_old## A set of ontologies produced by gprofiler using 116
## genes against the hsapiens annotations and significance cutoff 0.05.
## There are:
## 26 MF
## 112 BP
## 3 KEGG
## 7 REAC
## 4 WP
## 72 TF
## 1 MIRNA
## 0 HPA
## 0 CORUM
## 0 HP hits.new_annotated <- merge(fData(t_eosinophils), deseq_table, by = "row.names")
rownames(new_annotated) <- new_annotated[["Row.names"]]
new_annotated[["Row.names"]] <- NULL
write_xlsx(data = new_annotated, excel = "excel/eosinophil_visit_in_model_sva_cf_new.xlsx")## write_xlsx() wrote excel/eosinophil_visit_in_model_sva_cf_new.xlsx.
## The cursor is on sheet first, row: 17303 column: 23.old_annotated <- merge(fData(t_eosinophils), big_table, by = "row.names")
rownames(old_annotated) <- old_annotated[["Row.names"]]
old_annotated[["Row.names"]] <- NULL
write_xlsx(data = old_annotated, excel = "excel/eosinophil_visit_in_model_sva_cf_old.xlsx")## write_xlsx() wrote excel/eosinophil_visit_in_model_sva_cf_old.xlsx.
## The cursor is on sheet first, row: 10535 column: 76.8.0.3.1 C/F celltype volcano plots with specific labels
8.0.4 Figure 4B: Volcano plots
Note to self, when I rendered the html, stupid R ran out of temp files and so did not actually print the darn html document, as a result I modified the render function to try to make sure there is a clean directory in which to work; testing now. If it continues to not work, I will need to remove some of the images created in this document.
num_color <- color_choices[["clinic_cf"]][["tumaco_failure"]]
den_color <- color_choices[["clinic_cf"]][["tumaco_cure"]]
wanted_genes <- c("FI44L", "IFI27", "PRR5", "PRR5-ARHGAP8", "RHCE",
"FBXO39", "RSAD2", "SMTNL1", "USP18", "AFAP1")
cf_monocyte_table <- t_cf_monocyte_table_sva[["data"]][["outcome"]]
cf_monocyte_volcano <- plot_volcano_condition_de(
cf_monocyte_table, "outcome", label = wanted_genes,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = "figures/cf_monocyte_volcano_labeled.svg")
cf_monocyte_volcano[["plot"]]
dev.off()## png
## 2cf_monocyte_volcano[["plot"]]
cf_monocyte_volcano_top10 <- plot_volcano_condition_de(
cf_monocyte_table, "outcome", label = 10,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = glue("images/cf_monocyte_volcano_labeled_top10-v{ver}.svg"))
cf_monocyte_volcano_top10[["plot"]]
dev.off()## png
## 2cf_monocyte_volcano_top10[["plot"]]
cf_eosinophil_table <- t_cf_eosinophil_table_sva[["data"]][["outcome"]]
cf_eosinophil_volcano <- plot_volcano_condition_de(
cf_eosinophil_table, "outcome", label = wanted_genes,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = "figures/cf_eosinophil_volcano_labeled.svg")
cf_eosinophil_volcano[["plot"]]
dev.off()## png
## 2cf_eosinophil_volcano[["plot"]]
cf_eosinophil_volcano_top10 <- plot_volcano_condition_de(
cf_eosinophil_table, "outcome", label = 10,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = glue("images/cf_eosinophil_volcano_labeled_top10-v{ver}.svg"))
cf_eosinophil_volcano_top10[["plot"]]
dev.off()## png
## 2cf_eosinophil_volcano_top10[["plot"]]
cf_neutrophil_table <- t_cf_neutrophil_table_sva[["data"]][["outcome"]]
cf_neutrophil_volcano <- plot_volcano_condition_de(
cf_neutrophil_table, "outcome", label = wanted_genes,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = "figures/cf_neutrophil_volcano_labeled.svg")
cf_neutrophil_volcano[["plot"]]
dev.off()## png
## 2cf_neutrophil_volcano[["plot"]]
cf_neutrophil_volcano_top10 <- plot_volcano_condition_de(
cf_neutrophil_table, "outcome", label = 10,
fc_col = "deseq_logfc", p_col = "deseq_adjp", line_position = NULL,
color_high = num_color, color_low = den_color, label_size = 6)
pp(file = glue("images/cf_neutrophil_volcano_labeled_top10-v{ver}.svg"))
cf_neutrophil_volcano_top10[["plot"]]
dev.off()## png
## 2cf_neutrophil_volcano_top10[["plot"]]
8.0.5 Eosinophil time comparisons
t_cf_eosinophil_v1_de_sva <- all_pairwise(tv1_eosinophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 5 3## Removing 0 low-count genes (9979 remaining).## Setting 57 low elements to zero.## transform_counts: Found 57 values equal to 0, adding 1 to the matrix.t_cf_eosinophil_v1_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8464
## limma_vs_edger 0.8498
## limma_vs_basic 0.9207
## limma_vs_noiseq -0.8343
## deseq_vs_edger 0.9996
## deseq_vs_basic 0.8703
## deseq_vs_noiseq -0.7805
## edger_vs_basic 0.8716
## edger_vs_noiseq -0.7849
## basic_vs_noiseq -0.8407t_cf_eosinophil_v1_table_sva <- combine_de_tables(
t_cf_eosinophil_v1_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_v1_cf_table_sva-v{ver}.xlsx"))
t_cf_eosinophil_v1_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 13 19 11
## edger_sigdown limma_sigup limma_sigdown
## 1 10 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_eosinophil_v1_sig_sva <- extract_significant_genes(
t_cf_eosinophil_v1_table_sva,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_v1_cf_sig_sva-v{ver}.xlsx"))
t_cf_eosinophil_v1_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 13 19 11
## edger_sigdown limma_sigup limma_sigdown
## 1 10 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?
## Plot describing unique/shared genes in a differential expression table.
dim(t_cf_eosinophil_v1_sig_sva$deseq$ups[[1]])## [1] 13 59dim(t_cf_eosinophil_v1_sig_sva$deseq$downs[[1]])## [1] 19 59t_cf_eosinophil_v2_de_sva <- all_pairwise(tv2_eosinophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 6 3## Removing 0 low-count genes (10117 remaining).## Setting 90 low elements to zero.## transform_counts: Found 90 values equal to 0, adding 1 to the matrix.t_cf_eosinophil_v2_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.8540
## limma_vs_edger 0.8581
## limma_vs_basic 0.8936
## limma_vs_noiseq -0.7843
## deseq_vs_edger 0.9996
## deseq_vs_basic 0.8446
## deseq_vs_noiseq -0.8331
## edger_vs_basic 0.8465
## edger_vs_noiseq -0.8359
## basic_vs_noiseq -0.8616t_cf_eosinophil_v2_table_sva <- combine_de_tables(
t_cf_eosinophil_v2_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_v2_cf_table_sva-v{ver}.xlsx"))
t_cf_eosinophil_v2_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 9 4 10
## edger_sigdown limma_sigup limma_sigdown
## 1 1 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_eosinophil_v2_sig_sva <- extract_significant_genes(
t_cf_eosinophil_v2_table_sva,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_v2_cf_sig_sva-v{ver}.xlsx"))
t_cf_eosinophil_v2_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 10 1 9 4 0
## basic_down
## outcome 0
dim(t_cf_eosinophil_v2_sig_sva$deseq$ups[[1]])## [1] 9 59dim(t_cf_eosinophil_v2_sig_sva$deseq$downs[[1]])## [1] 4 59t_cf_eosinophil_v3_de_sva <- all_pairwise(tv3_eosinophils, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## tumaco_cure tumaco_failure
## 6 3## Removing 0 low-count genes (10080 remaining).## Setting 48 low elements to zero.## transform_counts: Found 48 values equal to 0, adding 1 to the matrix.t_cf_eosinophil_v3_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## tmc_flr___
## limma_vs_deseq 0.9137
## limma_vs_edger 0.9138
## limma_vs_basic 0.8620
## limma_vs_noiseq -0.7838
## deseq_vs_edger 1.0000
## deseq_vs_basic 0.8019
## deseq_vs_noiseq -0.8252
## edger_vs_basic 0.8021
## edger_vs_noiseq -0.8258
## basic_vs_noiseq -0.8696t_cf_eosinophil_v3_table_sva <- combine_de_tables(
t_cf_eosinophil_v3_de_sva, keepers = t_cf_contrast,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_v3_cf_table_sva-v{ver}.xlsx"))
t_cf_eosinophil_v3_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup
## 1 tumaco_failure_vs_tumaco_cure 68 29 73
## edger_sigdown limma_sigup limma_sigdown
## 1 10 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_cf_eosinophil_v3_sig_sva <- extract_significant_genes(
t_cf_eosinophil_v3_table_sva,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_v3_cf_sig_sva-v{ver}.xlsx"))
t_cf_eosinophil_v3_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## outcome 0 0 73 10 68 29 0
## basic_down
## outcome 0
dim(t_cf_eosinophil_v3_sig_sva$deseq$ups[[1]])## [1] 68 59dim(t_cf_eosinophil_v3_sig_sva$deseq$downs[[1]])## [1] 29 598.0.5.1 Eosinophils: Compare sva to batch-in-visit
sva_aucc <- calculate_aucc(t_cf_eosinophil_table_sva[["data"]][[1]],
tbl2 = t_cf_eosinophil_table_batchvisit[["data"]][[1]],
py = "deseq_adjp", ly = "deseq_logfc")
sva_aucc## These two tables have an aucc value of: 0.576029928864987 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 152, df = 10530, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.823 0.835
## sample estimates:
## cor
## 0.8291
shared_ids <- rownames(t_cf_eosinophil_table_sva[["data"]][[1]]) %in%
rownames(t_cf_eosinophil_table_batchvisit[["data"]][[1]])
first <- t_cf_eosinophil_table_sva[["data"]][[1]][shared_ids, ]
second <- t_cf_eosinophil_table_batchvisit[["data"]][[1]][rownames(first), ]
cor.test(first[["deseq_logfc"]], second[["deseq_logfc"]])##
## Pearson's product-moment correlation
##
## data: first[["deseq_logfc"]] and second[["deseq_logfc"]]
## t = 152, df = 10530, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.823 0.835
## sample estimates:
## cor
## 0.82918.0.5.2 Compare monocyte CF, neutrophil CF, eosinophil CF
t_mono_neut_sva_aucc <- calculate_aucc(t_cf_monocyte_table_sva[["data"]][["outcome"]],
tbl2 = t_cf_neutrophil_table_sva[["data"]][["outcome"]],
py = "deseq_adjp", ly = "deseq_logfc")
t_mono_neut_sva_aucc## These two tables have an aucc value of: 0.204316386168083 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 43, df = 8577, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.4028 0.4376
## sample estimates:
## cor
## 0.4203
t_mono_eo_sva_aucc <- calculate_aucc(t_cf_monocyte_table_sva[["data"]][["outcome"]],
tbl2 = t_cf_eosinophil_table_sva[["data"]][["outcome"]],
py = "deseq_adjp", ly = "deseq_logfc")
t_mono_eo_sva_aucc## These two tables have an aucc value of: 0.0963678364630121 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 22, df = 9765, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.2015 0.2393
## sample estimates:
## cor
## 0.2205
t_neut_eo_sva_aucc <- calculate_aucc(t_cf_neutrophil_table_sva[["data"]][["outcome"]],
tbl2 = t_cf_eosinophil_table_sva[["data"]][["outcome"]],
py = "deseq_adjp", ly = "deseq_logfc")
t_neut_eo_sva_aucc## These two tables have an aucc value of: 0.20148477670576 and correlation:##
## Pearson's product-moment correlation
##
## data: tbl[[lx]] and tbl[[ly]]
## t = 42, df = 8571, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.3973 0.4323
## sample estimates:
## cor
## 0.415
8.0.6 By visit
For these contrasts, we want to see fail_v1 vs. cure_v1, fail_v2 vs. cure_v2 etc. As a result, we will need to juggle the data slightly and add another set of contrasts.
8.0.6.1 Cure/Fail by visits, all cell types
t_visit_cf_all_de_sva <- all_pairwise(t_visitcf, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## v1_cure v1_failure v2_cure v2_failure v3_cure v3_failure
## 30 24 20 15 17 17## Removing 0 low-count genes (14156 remaining).## Setting 17160 low elements to zero.## transform_counts: Found 17160 values equal to 0, adding 1 to the matrix.t_visit_cf_all_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_cf_all_table_sva <- combine_de_tables(
t_visit_cf_all_de_sva, keepers = visitcf_contrasts,
excel = glue("{cf_prefix}/t_all_visitcf_table_sva-v{ver}.xlsx"))
t_visit_cf_all_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 v1_failure_vs_v1_cure 26 76 26 58
## 2 v2_failure_vs_v2_cure 51 41 43 28
## 3 v3_failure_vs_v3_cure 77 32 33 25
## limma_sigup limma_sigdown
## 1 9 17
## 2 3 0
## 3 3 0## Plot describing unique/shared genes in a differential expression table.
t_visit_cf_all_sig_sva <- extract_significant_genes(
t_visit_cf_all_table_sva,
excel = glue("{cf_prefix}/t_all_visitcf_sig_sva-v{ver}.xlsx"))
t_visit_cf_all_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## v1cf 9 17 26 58 26 76 0
## v2cf 3 0 43 28 51 41 0
## v3cf 3 0 33 25 77 32 0
## basic_down
## v1cf 0
## v2cf 0
## v3cf 0
8.0.6.2 Cure/Fail by visit, Monocytes
visitcf_factor <- paste0("v", pData(t_monocytes)[["visitnumber"]], "_",
pData(t_monocytes)[["finaloutcome"]])
t_monocytes_visitcf <- set_expt_conditions(t_monocytes, fact = visitcf_factor)## The numbers of samples by condition are:##
## v1_cure v1_failure v2_cure v2_failure v3_cure v3_failure
## 8 8 7 6 6 7t_visit_cf_monocyte_de_sva <- all_pairwise(t_monocytes_visitcf, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## v1_cure v1_failure v2_cure v2_failure v3_cure v3_failure
## 8 8 7 6 6 7## Removing 0 low-count genes (10862 remaining).## Setting 700 low elements to zero.## transform_counts: Found 700 values equal to 0, adding 1 to the matrix.t_visit_cf_monocyte_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_cf_monocyte_table_sva <- combine_de_tables(
t_visit_cf_monocyte_de_sva, keepers = visitcf_contrasts,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_visitcf_table_sva-v{ver}.xlsx"))
t_visit_cf_monocyte_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 v1_failure_vs_v1_cure 15 10 10 13
## 2 v2_failure_vs_v2_cure 0 0 0 0
## 3 v3_failure_vs_v3_cure 0 0 0 0
## limma_sigup limma_sigdown
## 1 1 1
## 2 0 0
## 3 0 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_visit_cf_monocyte_sig_sva <- extract_significant_genes(
t_visit_cf_monocyte_table_sva,
excel = glue("{cf_prefix}/Monocytes/t_monocyte_visitcf_sig_sva-v{ver}.xlsx"))
t_visit_cf_monocyte_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## v1cf 1 1 10 13 15 10 0
## v2cf 0 0 0 0 0 0 0
## v3cf 0 0 0 0 0 0 0
## basic_down
## v1cf 0
## v2cf 0
## v3cf 0
t_v1fc_deseq_ma <- t_visit_cf_monocyte_table_sva[["plots"]][["v1cf"]][["deseq_ma_plots"]][["plot"]]
dev <- pp(file = "images/monocyte_cf_de_v1_maplot.png")
t_v1fc_deseq_ma## NULLclosed <- dev.off()
t_v1fc_deseq_ma## NULLt_v2fc_deseq_ma <- t_visit_cf_monocyte_table_sva[["plots"]][["v2cf"]][["deseq_ma_plots"]][["plot"]]
dev <- pp(file = "images/monocyte_cf_de_v2_maplot.png")
t_v2fc_deseq_ma## NULLclosed <- dev.off()
t_v2fc_deseq_ma## NULLt_v3fc_deseq_ma <- t_visit_cf_monocyte_table_sva[["plots"]][["v3cf"]][["deseq_ma_plots"]][["plot"]]
dev <- pp(file = "images/monocyte_cf_de_v3_maplot.png")
t_v3fc_deseq_ma## NULLclosed <- dev.off()
t_v3fc_deseq_ma## NULLOne query from Alejandro is to look at the genes shared up/down across visits. I am not entirely certain we have enough samples for this to work, but let us find out.
I am thinking this is a good place to use the AUCC curves I learned about thanks to Julie Cridland.
Note that the following is all monocyte samples, this should therefore potentially be moved up and a version of this with only the Tumaco samples put here?
v1cf <- t_visit_cf_monocyte_table_sva[["data"]][["v1cf"]]
v2cf <- t_visit_cf_monocyte_table_sva[["data"]][["v2cf"]]
v3cf <- t_visit_cf_monocyte_table_sva[["data"]][["v3cf"]]
v1_sig <- c(
rownames(t_visit_cf_monocyte_sig_sva[["deseq"]][["ups"]][["v1cf"]]),
rownames(t_visit_cf_monocyte_sig_sva[["deseq"]][["downs"]][["v1cf"]]))
length(v1_sig)## [1] 25v2_sig <- c(
rownames(t_visit_cf_monocyte_sig_sva[["deseq"]][["ups"]][["v2cf"]]),
rownames(t_visit_cf_monocyte_sig_sva[["deseq"]][["downs"]][["v2cf"]]))
length(v2_sig)## [1] 0v3_sig <- c(
rownames(t_visit_cf_monocyte_sig_sva[["deseq"]][["ups"]][["v2cf"]]),
rownames(t_visit_cf_monocyte_sig_sva[["deseq"]][["downs"]][["v2cf"]]))
length(v3_sig)## [1] 0t_monocyte_visit_aucc_v2v1 <- calculate_aucc(v1cf, tbl2 = v2cf,
py = "deseq_adjp", ly = "deseq_logfc")
dev <- pp(file = "images/monocyte_visit_v2v1_aucc.png")
t_monocyte_visit_aucc_v2v1[["plot"]]
closed <- dev.off()
t_monocyte_visit_aucc_v2v1[["plot"]]
t_monocyte_visit_aucc_v3v1 <- calculate_aucc(v1cf, tbl2 = v3cf,
py = "deseq_adjp", ly = "deseq_logfc")
dev <- pp(file = "images/monocyte_visit_v3v1_aucc.png")
t_monocyte_visit_aucc_v3v1[["plot"]]
closed <- dev.off()
t_monocyte_visit_aucc_v3v1[["plot"]]
8.0.6.3 Cure/Fail by visit, Neutrophils
visitcf_factor <- paste0("v", pData(t_neutrophils)[["visitnumber"]], "_",
pData(t_neutrophils)[["finaloutcome"]])
t_neutrophil_visitcf <- set_expt_conditions(t_neutrophils, fact = visitcf_factor)## The numbers of samples by condition are:##
## v1_cure v1_failure v2_cure v2_failure v3_cure v3_failure
## 8 8 7 6 5 7t_visit_cf_neutrophil_de_sva <- all_pairwise(t_neutrophil_visitcf, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## v1_cure v1_failure v2_cure v2_failure v3_cure v3_failure
## 8 8 7 6 5 7## Removing 0 low-count genes (9101 remaining).## Setting 685 low elements to zero.## transform_counts: Found 685 values equal to 0, adding 1 to the matrix.t_visit_cf_neutrophil_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_cf_neutrophil_table_sva <- combine_de_tables(
t_visit_cf_neutrophil_de_sva, keepers = visitcf_contrasts,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_visitcf_table_sva-v{ver}.xlsx"))
t_visit_cf_neutrophil_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 v1_failure_vs_v1_cure 12 6 6 6
## 2 v2_failure_vs_v2_cure 2 6 2 3
## 3 v3_failure_vs_v3_cure 2 2 0 2
## limma_sigup limma_sigdown
## 1 1 0
## 2 0 0
## 3 0 0## Plot describing unique/shared genes in a differential expression table.
t_visit_cf_neutrophil_sig_sva <- extract_significant_genes(
t_visit_cf_neutrophil_table_sva,
excel = glue("{cf_prefix}/Neutrophils/t_neutrophil_visitcf_sig_sva-v{ver}.xlsx"))
t_visit_cf_neutrophil_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## v1cf 1 0 6 6 12 6 0
## v2cf 0 0 2 3 2 6 0
## v3cf 0 0 0 2 2 2 0
## basic_down
## v1cf 0
## v2cf 0
## v3cf 0
8.0.6.4 Cure/Fail by visit, Eosinophils
visitcf_factor <- paste0("v", pData(t_eosinophils)[["visitnumber"]], "_",
pData(t_eosinophils)[["finaloutcome"]])
t_eosinophil_visitcf <- set_expt_conditions(t_eosinophils, fact = visitcf_factor)## The numbers of samples by condition are:##
## v1_cure v1_failure v2_cure v2_failure v3_cure v3_failure
## 5 3 6 3 6 3t_visit_cf_eosinophil_de_sva <- all_pairwise(t_eosinophil_visitcf, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## v1_cure v1_failure v2_cure v2_failure v3_cure v3_failure
## 5 3 6 3 6 3## Removing 0 low-count genes (10532 remaining).## Setting 373 low elements to zero.## transform_counts: Found 373 values equal to 0, adding 1 to the matrix.t_visit_cf_eosinophil_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_cf_eosinophil_table_sva <- combine_de_tables(
t_visit_cf_eosinophil_de_sva, keepers = visitcf_contrasts,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_visitcf_table_sva-v{ver}.xlsx"))
t_visit_cf_eosinophil_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 v1_failure_vs_v1_cure 9 11 2 3
## 2 v2_failure_vs_v2_cure 4 3 5 2
## 3 v3_failure_vs_v3_cure 14 7 17 2
## limma_sigup limma_sigdown
## 1 0 1
## 2 0 0
## 3 0 0## Plot describing unique/shared genes in a differential expression table.
t_visit_cf_eosinophil_sig_sva <- extract_significant_genes(
t_visit_cf_eosinophil_table_sva,
excel = glue("{cf_prefix}/Eosinophils/t_eosinophil_visitcf_sig_sva-v{ver}.xlsx"))
t_visit_cf_eosinophil_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## v1cf 0 1 2 3 9 11 0
## v2cf 0 0 5 2 4 3 0
## v3cf 0 0 17 2 14 7 0
## basic_down
## v1cf 0
## v2cf 0
## v3cf 0
8.1 Persistence in visit 3
Having put some SL read mapping information in the sample sheet, Maria Adelaida added a new column using it with the putative persistence state on a per-sample basis. One question which arised from that: what differences are observable between the persistent yes vs. no samples on a per-cell-type basis among the visit 3 samples.
8.1.1 Setting up
First things first, create the datasets.
persistence_expt <- subset_expt(t_clinical, subset = "persistence=='Y'|persistence=='N'") %>%
subset_expt(subset = 'visitnumber==3') %>%
set_expt_conditions(fact = 'persistence')## subset_expt(): There were 123, now there are 83 samples.## subset_expt(): There were 83, now there are 30 samples.## The numbers of samples by condition are:##
## N Y
## 6 24## persistence_biopsy <- subset_expt(persistence_expt, subset = "typeofcells=='biopsy'")
persistence_monocyte <- subset_expt(persistence_expt, subset = "typeofcells=='monocytes'")## subset_expt(): There were 30, now there are 12 samples.persistence_neutrophil <- subset_expt(persistence_expt, subset = "typeofcells=='neutrophils'")## subset_expt(): There were 30, now there are 10 samples.persistence_eosinophil <- subset_expt(persistence_expt, subset = "typeofcells=='eosinophils'")## subset_expt(): There were 30, now there are 8 samples.8.1.2 Take a look
See if there are any patterns which look usable.
## All
persistence_norm <- normalize_expt(persistence_expt, transform = "log2", convert = "cpm",
norm = "quant", filter = TRUE)## Removing 8563 low-count genes (11389 remaining).## transform_counts: Found 15 values equal to 0, adding 1 to the matrix.plot_pca(persistence_norm)[["plot"]]
persistence_nb <- normalize_expt(persistence_expt, transform = "log2", convert = "cpm",
batch = "svaseq", filter = TRUE)## Removing 8563 low-count genes (11389 remaining).## Setting 1544 low elements to zero.## transform_counts: Found 1544 values equal to 0, adding 1 to the matrix.plot_pca(persistence_nb)[["plot"]]
## Biopsies
##persistence_biopsy_norm <- normalize_expt(persistence_biopsy, transform = "log2", convert = "cpm",
## norm = "quant", filter = TRUE)
##plot_pca(persistence_biopsy_norm)[["plot"]]
## Insufficient data
## Monocytes
persistence_monocyte_norm <- normalize_expt(persistence_monocyte, transform = "log2", convert = "cpm",
norm = "quant", filter = TRUE)## Removing 9623 low-count genes (10329 remaining).## transform_counts: Found 1 values equal to 0, adding 1 to the matrix.plot_pca(persistence_monocyte_norm)[["plot"]]
persistence_monocyte_nb <- normalize_expt(persistence_monocyte, transform = "log2", convert = "cpm",
batch = "svaseq", filter = TRUE)## Removing 9623 low-count genes (10329 remaining).## Setting 47 low elements to zero.## transform_counts: Found 47 values equal to 0, adding 1 to the matrix.plot_pca(persistence_monocyte_nb)[["plot"]]
## Neutrophils
persistence_neutrophil_norm <- normalize_expt(persistence_neutrophil, transform = "log2", convert = "cpm",
norm = "quant", filter = TRUE)## Removing 11558 low-count genes (8394 remaining).## transform_counts: Found 2 values equal to 0, adding 1 to the matrix.plot_pca(persistence_neutrophil_norm)[["plot"]]
persistence_neutrophil_nb <- normalize_expt(persistence_neutrophil, transform = "log2", convert = "cpm",
batch = "svaseq", filter = TRUE)## Removing 11558 low-count genes (8394 remaining).## Setting 46 low elements to zero.## transform_counts: Found 46 values equal to 0, adding 1 to the matrix.plot_pca(persistence_neutrophil_nb)[["plot"]]
## Eosinophils
persistence_eosinophil_norm <- normalize_expt(persistence_eosinophil, transform = "log2", convert = "cpm",
norm = "quant", filter = TRUE)## Removing 9922 low-count genes (10030 remaining).## transform_counts: Found 1 values equal to 0, adding 1 to the matrix.plot_pca(persistence_eosinophil_norm)[["plot"]]
persistence_eosinophil_nb <- normalize_expt(persistence_eosinophil, transform = "log2", convert = "cpm",
batch = "svaseq", filter = TRUE)## Removing 9922 low-count genes (10030 remaining).## Setting 25 low elements to zero.## transform_counts: Found 25 values equal to 0, adding 1 to the matrix.plot_pca(persistence_eosinophil_nb)[["plot"]]
8.1.3 persistence DE
persistence_de_sva <- all_pairwise(persistence_expt, filter = TRUE, methods = methods,
parallel = parallel, model_batch = "svaseq")##
## N Y
## 6 24## Removing 0 low-count genes (11389 remaining).## Setting 1544 low elements to zero.## transform_counts: Found 1544 values equal to 0, adding 1 to the matrix.persistence_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## Y_vs_N
## limma_vs_deseq 0.8112
## limma_vs_edger 0.8765
## limma_vs_basic 0.8217
## limma_vs_noiseq -0.6444
## deseq_vs_edger 0.9605
## deseq_vs_basic 0.7178
## deseq_vs_noiseq -0.5868
## edger_vs_basic 0.7791
## edger_vs_noiseq -0.6432
## basic_vs_noiseq -0.7960persistence_table_sva <- combine_de_tables(
persistence_de_sva,
excel = glue("{xlsx_prefix}/DE_Persistence/persistence_all_de_sva-v{ver}.xlsx"))
persistence_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown limma_sigup
## 1 Y_vs_N 55 44 26 49 7
## limma_sigdown
## 1 22## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
persistence_monocyte_de_sva <- all_pairwise(persistence_monocyte, filter = TRUE,
parallel = parallel, model_batch = "svaseq",
methods = methods)##
## N Y
## 2 10## Removing 0 low-count genes (10329 remaining).## Setting 47 low elements to zero.## transform_counts: Found 47 values equal to 0, adding 1 to the matrix.persistence_monocyte_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## Y_vs_N
## limma_vs_deseq 0.9260
## limma_vs_edger 0.9270
## limma_vs_basic 0.9858
## limma_vs_noiseq -0.9013
## deseq_vs_edger 1.0000
## deseq_vs_basic 0.9237
## deseq_vs_noiseq -0.9181
## edger_vs_basic 0.9245
## edger_vs_noiseq -0.9193
## basic_vs_noiseq -0.9039persistence_monocyte_table_sva <- combine_de_tables(
persistence_monocyte_de_sva,
excel = glue("{xlsx_prefix}/DE_Persistence/persistence_monocyte_de_sva-v{ver}.xlsx"))
persistence_monocyte_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown limma_sigup
## 1 Y_vs_N 1 0 0 1 0
## limma_sigdown
## 1 0## Only Y_vs_N_up has information, cannot create an UpSet.## Plot describing unique/shared genes in a differential expression table.## NULLpersistence_neutrophil_de_sva <- all_pairwise(persistence_neutrophil, filter = TRUE,
parallel = parallel, model_batch = "svaseq",
methods = methods)##
## N Y
## 3 7## Removing 0 low-count genes (8394 remaining).## Setting 46 low elements to zero.## transform_counts: Found 46 values equal to 0, adding 1 to the matrix.persistence_neutrophil_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## Y_vs_N
## limma_vs_deseq 0.9407
## limma_vs_edger 0.9408
## limma_vs_basic 0.8808
## limma_vs_noiseq -0.7817
## deseq_vs_edger 0.9985
## deseq_vs_basic 0.8270
## deseq_vs_noiseq -0.7593
## edger_vs_basic 0.8283
## edger_vs_noiseq -0.7602
## basic_vs_noiseq -0.9003persistence_neutrophil_table_sva <- combine_de_tables(
persistence_neutrophil_de_sva,
excel = glue("{xlsx_prefix}/DE_Persistence/persistence_neutrophil_de_sva-v{ver}.xlsx"))
persistence_neutrophil_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown limma_sigup
## 1 Y_vs_N 26 49 17 35 0
## limma_sigdown
## 1 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
## There are insufficient samples (1) in the 'N' category.
##persistence_eosinophil_de_sva <- all_pairwise(persistence_eosinophil, filter = TRUE,
## parallel = parallel, model_batch = "svaseq",
## methods = methods)
##persistence_eosinophil_de_sva
##persistence_eosinophil_table_sva <- combine_de_tables(
## persistence_eosinophil_de_sva,
## excel = glue("{xlsx_prefix}/DE_Persistence/persistence_eosinophil_de_sva-v{ver}.xlsx"))8.2 Comparing visits without regard to cure/fail
8.2.1 All cell types
t_visit_all_de_sva <- all_pairwise(t_visit, filter = TRUE, methods = methods,
parallel = parallel, model_batch = "svaseq")##
## 3 2 1
## 34 35 40## Removing 0 low-count genes (11910 remaining).## Setting 9636 low elements to zero.## transform_counts: Found 9636 values equal to 0, adding 1 to the matrix.t_visit_all_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_all_table_sva <- combine_de_tables(
t_visit_all_de_sva, keepers = visit_contrasts,
excel = glue("{xlsx_prefix}/DE_Visits/t_all_visit_table_sva-v{ver}.xlsx"))
t_visit_all_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown limma_sigup
## 1 c2_vs_c1 25 9 20 10 19
## 2 c3_vs_c1 20 20 18 16 21
## 3 c3_vs_c2 0 2 0 2 0
## limma_sigdown
## 1 7
## 2 7
## 3 0## Plot describing unique/shared genes in a differential expression table.
t_visit_all_sig_sva <- extract_significant_genes(
t_visit_all_table_sva,
excel = glue("{xlsx_prefix}/DE_Visits/t_all_visit_sig_sva-v{ver}.xlsx"))
t_visit_all_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## v2v1 19 7 20 10 25 9 0
## v3v1 21 7 18 16 20 20 0
## v3v2 0 0 0 2 0 2 0
## basic_down
## v2v1 0
## v3v1 0
## v3v2 0
8.2.2 Monocyte samples
t_visit_monocytes <- set_expt_conditions(t_monocytes, fact = "visitnumber")## The numbers of samples by condition are:##
## 3 2 1
## 13 13 16t_visit_monocyte_de_sva <- all_pairwise(t_visit_monocytes, filter = TRUE,
parallel = parallel, model_batch = "svaseq",
methods = methods)##
## 3 2 1
## 13 13 16## Removing 0 low-count genes (10862 remaining).## Setting 658 low elements to zero.## transform_counts: Found 658 values equal to 0, adding 1 to the matrix.t_visit_monocyte_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_monocyte_table_sva <- combine_de_tables(
t_visit_monocyte_de_sva, keepers = visit_contrasts,
excel = glue("{xlsx_prefix}/DE_Visits/Monocytes/t_monocyte_visit_table_sva-v{ver}.xlsx"))
t_visit_monocyte_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown limma_sigup
## 1 c2_vs_c1 1 2 1 1 0
## 2 c3_vs_c1 2 1 1 1 0
## 3 c3_vs_c2 0 0 0 0 0
## limma_sigdown
## 1 0
## 2 0
## 3 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
t_visit_monocyte_sig_sva <- extract_significant_genes(
t_visit_monocyte_table_sva,
excel = glue("{xlsx_prefix}/DE_Visits/Monocytes/t_monocyte_visit_sig_sva-v{ver}.xlsx"))
t_visit_monocyte_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## v2v1 0 0 1 1 1 2 0
## v3v1 0 0 1 1 2 1 0
## v3v2 0 0 0 0 0 0 0
## basic_down
## v2v1 0
## v3v1 0
## v3v2 0
8.2.3 Neutrophil samples
t_visit_neutrophils <- set_expt_conditions(t_neutrophils, fact = "visitnumber")## The numbers of samples by condition are:##
## 3 2 1
## 12 13 16t_visit_neutrophil_de_sva <- all_pairwise(t_visit_neutrophils, filter = TRUE,
parallel = parallel, model_batch = "svaseq",
methods = methods)##
## 3 2 1
## 12 13 16## Removing 0 low-count genes (9101 remaining).## Setting 593 low elements to zero.## transform_counts: Found 593 values equal to 0, adding 1 to the matrix.t_visit_neutrophil_de_sva## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_neutrophil_table_sva <- combine_de_tables(
t_visit_neutrophil_de_sva, keepers = visit_contrasts,
excel = glue("{xlsx_prefix}/DE_Visits/Neutrophils/t_neutrophil_visit_table_sva-v{ver}.xlsx"))
t_visit_neutrophil_table_sva## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown limma_sigup
## 1 c2_vs_c1 111 88 111 88 116
## 2 c3_vs_c1 127 45 122 44 93
## 3 c3_vs_c2 1 0 0 0 0
## limma_sigdown
## 1 52
## 2 67
## 3 0## Plot describing unique/shared genes in a differential expression table.
t_visit_neutrophil_sig_sva <- extract_significant_genes(
t_visit_neutrophil_table_sva,
excel = glue("{xlsx_prefix}/DE_Visits/Neutrophils/t_neutrophil_visit_sig_sva-v{ver}.xlsx"))
t_visit_neutrophil_sig_sva## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down basic_up
## v2v1 116 52 111 88 111 88 83
## v3v1 93 67 122 44 127 45 52
## v3v2 0 0 0 0 1 0 0
## basic_down
## v2v1 35
## v3v1 17
## v3v2 0
8.2.4 Eosinophil samples
t_visit_eosinophils <- set_expt_conditions(t_eosinophils, fact="visitnumber")## The numbers of samples by condition are:##
## 3 2 1
## 9 9 8t_visit_eosinophil_de <- all_pairwise(t_visit_eosinophils, filter = TRUE,
parallel = parallel, model_batch = "svaseq",
methods = methods)##
## 3 2 1
## 9 9 8## Removing 0 low-count genes (10532 remaining).## Setting 271 low elements to zero.## transform_counts: Found 271 values equal to 0, adding 1 to the matrix.
t_visit_eosinophil_de## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_visit_eosinophil_table <- combine_de_tables(
t_visit_eosinophil_de, keepers = visit_contrasts,
excel = glue("{xlsx_prefix}/DE_Visits/Eosinophils/t_eosinophil_visit_table_sva-v{ver}.xlsx"))
t_visit_eosinophil_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown limma_sigup
## 1 c2_vs_c1 0 0 0 0 0
## 2 c3_vs_c1 0 0 0 0 0
## 3 c3_vs_c2 0 0 0 0 0
## limma_sigdown
## 1 0
## 2 0
## 3 0## Only has information, cannot create an UpSet.## Plot describing unique/shared genes in a differential expression table.## NULLt_visit_eosinophil_sig <- extract_significant_genes(
t_visit_eosinophil_table,
excel = glue("{xlsx_prefix}/DE_Visits/Eosinophils/t_eosinophil_visit_sig_sva-v{ver}.xlsx"))
## No significant genes observed.9 Explore ROC
Alejandro showed some ROC curves for eosinophil data showing sensitivity vs. specificity of a couple genes which were observed in v1 eosinophils vs. all-times eosinophils across cure/fail. I am curious to better understand how this was done and what utility it might have in other contexts.
To that end, I want to try something similar myself. In order to properly perform the analysis with these various tools, I need to reconfigure the data in a pretty specific format:
- Single df with 1 row per set of observations (sample in this case I think)
- The outcome column(s) need to be 1 (or more?) metadata factor(s) (cure/fail or a paste0 of relevant queries (eo_v1_cure, eo_v123_cure, etc)
- The predictor column(s) are the measurements (rpkm of 1 or more genes), 1 column each gene.
If I intend to use this for our tx data, I will likely need a utility function to create the properly formatted input df.
For the purposes of my playing, I will choose three genes from the eosinophil C/F table, one which is significant, one which is not, and an arbitrary.
The input genes will therefore be chosen from the data structure: t_cf_eosinophil_table_sva:
ENSG00000198178, ENSG00000179344, ENSG00000182628
eo_rpkm <- normalize_expt(tv1_eosinophils, convert = "rpkm", column = "cds_length")## There appear to be 5355 genes without a length.10 An external dataset
This paper is DOI:10.1126/scitranslmed.aax4204
Variable gene expression and parasite load predict treatment outcome in cutaneous leishmaniasis.
One query from Maria Adelaida is to see how this data fits with ours. I have read this paper a couple of times now and I get confused on a couple of points every time, which I will explain in a moment. The expermental design is key to my confusion and key to what I think is being missed in our interpretation of the results:
- The PCA is not cure vs. fail but healthy skin vs. CL lesion.
10.1 Only the Scott data
external_norm <- normalize_expt(external_cf, filter = TRUE, norm = "quant",
convert = "cpm", transform = "log2")## Removing 7327 low-count genes (14154 remaining).plot_pca(external_norm)## The result of performing a fast_svd dimension reduction.
## The x-axis is PC1 and the y-axis is PC2
## Colors are defined by cure, failure
## Shapes are defined by female, male.
external_nb <- normalize_expt(external_cf, filter = TRUE, batch = "svaseq",
convert = "cpm", transform = "log2")## Removing 7327 low-count genes (14154 remaining).## Setting 171 low elements to zero.## transform_counts: Found 171 values equal to 0, adding 1 to the matrix.plot_pca(external_nb)## The result of performing a fast_svd dimension reduction.
## The x-axis is PC1 and the y-axis is PC2
## Colors are defined by cure, failure
## Shapes are defined by female, male.
external_de <- all_pairwise(external_cf, filter = TRUE, methods = methods,
parallel = parallel, model_batch = "svaseq")##
## cure failure
## 14 7## Removing 0 low-count genes (14154 remaining).## Setting 171 low elements to zero.## transform_counts: Found 171 values equal to 0, adding 1 to the matrix.external_de## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## limma_vs_deseq 0.8487
## limma_vs_edger 0.8497
## limma_vs_basic 0.4180
## limma_vs_noiseq -0.3286
## deseq_vs_edger 0.9997
## deseq_vs_basic 0.3908
## deseq_vs_noiseq -0.3756
## edger_vs_basic 0.3914
## edger_vs_noiseq -0.3768
## basic_vs_noiseq -0.9338external_table <- combine_de_tables(external_de, excel = "excel/scott_table.xlsx")
external_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 0 0 0 0
## limma_sigup limma_sigdown
## 1 0 0## Only has information, cannot create an UpSet.## Plot describing unique/shared genes in a differential expression table.## NULLexternal_sig <- extract_significant_genes(external_table, excel = "excel/scott_sig.xlsx")
external_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## failure_vs_cure 0 0 0 0 0 0
## basic_up basic_down
## failure_vs_cure 0 0external_top100 <- extract_significant_genes(external_table, n = 100)
external_up <- external_top100[["deseq"]][["ups"]][["failure_vs_cure"]]
external_down <- external_top100[["deseq"]][["downs"]][["failure_vs_cure"]]11 An explicit comparison of methods.
I think I am getting a significantly different result from Scott, so I am going to do an explicit side-by-side comparison of our results at each step. In order to do this, I am using the capsule they kindly provided with their publication.
I am copy/pasting material from their publication with some modification which I will note as I go.
Here is their block ‘r packages’
Note/Spoiler alert: It actually turns out our results are basically relatively similar, I just didn’t understand what comparisons are actually in paper vs those I have primary interest. In addition, we handled gene IDs differently (gene card vs. EnsemblID) which has a surprisingly big effect.
Oh, I just realized that when I did these analyses, I did them in a completely separate tree and compared the results post-facto. This assumption remains in this document and therefore is unlikely to work properly in the containerized environment I am attempting to create. Given that the primary goal of this section is to show to myself that I compared the two datasets as thoroughly as I could, perhaps I should just disable them for the container and allow the reader to perform the exercise de-novo.
library(tidyverse)
library(ggthemes)
library(reshape2)
library(edgeR)
library(patchwork)
library(vegan)
library(DT)
library(tximport)
library(gplots)
library(FinCal)
library(ggrepel)
library(gt)
library(ggExtra)
library(EnsDb.Hsapiens.v86)
library(stringr)
library(cowplot)
library(ggpubr)I have a separate tree in which I copied the capsule and data. I performed exactly their steps kallisto quant steps within it and put the output data into the same place within it. I did change the commands slightly because I downloaded the files from SRA and so don’t have them with names like ‘host_CL01’, but instead ‘PRJNA…’. But the samples are in the same order, so I sent the output files to the same final filenames. Here is an example from the first sample:
cd preprocessing
module add kallisto
kallisto index -i Homo_sapiens.GRCh38.cdna.all.Index Homo_sapiens.GRCh38.cdna.all.fa
# Map reads to the indexed reference transcriptome for HOST
# first the healthy subjects (HS)
export LESS = '--buffers 0 -B'
kallisto quant -i Homo_sapiens.GRCh38.cdna.all.Index -o host_HS01 -t 24 -b 60 \
--single -l 250 -s 30 <(less SRR8668755/*-trimmed.fastq.xz) 2>host_HS01.log 1>&2 &12 Block ‘sample_info’
I am going to change the path very slightly in the following block simply because I put the capsule in a separate directory and do not want to copy it here. Otherwise it is unmodified. Also, the function gt::tab_header() annoys the crap out of me.
import <- read_tsv("../scott_2019/capsule-6534016/data/studydesign.txt")
import %>% dplyr::filter(disease == "cutaneous") %>%
dplyr::select(-2) %>% gt() %>%
tab_header(title = md("Clinical metadata from patients with cutaneous leishmaniasis (CL)"),
subtitle = md("`(n=21)`")) %>% cols_align(align = "center", columns = TRUE)
targets.lesion <- import
targets.onlypatients <- targets.lesion[8:28,] # only CL lesions (n=21)
# Making factors that will be used for pairwise comparisons:
# HS vs. CL lesions as a factor:
disease.lesion <- factor(targets.lesion$disease)
# Cure vs. Failure lesions as a factor:
treatment.lesion <- factor(targets.onlypatients$treatment_outcome)13 Importing the data and annotations
They did use a slightly different annotation set, Ensembl revision 86. Once again I am modifying the paths slightly to reflect where I put the capsule.
# capturing Ensembl transcript IDs (tx) and gene symbols ("gene_name") from
# EnsDb.Hsapiens.v86 annotation package
Tx <- as.data.frame(transcripts(EnsDb.Hsapiens.v86,
columns=c(listColumns(EnsDb.Hsapiens.v86, "tx"),
"gene_name")))
Tx <- dplyr::rename(Tx, target_id = tx_id)
row.names(Tx) <- NULL
Tx <- Tx[,c(6,12)]
# getting file paths for Kallisto outputs
paths.all <- file.path("../scott_2019/capsule-6534016/data/readMapping/human", targets.lesion$sample, "abundance.h5")
paths.patients <- file.path("../scott_2019/capsule-6534016/data/readMapping/human", targets.onlypatients$sample, "abundance.h5")
# importing .h5 Kallisto data and collapsing transcript-level data to genes
Txi.lesion.coding <- tximport(paths.all,
type = "kallisto",
tx2gene = Tx,
txOut = FALSE,
ignoreTxVersion = TRUE,
countsFromAbundance = "lengthScaledTPM")
# importing againg, but this time just the CL patients
Txi.lesion.coding.onlypatients <- tximport(paths.patients,
type = "kallisto",
tx2gene = Tx,
txOut = FALSE,
ignoreTxVersion = TRUE,
countsFromAbundance = "lengthScaledTPM")14 Filtering and normalization
The block ‘visualizationDatasets’ follows unchanged. In the next block I will add another plot or perhaps 2
# First make a DGEList from the counts:
Txi.lesion.coding.DGEList <- DGEList(Txi.lesion.coding$counts)
colnames(Txi.lesion.coding.DGEList$counts) <- targets.lesion$sample
colnames(Txi.lesion.coding$counts) <- targets.lesion$sample
Txi.lesion.coding.DGEList.OP <- DGEList(Txi.lesion.coding.onlypatients$counts)
colnames(Txi.lesion.coding.DGEList.OP) <- targets.onlypatients$sample
# Convert to counts per million:
Txi.lesion.coding.DGEList.cpm <- edgeR::cpm(Txi.lesion.coding.DGEList, log = TRUE)
Txi.lesion.coding.DGEList.OP.cpm <- edgeR::cpm(Txi.lesion.coding.DGEList.OP, log = TRUE)
keepers.coding <- rowSums(Txi.lesion.coding.DGEList.cpm>1)>=7
keepers.coding.OP <- rowSums(Txi.lesion.coding.DGEList.OP.cpm>1)>=7
Txi.lesion.coding.DGEList.filtered <- Txi.lesion.coding.DGEList[keepers.coding,]
Txi.lesion.coding.DGEList.OP.filtered <- Txi.lesion.coding.DGEList.OP[keepers.coding.OP,]
# convert back to cpm:
Txi.lesion.coding.DGEList.LogCPM.filtered <- edgeR::cpm(Txi.lesion.coding.DGEList.filtered,
log=TRUE)
Txi.lesion.coding.DGEList.LogCPM.OP.filtered <- edgeR::cpm(Txi.lesion.coding.DGEList.OP.filtered,
log=TRUE)
# Normalizing data:
calcNorm1 <- calcNormFactors(Txi.lesion.coding.DGEList.filtered, method = "TMM")
calcNorm2 <- calcNormFactors(Txi.lesion.coding.DGEList.OP.filtered, method = "TMM")
Txi.lesion.coding.DGEList.LogCPM.filtered.norm <- edgeR::cpm(calcNorm1, log=TRUE)
colnames(Txi.lesion.coding.DGEList.LogCPM.filtered.norm) <- targets.lesion$sample
Txi.lesion.coding.DGEList.OP.LogCPM.filtered.norm <- edgeR::cpm(calcNorm2, log=TRUE)
colnames(Txi.lesion.coding.DGEList.OP.LogCPM.filtered.norm) <- targets.onlypatients$sample
# Raw dataset:
V1 <- as.data.frame(Txi.lesion.coding.DGEList.cpm)
colnames(V1) <- targets.lesion$sample
V1 <- melt(V1)
colnames(V1) <- c("sample","expression")
# Filtered dataset:
V1.1 <- as.data.frame(Txi.lesion.coding.DGEList.LogCPM.filtered)
colnames(V1.1) <- targets.lesion$sample
V1.1 <- melt(V1.1)
colnames(V1.1) <- c("sample","expression")
# Filtered-normalized dataset:
V1.1.1 <- as.data.frame(Txi.lesion.coding.DGEList.LogCPM.filtered.norm)
colnames(V1.1.1) <- targets.lesion$sample
V1.1.1 <- melt(V1.1.1)
colnames(V1.1.1) <- c("sample","expression")
# plotting:
ggplot(V1, aes(x=sample, y=expression, fill=sample)) +
geom_violin(trim = TRUE, show.legend = TRUE) +
stat_summary(fun.y = "median", geom = "point", shape = 95, size = 10, color = "black") +
theme_bw() +
theme(legend.position = "none", axis.title=element_text(size=7),
axis.title.x=element_blank(), axis.text=element_text(size=5),
axis.text.x = element_text(angle = 90, hjust = 1),
plot.title = element_text(size = 7)) +
ggtitle("Raw dataset") +
ggplot(V1.1, aes(x=sample, y=expression, fill=sample)) +
geom_violin(trim = TRUE, show.legend = TRUE) +
stat_summary(fun.y = "median", geom = "point", shape = 95, size = 10, color = "black") +
theme_bw() +
theme(legend.position = "none", axis.title=element_text(size=7),
axis.title.x=element_blank(), axis.text=element_text(size=5),
axis.text.x = element_text(angle = 90, hjust = 1),
plot.title = element_text(size = 7)) +
ggtitle("Filtered dataset") +
ggplot(V1.1.1, aes(x=sample, y=expression, fill=sample)) +
geom_violin(trim = TRUE, show.legend = TRUE) +
stat_summary(fun.y = "median", geom = "point", shape = 95, size = 10, color = "black") +
theme_bw() +
theme(legend.position = "none", axis.title=element_text(size=7),
axis.title.x=element_blank(), axis.text=element_text(size=5),
axis.text.x = element_text(angle = 90, hjust = 1),
plot.title = element_text(size = 7)) +
ggtitle("Filtered and normalized dataset")15 The unfiltered data
The following block in their dataset recreated the matrix without filtering and will use that for differential expression. It is a little hard to follow for me because they subset based on the sample numbers (8 to 28, which if I am not mistaken just drops the healthy samples?).
DataNotFiltered_Norm_OP <- calcNormFactors(Txi.lesion.coding.DGEList[,8:28],
method = "TMM")
DataNotFiltered_Norm_log2CPM_OP <- edgeR::cpm(DataNotFiltered_Norm_OP, log=TRUE)
colnames(DataNotFiltered_Norm_log2CPM_OP) <- targets.onlypatients$sample
CPM_normData_notfiltered_OP <- 2^(DataNotFiltered_Norm_log2CPM_OP)
#uncomment the next line to produce raw data that was uploaded to the Gene Expression Omnibus (GEO) for publication.
#write.table(Txi.lesion.coding$counts, file = "Amorim_GEO_raw.txt", sep = "\t", quote = FALSE)
# Including all the individuals (HS and CL patients) for public domain submission:
DataNotFiltered_Norm <- calcNormFactors(Txi.lesion.coding.DGEList, method = "TMM")
DataNotFiltered_Norm_log2CPM <- edgeR::cpm(DataNotFiltered_Norm, log=TRUE)
colnames(DataNotFiltered_Norm_log2CPM) <- targets.lesion$sample
CPM_normData_notfiltered <- 2^(DataNotFiltered_Norm_log2CPM)
#uncomment the next line to produce the normalized data file that was uploaded to the Gene Expression Omnibus (GEO) for publication.
#write.table(DataNotFiltered_Norm_log2CPM, "Amorim_GEO_normalized.txt", sep = "\t", quote = FALSE)16 The scott exploratory analysis
The following block generated a couple of the figures in the paper and comprise a pretty straightforward PCA. I am going to make a following block containing the same image with the cure/fail visualization using the same method/data.
pca.res <- prcomp(t(Txi.lesion.coding.DGEList.LogCPM.filtered.norm), scale.=F, retx=T)
pc.var <- pca.res$sdev^2
pc.per <- round(pc.var/sum(pc.var)*100, 1)
data.frame <- as.data.frame(pca.res$x)
# Calculate distance between samples by permanova:
allsamples.dist <- vegdist(t(2^Txi.lesion.coding.DGEList.LogCPM.filtered.norm),
method = "bray")
vegan <- adonis2(allsamples.dist~targets.lesion$disease,
data=targets.lesion,
permutations = 999, method="bray")
targets.lesion$disease
ggplot(data.frame, aes(x=PC1, y=PC2, color=factor(targets.lesion$disease))) +
geom_point(size=5, shape=20) +
theme_calc() +
theme(panel.grid.major = element_blank(), panel.grid.minor = element_blank(),
axis.text.x = element_text(size = 15, vjust = 0.5),
axis.text.y = element_text(size = 15), axis.title = element_text(size = 15),
legend.position="none") +
scale_color_manual(values = c("#073F80","#EB512C")) +
annotate("text", x=-50, y=80, label=paste("Permanova Pr(>F) =",
vegan[1,5]), size=3, fontface="bold") +
xlab(paste("PC1 -",pc.per[1],"%")) +
ylab(paste("PC2 -",pc.per[2],"%")) +
xlim(-200,110)16.0.1 My most similar pca
I just realized that somewhere along the way in creating this container, I messed up this analysis pretty badly:
- I dropped the 7 control samples.
- I am comparing cure/fail but these analyses are all control/cutaneous.
When I originally did this on my workstation I had an actual 1:1 comparison and saw that our results were quite similar. I need to bring that back into this in order to show that neither we nor they are crazy people.
Either way, I think the main takeaway is that their dataset does not spend much time looking at cure/fail but instead control/infected for a reason.
Note, the fun aspects of the experiment (time to cure, size of lesion, etc) are not annotated in the metadata provided by SRA, but instead may be found in the capsule kindly provided by the lab. As a result, I copied that file into the sample_sheets/ directory and have added it to the expressionset. There is an important caveat, though: I did not include the non-diseased samples for this comparison; as a result the disease metadata factor is boring (e.g. it is only cutaneous).
external_cf[["accession"]] <- pData(external_cf)[["sample"]]
disease_factor <- pData(external_cf)[["disease"]]
table(disease_factor)## disease_factor
## cutaneous
## 21external_disease <- set_expt_conditions(external_cf, fact = disease_factor)## The numbers of samples by condition are:##
## cutaneous
## 21external_l2cpm <- normalize_expt(external_cf, filter = TRUE,
convert = "cpm", transform = "log2")## Removing 7327 low-count genes (14154 remaining).## transform_counts: Found 165 values equal to 0, adding 1 to the matrix.plot_pca(external_l2cpm, plot_labels = "repel")## The result of performing a fast_svd dimension reduction.
## The x-axis is PC1 and the y-axis is PC2
## Colors are defined by cure, failure
## Shapes are defined by female, male.
Use the following block if you wish to bring together SRA-downloaded data with the experimental design from the Scott paper. It requires running the blocks above in which I loaded the capsule-derived metadata.
test <- pData(external_cf)
test_import <- as.data.frame(import)
test_import[["accession"]] <- pData(external_cf[["accession"]])
test_merged <- merge(test, import, by = "accession")This is real comparison point to their cure/fail analysis.
16.1 Cure/Fail PCA using the same prcomp result
I am just copy/pasting their code again, but changing the color factor so that cure is purple, failure is red, and na(uninfected) is black.
The following plot should be the first direct comparison point between the two analysis pipelines. Thus, if you look back a few block at my invocation of plot_pca(external_norm), you will see a green/orange plot which is functionally identical if you note:
- The x and y axes are flipped, which ok whatever it is PCA.
- I excluded the healthy samples.
- I dropped to gene level and used hisat.
With those caveats in mind, it is trivial to find the same relationshipes in the samples. E.g. the bottom red/purple individual samples are in the same relative position as my top orange/green pair. the same 4 samples are relative x-axis outliers (my right green, their left purple). The last 6 samples (my orange, their red) are all in the relative orientation.
I think I can further prove the similarity of our inputs via a direct comparison of the datastructures: Txi.lesion.coding.DGEList.LogCPM.filtered.norm (ugh what a name) vs. external_cf. In order to make that comparison, I need to rename my rows to the genecard IDs and the columns.
their_norm_exprs <- Txi.lesion.coding.DGEList.LogCPM.filtered.norm
my_hgnc_ids <- make.names(fData(external_cf)[["hgnc_symbol"]], unique = TRUE)
my_renamed <- set_expt_genenames(external_cf, ids = my_hgnc_ids)
my_norm <- normalize_expt(my_renamed, filter = TRUE, transform = "log2", convert = "cpm")
my_norm_exprs <- as.data.frame(exprs(my_norm))
our_exprs <- merge(their_norm_exprs, my_norm_exprs, by = "row.names")
rownames(our_exprs) <- our_exprs[["Row.names"]]
our_exprs[["Row.names"]] <- NULL
dim(our_exprs)
## I fully expected a correlation heatmap of the combined
## data to show a set of paired samples across the board.
## That is absolutely not true.
correlations <- plot_corheat(our_exprs)
correlations[["scatter"]]
correlations[["plot"]]color_fact <- factor(targets.lesion$treatment_outcome)
levels(color_fact)
## Added by atb to see cure/fail on the same dataset
ggplot(data.frame, aes(x=PC1, y=PC2, color=color_fact)) +
geom_point(size=5, shape=20) +
theme_calc() +
theme(panel.grid.major = element_blank(), panel.grid.minor = element_blank(),
axis.text.x = element_text(size = 15, vjust = 0.5),
axis.text.y = element_text(size = 15), axis.title = element_text(size = 15),
legend.position="none") +
scale_color_manual(values = c("purple", "red","black")) +
annotate("text", x=-50, y=80, label=paste("Permanova Pr(>F) =",
vegan[1,5]), size=3, fontface="bold") +
xlab(paste("PC1 -",pc.per[1],"%")) +
ylab(paste("PC2 -",pc.per[2],"%")) +
xlim(-200,110)17 DE comparisons
The following is their comparison of healthy tissue vs. CL lesion and Failure vs. Cure. I am going to follow it with my analagous examination using limma. Note, each of the pairs of variables created in the following block is xxx followed by xxx.treat; the former is healthy vs lesion and the latter is the fail vs cure set.
# Model matrices:
# CL lesions vs. HS:
design.lesion <- model.matrix(~0 + disease.lesion)
colnames(design.lesion) <- levels(disease.lesion)
# Failure vs. Cure:
design.lesion.treatment <- model.matrix(~0 + treatment.lesion)
colnames(design.lesion.treatment) <- levels(treatment.lesion)
myDGEList.lesion.coding <- DGEList(calcNorm1$counts)
myDGEList.OP.NotFil <- DGEList(CPM_normData_notfiltered_OP)
# Model mean-variance trend and fit linear model to data.
# Use VOOM function from Limma package to model the mean-variance relationship
normData.lesion.coding <- voom(myDGEList.lesion.coding, design.lesion)
normData.OP.NotFil <- voom(myDGEList.OP.NotFil, design.lesion.treatment)
colnames(normData.lesion.coding) <- targets.lesion$sample
colnames(normData.OP.NotFil) <- targets.onlypatients$sample
# fit a linear model to your data
fit.lesion.coding <- lmFit(normData.lesion.coding, design.lesion)
fit.lesion.coding.treatment <- lmFit(normData.OP.NotFil, design.lesion.treatment)
# contrast matrix
contrast.matrix.lesion <- makeContrasts(CL.vs.CON = cutaneous - control,
levels=design.lesion)
contrast.matrix.lesion.treat <- makeContrasts(failure.vs.cure = failure - cure,
levels=design.lesion.treatment)
# extract the linear model fit
fits.lesion.coding <- contrasts.fit(fit.lesion.coding,
contrast.matrix.lesion)
fits.lesion.coding.treat <- contrasts.fit(fit.lesion.coding.treatment,
contrast.matrix.lesion.treat)
# get bayesian stats for your linear model fit
ebFit.lesion.coding <- eBayes(fits.lesion.coding)
ebFit.lesion.coding.treat <- eBayes(fits.lesion.coding.treat)
# TopTable ----
allHits.lesion.coding <- topTable(ebFit.lesion.coding,
adjust ="BH", coef=1,
number=34935, sort.by="logFC")
allHits.lesion.coding.treat <- topTable(ebFit.lesion.coding.treat,
adjust ="BH", coef=1,
number=34776, sort.by="logFC")
myTopHits <- rownames_to_column(allHits.lesion.coding, "geneID")
myTopHits.treat <- rownames_to_column(allHits.lesion.coding.treat, "geneID")
# mutate the format of numeric values:
myTopHits <- mutate(myTopHits, log10Pval = round(-log10(adj.P.Val),2),
adj.P.Val = round(adj.P.Val, 2),
B = round(B, 2),
AveExpr = round(AveExpr, 2),
t = round(t, 2),
logFC = round(logFC, 2),
geneID = geneID)
myTopHits.treat <- mutate(myTopHits.treat, log10Pval = round(-log10(adj.P.Val),2),
adj.P.Val = round(adj.P.Val, 2),
B = round(B, 2),
AveExpr = round(AveExpr, 2),
t = round(t, 2),
logFC = round(logFC, 2),
geneID = geneID)
#save(myTopHits, file = "myTopHits")
#save(myTopHits.treat, file = "myTopHits.treat")18 Perform my analagous limma analysis
my_filt <- normalize_expt(my_renamed, filter = "simple")
limma_cf <- limma_pairwise(my_filt, model_batch = FALSE)
my_table <- limma_cf[["all_tables"]][["failure_vs_cure"]]
their_table <- myTopHits.treat
dim(my_table)
dim(myTopHits.treat)
our_table <- merge(my_table, myTopHits.treat, by.x = "row.names", by.y = "geneID")
dim(our_table)
comparison <- plot_linear_scatter(our_table[, c("logFC.x", "logFC.y")])
comparison$scatter
comparison$correlation
comparison$lm_modelOk, so there is a constituitive difference in our results, and it is significant. What does that mean for the set of genes observed?
With that said, in my most recent manual run of this, the results are quite good, I got a 0.75 correlation; I bet the primary outliers (on the axes) are just genes for which we got different gene<->tx mappings due to me using hisat and their usage of kallisto.
I guess I can test this hypothesis by just swapping in their counts into my data structure.
test_counts <- as.data.frame(myDGEList.lesion.coding[["counts"]])
test_counts[["host_HS01"]] <- NULL
test_counts[["host_HS02"]] <- NULL
test_counts[["host_HS03"]] <- NULL
test_counts[["host_HS04"]] <- NULL
test_counts[["host_HS05"]] <- NULL
test_counts[["host_HS06"]] <- NULL
test_counts[["host_HS07"]] <- NULL
dim(test_counts)
dim(exprs(my_test))
## Oh, that surprises me, the kallisto data has ~ 6k fewer genes?19 See if there are shared DE genes
!!NOTE!! I am using a non-adjusted p-value filter here because I want to use the same filter they used for the volcano plot.
my_filter <- abs(my_table[["logFC"]]) > 1.0 & my_table[["P.Value"]] <= 0.05
sum(my_filter)
their_filter <- abs(their_table[["logFC"]]) > 1.0 & their_table[["P.Value"]] <= 0.05
sum(their_filter)
my_shared <- rownames(my_table)[my_filter] %in% their_table[their_filter, "geneID"]
sum(my_shared)
shared <- rownames(my_table)[my_filter]
shared[my_shared]
both <- list(
"us" = rownames(my_table)[my_filter],
"them" = their_table[their_filter, "geneID"])
tt <- UpSetR::fromList(both)
UpSetR::upset(tt)19.1 Compare the two datasets directly
only_tmrc3 <- subset_expt(tmrc3_external, subset = "condition=='Colombia'") %>%
set_expt_conditions(fact = "finaloutcome")## subset_expt(): There were 39, now there are 18 samples.## The numbers of samples by condition are:##
## cure failure
## 13 5only_tmrc3_de <- all_pairwise(only_tmrc3, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)##
## cure failure
## 13 5## Removing 0 low-count genes (13615 remaining).## Setting 225 low elements to zero.## transform_counts: Found 225 values equal to 0, adding 1 to the matrix.only_tmrc3_de## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.## The logFC agreement among the methods follows:## falr_vs_cr
## limma_vs_deseq 0.7154
## limma_vs_edger 0.8311
## limma_vs_basic 0.9061
## limma_vs_noiseq -0.8065
## deseq_vs_edger 0.9247
## deseq_vs_basic 0.7781
## deseq_vs_noiseq -0.7249
## edger_vs_basic 0.8963
## edger_vs_noiseq -0.8438
## basic_vs_noiseq -0.8787only_tmrc3_table <- combine_de_tables(only_tmrc3_de)
only_tmrc3_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown edger_sigup edger_sigdown
## 1 failure_vs_cure 27 26 28 15
## limma_sigup limma_sigdown
## 1 1 0## `geom_line()`: Each group consists of only one observation.
## i Do you need to adjust the group aesthetic?## Plot describing unique/shared genes in a differential expression table.
only_tmrc3_top100 <- extract_significant_genes(only_tmrc3_table, n = 100)
only_tmrc3_up <- only_tmrc3_top100[["deseq"]][["ups"]][["failure_vs_cure"]]
only_tmrc3_down <- only_tmrc3_top100[["deseq"]][["downs"]][["failure_vs_cure"]]
tmrc3_external_de <- all_pairwise(tmrc3_external, model_batch = "svaseq",
parallel = parallel, filter = "simple",
methods = methods)##
## Brazil Colombia
## 21 18## Potentially check over the experimental design, there appear to be missing values.## Warning in plot_pca(pre_batch, plot_labels = FALSE, ...): There are NA values
## in the component data. This can lead to weird plotting errors.## Removing 4594 low-count genes (14577 remaining).## Setting 3653 low elements to zero.## transform_counts: Found 3653 values equal to 0, adding 1 to the matrix.## Potentially check over the experimental design, there appear to be missing values.## Warning in plot_pca(post_batch, plot_labels = FALSE, ...): There are NA values
## in the component data. This can lead to weird plotting errors.tmrc3_external_table <- combine_de_tables(tmrc3_external_de, excel = "excel/tmrc3_scott_biopsies.xlsx")## Error : colNames must be a unique vector (case sensitive)tmrc3_external_sig <- extract_significant_genes(tmrc3_external_table, excel = "excel/tmrc3_scott_biopsies_sig.xlsx")
tmrc3_external_cf <- set_expt_conditions(tmrc3_external, fact = "finaloutcome") %>%
set_expt_batches(fact = "lab")## Warning in `[<-.factor`(`*tmp*`, null_ids, value = "null"): invalid factor
## level, NA generated## The numbers of samples by condition are:##
## cure failure
## 13 5## Error in h(simpleError(msg, call)): error in evaluating the argument 'object' in selecting a method for function 'pData': 'names' attribute [3] must be the same length as the vector [2]tmrc3_external_cf_norm <- normalize_expt(tmrc3_external_cf, filter = TRUE, norm = "quant", convert = "cpm", transform = "log2")## Error in h(simpleError(msg, call)): error in evaluating the argument 'expt' in selecting a method for function 'normalize_expt': object 'tmrc3_external_cf' not foundplot_pca(tmrc3_external_cf_norm)## Error in eval(expr, envir, enclos): object 'tmrc3_external_cf_norm' not foundtmrc3_external_cf_nb <- normalize_expt(tmrc3_external_cf, filter = TRUE, batch = "svaseq", convert = "cpm", transform = "log2")## Error in h(simpleError(msg, call)): error in evaluating the argument 'expt' in selecting a method for function 'normalize_expt': object 'tmrc3_external_cf' not foundplot_pca(tmrc3_external_cf_nb)## Error in eval(expr, envir, enclos): object 'tmrc3_external_cf_nb' not foundtmrc3_external_cf_de <- all_pairwise(tmrc3_external_cf, model_batch = "svaseq",
parallel = parallel, filter = TRUE,
methods = methods)## Error in h(simpleError(msg, call)): error in evaluating the argument 'object' in selecting a method for function 'pData': object 'tmrc3_external_cf' not foundtmrc3_external_cf_de## Error in eval(expr, envir, enclos): object 'tmrc3_external_cf_de' not foundtmrc3_external_cf_table <- combine_de_tables(tmrc3_external_cf_de, excel = "excel/tmrc3_scott_cf_table.xlsx")## Error in eval(expr, envir, enclos): object 'tmrc3_external_cf_de' not foundtmrc3_external_cf_table## Error in eval(expr, envir, enclos): object 'tmrc3_external_cf_table' not foundtmrc3_external_cf_sig <- extract_significant_genes(tmrc3_external_cf_table, excel = "excel/tmrc3_scott_cf_sig.xlsx")## Error in eval(expr, envir, enclos): object 'tmrc3_external_cf_table' not foundtmrc3_external_cf_sig## Error in eval(expr, envir, enclos): object 'tmrc3_external_cf_sig' not foundtmrc3_external_species <- set_expt_conditions(tmrc3_external, fact = "ParasiteSpecies") %>%
set_expt_colors(color_choices[["parasite"]])## The numbers of samples by condition are:##
## lvbraziliensis lvpanamensis notapplicable
## 22 14 3## Warning in set_expt_colors(., color_choices[["parasite"]]): Colors for the
## following categories are not being used: lvguyanensis.20 Compare the l2FC values
Let us look at the top/bottom 100 genes of these two datasets and see if they have any similarities.
Note to self, set up s4 dispatch on compare_de_tables!
compared <- compare_de_tables(only_tmrc3_table, external_table, first_table = 1, second_table = 1)
compared$scatter
compared$correlation##
## Pearson's product-moment correlation
##
## data: df[[xcol]] and df[[ycol]]
## t = 14, df = 13240, p-value <2e-16
## alternative hypothesis: true correlation is not equal to 0
## 95 percent confidence interval:
## 0.1033 0.1368
## sample estimates:
## cor
## 0.120121 Compare visits by celltype and C/F
I assume this request came out of the review process, but I am not quite sure where to put it. If I understand it correctly, the goal is to look across visits for combinations of cure and fail (not fail/cure, but v2/v1) and across cell types.
Thus, in order to do this, I will need to combine those three parameters or set up a more complex model to handle this.
t_cellvisitcf <- set_expt_conditions(t_clinical_nobiop, fact = "cell_visit_cf")## The numbers of samples by condition are:##
## eosinophils_1_cure eosinophils_1_failure eosinophils_2_cure
## 5 3 6
## eosinophils_2_failure eosinophils_3_cure eosinophils_3_failure
## 3 6 3
## monocytes_1_cure monocytes_1_failure monocytes_2_cure
## 8 8 7
## monocytes_2_failure monocytes_3_cure monocytes_3_failure
## 6 6 7
## neutrophils_1_cure neutrophils_1_failure neutrophils_2_cure
## 8 8 7
## neutrophils_2_failure neutrophils_3_cure neutrophils_3_failure
## 6 5 7t_cellvisitcf_de <- all_pairwise(t_cellvisitcf, keepers = visittype_contrasts,
model_batch = "svaseq", filter = TRUE, parallel = parallel,
methods = methods)##
## eosinophils_1_cure eosinophils_1_failure eosinophils_2_cure
## 5 3 6
## eosinophils_2_failure eosinophils_3_cure eosinophils_3_failure
## 3 6 3
## monocytes_1_cure monocytes_1_failure monocytes_2_cure
## 8 8 7
## monocytes_2_failure monocytes_3_cure monocytes_3_failure
## 6 6 7
## neutrophils_1_cure neutrophils_1_failure neutrophils_2_cure
## 8 8 7
## neutrophils_2_failure neutrophils_3_cure neutrophils_3_failure
## 6 5 7## Removing 0 low-count genes (11910 remaining).## Setting 5938 low elements to zero.## transform_counts: Found 5938 values equal to 0, adding 1 to the matrix.t_cellvisitcf_de## A pairwise differential expression with results from: basic, deseq, edger, limma, noiseq.## This used a surrogate/batch estimate from: svaseq.## The primary analysis performed 10 comparisons.t_cellvisitcf_mono_table <- combine_de_tables(
t_cellvisitcf_de, keepers = visittype_contrasts_mono,
excel = glue("{xlsx_prefix}/DE_Visits/Cure_Fail/monocyte_visit_cf_combined_table_sva-v{ver}.xlsx"))
t_cellvisitcf_mono_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown
## 1 monocytes_2_cure_vs_monocytes_1_cure 0 2
## 2 monocytes_2_failure_vs_monocytes_1_failure 2 2
## 3 monocytes_3_cure_vs_monocytes_1_cure 1 3
## 4 monocytes_3_failure_vs_monocytes_1_failure 1 3
## edger_sigup edger_sigdown limma_sigup limma_sigdown
## 1 0 0 0 0
## 2 1 1 1 0
## 3 0 0 0 0
## 4 0 0 0 0## Plot describing unique/shared genes in a differential expression table.
t_cellvisitcf_mono_sig <- extract_significant_genes(
t_cellvisitcf_mono_table,
excel = glue("{xlsx_prefix}/DE_Visits/Cure_Fail/monocyte_visit_cf_combined_sig_sva-v{ver}.xlsx"))
t_cellvisitcf_mono_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## v2v1_mono_cure 0 0 0 0 0 2
## v2v1_mono_failure 1 0 1 1 2 2
## v3v1_mono_cure 0 0 0 0 1 3
## v3v1_mono_failure 0 0 0 0 1 3
## basic_up basic_down
## v2v1_mono_cure 0 0
## v2v1_mono_failure 0 0
## v3v1_mono_cure 0 0
## v3v1_mono_failure 0 0
t_cellvisitcf_neut_table <- combine_de_tables(
t_cellvisitcf_de, keepers = visittype_contrasts_ne,
excel = glue("{xlsx_prefix}/DE_Visits/Cure_Fail/neutrophil_visit_cf_combined_table_sva-v{ver}.xlsx"))
t_cellvisitcf_neut_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown
## 1 neutrophils_2_cure_vs_neutrophils_1_cure 85 132
## 2 neutrophils_2_failure_vs_neutrophils_1_failure 127 150
## 3 neutrophils_3_cure_vs_neutrophils_1_cure 105 195
## 4 neutrophils_3_failure_vs_neutrophils_1_failure 87 24
## edger_sigup edger_sigdown limma_sigup limma_sigdown
## 1 75 118 90 31
## 2 116 175 105 42
## 3 110 157 114 39
## 4 77 20 56 36## Plot describing unique/shared genes in a differential expression table.
t_cellvisitcf_neut_sig <- extract_significant_genes(
t_cellvisitcf_neut_table,
excel = glue("{xlsx_prefix}/DE_Visits/Cure_Fail/neutrophil_visit_cf_combined_sig_sva-v{ver}.xlsx"))
t_cellvisitcf_neut_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## v2v1_ne_cure 90 31 75 118 85 132
## v2v1_ne_failure 105 42 116 175 127 150
## v3v1_ne_cure 114 39 110 157 105 195
## v3v1_ne_failure 56 36 77 20 87 24
## basic_up basic_down
## v2v1_ne_cure 2 0
## v2v1_ne_failure 4 0
## v3v1_ne_cure 0 0
## v3v1_ne_failure 0 0
t_cellvisitcf_eo_table <- combine_de_tables(
t_cellvisitcf_de, keepers = visittype_contrasts_eo,
excel = glue("{xlsx_prefix}/DE_Visits/Cure_Fail/eosinophil_visit_cf_combined_table_sva-v{ver}.xlsx"))
t_cellvisitcf_eo_table## A set of combined differential expression results.## table deseq_sigup deseq_sigdown
## 1 eosinophils_2_cure_vs_eosinophils_1_cure 5 1
## 2 eosinophils_2_failure_vs_eosinophils_1_failure 1 5
## 3 eosinophils_3_cure_vs_eosinophils_1_cure 9 1
## 4 eosinophils_3_failure_vs_eosinophils_1_failure 0 8
## edger_sigup edger_sigdown limma_sigup limma_sigdown
## 1 0 0 0 0
## 2 0 0 0 0
## 3 0 0 0 1
## 4 0 0 0 0## Plot describing unique/shared genes in a differential expression table.
t_cellvisitcf_eo_sig <- extract_significant_genes(
t_cellvisitcf_eo_table,
excel = glue("{xlsx_prefix}/DE_Visits/Cure_Fail/eosinophil_visit_cf_combined_sig_sva-v{ver}.xlsx"))
t_cellvisitcf_eo_sig## A set of genes deemed significant according to limma, edger, deseq, basic.## The parameters defining significant were:## LFC cutoff: 1 adj P cutoff: 0.05## limma_up limma_down edger_up edger_down deseq_up deseq_down
## v2v1_eo_cure 0 0 0 0 5 1
## v2v1_eo_failure 0 0 0 0 1 5
## v3v1_eo_cure 0 1 0 0 9 1
## v3v1_eo_failure 0 0 0 0 0 8
## basic_up basic_down
## v2v1_eo_cure 0 0
## v2v1_eo_failure 0 0
## v3v1_eo_cure 0 0
## v3v1_eo_failure 0 0
tmp <- loadme(filename = savefile)Bibliography
Chung, Matthew, Vincent M. Bruno, David A. Rasko, Christina A. Cuomo,
José F. Muñoz, Jonathan Livny, Amol C. Shetty, Anup Mahurkar, and Julie
C. Dunning Hotopp. 2021. “Best Practices on the Differential
Expression Analysis of Multi-Species RNA-seq.” Genome Biology 22
(April): 121. https://doi.org/10.1186/s13059-021-02337-8.
Hoffman, Gabriel E, and Panos Roussos. 2020. “Dream: Powerful
Differential Expression Analysis for Repeated Measures Designs.”
Bioinformatics 37 (2): 192–201. https://doi.org/10.1093/bioinformatics/btaa687.
Leng, Ning, John A. Dawson, James A. Thomson, Victor Ruotti, Anna I.
Rissman, Bart M. G. Smits, Jill D. Haag, Michael N. Gould, Ron M.
Stewart, and Christina Kendziorski. 2013. “EBSeq: An
Empirical Bayes Hierarchical Model for Inference in RNA-seq Experiments.”
Bioinformatics 29 (8): 1035–43. https://doi.org/10.1093/bioinformatics/btt087.
Love, Michael I., Wolfgang Huber, and Simon Anders. 2014.
“Moderated Estimation of Fold Change and Dispersion for
RNA-Seq Data with DESeq2.”
bioRxiv. https://doi.org/10.1101/002832.
McCarthy, Davis J., Yunshun Chen, and Gordon K. Smyth. 2012.
“Differential Expression Analysis of Multifactor
RNA-Seq Experiments with Respect to Biological
Variation.” Nucleic Acids Research 40 (10): 4288–97. https://doi.org/10.1093/nar/gks042.
Molania, Ramyar, Momeneh Foroutan, Johann A. Gagnon-Bartsch, Luke C.
Gandolfo, Aryan Jain, Abhishek Sinha, Gavriel Olshansky, Alexander
Dobrovic, Anthony T. Papenfuss, and Terence P. Speed. 2023.
“Removing Unwanted Variation from Large-Scale RNA
Sequencing Data with PRPS.” Nature
Biotechnology 41 (1): 82–95. https://doi.org/10.1038/s41587-022-01440-w.
Risso, Davide, John Ngai, Terence P. Speed, and Sandrine Dudoit. 2014.
“Normalization of RNA-seq Data Using
Factor Analysis of Control Genes or Samples.” Nature
Biotechnology 32 (9): 896–902. https://doi.org/10.1038/nbt.2931.
Ritchie, Matthew E., Belinda Phipson, Di Wu, Yifang Hu, Charity W. Law,
Wei Shi, and Gordon K. Smyth. 2015. “Limma Powers Differential
Expression Analyses for RNA-sequencing and
Microarray Studies.” Nucleic Acids Research 43 (7):
e47–47. https://doi.org/10.1093/nar/gkv007.
Tarazona, Sonia, Pedro Furió-Tarí, David Turrà, Antonio Di Pietro, María
José Nueda, Alberto Ferrer, and Ana Conesa. 2015. “Data Quality
Aware Analysis of Differential Expression in RNA-seq with NOISeq
R/Bioc Package.” Nucleic Acids
Research 43 (21): e140. https://doi.org/10.1093/nar/gkv711.
LS0tCnRpdGxlOiAiVE1SQzMgYHIgU3lzLmdldGVudignVkVSU0lPTicpYDogRGlmZmVyZW50aWFsIEV4cHJlc3Npb24gYW5hbHlzZXMsIFR1bWFjbyBvbmx5LiIKYXV0aG9yOiAiYXRiIGFiZWxld0BnbWFpbC5jb20iCmRhdGU6ICJgciBTeXMuRGF0ZSgpYCIKYmlibGlvZ3JhcGh5OiBhdGIuYmliCnJ1bnRpbWU6IHNoaW55Cm91dHB1dDoKICBodG1sX2RvY3VtZW50OgogICAgY29kZV9kb3dubG9hZDogdHJ1ZQogICAgY29kZV9mb2xkaW5nOiBzaG93CiAgICBmaWdfY2FwdGlvbjogdHJ1ZQogICAgZmlnX2hlaWdodDogNwogICAgZmlnX3dpZHRoOiA3CiAgICBoaWdobGlnaHQ6IHplbmJ1cm4KICAgIGtlZXBfbWQ6IGZhbHNlCiAgICBtb2RlOiBzZWxmY29udGFpbmVkCiAgICBudW1iZXJfc2VjdGlvbnM6IHRydWUKICAgIHNlbGZfY29udGFpbmVkOiB0cnVlCiAgICB0aGVtZTogcmVhZGFibGUKICAgIHRvYzogdHJ1ZQogICAgdG9jX2Zsb2F0OgogICAgICBjb2xsYXBzZWQ6IGZhbHNlCiAgICAgIHNtb290aF9zY3JvbGw6IGZhbHNlCi0tLQoKPHN0eWxlIHR5cGU9InRleHQvY3NzIj4KYm9keSAubWFpbi1jb250YWluZXIgewogIG1heC13aWR0aDogMTYwMHB4Owp9CmJvZHksIHRkIHsKICBmb250LXNpemU6IDE2cHg7Cn0KY29kZS5yIHsKICBmb250LXNpemU6IDE2cHg7Cn0KcHJlIHsKICBmb250LXNpemU6IDE2cHgKfQo8L3N0eWxlPgoKYGBge3Igb3B0aW9ucywgaW5jbHVkZT1GQUxTRX0KbGlicmFyeShocGdsdG9vbHMpCmxpYnJhcnkoZHBseXIpCmxpYnJhcnkoZW5yaWNocGxvdCkKbGlicmFyeShmb3JjYXRzKQpsaWJyYXJ5KGdsdWUpCmxpYnJhcnkoZ2dwbG90MikKbGlicmFyeShsbWU0KQoKa25pdHI6Om9wdHNfa25pdCRzZXQocHJvZ3Jlc3MgPSBUUlVFLCB2ZXJib3NlID0gVFJVRSwgd2lkdGggPSA5MCwgZWNobyA9IFRSVUUpCmtuaXRyOjpvcHRzX2NodW5rJHNldCgKICBlcnJvciA9IFRSVUUsIGZpZy53aWR0aCA9IDgsIGZpZy5oZWlnaHQgPSA4LCBmaWcucmV0aW5hID0gMiwKICBvdXQud2lkdGggPSAiMTAwJSIsIGRldiA9ICJwbmciLAogIGRldi5hcmdzID0gbGlzdChwbmcgPSBsaXN0KHR5cGUgPSAiY2Fpcm8tcG5nIikpKQpvbGRfb3B0aW9ucyA8LSBvcHRpb25zKGRpZ2l0cyA9IDQsIHN0cmluZ3NBc0ZhY3RvcnMgPSBGQUxTRSwga25pdHIuZHVwbGljYXRlLmxhYmVsID0gImFsbG93IikKZ2dwbG90Mjo6dGhlbWVfc2V0KGdncGxvdDI6OnRoZW1lX2J3KGJhc2Vfc2l6ZSA9IDEyKSkKdmVyIDwtIFN5cy5nZXRlbnYoIlZFUlNJT04iKQpwYXJhbGxlbCA8LSB0b3VwcGVyKFN5cy5nZXRlbnYoIlBBUkFMTEVMIikpCmlmIChwYXJhbGxlbCA9PSAiIiB8fCBwYXJhbGxlbCA9PSAiVFJVRSIpIHsKICBwYXJhbGxlbCA8LSBUUlVFCn0gZWxzZSB7CiAgcGFyYWxsZWwgPC0gRkFMU0UKfQpydW5kYXRlIDwtIGZvcm1hdChTeXMuRGF0ZSgpLCBmb3JtYXQgPSAiJVklbSVkIikKCnJtZF9maWxlIDwtIGdsdWUoIjA0ZGlmZmVyZW50aWFsX2V4cHJlc3Npb25fdHVtYWNvLlJtZCIpCnNhdmVmaWxlIDwtIGdzdWIocGF0dGVybiA9ICJcXC5SbWQiLCByZXBsYWNlID0gIlxcLnJkYVxcLnh6IiwgeCA9IHJtZF9maWxlKQpsb2FkZWQgPC0gbG9hZChmaWxlID0gZ2x1ZSgicmRhL3RtcmMzX2RhdGFfc3RydWN0dXJlcy12e3Zlcn0ucmRhIikpCnhsc3hfcHJlZml4IDwtICJhbmFseXNlcy80X3R1bWFjbyIKY2ZfcHJlZml4IDwtIGdsdWUoInt4bHN4X3ByZWZpeH0vREVfQ3VyZV9GYWlsIikKYGBgCgojIENoYW5nZWxvZwoKKiAyMDI0MDY6IEFkZGVkIGFuIGV4cGxpY2l0IGNvbXBhcmlzb24gb2YgZGlmZmVyZW50IG1vZGVsCiAgY29uc3RydWN0aW9ucyB1c2luZyBvdXIgbW9zdCB2YXJpYWJsZSBjZWxsIHR5cGUsIHRoZSBuZXV0cm9waGlscy4KKiAyMDI0MDY6IFdvcmtpbmcgZW50aXJlbHkgb3V0IG9mIHRoZSBjb250YWluZXIgbm93LCBzZXBhcmF0ZWQKICBHU0UvR1NFQSBhbmFseXNlcywgYWRkZWQgYSBmdWxsIHRyZWF0bWVudCB3aXRoIGNsdXN0ZXJQcm9maWxlcjsgSSBhbQogIG5vdCBjdXJyZW50bHkgd3JpdGluZyB0aGUgY3AgcmVzdWx0cyBvdXQgYXMgeGxzeCBmaWxlcyB1bnRpbC91bmxlc3MKICBzb21lb25lIGV4cHJlc3NlcyBpbnRlcmVzdCBpbiB0aGVtLgoqIDIwMjMwOTogRGlzYWJsZWQgR1NWQSBhbmFseXNlcyB1bnRpbC91bmxlc3Mgd2UgZ2V0IHBlcm1pc3Npb24gdG8KICBpbmNsdWRlIHRoZSBtU2lnREIgNy41LjEgcmVsZWFzZS4gIEkgd2lsbCBzaW1wbGlmeSB0aGUgZmlsZW5hbWVzIHNvCiAgdGhhdCBvbmUgbWF5IGVhc2lseSBkcm9wIGluIGEgZG93bmxvYWRlZCBjb3B5IG9mIHRoZSBkYXRhIGFuZCBydW4KICB0aG9zZSBibG9ja3MuICBVbnRpbCB0aGVuLCBJIGd1ZXNzIHlvdSAoZmljdGl0aW91cyByZWFkZXIpIHdpbGwgaGF2ZQogIHRvIHRydXN0IG1lIHdoZW4gSSBzYXkgdGhvc2UgYmxvY2tzIGFsbCB3b3JrPyAoQWxzbywgR1NWQSB3YXMgbW92ZWQKICB0byBhIHNlcGFyYXRlIGRvY3VtZW50KQoqIDIwMjMwOTogTW92ZWQgYWxsIGdlbmUgc2V0IGVucmljaG1lbnQgYW5hbHlzZXMgdG8gMDRscnRfZ3NlYV9nc3ZhLlJtZAoqIDIwMjMwOSBuZXh0IGRheTogTW92aW5nIGdlbmUgc2V0IGVucmljaG1lbnQgYmFjayBiZWNhdXNlIGl0IGFkZHMgdG9vIG11Y2gKICBjb21wbGV4aXR5IHRvIHNhdmUvcmVsb2FkIHRoZSBERSByZXN1bHRzIGZvciBnUHJvZmlsZXIgYW5kIGZyaWVuZHMuCiogU3RpbGwgaHVudGluZyBmb3IgbWVzc2VkIHVwIGNvbG9ycywgY2hhbmdlZCBpbnB1dCBkYXRhIHRvIG1hdGNoIG5ldyB2ZXJzaW9uLgoKIyBJbnRyb2R1Y3Rpb24KClRoZSB2YXJpb3VzIGRpZmZlcmVudGlhbCBleHByZXNzaW9uIGFuYWx5c2VzIG9mIHRoZSBkYXRhIGdlbmVyYXRlZCBpbgp0bXJjM19kYXRhc2V0cyB3aWxsIG9jY3VyIGluIHRoaXMgZG9jdW1lbnQuICBNb3N0IG9mIHRoZSBhY3R1YWwgd29yawppcyB2aWEgdGhlIGZ1bmN0aW9uICdhbGxfcGFpcndpc2UoKSc7IHRoZSB3b3JkICdhbGwnIGluIHRoZSBuYW1lIGRvZXMKYSBsb3Qgb2Ygd29yazsgaXQgaXMgcmVzcG9uc2libGUgZm9yIHBlcmZvcm1pbmcgYWxsIHBvc3NpYmxlIHBhaXJ3aXNlCmNvbnRyYXN0cyB1c2luZyBhbGwgcG9zc2libGUgbWV0aG9kcyBmb3Igd2hpY2ggSSBoYXZlIHN1ZmZpY2llbnQKdW5kZXJzdGFuZGluZyB0byBiZSBhYmxlIHRvIHdyaXRlIGEgcmVhc29uYWJseSByb2J1c3QgcGFpcndpc2UKZnVuY3Rpb24uICBDdXJyZW50bHkgdGhpcyBpcyBsaW1pdGVkIHRvOgoKKiBERVNlcTIgKEBsb3ZlTW9kZXJhdGVkRXN0aW1hdGlvbkZvbGQyMDE0KTogIE91ciAnZGVmYXVsdCcKKiBlZGdlUiAoQG1jY2FydGh5RGlmZmVyZW50aWFsRXhwcmVzc2lvbkFuYWx5c2lzMjAxMik6ICBzaGFyZXMgYQogIGNsb3NlIGNvbmNlcHR1YWwgbGluZWFnZSB3aXRoIERFU2VxMiBJIHRoaW5rLgoqIGxpbW1hIChAcml0Y2hpZUxpbW1hUG93ZXJzRGlmZmVyZW50aWFsMjAxNWEpOiAgYWxvbmcgd2l0aCB2b29tIHRoaXMKICBwcm92aWRlcyBhIG5pY2VseSByb2J1c3Qgc2V0IG9mIHRvb2xzLgoqIEVCc2VxIChAbGVuZ0VCU2VxRW1waXJpY2FsQmF5ZXMyMDEzKTogIEkgdGhpbmsgaXQgaXMgbm90IGFzIHJvYnVzdCBhcwogIHRoZSBwcmV2aW91cyBlbnRyaWVzLCBidXQgSSBsaWtlIHVzaW5nIGl0IGJlY2F1c2UgaXQgaXMgYW4gYWxtb3N0CiAgcHVyZWx5IGJheWVzaWFuIG1ldGhvZCBhbmQgYXMgc3VjaCBwcm92aWRlcyBhIGRpZmZlcmVudCBwZXJzcGVjdGl2ZQogIG9uIGFueSBkYXRhc2V0LgoqIE5vaXNlcSAoQHRhcmF6b25hRGF0YVF1YWxpdHlBd2FyZTIwMTUpOiAgSSBub3RpY2VkIHRoaXMgbWV0aG9kCiAgcmVsYXRpdmVseSByZWNlbnRseSBhbmQgd2FzIHN1ZmZpY2llbnRseSBpbnRyaWd1ZWQgdGhhdCBJIHRocmV3IGEKICBtZXRob2QgdG9nZXRoZXIgdXNpbmcgaXQuICBUaGUgYXV0aG9ycyBhcHBlYXIgdG8gbWUgdG8gYmUgbG9va2luZyB0bwogIHVuZGVyc3RhbmQgYSBsb3Qgb2YgdGhlIHF1ZXN0aW9ucyBvbiB3aGljaCBJIHNwZW5kIGEgbG90IG9mIHRpbWUuCiogRHJlYW0gKEBob2ZmbWFuRHJlYW1Qb3dlcmZ1bERpZmZlcmVudGlhbDIwMjApOiBJIG1vc3RseSBsaWtlIHRoaXMKICBiZWNhdXNlIGl0IHVzZXMgdmFyaWFuY2VQYXJ0aXRpb24sIHdoaWNoIEkgdGhpbmsgaXMgYSByZWFsbHkgbmljZQogIHRveSB3aGVuIHRyeWluZyB0byB1bmRlcnN0YW5kIHdoYXQgaXMgZ29pbmcgb24gaW4gYSBkYXRhc2V0LgoqIGJhc2ljIGlzIG15IG93biwgZXhwbGljaXRseSB1bmluZm9ybWVkIGFuYWx5c2lzLiAgSXQgaXMgbXkKICAnbmVnYXRpdmUgY29udHJvbCcgbWV0aG9kIGJlY2F1c2UsIGlmIHNvbWV0aGluZyBhZ3JlZXMgZW50aXJlbHkgd2l0aAogIGl0LCB0aGVuIEkga25vdyB0aGF0IGFsbCB0aGUgZmFuY3kgbWF0aCBhbmQgc3RhdGlzdGljcyBwZXJmb3JtZWQgYnkKICB0aGF0IG1ldGhvZCB3b3JrZWQgb3V0IGp1c3QgdGhlIHNhbWUgYXMgc29tZSBkb29mdXMgKG1lKSBqdXN0IGxvZzIKICBzdWJ0cmFjdGluZyB0aGUgZXhwcmVzc2lvbiB2YWx1ZXMuICBJdCBpcyBub3QgcXVpdGUgdGhhdCBiYXNpYywgYnV0CiAgcHJldHR5IGNsb3NlLgoKVGhlIGZpcnN0IDMgbWV0aG9kcyBhbGxvdyBvbmUgdG8gYWRkIHN1cnJvZ2F0ZSB2YXJpYWJsZSBlc3RpbWF0ZXMgdG8KdGhlIG1vZGVsIHdoZW4gcGVyZm9ybWluZyB0aGUgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24gYW5hbHlzZXMuCk5vaXNlcSBhbmQgRHJlYW0gaGFuZGxlIHN1cnJvZ2F0ZXMgdXNpbmcgdGhlaXIgb3duIGhldXJpc3RpY3MsIEVCU2VxCmlzIGluaW1pY2FibGUgdG8gdGhhdCBraW5kIG9mIG1vZGVsLCBhbmQgSSBleHBsaWNpdGx5IGNob3NlIHRvIG5vdAptYWtlIHRoYXQgcG9zc2libGUgZm9yIGJhc2ljLiAgV2l0aCB0aGF0IGluIG1pbmQsIGluIG1vc3QgaW5zdGFuY2VzCkkgdXN1YWxseSBkZWFsIHdpdGggc3Vycm9nYXRlcy9iYXRjaGVzIGluIG9uZSBvZiBhIGZldyB3YXlzOgoKMS4gIElmIHRoZSBkYXRhIGlzIGFic3VyZGx5IHByZXR0eSwgZG8gbm90aGluZyAocHJldHR5IG11Y2gKICAgIG9ubHkgZm9yIHdlbGwtY29udHJvbGxlZCBiYWN0ZXJpYWwgZGF0YSkuCjIuICBBZGQgYSBrbm93biBiYXRjaCBmYWN0b3IgdG8gdGhlIG1vZGVsICh0aGUgZGVmYXVsdCkuCjMuICBUcnkgdG8gZW5zdXJlIHRoZSBkYXRhIGlzIHN1aXRhYmxlIGFuZCBpbnZva2Ugc3ZhCiAgICAoQGxlZWtTVkFQYWNrYWdlUmVtb3ZpbmcyMDEyKSB0byBhY3F1aXJlIGVzdGltYXRlcyBhbmQgYWRkIHRoZW0gdG8KICAgIHRoZSBtb2RlbC4KNC4gIElmIHRoZSBkYXRhIGhhcyBhIGtub3duIGJhdGNoIGZhY3RvciBhbmQgaXQgaXMgcGFydGljdWxhcmx5CiAgICBwYXRob2xvZ2ljYWwsIHVzZSB0aGUgY29tYmF0IGltcGxlbWVudGF0aW9uIGluIHN2YS4gIEFzIGEgZ2VuZXJhbAogICAgcnVsZSBJIGRvIG5vdCBsaWtlIHRoaXMgb3B0aW9uIGJlY2F1c2UgaXQgaXMgZGF0YSBkZXN0cnVjdGl2ZS4KClRoZSBsYXN0IHR3byBvcHRpb25zIGFyZSBoYW5kbGVkIHZpYSBhIGZ1bmN0aW9uIG5hbWVkICdhbGxfYWRqdXN0ZXJzJwppbiBocGdsdG9vbHMgd2hpY2ggaXMgcmVzcG9uc2libGUgZm9yIGVuc3VyaW5nIHRoYXQgdGhlIGRhdGEgaXMgc2FuZQpmb3IgdGhlIGFzc3VtcHRpb25zIG1hZGUgYnkgZWFjaCBtZXRob2QgYW5kIGludm9rZXMgZWFjaCBtZXRob2QKKGhvcGVmdWxseSkgcHJvcGVybHkuICBJdCByZXR1cm5zIGJvdGggbW9kaWZpZWQgY291bnRzIGFuZCBtb2RlbAplc3RpbWF0ZXMgd2hlbiBwb3NzaWJsZSBhbmQgaGFzIGltcGxlbWVudGF0aW9ucyBmb3IgYSBmYWlyIG51bWJlciBvZgptZXRob2RzIGluIHRoaXMgcmVhbG0uICBzdmEgaXMgbXkgZmF2b3JpdGUgYnkgYSBwcmV0dHkgYmlnIG1hcmdpbiwKdGhvdWdoIEkgZG8gc29tZXRpbWVzIHVzZSBSVVYgKEByaXNzb05vcm1hbGl6YXRpb25STkFzZXFEYXRhMjAxNCkgYW5kIG9mCmNvdXJzZSwgaW4gd3JpdGluZyB0aGlzIGRvY3VtZW50IEkgc3R1bWJsZWQgaW50byBhbm90aGVyIGludGVyZXN0aW5nCmNvbnRlbmRlcjogKEBtb2xhbmlhUmVtb3ZpbmdVbndhbnRlZFZhcmlhdGlvbjIwMjMpICBhbGxfYWRqdXN0ZXJzKCkKYWxzbyBoYXMgaW1wbGVtZW50YXRpb25zIG9mIGV2ZXJ5IGV4YW1wbGUvbWV0aG9kIEkgZ290IG91dCBvZiB0aGUKcGFwZXJzIGZvciBzdmEgKGUuZy4gc3N2YS9mc3ZhKSwgaXN2YSwgc21hcnRzdmEsIGFuZCBzb21lIG90aGVycy4KCiMjIERlZmluZSBjb250cmFzdHMgZm9yIERFIGFuYWx5c2VzCgpFYWNoIG9mIHRoZSBmb2xsb3dpbmcgbGlzdHMgZGVzY3JpYmVzIHRoZSBzZXQgb2YgY29udHJhc3RzIHRoYXQgSQp0aGluayBhcmUgaW50ZXJlc3RpbmcgZm9yIHRoZSB2YXJpb3VzIHdheXMgb25lIG1pZ2h0IGNvbnNpZGVyIHRoZQpUTVJDMyBkYXRhc2V0LiAgVGhlIHZhcmlhYmxlcyBhcmUgbmFtZWQgYWNjb3JkaW5nIHRvIHRoZSBhc3N1bWVkIGRhdGEKd2l0aCB3aGljaCB0aGV5IHdpbGwgYmUgdXNlZCwgdGh1cyB0Y19jZl9jb250cmFzdHMgaXMgZXhwZWN0ZWQgdG8gYmUKdXNlZCBmb3IgdGhlIFR1bWFjbytDYWxpIGRhdGEgYW5kIHByb3ZpZGUgYSBzZXJpZXMgb2YgY3VyZS9mYWlsCmNvbXBhcmlzb25zIHdoaWNoICh0byB0aGUgZXh0ZW50IHBvc3NpYmxlKSBhY3Jvc3MgYm90aCBsb2NhdGlvbnMuICBJbgpldmVyeSBjYXNlLCB0aGUgbmFtZSBvZiB0aGUgbGlzdCBlbGVtZW50IHdpbGwgYmUgdXNlZCBhcyB0aGUgY29udHJhc3QKbmFtZSwgYW5kIHdpbGwgdGh1cyBiZSBzZWVuIGFzIHRoZSBzaGVldCBuYW1lIGluIHRoZSBvdXRwdXQgeGxzeApmaWxlKHMpOyB0aGUgdHdvIHBpZWNlcyBvZiB0aGUgY2hhcmFjdGVyIHZlY3RvciB2YWx1ZSBhcmUgdGhlCm51bWVyYXRvciBhbmQgZGVub21pbmF0b3Igb2YgdGhlIGFzc29jaWF0ZWQgY29udHJhc3QuCgoqIE91ciBwcmltYXJ5IHF1ZXN0aW9uOiBmYWlsL2N1cmU6ICBBbnkgZXhjZWwgZmlsZSB3cml0dGVuIHVzaW5nIHRoaXMKY29udHJhc3Qgd2lsbCBnZXQgYSBzaW5nbGUgd29ya3NoZWV0IGNvbXBhcmluZyBmYWlsL2N1cmUuCiogQ29tcGFyZSBmYWlsL2N1cmUgZm9yIGVhY2ggdmlzaXQ6IFRoaXMgdGFrZXMgYSBtb3JlIGdyYW51bGFyIHZpZXcgb2YKdGhlIHByZXZpb3VzIGNvbnRyYXN0LiAgSWYgb25lIGlzIHNvLWluY2xpbmVkLCBvbmUgY291bGQgY29tcGFyZQpyZXN1bHRzIGZyb20gdGhlIGZvbGxvd2luZyBjb250cmFzdCBhZ2FpbnN0IHRoZSBwcmV2aW91cyBhbmQgZm9sbG93aW5nCmNvbnRyYXN0IHRvIGxlYXJuIGFib3V0IHRoZSBkeW5hbWljcyBvZiB0aGUgaGVhbGluZyAob3Igbm90KSBwcm9jZXNzLgoqIEFsbCBzYW1wbGVzIGJ5IHZpc2l0OiBUaGlzIGlzIGVmZmVjdGl2ZWx5IHRoZSBvcHBvc2l0ZSBvZiB0aGUKcHJldmlvdXMgYW5kIGNvbXBhcmVzIGFsbCBzYW1wbGVzIG9mIHZpc2l0IHggYWdhaW5zdCB2aXNpdCB5LgoqIFZpc2l0IDEgdnMgZXZlcnl0aGluZyBlbHNlOiBXaGVuIEkgZmlyc3QgZGlkIHRoZSBwcmV2aW91cyBzZXQgb2YKY29udHJhc3RzIEkgcXVpY2tseSByZWFsaXplZCB0aGF0IHZpc2l0cyAyIGFuZCAzIGFyZSByZWxhdGl2ZWx5CnNpbWlsYXIgYW5kIHRoYXQgaXQgbWF5IGJlIHBvc3NpYmxlIHRvIGdhaW4gYSBsaXR0bGUgcG93ZXIgYW5kIGxlYXJuIGEKbGl0dGxlIG1vcmUgYnkgY29tYmluaW5nIHRoZW0uCiogRGlyZWN0bHkgY29tcGFyZSBjZWxsdHlwZXM6IFdlIGhhdmUgdGhyZWUgY2xpbmljYWwgY2VsbCB0eXBlcyBpbiB0aGUKZGF0YSBhbmQgdGhlIGRpZmZlcmVuY2VzIGFtb25nIHRoZW0gYXJlIHF1aXRlIGludGVyZXN0aW5nLgoqIEV0aG5pY2l0aWVzOiBXZSBhbHNvIGhhdmUgdGhyZWUgZXRobmljIGdyb3VwcyBpbiB0aGUgZGF0YSwgdGhvdWdoCnRoZXJlIGFyZSBzb21lIHdhY2t5IGNvbmZvdW5kZWQgdmFyaWFibGVzIHdoZW4gY29uc2lkZXJpbmcgdGhlbQp0aHJvdWdoIHRoZSBsZW5zZSBvZiBjdXJlL2ZhaWw7IHNvIGFueSByZXN1bHRzIGNvbXBhcmluZyB0aGVtIHNob3VsZApiZSB0cmVhdGVkIHdpdGggY2F1dGlvbi4KKiBQb3dlcmxlc3MgdmlzaXRzK2NlbGx0eXBlK2NmOiBUaGlzIGlzIGEgbGFzdC1taW51dGUgYWRkaXRpb24KcmVxdWVzdGVkIGJ5IE1hcmlhIEFkZWxhaWRhLiAgSSBhc3N1bWUgaXQgd2FzIHN1Z2dlc3RlZCBieSBhIHJldmlld2VyLAp0aG91Z2ggSSBkbyBub3QgcmVjYWxsIHNlZWluZyBhbnl0aGluZyBpbiB0aGUgcmV2aWV3cyB3aGljaCBtYWRlIHRoaXMKcmVxdWVzdC4gIFRoZSBudW1iZXIgb2Ygc2FtcGxlcyB3ZSBoYXZlIGluIHRoZSBkYXRhIGp1c3QgX2JhcmVseV8Kc3VwcG9ydHMgdGhlc2UgY29udHJhc3RzLCBhbmQgZ2l2ZW4gdGhlIHN0cmVuZ3RoIG9mIGFsbCB0aGUgdmFyaW91cwpzdXJyb2dhdGVzLCBJIHdvdWxkIGJlIHNvbWV3aGF0IHJlbHVjdGFudCB0byB0cnVzdCBhbnkgZ2VuZXMgZGVlbWVkIERFCmluIHRoZW0gd2l0aG91dCBzb21lIG90aGVyIGV2aWRlbmNlLiAgSXQgc2hvdWxkIGJlIG5vdGVkIHRoYXQgdGhpcyBpcwp0aGUgaW50ZWxsZWN0dWFsIGNvdW50ZXJwb2ludCB0byB0aGUgY3JpdGlxdWUgZnJvbSBhIGRpZmZlcmVudApyZXZpZXdlciwgdGhhdCBhcnRpZmljYWxseSBtZXJnaW5nIGZhY3RvcnMgbGlrZSB0aGlzIGlzIHByb2JsZW1hdGljIChJCnBlcnNvbmFsbHkgdGVuZCB0byBhZ3JlZSB3aXRoIHRoZSBsYXRlciBhcmd1bWVudCBtb3JlIHRoYW4gdGhlIGZvcm1lcgp3aXRoIHRoZSBjYXZlYXQgdGhhdCB0aGUgYWRkZWQgY29tcGxleGl0eSAod2l0aCByZXNwZWN0IHRvIHdoYXQgaXMKYWN0dWFsbHkgdHlwZWQgYnkgdGhlIHBlcnNvbiAobWUpKSBjYW4gYmUgYSBwcm9ibGVtLiAgVGh1cyBJIHRlbmQgdG8KZG8gdGhlIHRoaW5nIHdoaWNoIGlzIGV4cGxpY2l0bHkgbGVzcyBzdGF0aXN0aWNhbGx5IGNvcnJlY3QgKGJ1dCBJIGNhbgphbHNvIHNob3cgcHJldHR5IGRlZmluaXRpdmVseSB0aGF0IHRoZSByZXN1bHRzIGFyZSB2ZXJ5IG5lYXJseQppZGVudGljYWwpIGluIG9yZGVyIHRvIG1ha2UgaXQgZWFzaWVyIHRvIHNob3cgdGhhdCBubyBtaXN0YWtlcyB3ZXJlCm1hZGUuICBFLmcuIHRlbnNpb24gYmV0d2VlbiAnY29ycmVjdG5lc3MnIGFuZCAncm9idXN0bmVzcycuCgpgYGB7cn0KdF9jZl9jb250cmFzdCA8LSBsaXN0KAogICJvdXRjb21lIiA9IGMoInR1bWFjb19mYWlsdXJlIiwgInR1bWFjb19jdXJlIikpCmNmX2NvbnRyYXN0IDwtIGxpc3QoCiAgIm91dGNvbWUiID0gYygiZmFpbHVyZSIsICJjdXJlIikpCnZpc2l0Y2ZfY29udHJhc3RzIDwtIGxpc3QoCiAgInYxY2YiID0gYygidjFfZmFpbHVyZSIsICJ2MV9jdXJlIiksCiAgInYyY2YiID0gYygidjJfZmFpbHVyZSIsICJ2Ml9jdXJlIiksCiAgInYzY2YiID0gYygidjNfZmFpbHVyZSIsICJ2M19jdXJlIikpCnZpc2l0X2NvbnRyYXN0cyA8LSBsaXN0KAogICJ2MnYxIiA9IGMoImMyIiwgImMxIiksCiAgInYzdjEiID0gYygiYzMiLCAiYzEiKSwKICAidjN2MiIgPSBjKCJjMyIsICJjMiIpKQp2aXNpdF92MWxhdGVyIDwtIGxpc3QoCiAgImxhdGVyX3ZzX2ZpcnN0IiA9IGMoImxhdGVyIiwgImZpcnN0IikpCmNlbGx0eXBlcyA8LSBsaXN0KAogICJlb19tb25vIiA9IGMoImVvc2lub3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJuZV9tb25vIiA9IGMoIm5ldXRyb3BoaWxzIiwgIm1vbm9jeXRlcyIpLAogICJlb19uZSIgPSBjKCJlb3Npbm9waGlscyIsICJuZXV0cm9waGlscyIpKQpldGhuaWNpdHlfY29udHJhc3RzIDwtIGxpc3QoCiAgIm1lc3Rpem9faW5kaWdlbm91cyIgPSBjKCJtZXN0aXphIiwgImluZGlnZW5hIiksCiAgIm1lc3Rpem9fYWZyb2NvbCIgPSBjKCJtZXN0aXphIiwgImFmcm9jb2wiKSwKICAiaW5kaWdlbm91c19hZnJvY29sIiA9IGMoImluZGlnZW5hIiwgImFmcm9jb2wiKSkKdmlzaXR0eXBlX2NvbnRyYXN0c19tb25vIDwtIGxpc3QoCiAgInYydjFfbW9ub19jdXJlIiA9IGMoIm1vbm9jeXRlc18yX2N1cmUiLCAibW9ub2N5dGVzXzFfY3VyZSIpLAogICJ2MnYxX21vbm9fZmFpbHVyZSIgPSBjKCJtb25vY3l0ZXNfMl9mYWlsdXJlIiwgIm1vbm9jeXRlc18xX2ZhaWx1cmUiKSwKICAidjN2MV9tb25vX2N1cmUiID0gYygibW9ub2N5dGVzXzNfY3VyZSIsICJtb25vY3l0ZXNfMV9jdXJlIiksCiAgInYzdjFfbW9ub19mYWlsdXJlIiA9IGMoIm1vbm9jeXRlc18zX2ZhaWx1cmUiLCAibW9ub2N5dGVzXzFfZmFpbHVyZSIpKQp2aXNpdHR5cGVfY29udHJhc3RzX2VvIDwtIGxpc3QoCiAgInYydjFfZW9fY3VyZSIgPSBjKCJlb3Npbm9waGlsc18yX2N1cmUiLCAiZW9zaW5vcGhpbHNfMV9jdXJlIiksCiAgInYydjFfZW9fZmFpbHVyZSIgPSBjKCJlb3Npbm9waGlsc18yX2ZhaWx1cmUiLCAiZW9zaW5vcGhpbHNfMV9mYWlsdXJlIiksCiAgInYzdjFfZW9fY3VyZSIgPSBjKCJlb3Npbm9waGlsc18zX2N1cmUiLCAiZW9zaW5vcGhpbHNfMV9jdXJlIiksCiAgInYzdjFfZW9fZmFpbHVyZSIgPSBjKCJlb3Npbm9waGlsc18zX2ZhaWx1cmUiLCAiZW9zaW5vcGhpbHNfMV9mYWlsdXJlIikpCnZpc2l0dHlwZV9jb250cmFzdHNfbmUgPC0gbGlzdCgKICAidjJ2MV9uZV9jdXJlIiA9IGMoIm5ldXRyb3BoaWxzXzJfY3VyZSIsICJuZXV0cm9waGlsc18xX2N1cmUiKSwKICAidjJ2MV9uZV9mYWlsdXJlIiA9IGMoIm5ldXRyb3BoaWxzXzJfZmFpbHVyZSIsICJuZXV0cm9waGlsc18xX2ZhaWx1cmUiKSwKICAidjN2MV9uZV9jdXJlIiA9IGMoIm5ldXRyb3BoaWxzXzNfY3VyZSIsICJuZXV0cm9waGlsc18xX2N1cmUiKSwKICAidjN2MV9uZV9mYWlsdXJlIiA9IGMoIm5ldXRyb3BoaWxzXzNfZmFpbHVyZSIsICJuZXV0cm9waGlsc18xX2ZhaWx1cmUiKSkKdmlzaXR0eXBlX2NvbnRyYXN0cyA8LSBjKHZpc2l0dHlwZV9jb250cmFzdHNfbW9ubywKICAgICAgICAgICAgICAgICAgICAgICAgIHZpc2l0dHlwZV9jb250cmFzdHNfZW8sCiAgICAgICAgICAgICAgICAgICAgICAgICB2aXNpdHR5cGVfY29udHJhc3RzX25lKQpgYGAKCiMjIEdlbmUgU2V0IEVucmljaG1lbnQKClByZXZpb3VzbHksIHRoZSBnZW5lIHNldCBlbnJpY2htZW50IHdpbGwgZm9sbG93ZWQgZWFjaCBERSBhbmFseXNpcwpkdXJpbmcgdGhpcyBkb2N1bWVudC4gIEkgYW0gYWRkaW5nIGEgc2VyaWVzIG9mIGV4cGxpY2l0bHkgR1NFQQphbmFseXNlcyBpbiB0aGlzIG1vc3QgcmVjZW50IGl0ZXJhdGlvbiwgaW4gdGhlc2UgSSB3aWxsIHBhc3MgdGhlIGZ1bGwKREUgdGFibGUgYW5kIGNoZWNrIHRoZSBkaXN0cmlidXRpb24gb2YgbG9nRkMgdmFsdWVzIGFnYWluc3QgdGhlIGdlbmVzCmluIGVhY2ggY2F0ZWdvcnkgYXMgb3Bwb3NlZCB0byB0aGUgc2ltcGxlciBvdmVyLWVucmljaG1lbnQgb2YgdGhlCmhpZ2gvbG93IERFIGdlbmVzLgoKSG93ZXZlciwgSSBtb3ZlZCB0aG9zZSBhbmFseXNlcyB0byBhIHNlcGFyYXRlIGRvY3VtZW50IGluIHRoZSBob3BlcyBvZgppbXByb3ZpbmcgdGhlaXIgb3JnYW5pemF0aW9uLgoKIyBPbmx5IFR1bWFjbyBzYW1wbGVzCgpTdGFydCBvdmVyLCB0aGlzIHRpbWUgd2l0aCBvbmx5IHRoZSBzYW1wbGVzIGZyb20gVHVtYWNvLiAgV2UgY3VycmVudGx5CmFyZSBhc3N1bWluZyB0aGVzZSB3aWxsIHByb3ZlIHRvIGJlIHRoZSBvbmx5IGFuYWx5c2VzIHVzZWQgZm9yIGZpbmFsCmludGVycHJldGF0aW9uLiAgVGhpcyBpcyBwcmltYXJpbHkgYmVjYXVzZSB3ZSBoYXZlIGluc3VmZmljaWVudApmYWlsZWQgdHJlYXRtZW50IHNhbXBsZXMgZnJvbSBDYWxpLiAgVGhlcmUgaXMgb25lIGRpc2FkdmFudGFnZSB3aGVuCnVzaW5nIHRoZXNlIHNhbXBsZXM6IHRoZXkgaGFkIHRvIHRyYXZlbCBmdXJ0aGVyIHRoYW4gdGhlIHNhbXBsZXMgdGFrZW4KaW4gQ2FsaSBhbmQgdGhlcmUgaXMgc2lnbmlmaWNhbnQgdmFyaWFuY2Ugb2JzZXJ2ZWQgYmV0d2VlbiB0aGUgdHdvCmxvY2F0aW9ucyBhbmQgd2UgY2Fubm90IGRpc2Nlcm4gaXRzIHNvdXJjZS4gIEluIHRoZSB3b3JzdCBjYXNlCnNjZW5hcmlvIChvbmUgd2hpY2ggSSB0aGluayB1bmxpa2VseSksIHRoZSB2YXJpYW5jZSBpcyBjYXVzZWQKYnkgZGVncmFkZWQgUk5BIGR1cmluZyB0cmFuc2l0LiAgV2UgZG8ga25vdyB0aGF0IHRoZSBzYW1wbGVzIHdlcmUKd2VsbC1zdG9yZWQgaW4gUk5BTGF0ZXIgYW5kIGZyb3plbi9ldGMsIHNvIEkgYW0gaW5jbGluZWQgdG8gZGlzY291bnQKdGhhdCBwb3NzaWJpbGl0eS4gIEkgdGhpbmsgYSBtb3JlIGNvbXBlbGxpbmcgZGlmZmVyZW5jZSBsaWVzIGluIHRoZQpkaWZmZXJlbnQgcG9wdWxhdGlvbiBkZW1vZ3JhcGhpY3Mgb2JzZXJ2ZWQgaW4gdGhlIHR3byBsb2NhdGlvbnMuCkFjdHVhbGx5LCBub3cgdGhhdCBJIGhhdmUgdHlwZWQgdGhlc2Ugc2VudGVuY2VzIG91dCwgSSB0aGluayBJIGNhbgpzZW1pLXRlc3QgdGhpcyBoeXBvdGhlc2lzIGJ5IGxvb2tpbmcgYXQgdGhlIHNldCBvZiBERSBnZW5lcyBiZXR3ZWVuCnRoZSB0d28gbG9jYXRpb25zIGFuZCBjb21wYXJlIHRoYXQgcmVzdWx0IHRvIHRoZSBUdW1hY28gKGFuZC9vciBDYWxpKQpldGhuaWNpdHkgY29tcGFyaXNvbiB3aGljaCBpcyBtb3N0IHJlcHJlc2VudGF0aXZlIG9mIHRoZSBldGhuaWNpdHkKZGlmZmVyZW5jZXMgYmV0d2VlbiB0aGVtLiAgSWYgSSBnZXQgaXQgaW50byBteSBoZWFkIHRvIHRyeSB0aGlzLCBJCndpbGwgbmVlZCB0byBsb2FkIHRoZSBERSB0YWJsZXMgZnJvbSB0aGUKMDNkaWZmZXJlbnRpYWxfZXhwcmVzc2lvbl9ib3RoLlJtZCBkb2N1bWVudDsgc28gSSBhbSBtb3N0IGxpa2VseSB0bwp0cnkgaXQgb3V0IGluIHRoZSAwN3Zhcl9jb2VmIGRvY3VtZW50LCB3aGljaCB3YXMgbW9zdGx5IHdyaXR0ZW4gYnkKVGhlcmVzYSBhbmQgaXMgYWxyZWFkeSBleGFtaW5pbmcgc29tZSBzaW1pbGFyIHF1ZXN0aW9ucy4KCiMjIEFsbCBzYW1wbGVzCgpTdGFydCBieSBjb25zaWRlcmluZyBhbGwgVHVtYWNvIGNlbGwgdHlwZXMuICBOb3RlIHRoYXQgaW4gdGhpcyBjYXNlIHdlCm9ubHkgdXNlIFNWQSwgcHJpbWFyaWx5IGJlY2F1c2UgSSBhbSBub3QgY2VydGFpbiB3aGF0IHdvdWxkIGJlIGFuCmFwcHJvcHJpYXRlIGJhdGNoIGZhY3RvciwgcGVyaGFwcyB2aXNpdD8KCmBgYHtyfQp0X2NmX2NsaW5pY2FsX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodF9jbGluaWNhbCwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9jbGluaWNhbF9kZV9zdmEKdF9jZl9jbGluaWNhbF90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZl9jbGluaWNhbF9kZV9zdmEsIGtlZXBlcnMgPSBjZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RfY2xpbmljYWxfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfY2xpbmljYWxfdGFibGVfc3ZhCnRfY2ZfY2xpbmljYWxfdGFibGVfc3ZhW1sicGxvdHMiXV1bWyJvdXRjb21lIl1dW1siZGVzZXFfbWFfcGxvdHMiXV0KdF9jZl9jbGluaWNhbF9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9jbGluaWNhbF90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90X2NsaW5pY2FsX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9jbGluaWNhbF9zaWdfc3ZhCgpkaW0odF9jZl9jbGluaWNhbF9zaWdfc3ZhJGRlc2VxJHVwc1tbMV1dKQpkaW0odF9jZl9jbGluaWNhbF9zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pCmBgYAoKUmVwZWF0IHdpdGhvdXQgdGhlIGJpb3BzaWVzLgoKYGBge3J9CnRfY2ZfY2xpbmljYWxuYl9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfY2xpbmljYWxfbm9iaW9wLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9jbGluaWNhbG5iX2RlX3N2YQp0X2NmX2NsaW5pY2FsbmJfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfY2ZfY2xpbmljYWxuYl9kZV9zdmEsIGtlZXBlcnMgPSBjZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0FsbF9TYW1wbGVzL3RfY2xpbmljYWxfbm9iaW9wX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX2NsaW5pY2FsbmJfdGFibGVfc3ZhCnRfY2ZfY2xpbmljYWxuYl90YWJsZV9zdmFbWyJwbG90cyJdXVtbIm91dGNvbWUiXV1bWyJkZXNlcV9tYV9wbG90cyJdXQp0X2NmX2NsaW5pY2FsbmJfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRfY2ZfY2xpbmljYWxuYl90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9BbGxfU2FtcGxlcy90X2NsaW5pY2FsX25vYmlvcF9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfY2xpbmljYWxuYl9zaWdfc3ZhCgpkaW0odF9jZl9jbGluaWNhbG5iX3NpZ19zdmEkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX2NsaW5pY2FsbmJfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQpgYGAKCkFzIHRoZSBkYXRhIHN0cnVjdHVyZSdzIG5hbWUgc3VnZ2VzdHMsIHRoZSBhYm92ZSBjb21wYXJpc29uIHNlZWtzIHRvCmxlYXJuIGlmIHRoZXJlIGFyZSBmYWlsL2N1cmUgZGlmZmVyZW5jZXMgZGlzY2VybmFibGUgYWNyb3NzIGFsbApjbGluaWNhbCBjZWxsdHlwZXMgaW4gc2FtcGxlcyB0YWtlbiBpbiBUdW1hY28uCgpUaGUgc2V0IG9mIHN0ZXBzIHRha2VuIGluIHRoaXMgcHJldmlvdXMgYmxvY2sgd2lsbCBiZSBlc3NlbnRpYWxseQpyZXBlYXRlZCBmb3IgZXZlcnkgc2V0IG9mIGNvbnRyYXN0cyBhbmQgd2F5IG9mIG1peGluZy9tYXRjaGluZyB0aGUKZGF0YSBhbmQgZm9sbG93cyB0aGUgcGF0aDoKCjEuICBSdW4gYWxsX3BhaXJ3aXNlIHRvIHJ1biBkZXNlcSBhbmQgZnJpZW5kcyB1c2luZyBzdXJvZ2F0ZSBlc3RpbWF0ZXMKICAgIHByb3ZpZGVkIGJ5IHN2YSB3aGVuIGFwcHJvcHJpYXRlL3Bvc3NpYmxlLiAgVGhpcyBjcmVhdGVzIGFuIHVud2llbGR5CiAgICBkYXRhc3RydWN0dXJlIGNvbnRhaW5pbmcgdGhlIHJlc3VsdHMgZnJvbSBhbGwgbWV0aG9kcyBhbmQgYWxsCiAgICBjb250cmFzdHMgYXMgYSBzZXJpZXMgb2YgbmVzdGVkIGxpc3RzLgoyLiAgTWFzaCB0aGVtIHRvZ2V0aGVyIHdpdGggY29tYmluZV9kZV90YWJsZXMsIHVzZSB0aGUgJ2tlZXBlcnMnCiAgICBhcmd1bWVudCB0byBkZWZpbmUgdGhlIGRlc2lyZWQgbnVtZXJhdG9ycy9kZW5vbWluYXRvcnMsIGFuZCB3cml0ZQogICAgdGhlIHRhYmxlcyB0byB0aGUgZmlsZSBwcm92aWRlZCBpbiB0aGUgJ2V4Y2VsJyBhcmd1bWVudC4KMy4gIFlhbmsgb3V0IHRoZSAnc2lnbmlmaWNhbnQnIGdlbmVzIGFuZCBzZW5kIHRoZW0gdG8gYSBzZXBhcmF0ZSBleGNlbAogICAgZG9jdW1lbnQuICBJbiBhbGwgY2FzZXMsICdzaWduaWZpY2FudCcgaXMgdGhlIHNldCB3aXRoIGEgfGxvZzJGQ3wKICAgID49IDEuMCBhbmQgYWRqdXN0ZWQgcC12YWx1ZSA8PSAwLjA1LiAgVGhpcyByZW1pbmRzIG1lLCBvbmUgb2YgdGhlCiAgICByZXZpZXdlcnMgbWVudGlvbmVkIGEgc2V0IG9mIGludGVybmF0aW9uYWwgZ3VpZGVsaW5lcyBmb3IKICAgIHNpZ25pZmljYW50IGdlbmVzLCBJIHRob3VnaHQgSSBiYXNpY2FsbHkga25vdyB3aGF0IEkgYW0gZG9pbmcsIGJ1dAogICAgdGhpcyBjYXVnaHQgbWUgY29tcGxldGVseSB1bmF3YXJlLiAgSWYgYW55b25lIGV2ZXIgcmVhZHMgdGhpcyAobm8KICAgIG9uZSB3aWxsLCBsZXQgdXMgYmUgaG9uZXN0KSBJIHdvdWxkIGxvdmUgdG8ga25vdy4gIFRoZSBjbG9zZXN0CiAgICB0aGluZyBJIGZvdW5kIGlzOiAoQGNodW5nQmVzdFByYWN0aWNlc0RpZmZlcmVudGlhbDIwMjEpLCBidXQgSSBkbwogICAgbm90IHRoaW5rIGl0IHJlYWxseSBhZGRyZXNzZXMgdGhpcyBpZGVhIChJIGhhdmUgbm90IHlldCByZWFkIGl0CiAgICBjYXJlZnVsbHkpLgoKVGhlc2UgZGF0YXN0cnVjdHVyZXMgYXJlIGFsbCBleHBvc2VkIHRvIHZhcmlvdXMgZnVuY3Rpb25zIGluIGhwZ2x0b29scwp3aGljaCBhbGxvdyBvbmUgdG8gcG9rZS9jb21wYXJlIHRoZW07IEkgYW0gbm90IGEgZmFuIG9mIEV4Y2VsLCBidXQgSQp0aGluayB0aGUgeGxzeCBkb2N1bWVudHMgY3JlYXRlcyBhcmUgcHJldHR5IGRlY2VudCwgdG9vLgoKIyBWaXNpdCBjb21wYXJpc29ucwoKTGF0ZXIgaW4gdGhpcyBkb2N1bWVudCBJIGRvIGEgYnVuY2ggb2YgdmlzaXQvY2YgY29tcGFyaXNvbnMuICBJbiB0aGlzCmJsb2NrIEkgd2FudCB0byBleHBsaWNpdGx5IG9ubHkgY29tcGFyZSB2MSB0byBvdGhlciB2aXNpdHMuICBUaGlzIGlzCnNvbWV0aGluZyBJIGRpZCBxdWl0ZSBhIGxvdCBpbiB0aGUgMjAxOSBkYXRhc2V0cywgYnV0IG5ldmVyIGFjdHVhbGx5Cm1vdmVkIHRvIHRoaXMgZG9jdW1lbnQuCgpgYGB7cn0KdHYxX3ZzX2xhdGVyIDwtIGFsbF9wYWlyd2lzZSh0X3YxdnMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdHYxX3ZzX2xhdGVyCnR2MV92c19sYXRlcl90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0djFfdnNfbGF0ZXIsIGtlZXBlcnMgPSB2aXNpdF92MWxhdGVyLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMvdHYxX3ZzX2xhdGVyX3RhYmxlcy12e3Zlcn0ueGxzeCIpKQp0djFfdnNfbGF0ZXJfdGFibGUKdHYxX3ZzX2xhdGVyX3NpZyA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHR2MV92c19sYXRlcl90YWJsZSwKICBleGNlbCA9IGdsdWUoInt4bHN4X3ByZWZpeH0vREVfVmlzaXRzL3R2MV92c19sYXRlcl9zaWctdnt2ZXJ9Lnhsc3giKSkKdHYxX3ZzX2xhdGVyX3NpZwpgYGAKCiMgU2V4IGNvbXBhcmlzb24KCmBgYHtyfQp0X3NleCA8LSBzdWJzZXRfZXhwdCh0Y19zZXgsIHN1YnNldCA9ICJjbGluaWMgPT0gJ3R1bWFjbyciKQp0X3NleAp0X3NleF9kZSA8LSBhbGxfcGFpcndpc2UodF9zZXgsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSkKdF9zZXhfZGUKdF9zZXhfdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9zZXhfZGUsIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9HZW5lX1NldF9FbnJpY2htZW50L3Rfc2V4X3RhYmxlLXZ7dmVyfS54bHN4IikpCnRfc2V4X3RhYmxlCnRfc2V4X3NpZyA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRfc2V4X3RhYmxlLCBleGNlbCA9IGdsdWUoInt4bHN4X3ByZWZpeH0vR2VuZV9TZXRfRW5yaWNobWVudC90X3NleF9zaWctdnt2ZXJ9Lnhsc3giKSkKdF9zZXhfc2lnCmBgYAoKYGBge3J9CnRjX3NleF9jdXJlIDwtIHN1YnNldF9leHB0KHRjX3NleCwgc3Vic2V0ID0gImZpbmFsb3V0Y29tZT09J2N1cmUnIikKdF9zZXhfY3VyZSA8LSBzdWJzZXRfZXhwdCh0Y19zZXhfY3VyZSwgc3Vic2V0ID0gImNsaW5pYyA9PSAndHVtYWNvJyIpCgp0X3NleF9jdXJlX2RlIDwtIGFsbF9wYWlyd2lzZSh0X3NleF9jdXJlLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9zZXhfY3VyZV9kZQp0X3NleF9jdXJlX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfc2V4X2N1cmVfZGUsIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9TZXgvdF9zZXhfY3VyZV90YWJsZS12e3Zlcn0ueGxzeCIpKQp0X3NleF9jdXJlX3RhYmxlCnRfc2V4X2N1cmVfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9zZXhfY3VyZV90YWJsZSwgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX1NleC90X3NleF9jdXJlX3NpZy12e3Zlcn0ueGxzeCIpKQp0X3NleF9jdXJlX3NpZwpgYGAKCiMgRXRobmljaXR5IGNvbXBhcmlzb25zCgpgYGB7cn0KdF9ldGhuaWNpdHlfZGUgPC0gYWxsX3BhaXJ3aXNlKHRfZXRuaWFfZXhwdCwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9ldGhuaWNpdHlfZGUKdF9ldGhuaWNpdHlfdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9ldGhuaWNpdHlfZGUsIGtlZXBlcnMgPSBldGhuaWNpdHlfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9FdGhuaWNpdHkvdF9ldGhuaWNpdHlfdGFibGUtdnt2ZXJ9Lnhsc3giKSkKdF9ldGhuaWNpdHlfdGFibGUKdF9ldGhuaWNpdHlfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9ldGhuaWNpdHlfdGFibGUsIGFjY29yZGluZ190byA9ICJkZXNlcSIsCiAgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX0V0aG5pY2l0eS90X2V0aG5pY2l0eV9zaWctdnt2ZXJ9Lnhsc3giKSkKdF9ldGhuaWNpdHlfc2lnCmBgYAoKIyMjIFNlcGFyYXRlIHRoZSBUdW1hY28gZGF0YSBieSB2aXNpdAoKT25lIG9mIHRoZSBtb3N0IGNvbXBlbGxpbmcgaWRlYXMgaW4gdGhlIGRhdGEgaXMgdGhlIG9wcG9ydHVuaXR5IHRvCmZpbmQgZ2VuZXMgaW4gdGhlIGZpcnN0IHZpc2l0IHdoaWNoIG1heSBoZWxwIHByZWRpY3QgdGhlIGxpa2VsaWhvb2QKdGhhdCBhIHBlcnNvbiB3aWxsIHJlc3BvbmQgd2VsbCB0byB0cmVhdG1lbnQuICBUaGUgZm9sbG93aW5nIGJsb2NrCndpbGwgdGhlcmVmb3JlIGxvb2sgYXQgY3VyZS9mYWlsIGZyb20gVHVtYWNvIGF0IHZpc2l0IDEuCgojIyMjIEN1cmUvRmFpbCwgVHVtYWNvIFZpc2l0IDEKCmBgYHtyfQp0X2NmX2NsaW5pY2FsX3YxX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodHYxX3NhbXBsZXMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRfY2ZfY2xpbmljYWxfdjFfZGVfc3ZhCnRfY2ZfY2xpbmljYWxfdjFfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfY2ZfY2xpbmljYWxfdjFfZGVfc3ZhLCBrZWVwZXJzID0gY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9WaXNpdHMvdF9jbGluaWNhbF92MV9jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9jbGluaWNhbF92MV90YWJsZV9zdmEKdF9jZl9jbGluaWNhbF92MV9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9jbGluaWNhbF92MV90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9WaXNpdHMvdF9jbGluaWNhbF92MV9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfY2xpbmljYWxfdjFfc2lnX3N2YQoKZGltKHRfY2ZfY2xpbmljYWxfdjFfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfY2xpbmljYWxfdjFfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQpgYGAKCiMjIyMgQ3VyZS9GYWlsLCBUdW1hY28gVmlzaXQgMgoKVGhlIHZpc2l0IDIgYW5kIHZpc2l0IDMgc2FtcGxlcyBhcmUgaW50ZXJlc3RpbmcgYmVjYXVzZSB0aGV5IHByb3ZpZGUKYW4gb3Bwb3J0dW5pdHkgdG8gc2VlIGlmIHdlIGNhbiBvYnNlcnZlIGNoYW5nZXMgaW4gcmVzcG9uc2UgaW4gdGhlCm1pZGRsZSBhbmQgZW5kIG9mIHRyZWF0bWVudC4uLgoKYGBge3J9CnRfY2ZfY2xpbmljYWxfdjJfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0djJfc2FtcGxlcywgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9jbGluaWNhbF92Ml9kZV9zdmEKdF9jZl9jbGluaWNhbF92Ml90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZl9jbGluaWNhbF92Ml9kZV9zdmEsIGtlZXBlcnMgPSBjZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L1Zpc2l0cy90X2NsaW5pY2FsX3YyX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX2NsaW5pY2FsX3YyX3RhYmxlX3N2YQp0X2NmX2NsaW5pY2FsX3YyX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX2NsaW5pY2FsX3YyX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L1Zpc2l0cy90X2NsaW5pY2FsX3YyX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9jbGluaWNhbF92Ml9zaWdfc3ZhCgpkaW0odF9jZl9jbGluaWNhbF92Ml9zaWdfc3ZhJGRlc2VxJHVwc1tbMV1dKQpkaW0odF9jZl9jbGluaWNhbF92Ml9zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pCmBgYAoKIyMjIEJ5IGNlbGwgdHlwZQoKTm93IGxldCB1cyBzd2l0Y2ggb3VyIHZpZXcgdG8gZWFjaCBpbmRpdmlkdWFsIGNlbGwgdHlwZSBjb2xsZWN0ZWQuClRoZSBob3BlIGhlcmUgaXMgdGhhdCB3ZSB3aWxsIGJlIGFibGUgdG8gbGVhcm4gc29tZSBjZWxsLXNwZWNpZmljCmRpZmZlcmVuY2VzIGluIHRoZSByZXNwb25zZSBmb3IgcGVvcGxlIHdobyBkaWQobm90KSByZXNwb25kIHdlbGwuCgojIyMjIEN1cmUvRmFpbCwgQmlvcHNpZXMKCmBgYHtyfQp0X2NmX2Jpb3BzeV9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfYmlvcHNpZXMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9iaW9wc3lfZGVfc3ZhCnRfY2ZfYmlvcHN5X3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X2NmX2Jpb3BzeV9kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQmlvcHNpZXMvdF9iaW9wc3lfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfYmlvcHN5X3RhYmxlX3N2YQp0X2NmX2Jpb3BzeV9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9iaW9wc3lfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vQmlvcHNpZXMvdF9jZl9iaW9wc3lfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX2Jpb3BzeV9zaWdfc3ZhCgpkaW0odF9jZl9iaW9wc3lfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfYmlvcHN5X3NpZ19zdmEkZGVzZXEkZG93bnNbWzFdXSkKYGBgCgojIyMjIEN1cmUvRmFpbCwgTW9ub2N5dGVzCgpTYW1lIHF1ZXN0aW9uLCBidXQgdGhpcyB0aW1lIGxvb2tpbmcgYXQgbW9ub2N5dGVzLiAgSW4gYWRkaXRpb24sIHRoaXMKY29tcGFyaXNvbiB3YXMgZG9uZSB0d2ljZSwgb25jZSB1c2luZyBTVkEgYW5kIG9uY2UgdXNpbmcgdmlzaXQgYXMgYQpiYXRjaCBmYWN0b3IuCgpgYGB7cn0KdF9jZl9tb25vY3l0ZV9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfbW9ub2N5dGVzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NmX21vbm9jeXRlX2RlX3N2YQp0X2NmX21vbm9jeXRlX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X2NmX21vbm9jeXRlX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Nb25vY3l0ZXMvdF9tb25vY3l0ZV9jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9tb25vY3l0ZV90YWJsZV9zdmEKdF9jZl9tb25vY3l0ZV9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9tb25vY3l0ZV90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Nb25vY3l0ZXMvdF9tb25vY3l0ZV9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfbW9ub2N5dGVfc2lnX3N2YQoKZGltKHRfY2ZfbW9ub2N5dGVfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfbW9ub2N5dGVfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQoKdF9jZl9tb25vY3l0ZV9kZV9iYXRjaHZpc2l0IDwtIGFsbF9wYWlyd2lzZSh0X21vbm9jeXRlcywgbW9kZWxfYmF0Y2ggPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRfY2ZfbW9ub2N5dGVfZGVfYmF0Y2h2aXNpdAp0X2NmX21vbm9jeXRlX3RhYmxlX2JhdGNodmlzaXQgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZl9tb25vY3l0ZV9kZV9iYXRjaHZpc2l0LCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L01vbm9jeXRlcy90X21vbm9jeXRlX2NmX3RhYmxlX2JhdGNodmlzaXQtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9tb25vY3l0ZV90YWJsZV9iYXRjaHZpc2l0CnRfY2ZfbW9ub2N5dGVfc2lnX2JhdGNodmlzaXQgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX21vbm9jeXRlX3RhYmxlX2JhdGNodmlzaXQsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Nb25vY3l0ZXMvdF9tb25vY3l0ZV9jZl9zaWdfYmF0Y2h2aXNpdC12e3Zlcn0ueGxzeCIpKQp0X2NmX21vbm9jeXRlX3NpZ19iYXRjaHZpc2l0CgpkaW0odF9jZl9tb25vY3l0ZV9zaWdfYmF0Y2h2aXNpdCRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfbW9ub2N5dGVfc2lnX2JhdGNodmlzaXQkZGVzZXEkZG93bnNbWzFdXSkKYGBgCgojIyMjIyBSZXBlYXQgdGVzdCBvZiBkaWZmZXJlbnQgbW9kZWxzOiBNb25vY3l0ZXMKCkVpdGhlciBhYm92ZSBvciBiZWxvdyB0aGlzIHNlY3Rpb24gSSBoYXZlIGEgbmVhcmx5IGlkZW50aWNhbCBibG9jawp3aGljaCBzZWVrcyB0byBkZW1vbnN0cmF0ZSB0aGUgc2ltaWxhcml0aWVzL2RpZmZlcmVuY2Ugb2JzZXJ2ZWQKYmV0d2VlbiBteSBwcmVmZXJyZWQvc2ltcGxpZmllZCBtb2RlbCB2cy4gYSBtb3JlIGV4cGxpY2l0bHkgY29ycmVjdAphbmQgY29tcGxleCBtb2RlbC4gIElmIHRoZSB0cmVuZCBob2xkcyBmcm9tIHdoYXQgd2Ugb2JzZXJ2ZWQgd2l0aCB0aGUKZW9zaW5vcGhpbHMgYW5kIG5ldXRyb3BoaWxzLCBJIHdvdWxkIGV4cGVjdCB0byBzZWUgdGhhdCB0aGUgcmVzdWx0cwphcmUgbWFyZ2luYWxseSAnYmV0dGVyJyAoYXMgZGVmaW5lZCBieSB0aGUgc3RyZW5ndGggb2YgdGhlIHBlcmNlaXZlZAppbnRlcmxldWtpbiByZXNwb25zZSBhbmQgcmF3IG51bWJlciBvZiAnc2lnbmlmaWNhbnQnIGdlbmVzKTsgYnV0IEkKcmVtYWluIHdvcnJpZWQgdGhhdCB0aGlzIHdpbGwgcHJvdmUgYSBtb3JlIGJyaXR0bGUgYW5kIGVycm9yLXByb25lCmFuYWx5c2lzLgoKYGBge3J9CiMjIFRoZSBvcmlnaW5hbCBwYWlyd2lzZSBpbnZvY2F0aW9uIHdpdGggc3ZhOgojI3RfY2ZfbW9ub2N5dGVfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0X21vbm9jeXRlLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAojIyAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLCBwYXJhbGxlbCA9IEZBTFNFLAojIyAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGVzdF9tb25vY3l0ZXMgPC0gbm9ybWFsaXplX2V4cHQodF9tb25vY3l0ZXMsIGZpbHRlciA9ICJzaW1wbGUiKQp0ZXN0X21vbm9fZGVzaWduIDwtIHBEYXRhKHRlc3RfbW9ub2N5dGVzKQp0ZXN0X2Zvcm11bGEgPC0gYXMuZm9ybXVsYSgifiBmaW5hbG91dGNvbWUgKyB2aXNpdG51bWJlciIpCnRlc3RfbW9kZWwgPC0gbW9kZWwubWF0cml4KHRlc3RfZm9ybXVsYSwgZGF0YSA9IHRlc3RfbW9ub19kZXNpZ24pCm51bGxfZm9ybXVsYSA8LSBhcy5mb3JtdWxhKCJ+IHZpc2l0bnVtYmVyIikKbnVsbF9tb2RlbCA8LSBtb2RlbC5tYXRyaXgobnVsbF9mb3JtdWxhLCBkYXRhID0gdGVzdF9tb25vX2Rlc2lnbikKCmxpbmVhcl9tdHJ4IDwtIGV4cHJzKHRlc3RfbW9ub2N5dGVzKQpsMl9tdHJ4IDwtIGxvZzIobGluZWFyX210cnggKyAxKQpjaG9zZW5fc3Vycm9nYXRlcyA8LSBzdmE6Om51bS5zdihkYXQgPSBsMl9tdHJ4LCBtb2QgPSB0ZXN0X21vZGVsKQpjaG9zZW5fc3Vycm9nYXRlcwoKc3Vycm9nYXRlX3Jlc3VsdCA8LSBzdmE6OnN2YXNlcSgKICBkYXQgPSBsaW5lYXJfbXRyeCwgbi5zdiA9IGNob3Nlbl9zdXJyb2dhdGVzLCBtb2QgPSB0ZXN0X21vZGVsLCBtb2QwID0gbnVsbF9tb2RlbCkKbW9kZWxfYWRqdXN0IDwtIGFzLm1hdHJpeChzdXJyb2dhdGVfcmVzdWx0W1sic3YiXV0pCgpjb2xuYW1lcyhtb2RlbF9hZGp1c3QpIDwtIGMoIlNWMSIsICJTVjIiLCAiU1YzIikKcm93bmFtZXMobW9kZWxfYWRqdXN0KSA8LSByb3duYW1lcyhwRGF0YSh0ZXN0X21vbm9jeXRlcykpCmxvbmdlcl9tb2RlbCA8LSBhcy5mb3JtdWxhKCJ+IGZpbmFsb3V0Y29tZSArIHZpc2l0bnVtYmVyICsgU1YxICsgU1YyICsgU1YzIikKbW9ub19kZXNpZ25fc3ZzIDwtIGNiaW5kKHRlc3RfbW9ub19kZXNpZ24sIG1vZGVsX2FkanVzdCkKc3VtbWFyaXplZCA8LSBERVNlcTI6OkRFU2VxRGF0YVNldEZyb21NYXRyaXgoY291bnREYXRhID0gbGluZWFyX210cngsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNvbERhdGEgPSBtb25vX2Rlc2lnbl9zdnMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGRlc2lnbiA9IGxvbmdlcl9tb2RlbCkKZGVzZXFfcnVuIDwtIERFU2VxMjo6REVTZXEoc3VtbWFyaXplZCkKZGVzZXFfdGFibGUgPC0gYXMuZGF0YS5mcmFtZShERVNlcTI6OnJlc3VsdHMob2JqZWN0ID0gZGVzZXFfcnVuLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb250cmFzdCA9IGMoImZpbmFsb3V0Y29tZSIsICJmYWlsdXJlIiwgImN1cmUiKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZm9ybWF0ID0gIkRhdGFGcmFtZSIpKQoKYmlnX3RhYmxlIDwtIHRfY2ZfbW9ub2N5dGVfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0Kb25seV9kZXNlcSA8LSBiaWdfdGFibGVbLCBjKCJkZXNlcV9sb2dmYyIsICJkZXNlcV9hZGpwIildCm1lcmdlZCA8LSBtZXJnZShkZXNlcV90YWJsZSwgb25seV9kZXNlcSwgYnkgPSAicm93Lm5hbWVzIikKcm93bmFtZXMobWVyZ2VkKSA8LSBtZXJnZWRbWyJSb3cubmFtZXMiXV0KbWVyZ2VkW1siUm93Lm5hbWVzIl1dIDwtIE5VTEwKCmNvcl92YWx1ZSA8LSBjb3IudGVzdChtZXJnZWRbWyJsb2cyRm9sZENoYW5nZSJdXSwgbWVyZ2VkW1siZGVzZXFfbG9nZmMiXV0pCmNvcl92YWx1ZQpsb2dmY19wbG90dGVyIDwtIHBsb3RfbGluZWFyX3NjYXR0ZXIobWVyZ2VkWywgYygibG9nMkZvbGRDaGFuZ2UiLCAiZGVzZXFfbG9nZmMiKV0pCmxvZ2ZjX3Bsb3QgPC0gbG9nZmNfcGxvdHRlcltbInNjYXR0ZXIiXV0gKwogIHhsYWIoIkRFU2VxMiBsb2cyRkM6IFZpc2l0IGV4cGxpY2l0bHkgaW4gbW9kZWwiKSArCiAgeWxhYigiREVTZXEyIGxvZzJGQzogRGVmYXVsdCBwYWlyd2lzZSBjb21wYXJpc29uIikgKwogIGdndGl0bGUoZ2x1ZSgiQ29tcGFyaW5nIHJlc3VsdHMgZnJvbSBtb2RlbHM6IHtwcmV0dHlOdW0oY29yX3ZhbHVlW1snZXN0aW1hdGUnXV0pfSAocGVhcnNvbikiKSkKcHAoZmlsZSA9ICJmaWd1cmVzL2NvbXBhcmVfY2ZfYW5kX3Zpc2l0X2luX21vZGVsX21vbm9jeXRlX2xvZ2ZjLnN2ZyIpCmxvZ2ZjX3Bsb3QKZGV2Lm9mZigpCmxvZ2ZjX3Bsb3QKCmNvcl92YWx1ZSA8LSBjb3IudGVzdChtZXJnZWRbWyJwYWRqIl1dLCBtZXJnZWRbWyJkZXNlcV9hZGpwIl1dLCBtZXRob2QgPSAic3BlYXJtYW4iKQpjb3JfdmFsdWUKYWRqcF9wbG90dGVyIDwtIHBsb3RfbGluZWFyX3NjYXR0ZXIobWVyZ2VkWywgYygicGFkaiIsICJkZXNlcV9hZGpwIildKQphZGpwX3Bsb3QgPC0gYWRqcF9wbG90dGVyW1sic2NhdHRlciJdXSArCiAgeGxhYigiREVTZXEyIGFkanA6IFZpc2l0IGV4cGxpY2l0bHkgaW4gbW9kZWwiKSArCiAgeWxhYigiREVTZXEyIGFkanA6IERlZmF1bHQgcGFpcndpc2UgY29tcGFyaXNvbiIpICsKICBnZ3RpdGxlKGdsdWUoIkNvbXBhcmluZyByZXN1bHRzIGZyb20gbW9kZWxzOiB7cHJldHR5TnVtKGNvcl92YWx1ZVtbJ2VzdGltYXRlJ11dKX0gKHNwZWFybWFuKSIpKQpwcChmaWxlID0gImltYWdlcy9jb21wYXJlX2NmX2FuZF92aXNpdF9pbl9tb2RlbF9tb25vY3l0ZV9hZGpwLnN2ZyIpCmFkanBfcGxvdApkZXYub2ZmKCkKYWRqcF9wbG90CgpwcmV2aW91c19zaWdfaWR4IDwtIGJpZ190YWJsZVtbImRlc2VxX2FkanAiXV0gPD0gMC4wNSAmIGFicyhiaWdfdGFibGVbWyJkZXNlcV9sb2dmYyJdXSA+PSAxLjApCnN1bW1hcnkocHJldmlvdXNfc2lnX2lkeCkKcHJldmlvdXNfZ2VuZXMgPC0gcm93bmFtZXMoYmlnX3RhYmxlKVtwcmV2aW91c19zaWdfaWR4XQoKbmV3X3NpZ19pZHggPC0gYWJzKGRlc2VxX3RhYmxlW1sibG9nMkZvbGRDaGFuZ2UiXV0pID49IDEuMCAmIGRlc2VxX3RhYmxlW1sicGFkaiJdXSA8IDAuMDUKbmV3X2dlbmVzIDwtIHJvd25hbWVzKGRlc2VxX3RhYmxlKVtuZXdfc2lnX2lkeF0KbmFfaWR4IDwtIGlzLm5hKG5ld19nZW5lcykKbmV3X2dlbmVzIDwtIG5ld19nZW5lc1shbmFfaWR4XQoKVmVubmVyYWJsZTo6VmVubihsaXN0KCJwcmV2aW91cyIgPSBwcmV2aW91c19nZW5lcywgIm5ldyIgPSBuZXdfZ2VuZXMpKQoKdGVzdF9uZXcgPC0gc2ltcGxlX2dwcm9maWxlcihuZXdfZ2VuZXMpCnRlc3RfbmV3CnRlc3Rfb2xkIDwtIHNpbXBsZV9ncHJvZmlsZXIocHJldmlvdXNfZ2VuZXMpCnRlc3Rfb2xkCgpuZXdfYW5ub3RhdGVkIDwtIG1lcmdlKGZEYXRhKHRfbW9ub2N5dGVzKSwgZGVzZXFfdGFibGUsIGJ5ID0gInJvdy5uYW1lcyIpCnJvd25hbWVzKG5ld19hbm5vdGF0ZWQpIDwtIG5ld19hbm5vdGF0ZWRbWyJSb3cubmFtZXMiXV0KbmV3X2Fubm90YXRlZFtbIlJvdy5uYW1lcyJdXSA8LSBOVUxMCndyaXRlX3hsc3goZGF0YSA9IG5ld19hbm5vdGF0ZWQsIGV4Y2VsID0gImV4Y2VsL21vbm9jeXRlX3Zpc2l0X2luX21vZGVsX3N2YV9jZl9uZXcueGxzeCIpCgpvbGRfYW5ub3RhdGVkIDwtIG1lcmdlKGZEYXRhKHRfZW9zaW5vcGhpbHMpLCBiaWdfdGFibGUsIGJ5ID0gInJvdy5uYW1lcyIpCnJvd25hbWVzKG9sZF9hbm5vdGF0ZWQpIDwtIG9sZF9hbm5vdGF0ZWRbWyJSb3cubmFtZXMiXV0Kb2xkX2Fubm90YXRlZFtbIlJvdy5uYW1lcyJdXSA8LSBOVUxMCndyaXRlX3hsc3goZGF0YSA9IG9sZF9hbm5vdGF0ZWQsIGV4Y2VsID0gImV4Y2VsL21vbm9jeXRlX3Zpc2l0X2luX21vZGVsX3N2YV9jZl9vbGQueGxzeCIpCmBgYAoKVGhlIHByZXZpb3VzIGNvdXBsZSBvZiBibG9ja3MgSSB0aGluayBhcmUgbm90IGFwcHJvYWNoaW5nIHRoaXMgcHJvYmxlbQpjb3JyZWN0bHkuICBJbiBvdXIgZGlzY3Vzc2lvbnMgd2l0aCBOZWFsLCBoZSBzdWdnZXN0ZWQgdGhhdCBhIG1peGVkCmxpbmVhciBtb2RlbCBpcyB0aGUgbW9zdCBhcHByb3ByaWF0ZSBtZXRob2QgZm9yIHRoaXMgdHlwZSBvZiBxdWVyeS4gIEkKdGhpbmsgSSBjYW4gcGVyZm9ybSB0aGF0IHdpdGggbGltbWEsIHZpYSB2b29tLiAgTGV0IHVzIHRyeSBhbmQgc2VlCndoYXQgaGFwcGVucy4gIEFmdGVyIGRvaW5nIHNvbWUgcmVhZGluZywgSSB0aGluayB0aGUgbW9zdCBhcHByb3ByaWF0ZQp3YXkgdG8gcGVyZm9ybSB0aGlzIGlzIHRvIHVzZSBkcmVhbSgpIGZyb20gdmFyaWFuY2VQYXJpdGlvbiwgd2hpY2ggaXMKY29vbCBiZWNhdXNlIEkgcmVhbGx5IGxpa2UgaXQuCgpJIGhhdmUgYWxyZWFkeSB3cml0dGVuIGEgc2tlbGV0b24gZnVuY3Rpb24gJ2RyZWFtX3BhaXJ3aXNlKCknIGFzIGEKc2libGluZyB0byBteSBvdGhlciAqX3BhaXJ3aXNlKCkgZnVuY3Rpb25zLiAgSSB0aGluayB0aGF0IHdpdGggc29tZQptaW5vciBtb2RpZmljYXRpb25zIChvciBtYXliZSBub25lIGF0IGFsbCwgd2hlbiBJIHdyb3RlIGl0IEkgd2FzCnRoaW5raW5nIGFib3V0IGZ1biBtb2RlbHMgdGhhdCB2YXJpYW5jZVBhcnRpdGlvbiBzdXBwb3J0cykgaXQgY2FuCmFjY2VwdCB0aGUgbWl4ZWQgbGluZWFyIG1vZGVsIG9mIGludGVyZXN0LgoKYGBge3IsIGV2YWw9RkFMU0V9Cm1peGVkX21vZGVsIDwtICJ+IDAgKyBmaW5hbG91dGNvbWUgKyB2aXNpdG51bWJlciArICgxfGRvbm9yKSIKbWl4ZWRfZnN0cmluZyA8LSBhcy5mb3JtdWxhKG1peGVkX21vZGVsKQpnZXRfZm9ybXVsYV9mYWN0b3JzKG1peGVkX21vZGVsKQptaXhlZF9lb3Npbm9waGlsX2RlIDwtIGRyZWFtX3BhaXJ3aXNlKHRfZW9zaW5vcGhpbHMsIGFsdF9tb2RlbCA9IG1peGVkX2ZzdHJpbmcpCm1peGVkX21vbm9jeXRlX2RlIDwtIGRyZWFtX3BhaXJ3aXNlKHRfbW9ub2N5dGVzLCBhbHRfbW9kZWwgPSBtaXhlZF9mc3RyaW5nKQptaXhlZF9uZXV0cm9waGlsX2RlIDwtIGRyZWFtX3BhaXJ3aXNlKHRfbmV1dHJvcGhpbHMsIGFsdF9tb2RlbCA9IG1peGVkX2ZzdHJpbmcpCmBgYAoKIyMgQ29tcGFyZSBtb25vY3l0ZXMKCmBgYHtyfQpkcmVhbV9yZXN1bHQgPC0gbWl4ZWRfbW9ub2N5dGVfZGVbWyJhbGxfdGFibGVzIl1dW1siY29udHJhc3RzIl1dW1sxXV0KCmJpZ190YWJsZSA8LSB0X2NmX21vbm9jeXRlX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJvdXRjb21lIl1dCm1lcmdlZCA8LSBtZXJnZShiaWdfdGFibGUsIGRyZWFtX3Jlc3VsdCwgYnkgPSAicm93Lm5hbWVzIikKcm93bmFtZXMobWVyZ2VkKSA8LSBtZXJnZWRbWyJSb3cubmFtZXMiXV0KbWVyZ2VkW1siUm93Lm5hbWVzIl1dIDwtIE5VTEwKY29yX3ZhbHVlIDwtIGNvci50ZXN0KG1lcmdlZFtbImxvZ0ZDIl1dLCBtZXJnZWRbWyJkZXNlcV9sb2dmYyJdXSkKY29yX3ZhbHVlCgp0X2NmX21vbm9jeXRlX2RlX3N2YVtbImRyZWFtIl1dIDwtIG1peGVkX21vbm9jeXRlX2RlCnRlc3QgPC0gY29tYmluZV9kZV90YWJsZXModF9jZl9tb25vY3l0ZV9kZV9zdmEsIGV4Y2VsID0gIi90bXAvdGVzdF9jb21iaW5lZC54bHN4IikKdGVzdF9hdWNjIDwtIGNhbGN1bGF0ZV9hdWNjKGJpZ190YWJsZSwgdGJsMiA9IGRyZWFtX3Jlc3VsdCwgcHggPSAiZGVzZXFfYWRqcCIsIHB5ID0gImFkai5QLlZhbCIsIGx4ID0gImRlc2VxX2xvZ2ZjIiwgbHkgPSAibG9nRkMiKQoKCmxvZ2ZjX3Bsb3R0ZXIgPC0gcGxvdF9saW5lYXJfc2NhdHRlcihtZXJnZWRbLCBjKCJsb2dGQyIsICJkZXNlcV9sb2dmYyIpXSkKbG9nZmNfcGxvdCA8LSBsb2dmY19wbG90dGVyW1sic2NhdHRlciJdXSArCiAgeGxhYigiRHJlYW0gbG9nMkZDIHdpdGggKDF8ZG9ub3IpIGFuZCB2aXNpdCBpbiBtb2RlbCIpICsKICB5bGFiKCJERVNlcTIgbG9nMkZDOiBEZWZhdWx0IHBhaXJ3aXNlIGNvbXBhcmlzb24iKSArCiAgZ2d0aXRsZShnbHVlKCJDb21wYXJpbmcgcmVzdWx0cyBmcm9tIG1vZGVsczoge3ByZXR0eU51bShjb3JfdmFsdWVbWydlc3RpbWF0ZSddXSl9IChwZWFyc29uKSIpKQpwcChmaWxlID0gImZpZ3VyZXMvY29tcGFyZV9jZl9hbmRfdmlzaXRfaW5fbW9kZWxfbW9ub2N5dGVfbG9nZmMuc3ZnIikKbG9nZmNfcGxvdApkZXYub2ZmKCkKbG9nZmNfcGxvdAoKcHJldmlvdXNfc2lnX2lkeCA8LSBtZXJnZWRbWyJkZXNlcV9hZGpwIl1dIDw9IDAuMDUgJiBhYnMobWVyZ2VkW1siZGVzZXFfbG9nZmMiXV0gPj0gMS4wKQpzdW1tYXJ5KHByZXZpb3VzX3NpZ19pZHgpCnByZXZpb3VzX2dlbmVzIDwtIHJvd25hbWVzKG1lcmdlZClbcHJldmlvdXNfc2lnX2lkeF0KCm5ld19zaWdfaWR4IDwtIGFicyhtZXJnZWRbWyJsb2dGQyJdXSkgPj0gMS4wICYgbWVyZ2VkW1siUC5WYWx1ZSJdXSA8IDAuMDUKc3VtbWFyeShuZXdfc2lnX2lkeCkKbmV3X2dlbmVzIDwtIHJvd25hbWVzKG1lcmdlZClbbmV3X3NpZ19pZHhdCm5hX2lkeCA8LSBpcy5uYShuZXdfZ2VuZXMpCm5ld19nZW5lcyA8LSBuZXdfZ2VuZXNbIW5hX2lkeF0KCmFubm90IDwtIGZEYXRhKHRfbW9ub2N5dGVzKQpjb21wYXJlIDwtIFZlbm5lcmFibGU6OlZlbm4obGlzdCgicHJldmlvdXMiID0gcHJldmlvdXNfZ2VuZXMsICJuZXciID0gbmV3X2dlbmVzKSkKc2hhcmVkX2dlbmVzIDwtIGNvbXBhcmVASW50ZXJzZWN0aW9uU2V0c1tbIjExIl1dCm5hbWVfaWR4IDwtIHJvd25hbWVzKGFubm90KSAlaW4lIHNoYXJlZF9nZW5lcwphbm5vdFtuYW1lX2lkeCwgXQpgYGAKCiMgVE9ETwoKMS4gIFJlcGVhdCB0aGlzIHByb2Nlc3MsIGNsZWFuIGl0IHVwIGZvcjogbW9ub2N5dGVzL25ldXRyb3BoaWxzCjIuICBSZXBlYXQgdGhpcyBwcm9jZXNzIGFuZCBjb21wYXJlIHRoZSByZXN1bHRzIHdoZW4gdXNpbmcgbW9kZWxzCiAgICB3aGljaCBhcmU6CiAgICBhLiAgfiBmaW5hbG91dGNvbWUgKyB2aXNpdG51bWJlciArICgxfGRvbm9yKQogICAgYi4gIH4gZmluYWxvdXRjb21lICsgdmlzaXRudW1iZXIKMy4gIENvbXBhcmUgdGhlIHJlc3VsdHMgZnJvbSBsaW1tYSBmb3IgYSxiCjQuICBFeHRyYWN0IHRoZSBzZXQgb2YgJ3NpZ25pZmljYW50JyBnZW5lcyB2aWEgbG9nRkMvcHZhbHVlIGZvciBhbGwgb2YKICAgIHRoZSBhYm92ZSBhbmQgc2VlIHRoZSBzaGFyZWQvdW5pcXVlIGdlbmVzLgoKIyBUZXN0IHNvbWUgY29kZSB0byBkbyB0aGlzIGF1dG9tYWdpY2FsbHkKCkkgdGhpbmsgSSBpbXBsZW1lbnRlZCBzb21lIGNoYW5nZXMgdG8gbXkgdG95cyB3aGljaCBtYWtlIHRoZW0gYWJsZSB0bwpzZXQgdXAgYXBwcm9wcmlhdGUgbW9kZWxzIGFuZCBjb250cmFzdHMgZm9yIGFyYml0cmFyaWx5IGNob3NlbiBtb2RlbHMKaW5zdGVhZCBvZiBvbmx5IG15IHNpbXBsaWZpZWQgdmVyc2lvbi4gIExldCB1cyB0ZXN0IHRoYXQgaGVyZSEKCmBgYHtyLCBldmFsPUZBTFNFfQp0dCA9IG5vcm1hbGl6ZV9leHB0KHRfbW9ub2N5dGVzLCB0cmFuc2Zvcm0gPSAibG9nMiIsIGNvbnZlcnQgPSAiY3BtIiwKICAgICAgICAgICAgICAgICAgICBmaWx0ZXIgPSBUUlVFLCBiYXRjaCA9ICJzdmFzZXEiKQoKdF9tb25vY3l0ZV9jZl92aXNpdF9zdmFfZGUgPC0gYWxsX3BhaXJ3aXNlKHRfbW9ub2N5dGVzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYWx0X21vZGVsID0gIn4gMCArIGZpbmFsb3V0Y29tZSArIHZpc2l0bnVtYmVyIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG51bGxfbW9kZWwgPSAifiAwICsgdmlzaXRudW1iZXIiLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBGQUxTRSwgbWV0aG9kcyA9IG1ldGhvZHMpCmBgYAoKIyMjIEluZGl2aWR1YWwgdmlzaXRzLCBNb25vY3l0ZXMKCk5vdyBmb2N1cyBpbiBvbiB0aGUgbW9ub2N5dGUgc2FtcGxlcyBvbiBhIHBlci12aXNpdCBiYXNpcy4KCiMjIyMgVmlzaXQgMQoKYGBge3J9CnRfY2ZfbW9ub2N5dGVfdjFfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0djFfbW9ub2N5dGVzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NmX21vbm9jeXRlX3YxX2RlX3N2YQp0X2NmX21vbm9jeXRlX3YxX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X2NmX21vbm9jeXRlX3YxX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Nb25vY3l0ZXMvdF9tb25vY3l0ZV92MV9jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9tb25vY3l0ZV92MV90YWJsZV9zdmEKdF9jZl9tb25vY3l0ZV92MV9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9tb25vY3l0ZV92MV90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Nb25vY3l0ZXMvdF9tb25vY3l0ZV92MV9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfbW9ub2N5dGVfdjFfc2lnX3N2YQoKZGltKHRfY2ZfbW9ub2N5dGVfdjFfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfbW9ub2N5dGVfdjFfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQpgYGAKCiMjIyMgTW9ub2N5dGVzOiBDb21wYXJlIHN2YSB0byBiYXRjaC1pbi1tb2RlbAoKYGBge3J9CnN2YV9hdWNjIDwtIGNhbGN1bGF0ZV9hdWNjKHRfY2ZfbW9ub2N5dGVfdGFibGVfc3ZhW1siZGF0YSJdXVtbMV1dLAogICAgICAgICAgICAgICAgICAgICAgICAgICB0YmwyID0gdF9jZl9tb25vY3l0ZV90YWJsZV9iYXRjaHZpc2l0W1siZGF0YSJdXVtbMV1dLAogICAgICAgICAgICAgICAgICAgICAgICAgICBweSA9ICJkZXNlcV9hZGpwIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQpzdmFfYXVjYwoKc2hhcmVkX2lkcyA8LSByb3duYW1lcyh0X2NmX21vbm9jeXRlX3RhYmxlX3N2YVtbImRhdGEiXV1bWzFdXSkgJWluJQogIHJvd25hbWVzKHRfY2ZfbW9ub2N5dGVfdGFibGVfYmF0Y2h2aXNpdFtbImRhdGEiXV1bWzFdXSkKZmlyc3QgPC0gdF9jZl9tb25vY3l0ZV90YWJsZV9zdmFbWyJkYXRhIl1dW1sxXV1bc2hhcmVkX2lkcywgXQpzZWNvbmQgPC0gdF9jZl9tb25vY3l0ZV90YWJsZV9iYXRjaHZpc2l0W1siZGF0YSJdXVtbMV1dW3Jvd25hbWVzKGZpcnN0KSwgXQpjb3IudGVzdChmaXJzdFtbImRlc2VxX2xvZ2ZjIl1dLCBzZWNvbmRbWyJkZXNlcV9sb2dmYyJdXSkKYGBgCgojIyMgTmV1dHJvcGhpbCBzYW1wbGVzCgpTd2l0Y2ggY29udGV4dCB0byB0aGUgTmV1dHJvcGhpbHMsIG9uY2UgYWdhaW4gcmVwZWF0IHRoZSBhbmFseXNpcwp1c2luZyBTVkEgYW5kIHZpc2l0IGFzIGEgYmF0Y2ggZmFjdG9yLgoKYGBge3J9CnRfY2ZfbmV1dHJvcGhpbF9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfbmV1dHJvcGhpbHMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NmX25ldXRyb3BoaWxfZGVfc3ZhCnRfY2ZfbmV1dHJvcGhpbF90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZl9uZXV0cm9waGlsX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9OZXV0cm9waGlscy90X25ldXRyb3BoaWxfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfbmV1dHJvcGhpbF90YWJsZV9zdmEKdF9jZl9uZXV0cm9waGlsX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX25ldXRyb3BoaWxfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdF9uZXV0cm9waGlsX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9uZXV0cm9waGlsX3NpZ19zdmEKCmRpbSh0X2NmX25ldXRyb3BoaWxfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfbmV1dHJvcGhpbF9zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pCgp0X2NmX25ldXRyb3BoaWxfZGVfYmF0Y2h2aXNpdCA8LSBhbGxfcGFpcndpc2UodF9uZXV0cm9waGlscywgbW9kZWxfYmF0Y2ggPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NmX25ldXRyb3BoaWxfZGVfYmF0Y2h2aXNpdAp0X2NmX25ldXRyb3BoaWxfdGFibGVfYmF0Y2h2aXNpdCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X2NmX25ldXRyb3BoaWxfZGVfYmF0Y2h2aXNpdCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9OZXV0cm9waGlscy90X25ldXRyb3BoaWxfY2ZfdGFibGVfYmF0Y2h2aXNpdC12e3Zlcn0ueGxzeCIpKQp0X2NmX25ldXRyb3BoaWxfdGFibGVfYmF0Y2h2aXNpdAp0X2NmX25ldXRyb3BoaWxfc2lnX2JhdGNodmlzaXQgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX25ldXRyb3BoaWxfdGFibGVfYmF0Y2h2aXNpdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RfbmV1dHJvcGhpbF9jZl9zaWdfYmF0Y2h2aXNpdC12e3Zlcn0ueGxzeCIpKQp0X2NmX25ldXRyb3BoaWxfc2lnX2JhdGNodmlzaXQKCmRpbSh0X2NmX25ldXRyb3BoaWxfc2lnX2JhdGNodmlzaXQkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX25ldXRyb3BoaWxfc2lnX2JhdGNodmlzaXQkZGVzZXEkZG93bnNbWzFdXSkKYGBgCgpMZXQgdXMgYWRkIGEgbmV3IGJsb2NrIGluIHdoaWNoIHdlIHRlc3QgYSBjb25jZXJuOiBpZiB3ZSBleHBsaWNpdGx5CmFkZCB2aXNpdCB0byB0aGUgbW9kZWwgKHdpdGggc3ZhLCBwb3RlbnRpYWxseSB3aXRob3V0IHRvbyksIHdpbGwgdGhhdApjaGFuZ2UgdGhlIHJlc3VsdHMgd2Ugb2JzZXJ2ZT8gIE15IGFzc3VtcHRpb24gaXMgdGhhdCBpdCBzaG91bGQgY2hhbmdlCnRoZSByZXN1bHRzIHZlcnkgbWluaW1hbGx5OyBidXQgd2Ugc2hvdWxkIG1ha2UgYWJzb2x1dGVseSBjZXJ0YWluIHRoYXQKdGhpcyBpcyB0cnVlLiAgVGhlIG5ldXRyb3BoaWxzIGFyZSB0aGUgcGxhY2UgdG8gdGVzdCB0aGlzIGZpcnN0CmJlY2F1c2UgdGhleSBoYXZlIHNvbWUgb2YgdGhlIG1vc3QgdmFyaWFuY2Ugb2JzZXJ2ZWQgaW4gdGhlIGRhdGEuCgpUaGVyZWZvcmUgSSB3YW50IHRvIGhhdmUgYW4gaW5zdGFuY2Ugb2YgdGhlIHBhaXJ3aXNlIGNvbnRyYXN0IHRoYXQgaGFzCmEgbW9kZWwgb2YgfiBmaW5hbG91dGNvbWUgKyB2aXNpdG51bWJlciArIFNWcyB3aGVyZSB0aGUgU1ZzIGNvbWUgZnJvbQphbiBpbnZvY2F0aW9uIG9mIHN2YSB3aGljaCBhbHNvIGhhcyBmaW5hbG91dGNvbWUgKyB2aXNpdG51bWJlciBiZWZvcmUKdGhlIG51bGwgbW9kZWwuCgpJbiB0aGVvcnksIGFsbF9wYWlyd2lzZSgpIGlzIGFibGUgdG8gZG8gdGhpcyB2aWEgdGhlIGFyZ3VtZW50CmFsdF9tb2RlbCwgYnV0IGl0IG1heSBiZSBzYWZlciB0byBkbyBpdCBtYW51YWxseSBpbiBvcmRlciB0bwphYnNvbHV0ZWx5IGVuc3VyZSB0aGF0IG5vdGhpbmcgdW5pbnRlbmRlZCBoYXBwZW5zLgoKYGBge3J9CiMjIFRoZSBvcmlnaW5hbCBwYWlyd2lzZSBpbnZvY2F0aW9uIHdpdGggc3ZhOgojIyB0X2NmX25ldXRyb3BoaWxfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0X25ldXRyb3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAojIyAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAojIyAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdGVzdF9uZXV0cm9waGlscyA8LSBub3JtYWxpemVfZXhwdCh0X25ldXRyb3BoaWxzLCBmaWx0ZXIgPSAic2ltcGxlIikKdGVzdF9uZXV0X2Rlc2lnbiA8LSBwRGF0YSh0ZXN0X25ldXRyb3BoaWxzKQp0ZXN0X2Zvcm11bGEgPC0gYXMuZm9ybXVsYSgifiAwICsgZmluYWxvdXRjb21lICsgdmlzaXRudW1iZXIiKQp0ZXN0X21vZGVsIDwtIG1vZGVsLm1hdHJpeCh0ZXN0X2Zvcm11bGEsIGRhdGEgPSB0ZXN0X25ldXRfZGVzaWduKQojIyBOb3RlIHRvIHNlbGY6IGRvdWJsZS1jaGVjayB0aGF0IHRoZSBmb2xsb3dpbmcgbGluZSBpcyBjb3JyZWN0LgpudWxsX2Zvcm11bGEgPC0gYXMuZm9ybXVsYSgifiAwICsgdmlzaXRudW1iZXIiKQojIyBudWxsX21vZGVsIDwtIHRlc3RfbW9kZWxbLCBjKDEsIDIpXQpudWxsX21vZGVsIDwtIG1vZGVsLm1hdHJpeChudWxsX2Zvcm11bGEsIGRhdGEgPSB0ZXN0X25ldXRfZGVzaWduKQoKbGluZWFyX210cnggPC0gZXhwcnModGVzdF9uZXV0cm9waGlscykKbDJfbXRyeCA8LSBsb2cyKGxpbmVhcl9tdHJ4ICsgMSkKY2hvc2VuX3N1cnJvZ2F0ZXMgPC0gc3ZhOjpudW0uc3YoZGF0ID0gbDJfbXRyeCwgbW9kID0gdGVzdF9tb2RlbCkKCnN1cnJvZ2F0ZV9yZXN1bHQgPC0gc3ZhOjpzdmFzZXEoCiAgZGF0ID0gbGluZWFyX210cngsIG4uc3YgPSBjaG9zZW5fc3Vycm9nYXRlcywgbW9kID0gdGVzdF9tb2RlbCwgbW9kMCA9IG51bGxfbW9kZWwpCm1vZGVsX2FkanVzdCA8LSBhcy5tYXRyaXgoc3Vycm9nYXRlX3Jlc3VsdFtbInN2Il1dKQoKIyMgSSBkb24ndCB0aGluayB0aGUgZm9sbG93aW5nIGlzIGFjdHVhbGx5IHJlcXVpcmVkLCBidXQgaXQgaXMgd2VpcmQgdG8ganVzdCBoYXZlIHRoaXMKIyMgdW5uYW1lZCBtYXRyaXggaGFuZ2luZ291dC4KIyMgU2V0IHRoZSBjb2x1bW5zIHRvIHRoZSBTViNzCmNvbG5hbWVzKG1vZGVsX2FkanVzdCkgPC0gYygiU1YxIiwgIlNWMiIsICJTVjMiLCAiU1Y0IikKIyMgU2V0IHRoZSByb3dzIHRoZSBzYW1wbGUgSURzCnJvd25hbWVzKG1vZGVsX2FkanVzdCkgPC0gcm93bmFtZXMocERhdGEodGVzdF9uZXV0cm9waGlscykpCgpsb25nZXJfbW9kZWwgPC0gYXMuZm9ybXVsYSgifiBmaW5hbG91dGNvbWUgKyB2aXNpdG51bWJlciArIFNWMSArIFNWMiArIFNWMyArIFNWNCIpCm5ldXRfZGVzaWduX3N2cyA8LSBjYmluZCh0ZXN0X25ldXRfZGVzaWduLCBtb2RlbF9hZGp1c3QpCnN1bW1hcml6ZWQgPC0gREVTZXEyOjpERVNlcURhdGFTZXRGcm9tTWF0cml4KGNvdW50RGF0YSA9IGxpbmVhcl9tdHJ4LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb2xEYXRhID0gbmV1dF9kZXNpZ25fc3ZzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBkZXNpZ24gPSBsb25nZXJfbW9kZWwpCmRlc2VxX3J1biA8LSBERVNlcTI6OkRFU2VxKHN1bW1hcml6ZWQpCmRlc2VxX3RhYmxlIDwtIGFzLmRhdGEuZnJhbWUoREVTZXEyOjpyZXN1bHRzKG9iamVjdCA9IGRlc2VxX3J1biwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY29udHJhc3QgPSBjKCJmaW5hbG91dGNvbWUiLCAiZmFpbHVyZSIsICJjdXJlIiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZvcm1hdCA9ICJEYXRhRnJhbWUiKSkKCiMjIFdlIHNob3VsZCBiZSBhYmxlIHRvIGRpcmVjdGx5IGNvbXBhcmUgdGhpcyB0byB0aGUgdGhlIGRlc2VxIGNvbHVtbnMgZnJvbSB0aGUgYWJvdmUKIyMgZGF0YSBzdHJ1Y3R1cmUgbmFtZWQ6IHRfY2ZfbmV1dHJvcGhpbF90YWJsZV9zdmEKCmJpZ190YWJsZSA8LSB0X2NmX25ldXRyb3BoaWxfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0Kb25seV9kZXNlcSA8LSBiaWdfdGFibGVbLCBjKCJkZXNlcV9sb2dmYyIsICJkZXNlcV9hZGpwIildCm1lcmdlZCA8LSBtZXJnZShkZXNlcV90YWJsZSwgb25seV9kZXNlcSwgYnkgPSAicm93Lm5hbWVzIikKcm93bmFtZXMobWVyZ2VkKSA8LSBtZXJnZWRbWyJSb3cubmFtZXMiXV0KbWVyZ2VkW1siUm93Lm5hbWVzIl1dIDwtIE5VTEwKCmNvcl92YWx1ZSA8LSBjb3IudGVzdChtZXJnZWRbWyJsb2cyRm9sZENoYW5nZSJdXSwgbWVyZ2VkW1siZGVzZXFfbG9nZmMiXV0pCmNvcl92YWx1ZQpsb2dmY19wbG90dGVyIDwtIHBsb3RfbGluZWFyX3NjYXR0ZXIobWVyZ2VkWywgYygibG9nMkZvbGRDaGFuZ2UiLCAiZGVzZXFfbG9nZmMiKV0pCmxvZ2ZjX3Bsb3QgPC0gbG9nZmNfcGxvdHRlcltbInNjYXR0ZXIiXV0gKwogIHhsYWIoIkRFU2VxMiBsb2cyRkM6IFZpc2l0IGV4cGxpY2l0bHkgaW4gbW9kZWwiKSArCiAgeWxhYigiREVTZXEyIGxvZzJGQzogRGVmYXVsdCBwYWlyd2lzZSBjb21wYXJpc29uIikgKwogIGdndGl0bGUoZ2x1ZSgiQ29tcGFyaW5nIHJlc3VsdHMgZnJvbSBtb2RlbHM6IHtwcmV0dHlOdW0oY29yX3ZhbHVlW1snZXN0aW1hdGUnXV0pfSAocGVhcnNvbikiKSkKcHAoZmlsZSA9ICJmaWd1cmVzL2NvbXBhcmVfY2ZfYW5kX3Zpc2l0X2luX21vZGVsX25ldXRyb3BoaWxfbG9nZmMuc3ZnIikKbG9nZmNfcGxvdApkZXYub2ZmKCkKbG9nZmNfcGxvdAoKY29yX3ZhbHVlIDwtIGNvci50ZXN0KG1lcmdlZFtbInBhZGoiXV0sIG1lcmdlZFtbImRlc2VxX2FkanAiXV0sIG1ldGhvZCA9ICJzcGVhcm1hbiIpCmNvcl92YWx1ZQphZGpwX3Bsb3R0ZXIgPC0gcGxvdF9saW5lYXJfc2NhdHRlcihtZXJnZWRbLCBjKCJwYWRqIiwgImRlc2VxX2FkanAiKV0pCmFkanBfcGxvdCA8LSBhZGpwX3Bsb3R0ZXJbWyJzY2F0dGVyIl1dICsKICB4bGFiKCJERVNlcTIgYWRqcDogVmlzaXQgZXhwbGljaXRseSBpbiBtb2RlbCIpICsKICB5bGFiKCJERVNlcTIgYWRqcDogRGVmYXVsdCBwYWlyd2lzZSBjb21wYXJpc29uIikgKwogIGdndGl0bGUoZ2x1ZSgiQ29tcGFyaW5nIHJlc3VsdHMgZnJvbSBtb2RlbHM6IHtwcmV0dHlOdW0oY29yX3ZhbHVlW1snZXN0aW1hdGUnXV0pfSAoc3BlYXJtYW4pIikpCnBwKGZpbGUgPSAiaW1hZ2VzL2NvbXBhcmVfY2ZfYW5kX3Zpc2l0X2luX21vZGVsX25ldXRyb3BoaWxfYWRqcC5zdmciKQphZGpwX3Bsb3QKZGV2Lm9mZigpCmFkanBfcGxvdAoKcHJldmlvdXNfc2lnX2lkeCA8LSBiaWdfdGFibGVbWyJkZXNlcV9hZGpwIl1dIDw9IDAuMDUgJiBhYnMoYmlnX3RhYmxlW1siZGVzZXFfbG9nZmMiXV0gPj0gMS4wKQpzdW1tYXJ5KHByZXZpb3VzX3NpZ19pZHgpCnByZXZpb3VzX2dlbmVzIDwtIHJvd25hbWVzKGJpZ190YWJsZSlbcHJldmlvdXNfc2lnX2lkeF0KCm5ld19zaWdfaWR4IDwtIGFicyhkZXNlcV90YWJsZVtbImxvZzJGb2xkQ2hhbmdlIl1dKSA+PSAxLjAgJiBkZXNlcV90YWJsZVtbInBhZGoiXV0gPCAwLjA1Cm5ld19nZW5lcyA8LSByb3duYW1lcyhkZXNlcV90YWJsZSlbbmV3X3NpZ19pZHhdCm5hX2lkeCA8LSBpcy5uYShuZXdfZ2VuZXMpCm5ld19nZW5lcyA8LSBuZXdfZ2VuZXNbIW5hX2lkeF0KClZlbm5lcmFibGU6OlZlbm4obGlzdCgicHJldmlvdXMiID0gcHJldmlvdXNfZ2VuZXMsICJuZXciID0gbmV3X2dlbmVzKSkKCnRlc3RfbmV3IDwtIHNpbXBsZV9ncHJvZmlsZXIobmV3X2dlbmVzKQp0ZXN0X25ldwp0ZXN0X29sZCA8LSBzaW1wbGVfZ3Byb2ZpbGVyKHByZXZpb3VzX2dlbmVzKQp0ZXN0X29sZAoKbmV3X2Fubm90YXRlZCA8LSBtZXJnZShmRGF0YSh0X25ldXRyb3BoaWxzKSwgZGVzZXFfdGFibGUsIGJ5ID0gInJvdy5uYW1lcyIpCnJvd25hbWVzKG5ld19hbm5vdGF0ZWQpIDwtIG5ld19hbm5vdGF0ZWRbWyJSb3cubmFtZXMiXV0KbmV3X2Fubm90YXRlZFtbIlJvdy5uYW1lcyJdXSA8LSBOVUxMCndyaXRlX3hsc3goZGF0YSA9IG5ld19hbm5vdGF0ZWQsIGV4Y2VsID0gImV4Y2VsL25ldXRyb3BoaWxfdmlzaXRfaW5fbW9kZWxfc3ZhX2NmX25ldy54bHN4IikKCm9sZF9hbm5vdGF0ZWQgPC0gbWVyZ2UoZkRhdGEodF9uZXV0cm9waGlscyksIGJpZ190YWJsZSwgYnkgPSAicm93Lm5hbWVzIikKcm93bmFtZXMob2xkX2Fubm90YXRlZCkgPC0gb2xkX2Fubm90YXRlZFtbIlJvdy5uYW1lcyJdXQpvbGRfYW5ub3RhdGVkW1siUm93Lm5hbWVzIl1dIDwtIE5VTEwKd3JpdGVfeGxzeChkYXRhID0gb2xkX2Fubm90YXRlZCwgZXhjZWwgPSAiZXhjZWwvbmV1dHJvcGhpbF92aXNpdF9pbl9tb2RlbF9zdmFfY2Zfb2xkLnhsc3giKQpgYGAKCiMjIyMgTmV1dHJvcGhpbHMgYnkgdmlzaXQKCldoZW4gSSBkaWQgdGhpcyB3aXRoIHRoZSBtb25vY3l0ZXMsIEkgc3BsaXQgaXQgdXAgaW50byBtdWx0aXBsZSBibG9ja3MKZm9yIGVhY2ggdmlzaXQuICBUaGlzIHRpbWUgSSBhbSBqdXN0IGdvaW5nIHRvIHJ1biB0aGVtIGFsbCB0b2dldGhlci4KCmBgYHtyfQp2aXNpdGNmX2ZhY3RvciA8LSBwYXN0ZTAoInYiLCBwRGF0YSh0X25ldXRyb3BoaWxzKVtbInZpc2l0bnVtYmVyIl1dLAogICAgICAgICAgICAgICAgICAgICAgICAgcERhdGEodF9uZXV0cm9waGlscylbWyJmaW5hbG91dGNvbWUiXV0pCnRfbmV1dHJvcGhpbF92aXNpdGNmIDwtIHNldF9leHB0X2NvbmRpdGlvbnModF9uZXV0cm9waGlscywgZmFjdD12aXNpdGNmX2ZhY3RvcikKCnRfY2ZfbmV1dHJvcGhpbF92aXNpdHNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0X25ldXRyb3BoaWxfdmlzaXRjZiwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9uZXV0cm9waGlsX3Zpc2l0c19kZV9zdmEKdF9jZl9uZXV0cm9waGlsX3Zpc2l0c190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZl9uZXV0cm9waGlsX3Zpc2l0c19kZV9zdmEsIGtlZXBlcnMgPSB2aXNpdGNmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RfbmV1dHJvcGhpbF92aXNpdGNmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX25ldXRyb3BoaWxfdmlzaXRzX3RhYmxlX3N2YQp0X2NmX25ldXRyb3BoaWxfdmlzaXRzX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX25ldXRyb3BoaWxfdmlzaXRzX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RfbmV1dHJvcGhpbF92aXNpdGNmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9uZXV0cm9waGlsX3Zpc2l0c19zaWdfc3ZhCgpkaW0odF9jZl9uZXV0cm9waGlsX3Zpc2l0c19zaWdfc3ZhJGRlc2VxJHVwc1tbMV1dKQpkaW0odF9jZl9uZXV0cm9waGlsX3Zpc2l0c19zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pCmBgYAoKTm93IFYxCgpgYGB7cn0KdF9jZl9uZXV0cm9waGlsX3YxX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodHYxX25ldXRyb3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9uZXV0cm9waGlsX3YxX2RlX3N2YQp0X2NmX25ldXRyb3BoaWxfdjFfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfY2ZfbmV1dHJvcGhpbF92MV9kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdF9uZXV0cm9waGlsX3YxX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX25ldXRyb3BoaWxfdjFfdGFibGVfc3ZhCnRfY2ZfbmV1dHJvcGhpbF92MV9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9uZXV0cm9waGlsX3YxX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RfbmV1dHJvcGhpbF92MV9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfbmV1dHJvcGhpbF92MV9zaWdfc3ZhCgpkaW0odF9jZl9uZXV0cm9waGlsX3YxX3NpZ19zdmEkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX25ldXRyb3BoaWxfdjFfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQoKdF9jZl9uZXV0cm9waGlsX3YyX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodHYyX25ldXRyb3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9uZXV0cm9waGlsX3YyX2RlX3N2YQp0X2NmX25ldXRyb3BoaWxfdjJfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfY2ZfbmV1dHJvcGhpbF92Ml9kZV9zdmEsCiAga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9OZXV0cm9waGlscy90X25ldXRyb3BoaWxfdjJfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfbmV1dHJvcGhpbF92Ml90YWJsZV9zdmEKdF9jZl9uZXV0cm9waGlsX3YyX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX25ldXRyb3BoaWxfdjJfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdF9uZXV0cm9waGlsX3YyX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9uZXV0cm9waGlsX3YyX3NpZ19zdmEKCmRpbSh0X2NmX25ldXRyb3BoaWxfdjJfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfbmV1dHJvcGhpbF92Ml9zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pCgp0X2NmX25ldXRyb3BoaWxfdjNfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0djNfbmV1dHJvcGhpbHMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NmX25ldXRyb3BoaWxfdjNfZGVfc3ZhCnRfY2ZfbmV1dHJvcGhpbF92M190YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZl9uZXV0cm9waGlsX3YzX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9OZXV0cm9waGlscy90X25ldXRyb3BoaWxfdjNfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfbmV1dHJvcGhpbF92M190YWJsZV9zdmEKdF9jZl9uZXV0cm9waGlsX3YzX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX25ldXRyb3BoaWxfdjNfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vTmV1dHJvcGhpbHMvdF9uZXV0cm9waGlsX3YzX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9uZXV0cm9waGlsX3YzX3NpZ19zdmEKCmRpbSh0X2NmX25ldXRyb3BoaWxfdjNfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfbmV1dHJvcGhpbF92M19zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pCmBgYAoKIyMjIyBOZXV0cm9waGlsczogQ29tcGFyZSBzdmEgdG8gYmF0Y2gtaW4tbW9kZWwKCmBgYHtyfQpzdmFfYXVjYyA8LSBjYWxjdWxhdGVfYXVjYyh0X2NmX25ldXRyb3BoaWxfdGFibGVfc3ZhW1siZGF0YSJdXVtbMV1dLAogICAgICAgICAgICAgICAgICAgICAgICAgICB0YmwyID0gdF9jZl9uZXV0cm9waGlsX3RhYmxlX2JhdGNodmlzaXRbWyJkYXRhIl1dW1sxXV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgIHB5ID0gImRlc2VxX2FkanAiLCBseSA9ICJkZXNlcV9sb2dmYyIpCnN2YV9hdWNjCgpzaGFyZWRfaWRzIDwtIHJvd25hbWVzKHRfY2ZfbmV1dHJvcGhpbF90YWJsZV9zdmFbWyJkYXRhIl1dW1sxXV0pICVpbiUKICByb3duYW1lcyh0X2NmX25ldXRyb3BoaWxfdGFibGVfYmF0Y2h2aXNpdFtbImRhdGEiXV1bWzFdXSkKZmlyc3QgPC0gdF9jZl9uZXV0cm9waGlsX3RhYmxlX3N2YVtbImRhdGEiXV1bWzFdXVtzaGFyZWRfaWRzLCBdCnNlY29uZCA8LSB0X2NmX25ldXRyb3BoaWxfdGFibGVfYmF0Y2h2aXNpdFtbImRhdGEiXV1bWzFdXVtyb3duYW1lcyhmaXJzdCksIF0KY29yLnRlc3QoZmlyc3RbWyJkZXNlcV9sb2dmYyJdXSwgc2Vjb25kW1siZGVzZXFfbG9nZmMiXV0pCmBgYAoKIyMjIEVvc2lub3BoaWxzCgpUaGlzIHRpbWUsIHdpdGggZmVlbGluZyEgIFJlcGVhdGluZyB0aGUgc2FtZSBzZXQgb2YgdGFza3Mgd2l0aCB0aGUKZW9zaW5vcGhpbCBzYW1wbGVzLgoKYGBge3J9CnRfY2ZfZW9zaW5vcGhpbF9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfZW9zaW5vcGhpbHMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NmX2Vvc2lub3BoaWxfZGVfc3ZhCnRfY2ZfZW9zaW5vcGhpbF90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZl9lb3Npbm9waGlsX2RlX3N2YSwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Fb3Npbm9waGlscy90X2Vvc2lub3BoaWxfY2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfZW9zaW5vcGhpbF90YWJsZV9zdmEKdF9jZl9lb3Npbm9waGlsX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX2Vvc2lub3BoaWxfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdF9lb3Npbm9waGlsX2NmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9lb3Npbm9waGlsX3NpZ19zdmEKCmRpbSh0X2NmX2Vvc2lub3BoaWxfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkKZGltKHRfY2ZfZW9zaW5vcGhpbF9zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pCgprbml0cjo6a2FibGUoaGVhZCh0X2NmX2Vvc2lub3BoaWxfc2lnX3N2YSRkZXNlcSR1cHNbWzFdXSkpCmtuaXRyOjprYWJsZShoZWFkKHRfY2ZfZW9zaW5vcGhpbF9zaWdfc3ZhJGRlc2VxJGRvd25zW1sxXV0pKQpgYGAKClJlcGVhdCB3aXRoIGJhdGNoIGluIHRoZSBtb2RlbC4KCmBgYHtyfQp0X2NmX2Vvc2lub3BoaWxfZGVfYmF0Y2h2aXNpdCA8LSBhbGxfcGFpcndpc2UodF9lb3Npbm9waGlscywgbW9kZWxfYmF0Y2ggPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NmX2Vvc2lub3BoaWxfZGVfYmF0Y2h2aXNpdAp0X2NmX2Vvc2lub3BoaWxfdGFibGVfYmF0Y2h2aXNpdCA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X2NmX2Vvc2lub3BoaWxfZGVfYmF0Y2h2aXNpdCwga2VlcGVycyA9IHRfY2ZfY29udHJhc3QsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Fb3Npbm9waGlscy90X2Vvc2lub3BoaWxfY2ZfdGFibGVfYmF0Y2h2aXNpdC12e3Zlcn0ueGxzeCIpKQp0X2NmX2Vvc2lub3BoaWxfdGFibGVfYmF0Y2h2aXNpdAp0X2NmX2Vvc2lub3BoaWxfc2lnX2JhdGNodmlzaXQgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NmX2Vvc2lub3BoaWxfdGFibGVfYmF0Y2h2aXNpdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RfZW9zaW5vcGhpbF9jZl9zaWdfYmF0Y2h2aXNpdC12e3Zlcn0ueGxzeCIpKQp0X2NmX2Vvc2lub3BoaWxfc2lnX2JhdGNodmlzaXQKCmRpbSh0X2NmX2Vvc2lub3BoaWxfc2lnX2JhdGNodmlzaXQkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX2Vvc2lub3BoaWxfc2lnX2JhdGNodmlzaXQkZGVzZXEkZG93bnNbWzFdXSkKCmtuaXRyOjprYWJsZShoZWFkKHRfY2ZfZW9zaW5vcGhpbF9zaWdfYmF0Y2h2aXNpdCRkZXNlcSR1cHNbWzFdXSkpCmtuaXRyOjprYWJsZShoZWFkKHRfY2ZfZW9zaW5vcGhpbF9zaWdfYmF0Y2h2aXNpdCRkZXNlcSRkb3duc1tbMV1dKSkKYGBgCgpSZXBlYXQgd2l0aCB2aXNpdCBpbiB0aGUgY29uZGl0aW9uIGNvbnRyYXN0LgoKYGBge3J9CnZpc2l0Y2ZfZmFjdG9yIDwtIHBhc3RlMCgidiIsIHBEYXRhKHRfZW9zaW5vcGhpbHMpW1sidmlzaXRudW1iZXIiXV0sCiAgICAgICAgICAgICAgICAgICAgICAgICBwRGF0YSh0X2Vvc2lub3BoaWxzKVtbImZpbmFsb3V0Y29tZSJdXSkKdF9lb3Npbm9waGlsX3Zpc2l0Y2YgPC0gc2V0X2V4cHRfY29uZGl0aW9ucyh0X2Vvc2lub3BoaWxzLCBmYWN0ID0gdmlzaXRjZl9mYWN0b3IpCgp0X2NmX2Vvc2lub3BoaWxfdmlzaXRzX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodF9lb3Npbm9waGlsX3Zpc2l0Y2YsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRfY2ZfZW9zaW5vcGhpbF92aXNpdHNfZGVfc3ZhCnRfY2ZfZW9zaW5vcGhpbF92aXNpdHNfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogICB0X2NmX2Vvc2lub3BoaWxfdmlzaXRzX2RlX3N2YSwga2VlcGVycyA9IHZpc2l0Y2ZfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdF9lb3Npbm9waGlsX3Zpc2l0Y2ZfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfZW9zaW5vcGhpbF92aXNpdHNfdGFibGVfc3ZhCnRfY2ZfZW9zaW5vcGhpbF92aXNpdHNfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRfY2ZfZW9zaW5vcGhpbF92aXNpdHNfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdF9lb3Npbm9waGlsX3Zpc2l0Y2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX2Vvc2lub3BoaWxfdmlzaXRzX3NpZ19zdmEKCmRpbSh0X2NmX2Vvc2lub3BoaWxfdmlzaXRzX3NpZ19zdmEkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX2Vvc2lub3BoaWxfdmlzaXRzX3NpZ19zdmEkZGVzZXEkZG93bnNbWzFdXSkKCgprbml0cjo6a2FibGUoaGVhZCh0X2NmX2Vvc2lub3BoaWxfdmlzaXRzX3NpZ19zdmEkZGVzZXEkdXBzW1sxXV0pKQprbml0cjo6a2FibGUoaGVhZCh0X2NmX2Vvc2lub3BoaWxfdmlzaXRzX3NpZ19zdmEkZGVzZXEkZG93bnNbWzFdXSkpCmBgYAoKIyMjIyMgUmVwZWF0IHRlc3Qgb2YgZGlmZmVyZW50IG1vZGVsczogRW9zaW5vcGhpbHMKCldlIHdpc2ggdG8gZW5zdXJlIHRoYXQgbXkgbW9kZWwgc2ltcGxpZmljYXRpb24gZGlkIG5vdCBkbyBhbnl0aGluZwppbmNvcnJlY3QgdG8gdGhlIGRhdGEgZm9yIGFsbCB0aHJlZSBjZWxsIHR5cGVzLCBJIGFscmVhZHkgZGlkIHRoaXMgZm9yCnRoZSBuZXV0cm9waGlscywgbGV0IHVzIHJlcGVhdCBmb3IgdGhlIGVvc2lub3BoaWxzLiAgSSBhbSB0aGVyZWZvcmUKKG1vc3RseSkgY29weS9wYXN0aW5nIHRoZSBuZXV0cm9waGlsIHNlY3Rpb24gaGVyZS5hCgpgYGB7cn0KIyMgVGhlIG9yaWdpbmFsIHBhaXJ3aXNlIGludm9jYXRpb24gd2l0aCBzdmE6CiN0X2NmX2Vvc2lub3BoaWxfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0X2Vvc2lub3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAojICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZmlsdGVyID0gVFJVRSwgcGFyYWxsZWw9RkFMU0UsIG1ldGhvZHMgPSBtZXRob2RzKQp0ZXN0X2Vvc2lub3BoaWxzIDwtIG5vcm1hbGl6ZV9leHB0KHRfZW9zaW5vcGhpbHMsIGZpbHRlciA9ICJzaW1wbGUiKQp0ZXN0X2VvX2Rlc2lnbiA8LSBwRGF0YSh0ZXN0X2Vvc2lub3BoaWxzKQp0ZXN0X2Zvcm11bGEgPC0gYXMuZm9ybXVsYSgifiAwICsgZmluYWxvdXRjb21lICsgdmlzaXRudW1iZXIiKQp0ZXN0X21vZGVsIDwtIG1vZGVsLm1hdHJpeCh0ZXN0X2Zvcm11bGEsIGRhdGEgPSB0ZXN0X2VvX2Rlc2lnbikKbnVsbF9mb3JtdWxhIDwtIGFzLmZvcm11bGEoIn4gMCArIHZpc2l0bnVtYmVyIikKbnVsbF9tb2RlbCA8LSBtb2RlbC5tYXRyaXgobnVsbF9mb3JtdWxhLCBkYXRhID0gdGVzdF9lb19kZXNpZ24pCgpsaW5lYXJfbXRyeCA8LSBleHBycyh0ZXN0X2Vvc2lub3BoaWxzKQpsMl9tdHJ4IDwtIGxvZzIobGluZWFyX210cnggKyAxKQpjaG9zZW5fc3Vycm9nYXRlcyA8LSBzdmE6Om51bS5zdihkYXQgPSBsMl9tdHJ4LCBtb2QgPSB0ZXN0X21vZGVsKQoKc3Vycm9nYXRlX3Jlc3VsdCA8LSBzdmE6OnN2YXNlcSgKICBkYXQgPSBsaW5lYXJfbXRyeCwgbi5zdiA9IGNob3Nlbl9zdXJyb2dhdGVzLCBtb2QgPSB0ZXN0X21vZGVsLCBtb2QwID0gbnVsbF9tb2RlbCkKbW9kZWxfYWRqdXN0IDwtIGFzLm1hdHJpeChzdXJyb2dhdGVfcmVzdWx0W1sic3YiXV0pCgpjb2xuYW1lcyhtb2RlbF9hZGp1c3QpIDwtIGMoIlNWMSIsICJTVjIiLCAiU1YzIikKcm93bmFtZXMobW9kZWxfYWRqdXN0KSA8LSByb3duYW1lcyhwRGF0YSh0ZXN0X2Vvc2lub3BoaWxzKSkKbG9uZ2VyX21vZGVsIDwtIGFzLmZvcm11bGEoIn4gZmluYWxvdXRjb21lICsgdmlzaXRudW1iZXIgKyBTVjEgKyBTVjIgKyBTVjMiKQplb19kZXNpZ25fc3ZzIDwtIGNiaW5kKHRlc3RfZW9fZGVzaWduLCBtb2RlbF9hZGp1c3QpCnN1bW1hcml6ZWQgPC0gREVTZXEyOjpERVNlcURhdGFTZXRGcm9tTWF0cml4KGNvdW50RGF0YSA9IGxpbmVhcl9tdHJ4LAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb2xEYXRhID0gZW9fZGVzaWduX3N2cywKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgZGVzaWduID0gbG9uZ2VyX21vZGVsKQpkZXNlcV9ydW4gPC0gREVTZXEyOjpERVNlcShzdW1tYXJpemVkKQpkZXNlcV90YWJsZSA8LSBhcy5kYXRhLmZyYW1lKERFU2VxMjo6cmVzdWx0cyhvYmplY3QgPSBkZXNlcV9ydW4sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNvbnRyYXN0ID0gYygiZmluYWxvdXRjb21lIiwgImZhaWx1cmUiLCAiY3VyZSIpLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmb3JtYXQgPSAiRGF0YUZyYW1lIikpCgpiaWdfdGFibGUgPC0gdF9jZl9lb3Npbm9waGlsX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJvdXRjb21lIl1dCm9ubHlfZGVzZXEgPC0gYmlnX3RhYmxlWywgYygiZGVzZXFfbG9nZmMiLCAiZGVzZXFfYWRqcCIpXQptZXJnZWQgPC0gbWVyZ2UoZGVzZXFfdGFibGUsIG9ubHlfZGVzZXEsIGJ5ID0gInJvdy5uYW1lcyIpCnJvd25hbWVzKG1lcmdlZCkgPC0gbWVyZ2VkW1siUm93Lm5hbWVzIl1dCm1lcmdlZFtbIlJvdy5uYW1lcyJdXSA8LSBOVUxMCgpjb3JfdmFsdWUgPC0gY29yLnRlc3QobWVyZ2VkW1sibG9nMkZvbGRDaGFuZ2UiXV0sIG1lcmdlZFtbImRlc2VxX2xvZ2ZjIl1dKQpjb3JfdmFsdWUKbG9nZmNfcGxvdHRlciA8LSBwbG90X2xpbmVhcl9zY2F0dGVyKG1lcmdlZFssIGMoImxvZzJGb2xkQ2hhbmdlIiwgImRlc2VxX2xvZ2ZjIildKQpsb2dmY19wbG90IDwtIGxvZ2ZjX3Bsb3R0ZXJbWyJzY2F0dGVyIl1dICsKICB4bGFiKCJERVNlcTIgbG9nMkZDOiBWaXNpdCBleHBsaWNpdGx5IGluIG1vZGVsIikgKwogIHlsYWIoIkRFU2VxMiBsb2cyRkM6IERlZmF1bHQgcGFpcndpc2UgY29tcGFyaXNvbiIpICsKICBnZ3RpdGxlKGdsdWUoIkNvbXBhcmluZyByZXN1bHRzIGZyb20gbW9kZWxzOiB7cHJldHR5TnVtKGNvcl92YWx1ZVtbJ2VzdGltYXRlJ11dKX0gKHBlYXJzb24pIikpCnBwKGZpbGUgPSAiZmlndXJlcy9jb21wYXJlX2NmX2FuZF92aXNpdF9pbl9tb2RlbF9lb3Npbm9waGlsX2xvZ2ZjLnN2ZyIpCmxvZ2ZjX3Bsb3QKZGV2Lm9mZigpCmxvZ2ZjX3Bsb3QKCmNvcl92YWx1ZSA8LSBjb3IudGVzdChtZXJnZWRbWyJwYWRqIl1dLCBtZXJnZWRbWyJkZXNlcV9hZGpwIl1dLCBtZXRob2QgPSAic3BlYXJtYW4iKQpjb3JfdmFsdWUKYWRqcF9wbG90dGVyIDwtIHBsb3RfbGluZWFyX3NjYXR0ZXIobWVyZ2VkWywgYygicGFkaiIsICJkZXNlcV9hZGpwIildKQphZGpwX3Bsb3QgPC0gYWRqcF9wbG90dGVyW1sic2NhdHRlciJdXSArCiAgeGxhYigiREVTZXEyIGFkanA6IFZpc2l0IGV4cGxpY2l0bHkgaW4gbW9kZWwiKSArCiAgeWxhYigiREVTZXEyIGFkanA6IERlZmF1bHQgcGFpcndpc2UgY29tcGFyaXNvbiIpICsKICBnZ3RpdGxlKGdsdWUoIkNvbXBhcmluZyByZXN1bHRzIGZyb20gbW9kZWxzOiB7cHJldHR5TnVtKGNvcl92YWx1ZVtbJ2VzdGltYXRlJ11dKX0gKHNwZWFybWFuKSIpKQpwcChmaWxlID0gImltYWdlcy9jb21wYXJlX2NmX2FuZF92aXNpdF9pbl9tb2RlbF9lb3Npbm9waGlsX2FkanAuc3ZnIikKYWRqcF9wbG90CmRldi5vZmYoKQphZGpwX3Bsb3QKCnByZXZpb3VzX3NpZ19pZHggPC0gYmlnX3RhYmxlW1siZGVzZXFfYWRqcCJdXSA8PSAwLjA1ICYgYWJzKGJpZ190YWJsZVtbImRlc2VxX2xvZ2ZjIl1dID49IDEuMCkKc3VtbWFyeShwcmV2aW91c19zaWdfaWR4KQpwcmV2aW91c19nZW5lcyA8LSByb3duYW1lcyhiaWdfdGFibGUpW3ByZXZpb3VzX3NpZ19pZHhdCgpuZXdfc2lnX2lkeCA8LSBhYnMoZGVzZXFfdGFibGVbWyJsb2cyRm9sZENoYW5nZSJdXSkgPj0gMS4wICYgZGVzZXFfdGFibGVbWyJwYWRqIl1dIDwgMC4wNQpuZXdfZ2VuZXMgPC0gcm93bmFtZXMoZGVzZXFfdGFibGUpW25ld19zaWdfaWR4XQpuYV9pZHggPC0gaXMubmEobmV3X2dlbmVzKQpuZXdfZ2VuZXMgPC0gbmV3X2dlbmVzWyFuYV9pZHhdCgpWZW5uZXJhYmxlOjpWZW5uKGxpc3QoInByZXZpb3VzIiA9IHByZXZpb3VzX2dlbmVzLCAibmV3IiA9IG5ld19nZW5lcykpCgp0ZXN0X25ldyA8LSBzaW1wbGVfZ3Byb2ZpbGVyKG5ld19nZW5lcykKdGVzdF9uZXcKdGVzdF9vbGQgPC0gc2ltcGxlX2dwcm9maWxlcihwcmV2aW91c19nZW5lcykKdGVzdF9vbGQKCm5ld19hbm5vdGF0ZWQgPC0gbWVyZ2UoZkRhdGEodF9lb3Npbm9waGlscyksIGRlc2VxX3RhYmxlLCBieSA9ICJyb3cubmFtZXMiKQpyb3duYW1lcyhuZXdfYW5ub3RhdGVkKSA8LSBuZXdfYW5ub3RhdGVkW1siUm93Lm5hbWVzIl1dCm5ld19hbm5vdGF0ZWRbWyJSb3cubmFtZXMiXV0gPC0gTlVMTAp3cml0ZV94bHN4KGRhdGEgPSBuZXdfYW5ub3RhdGVkLCBleGNlbCA9ICJleGNlbC9lb3Npbm9waGlsX3Zpc2l0X2luX21vZGVsX3N2YV9jZl9uZXcueGxzeCIpCgpvbGRfYW5ub3RhdGVkIDwtIG1lcmdlKGZEYXRhKHRfZW9zaW5vcGhpbHMpLCBiaWdfdGFibGUsIGJ5ID0gInJvdy5uYW1lcyIpCnJvd25hbWVzKG9sZF9hbm5vdGF0ZWQpIDwtIG9sZF9hbm5vdGF0ZWRbWyJSb3cubmFtZXMiXV0Kb2xkX2Fubm90YXRlZFtbIlJvdy5uYW1lcyJdXSA8LSBOVUxMCndyaXRlX3hsc3goZGF0YSA9IG9sZF9hbm5vdGF0ZWQsIGV4Y2VsID0gImV4Y2VsL2Vvc2lub3BoaWxfdmlzaXRfaW5fbW9kZWxfc3ZhX2NmX29sZC54bHN4IikKYGBgCgojIyMjIEMvRiBjZWxsdHlwZSB2b2xjYW5vIHBsb3RzIHdpdGggc3BlY2lmaWMgbGFiZWxzCgojIyMgRmlndXJlIDRCOiBWb2xjYW5vIHBsb3RzCgpOb3RlIHRvIHNlbGYsIHdoZW4gSSByZW5kZXJlZCB0aGUgaHRtbCwgc3R1cGlkIFIgcmFuIG91dCBvZiB0ZW1wIGZpbGVzCmFuZCBzbyBkaWQgbm90IGFjdHVhbGx5IHByaW50IHRoZSBkYXJuIGh0bWwgZG9jdW1lbnQsIGFzIGEgcmVzdWx0IEkKbW9kaWZpZWQgdGhlIHJlbmRlciBmdW5jdGlvbiB0byB0cnkgdG8gbWFrZSBzdXJlIHRoZXJlIGlzIGEgY2xlYW4KZGlyZWN0b3J5IGluIHdoaWNoIHRvIHdvcms7IHRlc3Rpbmcgbm93LiAgSWYgaXQgY29udGludWVzIHRvIG5vdCB3b3JrLApJIHdpbGwgbmVlZCB0byByZW1vdmUgc29tZSBvZiB0aGUgaW1hZ2VzIGNyZWF0ZWQgaW4gdGhpcyBkb2N1bWVudC4KCmBgYHtyfQpudW1fY29sb3IgPC0gY29sb3JfY2hvaWNlc1tbImNsaW5pY19jZiJdXVtbInR1bWFjb19mYWlsdXJlIl1dCmRlbl9jb2xvciA8LSBjb2xvcl9jaG9pY2VzW1siY2xpbmljX2NmIl1dW1sidHVtYWNvX2N1cmUiXV0Kd2FudGVkX2dlbmVzIDwtIGMoIkZJNDRMIiwgIklGSTI3IiwgIlBSUjUiLCAiUFJSNS1BUkhHQVA4IiwgIlJIQ0UiLAogICAgICAgICAgICAgICAgICAiRkJYTzM5IiwgIlJTQUQyIiwgIlNNVE5MMSIsICJVU1AxOCIsICJBRkFQMSIpCgpjZl9tb25vY3l0ZV90YWJsZSA8LSB0X2NmX21vbm9jeXRlX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJvdXRjb21lIl1dCmNmX21vbm9jeXRlX3ZvbGNhbm8gPC0gcGxvdF92b2xjYW5vX2NvbmRpdGlvbl9kZSgKICBjZl9tb25vY3l0ZV90YWJsZSwgIm91dGNvbWUiLCBsYWJlbCA9IHdhbnRlZF9nZW5lcywKICBmY19jb2wgPSAiZGVzZXFfbG9nZmMiLCBwX2NvbCA9ICJkZXNlcV9hZGpwIiwgbGluZV9wb3NpdGlvbiA9IE5VTEwsCiAgY29sb3JfaGlnaCA9IG51bV9jb2xvciwgY29sb3JfbG93ID0gZGVuX2NvbG9yLCBsYWJlbF9zaXplID0gNikKcHAoZmlsZSA9ICJmaWd1cmVzL2NmX21vbm9jeXRlX3ZvbGNhbm9fbGFiZWxlZC5zdmciKQpjZl9tb25vY3l0ZV92b2xjYW5vW1sicGxvdCJdXQpkZXYub2ZmKCkKY2ZfbW9ub2N5dGVfdm9sY2Fub1tbInBsb3QiXV0KCmNmX21vbm9jeXRlX3ZvbGNhbm9fdG9wMTAgPC0gcGxvdF92b2xjYW5vX2NvbmRpdGlvbl9kZSgKICBjZl9tb25vY3l0ZV90YWJsZSwgIm91dGNvbWUiLCBsYWJlbCA9IDEwLAogIGZjX2NvbCA9ICJkZXNlcV9sb2dmYyIsIHBfY29sID0gImRlc2VxX2FkanAiLCBsaW5lX3Bvc2l0aW9uID0gTlVMTCwKICBjb2xvcl9oaWdoID0gbnVtX2NvbG9yLCBjb2xvcl9sb3cgPSBkZW5fY29sb3IsIGxhYmVsX3NpemUgPSA2KQpwcChmaWxlID0gZ2x1ZSgiaW1hZ2VzL2NmX21vbm9jeXRlX3ZvbGNhbm9fbGFiZWxlZF90b3AxMC12e3Zlcn0uc3ZnIikpCmNmX21vbm9jeXRlX3ZvbGNhbm9fdG9wMTBbWyJwbG90Il1dCmRldi5vZmYoKQpjZl9tb25vY3l0ZV92b2xjYW5vX3RvcDEwW1sicGxvdCJdXQoKY2ZfZW9zaW5vcGhpbF90YWJsZSA8LSB0X2NmX2Vvc2lub3BoaWxfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0KY2ZfZW9zaW5vcGhpbF92b2xjYW5vIDwtIHBsb3Rfdm9sY2Fub19jb25kaXRpb25fZGUoCiAgY2ZfZW9zaW5vcGhpbF90YWJsZSwgIm91dGNvbWUiLCBsYWJlbCA9IHdhbnRlZF9nZW5lcywKICBmY19jb2wgPSAiZGVzZXFfbG9nZmMiLCBwX2NvbCA9ICJkZXNlcV9hZGpwIiwgbGluZV9wb3NpdGlvbiA9IE5VTEwsCiAgY29sb3JfaGlnaCA9IG51bV9jb2xvciwgY29sb3JfbG93ID0gZGVuX2NvbG9yLCBsYWJlbF9zaXplID0gNikKcHAoZmlsZSA9ICJmaWd1cmVzL2NmX2Vvc2lub3BoaWxfdm9sY2Fub19sYWJlbGVkLnN2ZyIpCmNmX2Vvc2lub3BoaWxfdm9sY2Fub1tbInBsb3QiXV0KZGV2Lm9mZigpCmNmX2Vvc2lub3BoaWxfdm9sY2Fub1tbInBsb3QiXV0KCmNmX2Vvc2lub3BoaWxfdm9sY2Fub190b3AxMCA8LSBwbG90X3ZvbGNhbm9fY29uZGl0aW9uX2RlKAogIGNmX2Vvc2lub3BoaWxfdGFibGUsICJvdXRjb21lIiwgbGFiZWwgPSAxMCwKICBmY19jb2wgPSAiZGVzZXFfbG9nZmMiLCBwX2NvbCA9ICJkZXNlcV9hZGpwIiwgbGluZV9wb3NpdGlvbiA9IE5VTEwsCiAgY29sb3JfaGlnaCA9IG51bV9jb2xvciwgY29sb3JfbG93ID0gZGVuX2NvbG9yLCBsYWJlbF9zaXplID0gNikKcHAoZmlsZSA9IGdsdWUoImltYWdlcy9jZl9lb3Npbm9waGlsX3ZvbGNhbm9fbGFiZWxlZF90b3AxMC12e3Zlcn0uc3ZnIikpCmNmX2Vvc2lub3BoaWxfdm9sY2Fub190b3AxMFtbInBsb3QiXV0KZGV2Lm9mZigpCmNmX2Vvc2lub3BoaWxfdm9sY2Fub190b3AxMFtbInBsb3QiXV0KCmNmX25ldXRyb3BoaWxfdGFibGUgPC0gdF9jZl9uZXV0cm9waGlsX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJvdXRjb21lIl1dCmNmX25ldXRyb3BoaWxfdm9sY2FubyA8LSBwbG90X3ZvbGNhbm9fY29uZGl0aW9uX2RlKAogIGNmX25ldXRyb3BoaWxfdGFibGUsICJvdXRjb21lIiwgbGFiZWwgPSB3YW50ZWRfZ2VuZXMsCiAgZmNfY29sID0gImRlc2VxX2xvZ2ZjIiwgcF9jb2wgPSAiZGVzZXFfYWRqcCIsIGxpbmVfcG9zaXRpb24gPSBOVUxMLAogIGNvbG9yX2hpZ2ggPSBudW1fY29sb3IsIGNvbG9yX2xvdyA9IGRlbl9jb2xvciwgbGFiZWxfc2l6ZSA9IDYpCnBwKGZpbGUgPSAiZmlndXJlcy9jZl9uZXV0cm9waGlsX3ZvbGNhbm9fbGFiZWxlZC5zdmciKQpjZl9uZXV0cm9waGlsX3ZvbGNhbm9bWyJwbG90Il1dCmRldi5vZmYoKQpjZl9uZXV0cm9waGlsX3ZvbGNhbm9bWyJwbG90Il1dCgpjZl9uZXV0cm9waGlsX3ZvbGNhbm9fdG9wMTAgPC0gcGxvdF92b2xjYW5vX2NvbmRpdGlvbl9kZSgKICBjZl9uZXV0cm9waGlsX3RhYmxlLCAib3V0Y29tZSIsIGxhYmVsID0gMTAsCiAgZmNfY29sID0gImRlc2VxX2xvZ2ZjIiwgcF9jb2wgPSAiZGVzZXFfYWRqcCIsIGxpbmVfcG9zaXRpb24gPSBOVUxMLAogIGNvbG9yX2hpZ2ggPSBudW1fY29sb3IsIGNvbG9yX2xvdyA9IGRlbl9jb2xvciwgbGFiZWxfc2l6ZSA9IDYpCnBwKGZpbGUgPSBnbHVlKCJpbWFnZXMvY2ZfbmV1dHJvcGhpbF92b2xjYW5vX2xhYmVsZWRfdG9wMTAtdnt2ZXJ9LnN2ZyIpKQpjZl9uZXV0cm9waGlsX3ZvbGNhbm9fdG9wMTBbWyJwbG90Il1dCmRldi5vZmYoKQpjZl9uZXV0cm9waGlsX3ZvbGNhbm9fdG9wMTBbWyJwbG90Il1dCmBgYAoKIyMjIEVvc2lub3BoaWwgdGltZSBjb21wYXJpc29ucwoKYGBge3J9CnRfY2ZfZW9zaW5vcGhpbF92MV9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHR2MV9lb3Npbm9waGlscywgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRfY2ZfZW9zaW5vcGhpbF92MV9kZV9zdmEKdF9jZl9lb3Npbm9waGlsX3YxX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X2NmX2Vvc2lub3BoaWxfdjFfZGVfc3ZhLCBrZWVwZXJzID0gdF9jZl9jb250cmFzdCwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RfZW9zaW5vcGhpbF92MV9jZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZl9lb3Npbm9waGlsX3YxX3RhYmxlX3N2YQp0X2NmX2Vvc2lub3BoaWxfdjFfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRfY2ZfZW9zaW5vcGhpbF92MV90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Fb3Npbm9waGlscy90X2Vvc2lub3BoaWxfdjFfY2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX2Vvc2lub3BoaWxfdjFfdGFibGVfc3ZhCgpkaW0odF9jZl9lb3Npbm9waGlsX3YxX3NpZ19zdmEkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX2Vvc2lub3BoaWxfdjFfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQoKdF9jZl9lb3Npbm9waGlsX3YyX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodHYyX2Vvc2lub3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9lb3Npbm9waGlsX3YyX2RlX3N2YQp0X2NmX2Vvc2lub3BoaWxfdjJfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfY2ZfZW9zaW5vcGhpbF92Ml9kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdF9lb3Npbm9waGlsX3YyX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX2Vvc2lub3BoaWxfdjJfdGFibGVfc3ZhCnRfY2ZfZW9zaW5vcGhpbF92Ml9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9lb3Npbm9waGlsX3YyX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RfZW9zaW5vcGhpbF92Ml9jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfZW9zaW5vcGhpbF92Ml9zaWdfc3ZhCgpkaW0odF9jZl9lb3Npbm9waGlsX3YyX3NpZ19zdmEkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX2Vvc2lub3BoaWxfdjJfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQoKdF9jZl9lb3Npbm9waGlsX3YzX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodHYzX2Vvc2lub3BoaWxzLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF9jZl9lb3Npbm9waGlsX3YzX2RlX3N2YQp0X2NmX2Vvc2lub3BoaWxfdjNfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfY2ZfZW9zaW5vcGhpbF92M19kZV9zdmEsIGtlZXBlcnMgPSB0X2NmX2NvbnRyYXN0LAogIGV4Y2VsID0gZ2x1ZSgie2NmX3ByZWZpeH0vRW9zaW5vcGhpbHMvdF9lb3Npbm9waGlsX3YzX2NmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NmX2Vvc2lub3BoaWxfdjNfdGFibGVfc3ZhCnRfY2ZfZW9zaW5vcGhpbF92M19zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF9jZl9lb3Npbm9waGlsX3YzX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L0Vvc2lub3BoaWxzL3RfZW9zaW5vcGhpbF92M19jZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2ZfZW9zaW5vcGhpbF92M19zaWdfc3ZhCgpkaW0odF9jZl9lb3Npbm9waGlsX3YzX3NpZ19zdmEkZGVzZXEkdXBzW1sxXV0pCmRpbSh0X2NmX2Vvc2lub3BoaWxfdjNfc2lnX3N2YSRkZXNlcSRkb3duc1tbMV1dKQpgYGAKCiMjIyMgRW9zaW5vcGhpbHM6IENvbXBhcmUgc3ZhIHRvIGJhdGNoLWluLXZpc2l0CgpgYGB7cn0Kc3ZhX2F1Y2MgPC0gY2FsY3VsYXRlX2F1Y2ModF9jZl9lb3Npbm9waGlsX3RhYmxlX3N2YVtbImRhdGEiXV1bWzFdXSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgdGJsMiA9IHRfY2ZfZW9zaW5vcGhpbF90YWJsZV9iYXRjaHZpc2l0W1siZGF0YSJdXVtbMV1dLAogICAgICAgICAgICAgICAgICAgICAgICAgICBweSA9ICJkZXNlcV9hZGpwIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQpzdmFfYXVjYwoKc2hhcmVkX2lkcyA8LSByb3duYW1lcyh0X2NmX2Vvc2lub3BoaWxfdGFibGVfc3ZhW1siZGF0YSJdXVtbMV1dKSAlaW4lCiAgcm93bmFtZXModF9jZl9lb3Npbm9waGlsX3RhYmxlX2JhdGNodmlzaXRbWyJkYXRhIl1dW1sxXV0pCmZpcnN0IDwtIHRfY2ZfZW9zaW5vcGhpbF90YWJsZV9zdmFbWyJkYXRhIl1dW1sxXV1bc2hhcmVkX2lkcywgXQpzZWNvbmQgPC0gdF9jZl9lb3Npbm9waGlsX3RhYmxlX2JhdGNodmlzaXRbWyJkYXRhIl1dW1sxXV1bcm93bmFtZXMoZmlyc3QpLCBdCmNvci50ZXN0KGZpcnN0W1siZGVzZXFfbG9nZmMiXV0sIHNlY29uZFtbImRlc2VxX2xvZ2ZjIl1dKQpgYGAKCiMjIyMgQ29tcGFyZSBtb25vY3l0ZSBDRiwgbmV1dHJvcGhpbCBDRiwgZW9zaW5vcGhpbCBDRgoKYGBge3J9CnRfbW9ub19uZXV0X3N2YV9hdWNjIDwtIGNhbGN1bGF0ZV9hdWNjKHRfY2ZfbW9ub2N5dGVfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRibDIgPSB0X2NmX25ldXRyb3BoaWxfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHB5ID0gImRlc2VxX2FkanAiLCBseSA9ICJkZXNlcV9sb2dmYyIpCnRfbW9ub19uZXV0X3N2YV9hdWNjCgp0X21vbm9fZW9fc3ZhX2F1Y2MgPC0gY2FsY3VsYXRlX2F1Y2ModF9jZl9tb25vY3l0ZV90YWJsZV9zdmFbWyJkYXRhIl1dW1sib3V0Y29tZSJdXSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHRibDIgPSB0X2NmX2Vvc2lub3BoaWxfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBweSA9ICJkZXNlcV9hZGpwIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQp0X21vbm9fZW9fc3ZhX2F1Y2MKCnRfbmV1dF9lb19zdmFfYXVjYyA8LSBjYWxjdWxhdGVfYXVjYyh0X2NmX25ldXRyb3BoaWxfdGFibGVfc3ZhW1siZGF0YSJdXVtbIm91dGNvbWUiXV0sCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB0YmwyID0gdF9jZl9lb3Npbm9waGlsX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJvdXRjb21lIl1dLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcHkgPSAiZGVzZXFfYWRqcCIsIGx5ID0gImRlc2VxX2xvZ2ZjIikKdF9uZXV0X2VvX3N2YV9hdWNjCmBgYAoKIyMjIEJ5IHZpc2l0CgpGb3IgdGhlc2UgY29udHJhc3RzLCB3ZSB3YW50IHRvIHNlZSBmYWlsX3YxIHZzLiBjdXJlX3YxLCBmYWlsX3YyCnZzLiBjdXJlX3YyIGV0Yy4gIEFzIGEgcmVzdWx0LCB3ZSB3aWxsIG5lZWQgdG8ganVnZ2xlIHRoZSBkYXRhCnNsaWdodGx5IGFuZCBhZGQgYW5vdGhlciBzZXQgb2YgY29udHJhc3RzLgoKIyMjIyBDdXJlL0ZhaWwgYnkgdmlzaXRzLCBhbGwgY2VsbCB0eXBlcwoKYGBge3J9CnRfdmlzaXRfY2ZfYWxsX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UodF92aXNpdGNmLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRfdmlzaXRfY2ZfYWxsX2RlX3N2YQp0X3Zpc2l0X2NmX2FsbF90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF92aXNpdF9jZl9hbGxfZGVfc3ZhLCBrZWVwZXJzID0gdmlzaXRjZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS90X2FsbF92aXNpdGNmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X3Zpc2l0X2NmX2FsbF90YWJsZV9zdmEKdF92aXNpdF9jZl9hbGxfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRfdmlzaXRfY2ZfYWxsX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L3RfYWxsX3Zpc2l0Y2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X3Zpc2l0X2NmX2FsbF9zaWdfc3ZhCmBgYAoKIyMjIyBDdXJlL0ZhaWwgYnkgdmlzaXQsIE1vbm9jeXRlcwoKYGBge3J9CnZpc2l0Y2ZfZmFjdG9yIDwtIHBhc3RlMCgidiIsIHBEYXRhKHRfbW9ub2N5dGVzKVtbInZpc2l0bnVtYmVyIl1dLCAiXyIsCiAgICAgICAgICAgICAgICAgICAgICAgICBwRGF0YSh0X21vbm9jeXRlcylbWyJmaW5hbG91dGNvbWUiXV0pCnRfbW9ub2N5dGVzX3Zpc2l0Y2YgPC0gc2V0X2V4cHRfY29uZGl0aW9ucyh0X21vbm9jeXRlcywgZmFjdCA9IHZpc2l0Y2ZfZmFjdG9yKQoKdF92aXNpdF9jZl9tb25vY3l0ZV9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfbW9ub2N5dGVzX3Zpc2l0Y2YsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRfdmlzaXRfY2ZfbW9ub2N5dGVfZGVfc3ZhCnRfdmlzaXRfY2ZfbW9ub2N5dGVfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfdmlzaXRfY2ZfbW9ub2N5dGVfZGVfc3ZhLCBrZWVwZXJzID0gdmlzaXRjZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Nb25vY3l0ZXMvdF9tb25vY3l0ZV92aXNpdGNmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X3Zpc2l0X2NmX21vbm9jeXRlX3RhYmxlX3N2YQp0X3Zpc2l0X2NmX21vbm9jeXRlX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X3Zpc2l0X2NmX21vbm9jeXRlX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L01vbm9jeXRlcy90X21vbm9jeXRlX3Zpc2l0Y2Zfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X3Zpc2l0X2NmX21vbm9jeXRlX3NpZ19zdmEKCnRfdjFmY19kZXNlcV9tYSA8LSB0X3Zpc2l0X2NmX21vbm9jeXRlX3RhYmxlX3N2YVtbInBsb3RzIl1dW1sidjFjZiJdXVtbImRlc2VxX21hX3Bsb3RzIl1dW1sicGxvdCJdXQpkZXYgPC0gcHAoZmlsZSA9ICJpbWFnZXMvbW9ub2N5dGVfY2ZfZGVfdjFfbWFwbG90LnBuZyIpCnRfdjFmY19kZXNlcV9tYQpjbG9zZWQgPC0gZGV2Lm9mZigpCnRfdjFmY19kZXNlcV9tYQoKdF92MmZjX2Rlc2VxX21hIDwtIHRfdmlzaXRfY2ZfbW9ub2N5dGVfdGFibGVfc3ZhW1sicGxvdHMiXV1bWyJ2MmNmIl1dW1siZGVzZXFfbWFfcGxvdHMiXV1bWyJwbG90Il1dCmRldiA8LSBwcChmaWxlID0gImltYWdlcy9tb25vY3l0ZV9jZl9kZV92Ml9tYXBsb3QucG5nIikKdF92MmZjX2Rlc2VxX21hCmNsb3NlZCA8LSBkZXYub2ZmKCkKdF92MmZjX2Rlc2VxX21hCgp0X3YzZmNfZGVzZXFfbWEgPC0gdF92aXNpdF9jZl9tb25vY3l0ZV90YWJsZV9zdmFbWyJwbG90cyJdXVtbInYzY2YiXV1bWyJkZXNlcV9tYV9wbG90cyJdXVtbInBsb3QiXV0KZGV2IDwtIHBwKGZpbGUgPSAiaW1hZ2VzL21vbm9jeXRlX2NmX2RlX3YzX21hcGxvdC5wbmciKQp0X3YzZmNfZGVzZXFfbWEKY2xvc2VkIDwtIGRldi5vZmYoKQp0X3YzZmNfZGVzZXFfbWEKYGBgCgpPbmUgcXVlcnkgZnJvbSBBbGVqYW5kcm8gaXMgdG8gbG9vayBhdCB0aGUgZ2VuZXMgc2hhcmVkIHVwL2Rvd24gYWNyb3NzCnZpc2l0cy4gIEkgYW0gbm90IGVudGlyZWx5IGNlcnRhaW4gd2UgaGF2ZSBlbm91Z2ggc2FtcGxlcyBmb3IgdGhpcyB0bwp3b3JrLCBidXQgbGV0IHVzIGZpbmQgb3V0LgoKSSBhbSB0aGlua2luZyB0aGlzIGlzIGEgZ29vZCBwbGFjZSB0byB1c2UgdGhlIEFVQ0MgY3VydmVzIEkgbGVhcm5lZAphYm91dCB0aGFua3MgdG8gSnVsaWUgQ3JpZGxhbmQuCgpOb3RlIHRoYXQgdGhlIGZvbGxvd2luZyBpcyBhbGwgbW9ub2N5dGUgc2FtcGxlcywgdGhpcyBzaG91bGQgdGhlcmVmb3JlCnBvdGVudGlhbGx5IGJlIG1vdmVkIHVwIGFuZCBhIHZlcnNpb24gb2YgdGhpcyB3aXRoIG9ubHkgdGhlIFR1bWFjbwpzYW1wbGVzIHB1dCBoZXJlPwoKYGBge3J9CnYxY2YgPC0gdF92aXNpdF9jZl9tb25vY3l0ZV90YWJsZV9zdmFbWyJkYXRhIl1dW1sidjFjZiJdXQp2MmNmIDwtIHRfdmlzaXRfY2ZfbW9ub2N5dGVfdGFibGVfc3ZhW1siZGF0YSJdXVtbInYyY2YiXV0KdjNjZiA8LSB0X3Zpc2l0X2NmX21vbm9jeXRlX3RhYmxlX3N2YVtbImRhdGEiXV1bWyJ2M2NmIl1dCgp2MV9zaWcgPC0gYygKICByb3duYW1lcyh0X3Zpc2l0X2NmX21vbm9jeXRlX3NpZ19zdmFbWyJkZXNlcSJdXVtbInVwcyJdXVtbInYxY2YiXV0pLAogIHJvd25hbWVzKHRfdmlzaXRfY2ZfbW9ub2N5dGVfc2lnX3N2YVtbImRlc2VxIl1dW1siZG93bnMiXV1bWyJ2MWNmIl1dKSkKbGVuZ3RoKHYxX3NpZykKCnYyX3NpZyA8LSBjKAogIHJvd25hbWVzKHRfdmlzaXRfY2ZfbW9ub2N5dGVfc2lnX3N2YVtbImRlc2VxIl1dW1sidXBzIl1dW1sidjJjZiJdXSksCiAgcm93bmFtZXModF92aXNpdF9jZl9tb25vY3l0ZV9zaWdfc3ZhW1siZGVzZXEiXV1bWyJkb3ducyJdXVtbInYyY2YiXV0pKQpsZW5ndGgodjJfc2lnKQoKdjNfc2lnIDwtIGMoCiAgcm93bmFtZXModF92aXNpdF9jZl9tb25vY3l0ZV9zaWdfc3ZhW1siZGVzZXEiXV1bWyJ1cHMiXV1bWyJ2MmNmIl1dKSwKICByb3duYW1lcyh0X3Zpc2l0X2NmX21vbm9jeXRlX3NpZ19zdmFbWyJkZXNlcSJdXVtbImRvd25zIl1dW1sidjJjZiJdXSkpCmxlbmd0aCh2M19zaWcpCgp0X21vbm9jeXRlX3Zpc2l0X2F1Y2NfdjJ2MSA8LSBjYWxjdWxhdGVfYXVjYyh2MWNmLCB0YmwyID0gdjJjZiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcHkgPSAiZGVzZXFfYWRqcCIsIGx5ID0gImRlc2VxX2xvZ2ZjIikKZGV2IDwtIHBwKGZpbGUgPSAiaW1hZ2VzL21vbm9jeXRlX3Zpc2l0X3YydjFfYXVjYy5wbmciKQp0X21vbm9jeXRlX3Zpc2l0X2F1Y2NfdjJ2MVtbInBsb3QiXV0KY2xvc2VkIDwtIGRldi5vZmYoKQp0X21vbm9jeXRlX3Zpc2l0X2F1Y2NfdjJ2MVtbInBsb3QiXV0KCnRfbW9ub2N5dGVfdmlzaXRfYXVjY192M3YxIDwtIGNhbGN1bGF0ZV9hdWNjKHYxY2YsIHRibDIgPSB2M2NmLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBweSA9ICJkZXNlcV9hZGpwIiwgbHkgPSAiZGVzZXFfbG9nZmMiKQpkZXYgPC0gcHAoZmlsZSA9ICJpbWFnZXMvbW9ub2N5dGVfdmlzaXRfdjN2MV9hdWNjLnBuZyIpCnRfbW9ub2N5dGVfdmlzaXRfYXVjY192M3YxW1sicGxvdCJdXQpjbG9zZWQgPC0gZGV2Lm9mZigpCnRfbW9ub2N5dGVfdmlzaXRfYXVjY192M3YxW1sicGxvdCJdXQpgYGAKCiMjIyMgQ3VyZS9GYWlsIGJ5IHZpc2l0LCBOZXV0cm9waGlscwoKYGBge3J9CnZpc2l0Y2ZfZmFjdG9yIDwtIHBhc3RlMCgidiIsIHBEYXRhKHRfbmV1dHJvcGhpbHMpW1sidmlzaXRudW1iZXIiXV0sICJfIiwKICAgICAgICAgICAgICAgICAgICAgICAgIHBEYXRhKHRfbmV1dHJvcGhpbHMpW1siZmluYWxvdXRjb21lIl1dKQp0X25ldXRyb3BoaWxfdmlzaXRjZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRfbmV1dHJvcGhpbHMsIGZhY3QgPSB2aXNpdGNmX2ZhY3RvcikKCnRfdmlzaXRfY2ZfbmV1dHJvcGhpbF9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfbmV1dHJvcGhpbF92aXNpdGNmLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF92aXNpdF9jZl9uZXV0cm9waGlsX2RlX3N2YQp0X3Zpc2l0X2NmX25ldXRyb3BoaWxfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfdmlzaXRfY2ZfbmV1dHJvcGhpbF9kZV9zdmEsIGtlZXBlcnMgPSB2aXNpdGNmX2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RfbmV1dHJvcGhpbF92aXNpdGNmX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X3Zpc2l0X2NmX25ldXRyb3BoaWxfdGFibGVfc3ZhCnRfdmlzaXRfY2ZfbmV1dHJvcGhpbF9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF92aXNpdF9jZl9uZXV0cm9waGlsX3RhYmxlX3N2YSwKICBleGNlbCA9IGdsdWUoIntjZl9wcmVmaXh9L05ldXRyb3BoaWxzL3RfbmV1dHJvcGhpbF92aXNpdGNmX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF92aXNpdF9jZl9uZXV0cm9waGlsX3NpZ19zdmEKYGBgCgojIyMjIEN1cmUvRmFpbCBieSB2aXNpdCwgRW9zaW5vcGhpbHMKCmBgYHtyfQp2aXNpdGNmX2ZhY3RvciA8LSBwYXN0ZTAoInYiLCBwRGF0YSh0X2Vvc2lub3BoaWxzKVtbInZpc2l0bnVtYmVyIl1dLCAiXyIsCiAgICAgICAgICAgICAgICAgICAgICAgICBwRGF0YSh0X2Vvc2lub3BoaWxzKVtbImZpbmFsb3V0Y29tZSJdXSkKdF9lb3Npbm9waGlsX3Zpc2l0Y2YgPC0gc2V0X2V4cHRfY29uZGl0aW9ucyh0X2Vvc2lub3BoaWxzLCBmYWN0ID0gdmlzaXRjZl9mYWN0b3IpCgp0X3Zpc2l0X2NmX2Vvc2lub3BoaWxfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0X2Vvc2lub3BoaWxfdmlzaXRjZiwgbW9kZWxfYmF0Y2ggPSAic3Zhc2VxIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgcGFyYWxsZWwgPSBwYXJhbGxlbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRfdmlzaXRfY2ZfZW9zaW5vcGhpbF9kZV9zdmEKdF92aXNpdF9jZl9lb3Npbm9waGlsX3RhYmxlX3N2YSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X3Zpc2l0X2NmX2Vvc2lub3BoaWxfZGVfc3ZhLCBrZWVwZXJzID0gdmlzaXRjZl9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Fb3Npbm9waGlscy90X2Vvc2lub3BoaWxfdmlzaXRjZl90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF92aXNpdF9jZl9lb3Npbm9waGlsX3RhYmxlX3N2YQp0X3Zpc2l0X2NmX2Vvc2lub3BoaWxfc2lnX3N2YSA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRfdmlzaXRfY2ZfZW9zaW5vcGhpbF90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7Y2ZfcHJlZml4fS9Fb3Npbm9waGlscy90X2Vvc2lub3BoaWxfdmlzaXRjZl9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfdmlzaXRfY2ZfZW9zaW5vcGhpbF9zaWdfc3ZhCmBgYAoKIyMgUGVyc2lzdGVuY2UgaW4gdmlzaXQgMwoKSGF2aW5nIHB1dCBzb21lIFNMIHJlYWQgbWFwcGluZyBpbmZvcm1hdGlvbiBpbiB0aGUgc2FtcGxlIHNoZWV0LCBNYXJpYQpBZGVsYWlkYSBhZGRlZCBhIG5ldyBjb2x1bW4gdXNpbmcgaXQgd2l0aCB0aGUgcHV0YXRpdmUgcGVyc2lzdGVuY2UKc3RhdGUgb24gYSBwZXItc2FtcGxlIGJhc2lzLiAgT25lIHF1ZXN0aW9uIHdoaWNoIGFyaXNlZCBmcm9tIHRoYXQ6CndoYXQgZGlmZmVyZW5jZXMgYXJlIG9ic2VydmFibGUgYmV0d2VlbiB0aGUgcGVyc2lzdGVudCB5ZXMgdnMuIG5vCnNhbXBsZXMgb24gYSBwZXItY2VsbC10eXBlIGJhc2lzIGFtb25nIHRoZSB2aXNpdCAzIHNhbXBsZXMuCgojIyMgU2V0dGluZyB1cAoKRmlyc3QgdGhpbmdzIGZpcnN0LCBjcmVhdGUgdGhlIGRhdGFzZXRzLgoKYGBge3J9CnBlcnNpc3RlbmNlX2V4cHQgPC0gc3Vic2V0X2V4cHQodF9jbGluaWNhbCwgc3Vic2V0ID0gInBlcnNpc3RlbmNlPT0nWSd8cGVyc2lzdGVuY2U9PSdOJyIpICU+JQogIHN1YnNldF9leHB0KHN1YnNldCA9ICd2aXNpdG51bWJlcj09MycpICU+JQogIHNldF9leHB0X2NvbmRpdGlvbnMoZmFjdCA9ICdwZXJzaXN0ZW5jZScpCgojIyBwZXJzaXN0ZW5jZV9iaW9wc3kgPC0gc3Vic2V0X2V4cHQocGVyc2lzdGVuY2VfZXhwdCwgc3Vic2V0ID0gInR5cGVvZmNlbGxzPT0nYmlvcHN5JyIpCnBlcnNpc3RlbmNlX21vbm9jeXRlIDwtIHN1YnNldF9leHB0KHBlcnNpc3RlbmNlX2V4cHQsIHN1YnNldCA9ICJ0eXBlb2ZjZWxscz09J21vbm9jeXRlcyciKQpwZXJzaXN0ZW5jZV9uZXV0cm9waGlsIDwtIHN1YnNldF9leHB0KHBlcnNpc3RlbmNlX2V4cHQsIHN1YnNldCA9ICJ0eXBlb2ZjZWxscz09J25ldXRyb3BoaWxzJyIpCnBlcnNpc3RlbmNlX2Vvc2lub3BoaWwgPC0gc3Vic2V0X2V4cHQocGVyc2lzdGVuY2VfZXhwdCwgc3Vic2V0ID0gInR5cGVvZmNlbGxzPT0nZW9zaW5vcGhpbHMnIikKYGBgCgojIyMgVGFrZSBhIGxvb2sKClNlZSBpZiB0aGVyZSBhcmUgYW55IHBhdHRlcm5zIHdoaWNoIGxvb2sgdXNhYmxlLgoKYGBge3J9CiMjIEFsbApwZXJzaXN0ZW5jZV9ub3JtIDwtIG5vcm1hbGl6ZV9leHB0KHBlcnNpc3RlbmNlX2V4cHQsIHRyYW5zZm9ybSA9ICJsb2cyIiwgY29udmVydCA9ICJjcG0iLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG5vcm0gPSAicXVhbnQiLCBmaWx0ZXIgPSBUUlVFKQpwbG90X3BjYShwZXJzaXN0ZW5jZV9ub3JtKVtbInBsb3QiXV0KcGVyc2lzdGVuY2VfbmIgPC0gbm9ybWFsaXplX2V4cHQocGVyc2lzdGVuY2VfZXhwdCwgdHJhbnNmb3JtID0gImxvZzIiLCBjb252ZXJ0ID0gImNwbSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGJhdGNoID0gInN2YXNlcSIsIGZpbHRlciA9IFRSVUUpCnBsb3RfcGNhKHBlcnNpc3RlbmNlX25iKVtbInBsb3QiXV0KCiMjIEJpb3BzaWVzCiMjcGVyc2lzdGVuY2VfYmlvcHN5X25vcm0gPC0gbm9ybWFsaXplX2V4cHQocGVyc2lzdGVuY2VfYmlvcHN5LCB0cmFuc2Zvcm0gPSAibG9nMiIsIGNvbnZlcnQgPSAiY3BtIiwKIyMgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG5vcm0gPSAicXVhbnQiLCBmaWx0ZXIgPSBUUlVFKQojI3Bsb3RfcGNhKHBlcnNpc3RlbmNlX2Jpb3BzeV9ub3JtKVtbInBsb3QiXV0KIyMgSW5zdWZmaWNpZW50IGRhdGEKCiMjIE1vbm9jeXRlcwpwZXJzaXN0ZW5jZV9tb25vY3l0ZV9ub3JtIDwtIG5vcm1hbGl6ZV9leHB0KHBlcnNpc3RlbmNlX21vbm9jeXRlLCB0cmFuc2Zvcm0gPSAibG9nMiIsIGNvbnZlcnQgPSAiY3BtIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBub3JtID0gInF1YW50IiwgZmlsdGVyID0gVFJVRSkKcGxvdF9wY2EocGVyc2lzdGVuY2VfbW9ub2N5dGVfbm9ybSlbWyJwbG90Il1dCnBlcnNpc3RlbmNlX21vbm9jeXRlX25iIDwtIG5vcm1hbGl6ZV9leHB0KHBlcnNpc3RlbmNlX21vbm9jeXRlLCB0cmFuc2Zvcm0gPSAibG9nMiIsIGNvbnZlcnQgPSAiY3BtIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmF0Y2ggPSAic3Zhc2VxIiwgZmlsdGVyID0gVFJVRSkKcGxvdF9wY2EocGVyc2lzdGVuY2VfbW9ub2N5dGVfbmIpW1sicGxvdCJdXQoKIyMgTmV1dHJvcGhpbHMKcGVyc2lzdGVuY2VfbmV1dHJvcGhpbF9ub3JtIDwtIG5vcm1hbGl6ZV9leHB0KHBlcnNpc3RlbmNlX25ldXRyb3BoaWwsIHRyYW5zZm9ybSA9ICJsb2cyIiwgY29udmVydCA9ICJjcG0iLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbm9ybSA9ICJxdWFudCIsIGZpbHRlciA9IFRSVUUpCnBsb3RfcGNhKHBlcnNpc3RlbmNlX25ldXRyb3BoaWxfbm9ybSlbWyJwbG90Il1dCnBlcnNpc3RlbmNlX25ldXRyb3BoaWxfbmIgPC0gbm9ybWFsaXplX2V4cHQocGVyc2lzdGVuY2VfbmV1dHJvcGhpbCwgdHJhbnNmb3JtID0gImxvZzIiLCBjb252ZXJ0ID0gImNwbSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYmF0Y2ggPSAic3Zhc2VxIiwgZmlsdGVyID0gVFJVRSkKcGxvdF9wY2EocGVyc2lzdGVuY2VfbmV1dHJvcGhpbF9uYilbWyJwbG90Il1dCgojIyBFb3Npbm9waGlscwpwZXJzaXN0ZW5jZV9lb3Npbm9waGlsX25vcm0gPC0gbm9ybWFsaXplX2V4cHQocGVyc2lzdGVuY2VfZW9zaW5vcGhpbCwgdHJhbnNmb3JtID0gImxvZzIiLCBjb252ZXJ0ID0gImNwbSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBub3JtID0gInF1YW50IiwgZmlsdGVyID0gVFJVRSkKcGxvdF9wY2EocGVyc2lzdGVuY2VfZW9zaW5vcGhpbF9ub3JtKVtbInBsb3QiXV0KcGVyc2lzdGVuY2VfZW9zaW5vcGhpbF9uYiA8LSBub3JtYWxpemVfZXhwdChwZXJzaXN0ZW5jZV9lb3Npbm9waGlsLCB0cmFuc2Zvcm0gPSAibG9nMiIsIGNvbnZlcnQgPSAiY3BtIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBiYXRjaCA9ICJzdmFzZXEiLCBmaWx0ZXIgPSBUUlVFKQpwbG90X3BjYShwZXJzaXN0ZW5jZV9lb3Npbm9waGlsX25iKVtbInBsb3QiXV0KYGBgCgojIyMgcGVyc2lzdGVuY2UgREUKCmBgYHtyfQpwZXJzaXN0ZW5jZV9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHBlcnNpc3RlbmNlX2V4cHQsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIpCnBlcnNpc3RlbmNlX2RlX3N2YQpwZXJzaXN0ZW5jZV90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgcGVyc2lzdGVuY2VfZGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9QZXJzaXN0ZW5jZS9wZXJzaXN0ZW5jZV9hbGxfZGVfc3ZhLXZ7dmVyfS54bHN4IikpCnBlcnNpc3RlbmNlX3RhYmxlX3N2YQpwZXJzaXN0ZW5jZV9tb25vY3l0ZV9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHBlcnNpc3RlbmNlX21vbm9jeXRlLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnBlcnNpc3RlbmNlX21vbm9jeXRlX2RlX3N2YQpwZXJzaXN0ZW5jZV9tb25vY3l0ZV90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgcGVyc2lzdGVuY2VfbW9ub2N5dGVfZGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9QZXJzaXN0ZW5jZS9wZXJzaXN0ZW5jZV9tb25vY3l0ZV9kZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKcGVyc2lzdGVuY2VfbW9ub2N5dGVfdGFibGVfc3ZhCgpwZXJzaXN0ZW5jZV9uZXV0cm9waGlsX2RlX3N2YSA8LSBhbGxfcGFpcndpc2UocGVyc2lzdGVuY2VfbmV1dHJvcGhpbCwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKcGVyc2lzdGVuY2VfbmV1dHJvcGhpbF9kZV9zdmEKcGVyc2lzdGVuY2VfbmV1dHJvcGhpbF90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgcGVyc2lzdGVuY2VfbmV1dHJvcGhpbF9kZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX1BlcnNpc3RlbmNlL3BlcnNpc3RlbmNlX25ldXRyb3BoaWxfZGVfc3ZhLXZ7dmVyfS54bHN4IikpCnBlcnNpc3RlbmNlX25ldXRyb3BoaWxfdGFibGVfc3ZhCgojIyBUaGVyZSBhcmUgaW5zdWZmaWNpZW50IHNhbXBsZXMgKDEpIGluIHRoZSAnTicgY2F0ZWdvcnkuCiMjcGVyc2lzdGVuY2VfZW9zaW5vcGhpbF9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHBlcnNpc3RlbmNlX2Vvc2lub3BoaWwsIGZpbHRlciA9IFRSVUUsCiMjICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiMjICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQojI3BlcnNpc3RlbmNlX2Vvc2lub3BoaWxfZGVfc3ZhCiMjcGVyc2lzdGVuY2VfZW9zaW5vcGhpbF90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiMjICBwZXJzaXN0ZW5jZV9lb3Npbm9waGlsX2RlX3N2YSwKIyMgIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9QZXJzaXN0ZW5jZS9wZXJzaXN0ZW5jZV9lb3Npbm9waGlsX2RlX3N2YS12e3Zlcn0ueGxzeCIpKQpgYGAKCiMjIENvbXBhcmluZyB2aXNpdHMgd2l0aG91dCByZWdhcmQgdG8gY3VyZS9mYWlsCgojIyMgQWxsIGNlbGwgdHlwZXMKCmBgYHtyfQp0X3Zpc2l0X2FsbF9kZV9zdmEgPC0gYWxsX3BhaXJ3aXNlKHRfdmlzaXQsIGZpbHRlciA9IFRSVUUsIG1ldGhvZHMgPSBtZXRob2RzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIpCnRfdmlzaXRfYWxsX2RlX3N2YQp0X3Zpc2l0X2FsbF90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF92aXNpdF9hbGxfZGVfc3ZhLCBrZWVwZXJzID0gdmlzaXRfY29udHJhc3RzLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMvdF9hbGxfdmlzaXRfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfdmlzaXRfYWxsX3RhYmxlX3N2YQp0X3Zpc2l0X2FsbF9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF92aXNpdF9hbGxfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMvdF9hbGxfdmlzaXRfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X3Zpc2l0X2FsbF9zaWdfc3ZhCmBgYAoKIyMjIE1vbm9jeXRlIHNhbXBsZXMKCmBgYHtyfQp0X3Zpc2l0X21vbm9jeXRlcyA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRfbW9ub2N5dGVzLCBmYWN0ID0gInZpc2l0bnVtYmVyIikKCnRfdmlzaXRfbW9ub2N5dGVfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0X3Zpc2l0X21vbm9jeXRlcywgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF92aXNpdF9tb25vY3l0ZV9kZV9zdmEKdF92aXNpdF9tb25vY3l0ZV90YWJsZV9zdmEgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF92aXNpdF9tb25vY3l0ZV9kZV9zdmEsIGtlZXBlcnMgPSB2aXNpdF9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX1Zpc2l0cy9Nb25vY3l0ZXMvdF9tb25vY3l0ZV92aXNpdF90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF92aXNpdF9tb25vY3l0ZV90YWJsZV9zdmEKdF92aXNpdF9tb25vY3l0ZV9zaWdfc3ZhIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoCiAgdF92aXNpdF9tb25vY3l0ZV90YWJsZV9zdmEsCiAgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX1Zpc2l0cy9Nb25vY3l0ZXMvdF9tb25vY3l0ZV92aXNpdF9zaWdfc3ZhLXZ7dmVyfS54bHN4IikpCnRfdmlzaXRfbW9ub2N5dGVfc2lnX3N2YQpgYGAKCiMjIyBOZXV0cm9waGlsIHNhbXBsZXMKCmBgYHtyfQp0X3Zpc2l0X25ldXRyb3BoaWxzIDwtIHNldF9leHB0X2NvbmRpdGlvbnModF9uZXV0cm9waGlscywgZmFjdCA9ICJ2aXNpdG51bWJlciIpCgp0X3Zpc2l0X25ldXRyb3BoaWxfZGVfc3ZhIDwtIGFsbF9wYWlyd2lzZSh0X3Zpc2l0X25ldXRyb3BoaWxzLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBtZXRob2RzID0gbWV0aG9kcykKdF92aXNpdF9uZXV0cm9waGlsX2RlX3N2YQp0X3Zpc2l0X25ldXRyb3BoaWxfdGFibGVfc3ZhIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfdmlzaXRfbmV1dHJvcGhpbF9kZV9zdmEsIGtlZXBlcnMgPSB2aXNpdF9jb250cmFzdHMsCiAgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX1Zpc2l0cy9OZXV0cm9waGlscy90X25ldXRyb3BoaWxfdmlzaXRfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfdmlzaXRfbmV1dHJvcGhpbF90YWJsZV9zdmEKdF92aXNpdF9uZXV0cm9waGlsX3NpZ19zdmEgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X3Zpc2l0X25ldXRyb3BoaWxfdGFibGVfc3ZhLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMvTmV1dHJvcGhpbHMvdF9uZXV0cm9waGlsX3Zpc2l0X3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF92aXNpdF9uZXV0cm9waGlsX3NpZ19zdmEKYGBgCgojIyMgRW9zaW5vcGhpbCBzYW1wbGVzCgpgYGB7cn0KdF92aXNpdF9lb3Npbm9waGlscyA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRfZW9zaW5vcGhpbHMsIGZhY3Q9InZpc2l0bnVtYmVyIikKCnRfdmlzaXRfZW9zaW5vcGhpbF9kZSA8LSBhbGxfcGFpcndpc2UodF92aXNpdF9lb3Npbm9waGlscywgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBtb2RlbF9iYXRjaCA9ICJzdmFzZXEiLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X3Zpc2l0X2Vvc2lub3BoaWxfZGUKdF92aXNpdF9lb3Npbm9waGlsX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfdmlzaXRfZW9zaW5vcGhpbF9kZSwga2VlcGVycyA9IHZpc2l0X2NvbnRyYXN0cywKICBleGNlbCA9IGdsdWUoInt4bHN4X3ByZWZpeH0vREVfVmlzaXRzL0Vvc2lub3BoaWxzL3RfZW9zaW5vcGhpbF92aXNpdF90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF92aXNpdF9lb3Npbm9waGlsX3RhYmxlCnRfdmlzaXRfZW9zaW5vcGhpbF9zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X3Zpc2l0X2Vvc2lub3BoaWxfdGFibGUsCiAgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX1Zpc2l0cy9Fb3Npbm9waGlscy90X2Vvc2lub3BoaWxfdmlzaXRfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQojIyBObyBzaWduaWZpY2FudCBnZW5lcyBvYnNlcnZlZC4KYGBgCgojIEV4cGxvcmUgUk9DCgpBbGVqYW5kcm8gc2hvd2VkIHNvbWUgUk9DIGN1cnZlcyBmb3IgZW9zaW5vcGhpbCBkYXRhIHNob3dpbmcKc2Vuc2l0aXZpdHkgdnMuIHNwZWNpZmljaXR5IG9mIGEgY291cGxlIGdlbmVzIHdoaWNoIHdlcmUgb2JzZXJ2ZWQgaW4KdjEgZW9zaW5vcGhpbHMgdnMuIGFsbC10aW1lcyBlb3Npbm9waGlscyBhY3Jvc3MgY3VyZS9mYWlsLiAgSSBhbQpjdXJpb3VzIHRvIGJldHRlciB1bmRlcnN0YW5kIGhvdyB0aGlzIHdhcyBkb25lIGFuZCB3aGF0IHV0aWxpdHkgaXQKbWlnaHQgaGF2ZSBpbiBvdGhlciBjb250ZXh0cy4KClRvIHRoYXQgZW5kLCBJIHdhbnQgdG8gdHJ5IHNvbWV0aGluZyBzaW1pbGFyIG15c2VsZi4gSW4gb3JkZXIgdG8KcHJvcGVybHkgcGVyZm9ybSB0aGUgYW5hbHlzaXMgd2l0aCB0aGVzZSB2YXJpb3VzIHRvb2xzLCBJIG5lZWQgdG8KcmVjb25maWd1cmUgdGhlIGRhdGEgaW4gYSBwcmV0dHkgc3BlY2lmaWMgZm9ybWF0OgoKMS4gIFNpbmdsZSBkZiB3aXRoIDEgcm93IHBlciBzZXQgb2Ygb2JzZXJ2YXRpb25zIChzYW1wbGUgaW4gdGhpcyBjYXNlCkkgdGhpbmspCjIuICBUaGUgb3V0Y29tZSBjb2x1bW4ocykgbmVlZCB0byBiZSAxIChvciBtb3JlPykgbWV0YWRhdGEgZmFjdG9yKHMpCihjdXJlL2ZhaWwgb3IgYSBwYXN0ZTAgb2YgcmVsZXZhbnQgcXVlcmllcyAoZW9fdjFfY3VyZSwKZW9fdjEyM19jdXJlLCBldGMpCjMuICBUaGUgcHJlZGljdG9yIGNvbHVtbihzKSBhcmUgdGhlIG1lYXN1cmVtZW50cyAocnBrbSBvZiAxIG9yIG1vcmUKZ2VuZXMpLCAxIGNvbHVtbiBlYWNoIGdlbmUuCgpJZiBJIGludGVuZCB0byB1c2UgdGhpcyBmb3Igb3VyIHR4IGRhdGEsIEkgd2lsbCBsaWtlbHkgbmVlZCBhIHV0aWxpdHkKZnVuY3Rpb24gdG8gY3JlYXRlIHRoZSBwcm9wZXJseSBmb3JtYXR0ZWQgaW5wdXQgZGYuCgpGb3IgdGhlIHB1cnBvc2VzIG9mIG15IHBsYXlpbmcsIEkgd2lsbCBjaG9vc2UgdGhyZWUgZ2VuZXMgZnJvbSB0aGUKZW9zaW5vcGhpbCBDL0YgdGFibGUsIG9uZSB3aGljaCBpcyBzaWduaWZpY2FudCwgb25lIHdoaWNoIGlzIG5vdCwgYW5kCmFuIGFyYml0cmFyeS4KClRoZSBpbnB1dCBnZW5lcyB3aWxsIHRoZXJlZm9yZSBiZSBjaG9zZW4gZnJvbSB0aGUgZGF0YSBzdHJ1Y3R1cmU6CnRfY2ZfZW9zaW5vcGhpbF90YWJsZV9zdmE6CgpFTlNHMDAwMDAxOTgxNzgsIEVOU0cwMDAwMDE3OTM0NCwgRU5TRzAwMDAwMTgyNjI4CgpgYGB7cn0KZW9fcnBrbSA8LSBub3JtYWxpemVfZXhwdCh0djFfZW9zaW5vcGhpbHMsIGNvbnZlcnQgPSAicnBrbSIsIGNvbHVtbiA9ICJjZHNfbGVuZ3RoIikKYGBgCgojIEFuIGV4dGVybmFsIGRhdGFzZXQKClRoaXMgcGFwZXIgaXMgRE9JOjEwLjExMjYvc2NpdHJhbnNsbWVkLmFheDQyMDQKClZhcmlhYmxlIGdlbmUgZXhwcmVzc2lvbiBhbmQgcGFyYXNpdGUgbG9hZCBwcmVkaWN0IHRyZWF0bWVudCBvdXRjb21lIGluIGN1dGFuZW91cyBsZWlzaG1hbmlhc2lzLgoKT25lIHF1ZXJ5IGZyb20gTWFyaWEgQWRlbGFpZGEgaXMgdG8gc2VlIGhvdyB0aGlzIGRhdGEgZml0cyB3aXRoIG91cnMuCkkgaGF2ZSByZWFkIHRoaXMgcGFwZXIgYSBjb3VwbGUgb2YgdGltZXMgbm93IGFuZCBJIGdldCBjb25mdXNlZCBvbiBhCmNvdXBsZSBvZiBwb2ludHMgZXZlcnkgdGltZSwgd2hpY2ggSSB3aWxsIGV4cGxhaW4gaW4gYSBtb21lbnQuICBUaGUKZXhwZXJtZW50YWwgZGVzaWduIGlzIGtleSB0byBteSBjb25mdXNpb24gYW5kIGtleSB0byB3aGF0IEkgdGhpbmsgaXMKYmVpbmcgbWlzc2VkIGluIG91ciBpbnRlcnByZXRhdGlvbiBvZiB0aGUgcmVzdWx0czoKCjEuICBUaGUgUENBIGlzIG5vdCBjdXJlIHZzLiBmYWlsIGJ1dCBoZWFsdGh5IHNraW4gdnMuIENMIGxlc2lvbi4KCiMjIE9ubHkgdGhlIFNjb3R0IGRhdGEKCmBgYHtyfQpleHRlcm5hbF9ub3JtIDwtIG5vcm1hbGl6ZV9leHB0KGV4dGVybmFsX2NmLCBmaWx0ZXIgPSBUUlVFLCBub3JtID0gInF1YW50IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb252ZXJ0ID0gImNwbSIsIHRyYW5zZm9ybSA9ICJsb2cyIikKcGxvdF9wY2EoZXh0ZXJuYWxfbm9ybSkKZXh0ZXJuYWxfbmIgPC0gbm9ybWFsaXplX2V4cHQoZXh0ZXJuYWxfY2YsIGZpbHRlciA9IFRSVUUsIGJhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY29udmVydCA9ICJjcG0iLCB0cmFuc2Zvcm0gPSAibG9nMiIpCnBsb3RfcGNhKGV4dGVybmFsX25iKQoKZXh0ZXJuYWxfZGUgPC0gYWxsX3BhaXJ3aXNlKGV4dGVybmFsX2NmLCBmaWx0ZXIgPSBUUlVFLCBtZXRob2RzID0gbWV0aG9kcywKICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIpCmV4dGVybmFsX2RlCmV4dGVybmFsX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKGV4dGVybmFsX2RlLCBleGNlbCA9ICJleGNlbC9zY290dF90YWJsZS54bHN4IikKZXh0ZXJuYWxfdGFibGUKZXh0ZXJuYWxfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXMoZXh0ZXJuYWxfdGFibGUsIGV4Y2VsID0gImV4Y2VsL3Njb3R0X3NpZy54bHN4IikKZXh0ZXJuYWxfc2lnCgpleHRlcm5hbF90b3AxMDAgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcyhleHRlcm5hbF90YWJsZSwgbiA9IDEwMCkKZXh0ZXJuYWxfdXAgPC0gZXh0ZXJuYWxfdG9wMTAwW1siZGVzZXEiXV1bWyJ1cHMiXV1bWyJmYWlsdXJlX3ZzX2N1cmUiXV0KZXh0ZXJuYWxfZG93biA8LSBleHRlcm5hbF90b3AxMDBbWyJkZXNlcSJdXVtbImRvd25zIl1dW1siZmFpbHVyZV92c19jdXJlIl1dCmBgYAoKIyBBbiBleHBsaWNpdCBjb21wYXJpc29uIG9mIG1ldGhvZHMuCgpJIHRoaW5rIEkgYW0gZ2V0dGluZyBhIHNpZ25pZmljYW50bHkgZGlmZmVyZW50IHJlc3VsdCBmcm9tIFNjb3R0LCBzbyBJCmFtIGdvaW5nIHRvIGRvIGFuIGV4cGxpY2l0IHNpZGUtYnktc2lkZSBjb21wYXJpc29uIG9mIG91ciByZXN1bHRzIGF0CmVhY2ggc3RlcC4gIEluIG9yZGVyIHRvIGRvIHRoaXMsIEkgYW0gdXNpbmcgdGhlIGNhcHN1bGUgdGhleSBraW5kbHkKcHJvdmlkZWQgd2l0aCB0aGVpciBwdWJsaWNhdGlvbi4KCkkgYW0gY29weS9wYXN0aW5nIG1hdGVyaWFsIGZyb20gdGhlaXIgcHVibGljYXRpb24gd2l0aCBzb21lCm1vZGlmaWNhdGlvbiB3aGljaCBJIHdpbGwgbm90ZSBhcyBJIGdvLgoKSGVyZSBpcyB0aGVpciBibG9jayAnciBwYWNrYWdlcycKCipOb3RlL1Nwb2lsZXIgYWxlcnQqOiBJdCBhY3R1YWxseSB0dXJucyBvdXQgb3VyIHJlc3VsdHMgYXJlIGJhc2ljYWxseQpyZWxhdGl2ZWx5IHNpbWlsYXIsIEkganVzdCBkaWRuJ3QgdW5kZXJzdGFuZCB3aGF0IGNvbXBhcmlzb25zIGFyZQphY3R1YWxseSBpbiBwYXBlciB2cyB0aG9zZSBJIGhhdmUgcHJpbWFyeSBpbnRlcmVzdC4gIEluIGFkZGl0aW9uLCB3ZQpoYW5kbGVkIGdlbmUgSURzIGRpZmZlcmVudGx5IChnZW5lIGNhcmQgdnMuIEVuc2VtYmxJRCkgd2hpY2ggaGFzIGEKc3VycHJpc2luZ2x5IGJpZyBlZmZlY3QuCgpPaCwgSSBqdXN0IHJlYWxpemVkIHRoYXQgd2hlbiBJIGRpZCB0aGVzZSBhbmFseXNlcywgSSBkaWQgdGhlbSBpbiBhCmNvbXBsZXRlbHkgc2VwYXJhdGUgdHJlZSBhbmQgY29tcGFyZWQgdGhlIHJlc3VsdHMgcG9zdC1mYWN0by4gIFRoaXMKYXNzdW1wdGlvbiByZW1haW5zIGluIHRoaXMgZG9jdW1lbnQgYW5kIHRoZXJlZm9yZSBpcyB1bmxpa2VseSB0byB3b3JrCnByb3Blcmx5IGluIHRoZSBjb250YWluZXJpemVkIGVudmlyb25tZW50IEkgYW0gYXR0ZW1wdGluZyB0byBjcmVhdGUuCkdpdmVuIHRoYXQgdGhlIHByaW1hcnkgZ29hbCBvZiB0aGlzIHNlY3Rpb24gaXMgdG8gc2hvdyB0byBteXNlbGYgdGhhdApJIGNvbXBhcmVkIHRoZSB0d28gZGF0YXNldHMgYXMgdGhvcm91Z2hseSBhcyBJIGNvdWxkLCBwZXJoYXBzIEkgc2hvdWxkCmp1c3QgZGlzYWJsZSB0aGVtIGZvciB0aGUgY29udGFpbmVyIGFuZCBhbGxvdyB0aGUgcmVhZGVyIHRvIHBlcmZvcm0KdGhlIGV4ZXJjaXNlIGRlLW5vdm8uCgpgYGB7ciwgZXZhbD1GQUxTRX0KbGlicmFyeSh0aWR5dmVyc2UpCmxpYnJhcnkoZ2d0aGVtZXMpCmxpYnJhcnkocmVzaGFwZTIpCmxpYnJhcnkoZWRnZVIpCmxpYnJhcnkocGF0Y2h3b3JrKQpsaWJyYXJ5KHZlZ2FuKQpsaWJyYXJ5KERUKQpsaWJyYXJ5KHR4aW1wb3J0KQpsaWJyYXJ5KGdwbG90cykKbGlicmFyeShGaW5DYWwpCmxpYnJhcnkoZ2dyZXBlbCkKbGlicmFyeShndCkKbGlicmFyeShnZ0V4dHJhKQpsaWJyYXJ5KEVuc0RiLkhzYXBpZW5zLnY4NikKbGlicmFyeShzdHJpbmdyKQpsaWJyYXJ5KGNvd3Bsb3QpCmxpYnJhcnkoZ2dwdWJyKQpgYGAKCkkgaGF2ZSBhIHNlcGFyYXRlIHRyZWUgaW4gd2hpY2ggSSBjb3BpZWQgdGhlIGNhcHN1bGUgYW5kIGRhdGEuICBJCnBlcmZvcm1lZCBleGFjdGx5IHRoZWlyIHN0ZXBzIGthbGxpc3RvIHF1YW50IHN0ZXBzIHdpdGhpbiBpdCBhbmQgcHV0CnRoZSBvdXRwdXQgZGF0YSBpbnRvIHRoZSBzYW1lIHBsYWNlIHdpdGhpbiBpdC4gIEkgZGlkIGNoYW5nZSB0aGUKY29tbWFuZHMgc2xpZ2h0bHkgYmVjYXVzZSBJIGRvd25sb2FkZWQgdGhlIGZpbGVzIGZyb20gU1JBIGFuZCBzbyBkb24ndApoYXZlIHRoZW0gd2l0aCBuYW1lcyBsaWtlICdob3N0X0NMMDEnLCBidXQgaW5zdGVhZCAnUFJKTkEuLi4nLiAgQnV0CnRoZSBzYW1wbGVzIGFyZSBpbiB0aGUgc2FtZSBvcmRlciwgc28gSSBzZW50IHRoZSBvdXRwdXQgZmlsZXMgdG8gdGhlCnNhbWUgZmluYWwgZmlsZW5hbWVzLiAgSGVyZSBpcyBhbiBleGFtcGxlIGZyb20gdGhlIGZpcnN0IHNhbXBsZToKCmBgYHtiYXNoIGZpcnN0X3NhbXBsZSwgZXZhbD1GQUxTRX0KY2QgcHJlcHJvY2Vzc2luZwptb2R1bGUgYWRkIGthbGxpc3RvCmthbGxpc3RvIGluZGV4IC1pIEhvbW9fc2FwaWVucy5HUkNoMzguY2RuYS5hbGwuSW5kZXggSG9tb19zYXBpZW5zLkdSQ2gzOC5jZG5hLmFsbC5mYQojIE1hcCByZWFkcyB0byB0aGUgaW5kZXhlZCByZWZlcmVuY2UgdHJhbnNjcmlwdG9tZSBmb3IgSE9TVAojIGZpcnN0IHRoZSBoZWFsdGh5IHN1YmplY3RzIChIUykKZXhwb3J0IExFU1MgPSAnLS1idWZmZXJzIDAgLUInCmthbGxpc3RvIHF1YW50IC1pIEhvbW9fc2FwaWVucy5HUkNoMzguY2RuYS5hbGwuSW5kZXggLW8gaG9zdF9IUzAxIC10IDI0IC1iIDYwIFwKICAgICAgICAgLS1zaW5nbGUgLWwgMjUwIC1zIDMwIDwobGVzcyBTUlI4NjY4NzU1LyotdHJpbW1lZC5mYXN0cS54eikgMj5ob3N0X0hTMDEubG9nIDE+JjIgJgpgYGAKCiMgQmxvY2sgJ3NhbXBsZV9pbmZvJwoKSSBhbSBnb2luZyB0byBjaGFuZ2UgdGhlIHBhdGggdmVyeSBzbGlnaHRseSBpbiB0aGUgZm9sbG93aW5nIGJsb2NrCnNpbXBseSBiZWNhdXNlIEkgcHV0IHRoZSBjYXBzdWxlIGluIGEgc2VwYXJhdGUgZGlyZWN0b3J5IGFuZCBkbyBub3QKd2FudCB0byBjb3B5IGl0IGhlcmUuICBPdGhlcndpc2UgaXQgaXMgdW5tb2RpZmllZC4gIEFsc28sIHRoZSBmdW5jdGlvbgpndDo6dGFiX2hlYWRlcigpIGFubm95cyB0aGUgY3JhcCBvdXQgb2YgbWUuCgpgYGB7ciwgZXZhbD1GQUxTRX0KaW1wb3J0IDwtIHJlYWRfdHN2KCIuLi9zY290dF8yMDE5L2NhcHN1bGUtNjUzNDAxNi9kYXRhL3N0dWR5ZGVzaWduLnR4dCIpCmltcG9ydCAlPiUgZHBseXI6OmZpbHRlcihkaXNlYXNlID09ICJjdXRhbmVvdXMiKSAlPiUKICBkcGx5cjo6c2VsZWN0KC0yKSAlPiUgIGd0KCkgJT4lCiAgdGFiX2hlYWRlcih0aXRsZSA9IG1kKCJDbGluaWNhbCBtZXRhZGF0YSBmcm9tIHBhdGllbnRzIHdpdGggY3V0YW5lb3VzIGxlaXNobWFuaWFzaXMgKENMKSIpLAogICAgICAgICAgICAgc3VidGl0bGUgPSBtZCgiYChuPTIxKWAiKSkgJT4lICBjb2xzX2FsaWduKGFsaWduID0gImNlbnRlciIsIGNvbHVtbnMgPSBUUlVFKQp0YXJnZXRzLmxlc2lvbiA8LSBpbXBvcnQKdGFyZ2V0cy5vbmx5cGF0aWVudHMgPC0gdGFyZ2V0cy5sZXNpb25bODoyOCxdICMgb25seSBDTCBsZXNpb25zIChuPTIxKQoKIyBNYWtpbmcgZmFjdG9ycyB0aGF0IHdpbGwgYmUgdXNlZCBmb3IgcGFpcndpc2UgY29tcGFyaXNvbnM6CiMgSFMgdnMuIENMIGxlc2lvbnMgYXMgYSBmYWN0b3I6CmRpc2Vhc2UubGVzaW9uIDwtIGZhY3Rvcih0YXJnZXRzLmxlc2lvbiRkaXNlYXNlKQojIEN1cmUgdnMuIEZhaWx1cmUgbGVzaW9ucyBhcyBhIGZhY3RvcjoKdHJlYXRtZW50Lmxlc2lvbiA8LSBmYWN0b3IodGFyZ2V0cy5vbmx5cGF0aWVudHMkdHJlYXRtZW50X291dGNvbWUpCmBgYAoKIyBJbXBvcnRpbmcgdGhlIGRhdGEgYW5kIGFubm90YXRpb25zCgpUaGV5IGRpZCB1c2UgYSBzbGlnaHRseSBkaWZmZXJlbnQgYW5ub3RhdGlvbiBzZXQsIEVuc2VtYmwgcmV2aXNpb24gODYuCk9uY2UgYWdhaW4gSSBhbSBtb2RpZnlpbmcgdGhlIHBhdGhzIHNsaWdodGx5IHRvIHJlZmxlY3Qgd2hlcmUgSSBwdXQKdGhlIGNhcHN1bGUuCgpgYGB7ciwgZXZhbD1GQUxTRX0KIyBjYXB0dXJpbmcgRW5zZW1ibCB0cmFuc2NyaXB0IElEcyAodHgpIGFuZCBnZW5lIHN5bWJvbHMgKCJnZW5lX25hbWUiKSBmcm9tCiMgRW5zRGIuSHNhcGllbnMudjg2IGFubm90YXRpb24gcGFja2FnZQpUeCA8LSBhcy5kYXRhLmZyYW1lKHRyYW5zY3JpcHRzKEVuc0RiLkhzYXBpZW5zLnY4NiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb2x1bW5zPWMobGlzdENvbHVtbnMoRW5zRGIuSHNhcGllbnMudjg2LCAidHgiKSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgImdlbmVfbmFtZSIpKSkKClR4IDwtIGRwbHlyOjpyZW5hbWUoVHgsIHRhcmdldF9pZCA9IHR4X2lkKQpyb3cubmFtZXMoVHgpIDwtIE5VTEwKVHggPC0gVHhbLGMoNiwxMildCgojIGdldHRpbmcgZmlsZSBwYXRocyBmb3IgS2FsbGlzdG8gb3V0cHV0cwpwYXRocy5hbGwgPC0gZmlsZS5wYXRoKCIuLi9zY290dF8yMDE5L2NhcHN1bGUtNjUzNDAxNi9kYXRhL3JlYWRNYXBwaW5nL2h1bWFuIiwgdGFyZ2V0cy5sZXNpb24kc2FtcGxlLCAiYWJ1bmRhbmNlLmg1IikKcGF0aHMucGF0aWVudHMgPC0gZmlsZS5wYXRoKCIuLi9zY290dF8yMDE5L2NhcHN1bGUtNjUzNDAxNi9kYXRhL3JlYWRNYXBwaW5nL2h1bWFuIiwgdGFyZ2V0cy5vbmx5cGF0aWVudHMkc2FtcGxlLCAiYWJ1bmRhbmNlLmg1IikKCiMgaW1wb3J0aW5nIC5oNSBLYWxsaXN0byBkYXRhIGFuZCBjb2xsYXBzaW5nIHRyYW5zY3JpcHQtbGV2ZWwgZGF0YSB0byBnZW5lcwpUeGkubGVzaW9uLmNvZGluZyA8LSB0eGltcG9ydChwYXRocy5hbGwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHR5cGUgPSAia2FsbGlzdG8iLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICB0eDJnZW5lID0gVHgsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHR4T3V0ID0gRkFMU0UsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGlnbm9yZVR4VmVyc2lvbiA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNvdW50c0Zyb21BYnVuZGFuY2UgPSAibGVuZ3RoU2NhbGVkVFBNIikKCiMgaW1wb3J0aW5nIGFnYWluZywgYnV0IHRoaXMgdGltZSBqdXN0IHRoZSBDTCBwYXRpZW50cwpUeGkubGVzaW9uLmNvZGluZy5vbmx5cGF0aWVudHMgPC0gdHhpbXBvcnQocGF0aHMucGF0aWVudHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB0eXBlID0gImthbGxpc3RvIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHR4MmdlbmUgPSBUeCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHR4T3V0ID0gRkFMU0UsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBpZ25vcmVUeFZlcnNpb24gPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY291bnRzRnJvbUFidW5kYW5jZSA9ICJsZW5ndGhTY2FsZWRUUE0iKQpgYGAKCiMgRmlsdGVyaW5nIGFuZCBub3JtYWxpemF0aW9uCgpUaGUgYmxvY2sgJ3Zpc3VhbGl6YXRpb25EYXRhc2V0cycgZm9sbG93cyB1bmNoYW5nZWQuICBJbiB0aGUgbmV4dApibG9jayBJIHdpbGwgYWRkIGFub3RoZXIgcGxvdCBvciBwZXJoYXBzIDIKCmBgYHtyLCBldmFsPUZBTFNFfQojIEZpcnN0IG1ha2UgYSBER0VMaXN0IGZyb20gdGhlIGNvdW50czoKVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdCA8LSBER0VMaXN0KFR4aS5sZXNpb24uY29kaW5nJGNvdW50cykKY29sbmFtZXMoVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdCRjb3VudHMpIDwtIHRhcmdldHMubGVzaW9uJHNhbXBsZQpjb2xuYW1lcyhUeGkubGVzaW9uLmNvZGluZyRjb3VudHMpIDwtIHRhcmdldHMubGVzaW9uJHNhbXBsZQoKVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5PUCA8LSBER0VMaXN0KFR4aS5sZXNpb24uY29kaW5nLm9ubHlwYXRpZW50cyRjb3VudHMpCmNvbG5hbWVzKFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuT1ApIDwtIHRhcmdldHMub25seXBhdGllbnRzJHNhbXBsZQoKIyBDb252ZXJ0IHRvIGNvdW50cyBwZXIgbWlsbGlvbjoKVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5jcG0gPC0gZWRnZVI6OmNwbShUeGkubGVzaW9uLmNvZGluZy5ER0VMaXN0LCBsb2cgPSBUUlVFKQpUeGkubGVzaW9uLmNvZGluZy5ER0VMaXN0Lk9QLmNwbSA8LSBlZGdlUjo6Y3BtKFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuT1AsIGxvZyA9IFRSVUUpCgprZWVwZXJzLmNvZGluZyA8LSByb3dTdW1zKFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuY3BtPjEpPj03CmtlZXBlcnMuY29kaW5nLk9QIDwtIHJvd1N1bXMoVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5PUC5jcG0+MSk+PTcKClR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuZmlsdGVyZWQgPC0gVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdFtrZWVwZXJzLmNvZGluZyxdClR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuT1AuZmlsdGVyZWQgPC0gVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5PUFtrZWVwZXJzLmNvZGluZy5PUCxdCgojIGNvbnZlcnQgYmFjayB0byBjcG06ClR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuTG9nQ1BNLmZpbHRlcmVkIDwtIGVkZ2VSOjpjcG0oVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5maWx0ZXJlZCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBsb2c9VFJVRSkKVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5Mb2dDUE0uT1AuZmlsdGVyZWQgPC0gZWRnZVI6OmNwbShUeGkubGVzaW9uLmNvZGluZy5ER0VMaXN0Lk9QLmZpbHRlcmVkLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxvZz1UUlVFKQoKIyBOb3JtYWxpemluZyBkYXRhOgpjYWxjTm9ybTEgPC0gY2FsY05vcm1GYWN0b3JzKFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuZmlsdGVyZWQsIG1ldGhvZCA9ICJUTU0iKQpjYWxjTm9ybTIgPC0gY2FsY05vcm1GYWN0b3JzKFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuT1AuZmlsdGVyZWQsIG1ldGhvZCA9ICJUTU0iKQoKVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5Mb2dDUE0uZmlsdGVyZWQubm9ybSA8LSBlZGdlUjo6Y3BtKGNhbGNOb3JtMSwgbG9nPVRSVUUpCmNvbG5hbWVzKFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuTG9nQ1BNLmZpbHRlcmVkLm5vcm0pIDwtIHRhcmdldHMubGVzaW9uJHNhbXBsZQpUeGkubGVzaW9uLmNvZGluZy5ER0VMaXN0Lk9QLkxvZ0NQTS5maWx0ZXJlZC5ub3JtIDwtIGVkZ2VSOjpjcG0oY2FsY05vcm0yLCBsb2c9VFJVRSkKY29sbmFtZXMoVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5PUC5Mb2dDUE0uZmlsdGVyZWQubm9ybSkgPC0gdGFyZ2V0cy5vbmx5cGF0aWVudHMkc2FtcGxlCiMgUmF3IGRhdGFzZXQ6ClYxIDwtIGFzLmRhdGEuZnJhbWUoVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5jcG0pCmNvbG5hbWVzKFYxKSA8LSB0YXJnZXRzLmxlc2lvbiRzYW1wbGUKVjEgPC0gbWVsdChWMSkKY29sbmFtZXMoVjEpIDwtIGMoInNhbXBsZSIsImV4cHJlc3Npb24iKQoKIyBGaWx0ZXJlZCBkYXRhc2V0OgpWMS4xIDwtIGFzLmRhdGEuZnJhbWUoVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5Mb2dDUE0uZmlsdGVyZWQpCmNvbG5hbWVzKFYxLjEpIDwtIHRhcmdldHMubGVzaW9uJHNhbXBsZQpWMS4xIDwtIG1lbHQoVjEuMSkKY29sbmFtZXMoVjEuMSkgPC0gYygic2FtcGxlIiwiZXhwcmVzc2lvbiIpCgojIEZpbHRlcmVkLW5vcm1hbGl6ZWQgZGF0YXNldDoKVjEuMS4xIDwtIGFzLmRhdGEuZnJhbWUoVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5Mb2dDUE0uZmlsdGVyZWQubm9ybSkKY29sbmFtZXMoVjEuMS4xKSA8LSB0YXJnZXRzLmxlc2lvbiRzYW1wbGUKVjEuMS4xIDwtIG1lbHQoVjEuMS4xKQpjb2xuYW1lcyhWMS4xLjEpIDwtIGMoInNhbXBsZSIsImV4cHJlc3Npb24iKQoKIyBwbG90dGluZzoKZ2dwbG90KFYxLCBhZXMoeD1zYW1wbGUsIHk9ZXhwcmVzc2lvbiwgZmlsbD1zYW1wbGUpKSArCiAgZ2VvbV92aW9saW4odHJpbSA9IFRSVUUsIHNob3cubGVnZW5kID0gVFJVRSkgKwogIHN0YXRfc3VtbWFyeShmdW4ueSA9ICJtZWRpYW4iLCBnZW9tID0gInBvaW50Iiwgc2hhcGUgPSA5NSwgc2l6ZSA9IDEwLCBjb2xvciA9ICJibGFjayIpICsKICB0aGVtZV9idygpICsKICB0aGVtZShsZWdlbmQucG9zaXRpb24gPSAibm9uZSIsIGF4aXMudGl0bGU9ZWxlbWVudF90ZXh0KHNpemU9NyksCiAgICAgICAgYXhpcy50aXRsZS54PWVsZW1lbnRfYmxhbmsoKSwgYXhpcy50ZXh0PWVsZW1lbnRfdGV4dChzaXplPTUpLAogICAgICAgIGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gOTAsIGhqdXN0ID0gMSksCiAgICAgICAgcGxvdC50aXRsZSA9IGVsZW1lbnRfdGV4dChzaXplID0gNykpICsKICBnZ3RpdGxlKCJSYXcgZGF0YXNldCIpICsKICBnZ3Bsb3QoVjEuMSwgYWVzKHg9c2FtcGxlLCB5PWV4cHJlc3Npb24sIGZpbGw9c2FtcGxlKSkgKwogIGdlb21fdmlvbGluKHRyaW0gPSBUUlVFLCBzaG93LmxlZ2VuZCA9IFRSVUUpICsKICBzdGF0X3N1bW1hcnkoZnVuLnkgPSAibWVkaWFuIiwgZ2VvbSA9ICJwb2ludCIsIHNoYXBlID0gOTUsIHNpemUgPSAxMCwgY29sb3IgPSAiYmxhY2siKSArCiAgdGhlbWVfYncoKSArCiAgdGhlbWUobGVnZW5kLnBvc2l0aW9uID0gIm5vbmUiLCBheGlzLnRpdGxlPWVsZW1lbnRfdGV4dChzaXplPTcpLAogICAgICAgIGF4aXMudGl0bGUueD1lbGVtZW50X2JsYW5rKCksIGF4aXMudGV4dD1lbGVtZW50X3RleHQoc2l6ZT01KSwKICAgICAgICBheGlzLnRleHQueCA9IGVsZW1lbnRfdGV4dChhbmdsZSA9IDkwLCBoanVzdCA9IDEpLAogICAgICAgIHBsb3QudGl0bGUgPSBlbGVtZW50X3RleHQoc2l6ZSA9IDcpKSArCiAgZ2d0aXRsZSgiRmlsdGVyZWQgZGF0YXNldCIpICsKICBnZ3Bsb3QoVjEuMS4xLCBhZXMoeD1zYW1wbGUsIHk9ZXhwcmVzc2lvbiwgZmlsbD1zYW1wbGUpKSArCiAgZ2VvbV92aW9saW4odHJpbSA9IFRSVUUsIHNob3cubGVnZW5kID0gVFJVRSkgKwogIHN0YXRfc3VtbWFyeShmdW4ueSA9ICJtZWRpYW4iLCBnZW9tID0gInBvaW50Iiwgc2hhcGUgPSA5NSwgc2l6ZSA9IDEwLCBjb2xvciA9ICJibGFjayIpICsKICB0aGVtZV9idygpICsKICB0aGVtZShsZWdlbmQucG9zaXRpb24gPSAibm9uZSIsIGF4aXMudGl0bGU9ZWxlbWVudF90ZXh0KHNpemU9NyksCiAgICAgICAgYXhpcy50aXRsZS54PWVsZW1lbnRfYmxhbmsoKSwgYXhpcy50ZXh0PWVsZW1lbnRfdGV4dChzaXplPTUpLAogICAgICAgIGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gOTAsIGhqdXN0ID0gMSksCiAgICAgICAgcGxvdC50aXRsZSA9IGVsZW1lbnRfdGV4dChzaXplID0gNykpICsKICBnZ3RpdGxlKCJGaWx0ZXJlZCBhbmQgbm9ybWFsaXplZCBkYXRhc2V0IikKYGBgCgojIFRoZSB1bmZpbHRlcmVkIGRhdGEKClRoZSBmb2xsb3dpbmcgYmxvY2sgaW4gdGhlaXIgZGF0YXNldCByZWNyZWF0ZWQgdGhlIG1hdHJpeCB3aXRob3V0CmZpbHRlcmluZyBhbmQgd2lsbCB1c2UgdGhhdCBmb3IgZGlmZmVyZW50aWFsIGV4cHJlc3Npb24uICBJdCBpcyBhCmxpdHRsZSBoYXJkIHRvIGZvbGxvdyBmb3IgbWUgYmVjYXVzZSB0aGV5IHN1YnNldCBiYXNlZCBvbiB0aGUgc2FtcGxlCm51bWJlcnMgKDggdG8gMjgsIHdoaWNoIGlmIEkgYW0gbm90IG1pc3Rha2VuIGp1c3QgZHJvcHMgdGhlIGhlYWx0aHkKc2FtcGxlcz8pLgoKYGBge3IsIGV2YWw9RkFMU0V9CkRhdGFOb3RGaWx0ZXJlZF9Ob3JtX09QIDwtIGNhbGNOb3JtRmFjdG9ycyhUeGkubGVzaW9uLmNvZGluZy5ER0VMaXN0Wyw4OjI4XSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJUTU0iKQpEYXRhTm90RmlsdGVyZWRfTm9ybV9sb2cyQ1BNX09QIDwtIGVkZ2VSOjpjcG0oRGF0YU5vdEZpbHRlcmVkX05vcm1fT1AsIGxvZz1UUlVFKQpjb2xuYW1lcyhEYXRhTm90RmlsdGVyZWRfTm9ybV9sb2cyQ1BNX09QKSA8LSB0YXJnZXRzLm9ubHlwYXRpZW50cyRzYW1wbGUKQ1BNX25vcm1EYXRhX25vdGZpbHRlcmVkX09QIDwtIDJeKERhdGFOb3RGaWx0ZXJlZF9Ob3JtX2xvZzJDUE1fT1ApCiN1bmNvbW1lbnQgdGhlIG5leHQgbGluZSB0byBwcm9kdWNlIHJhdyBkYXRhIHRoYXQgd2FzIHVwbG9hZGVkIHRvIHRoZSBHZW5lIEV4cHJlc3Npb24gT21uaWJ1cyAoR0VPKSBmb3IgcHVibGljYXRpb24uCiN3cml0ZS50YWJsZShUeGkubGVzaW9uLmNvZGluZyRjb3VudHMsIGZpbGUgPSAiQW1vcmltX0dFT19yYXcudHh0Iiwgc2VwID0gIlx0IiwgcXVvdGUgPSBGQUxTRSkKCiMgSW5jbHVkaW5nIGFsbCB0aGUgaW5kaXZpZHVhbHMgKEhTIGFuZCBDTCBwYXRpZW50cykgZm9yIHB1YmxpYyBkb21haW4gc3VibWlzc2lvbjoKRGF0YU5vdEZpbHRlcmVkX05vcm0gPC0gY2FsY05vcm1GYWN0b3JzKFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QsIG1ldGhvZCA9ICJUTU0iKQpEYXRhTm90RmlsdGVyZWRfTm9ybV9sb2cyQ1BNIDwtIGVkZ2VSOjpjcG0oRGF0YU5vdEZpbHRlcmVkX05vcm0sIGxvZz1UUlVFKQpjb2xuYW1lcyhEYXRhTm90RmlsdGVyZWRfTm9ybV9sb2cyQ1BNKSA8LSB0YXJnZXRzLmxlc2lvbiRzYW1wbGUKQ1BNX25vcm1EYXRhX25vdGZpbHRlcmVkIDwtIDJeKERhdGFOb3RGaWx0ZXJlZF9Ob3JtX2xvZzJDUE0pCiN1bmNvbW1lbnQgdGhlIG5leHQgbGluZSB0byBwcm9kdWNlIHRoZSBub3JtYWxpemVkIGRhdGEgZmlsZSB0aGF0IHdhcyB1cGxvYWRlZCB0byB0aGUgR2VuZSBFeHByZXNzaW9uIE9tbmlidXMgKEdFTykgZm9yIHB1YmxpY2F0aW9uLgojd3JpdGUudGFibGUoRGF0YU5vdEZpbHRlcmVkX05vcm1fbG9nMkNQTSwgIkFtb3JpbV9HRU9fbm9ybWFsaXplZC50eHQiLCBzZXAgPSAiXHQiLCBxdW90ZSA9IEZBTFNFKQpgYGAKCiMgVGhlIHNjb3R0IGV4cGxvcmF0b3J5IGFuYWx5c2lzCgpUaGUgZm9sbG93aW5nIGJsb2NrIGdlbmVyYXRlZCBhIGNvdXBsZSBvZiB0aGUgZmlndXJlcyBpbiB0aGUgcGFwZXIgYW5kCmNvbXByaXNlIGEgcHJldHR5IHN0cmFpZ2h0Zm9yd2FyZCBQQ0EuICBJIGFtIGdvaW5nIHRvIG1ha2UgYSBmb2xsb3dpbmcKYmxvY2sgY29udGFpbmluZyB0aGUgc2FtZSBpbWFnZSB3aXRoIHRoZSBjdXJlL2ZhaWwgdmlzdWFsaXphdGlvbiB1c2luZwp0aGUgc2FtZSBtZXRob2QvZGF0YS4KCmBgYHtyLCBldmFsPUZBTFNFfQpwY2EucmVzIDwtIHByY29tcCh0KFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuTG9nQ1BNLmZpbHRlcmVkLm5vcm0pLCBzY2FsZS49RiwgcmV0eD1UKQpwYy52YXIgPC0gcGNhLnJlcyRzZGV2XjIKcGMucGVyIDwtIHJvdW5kKHBjLnZhci9zdW0ocGMudmFyKSoxMDAsIDEpCmRhdGEuZnJhbWUgPC0gYXMuZGF0YS5mcmFtZShwY2EucmVzJHgpCgojIENhbGN1bGF0ZSBkaXN0YW5jZSBiZXR3ZWVuIHNhbXBsZXMgYnkgcGVybWFub3ZhOgphbGxzYW1wbGVzLmRpc3QgPC0gdmVnZGlzdCh0KDJeVHhpLmxlc2lvbi5jb2RpbmcuREdFTGlzdC5Mb2dDUE0uZmlsdGVyZWQubm9ybSksCiAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZCA9ICJicmF5IikKCnZlZ2FuIDwtIGFkb25pczIoYWxsc2FtcGxlcy5kaXN0fnRhcmdldHMubGVzaW9uJGRpc2Vhc2UsCiAgICAgICAgICAgICAgICAgZGF0YT10YXJnZXRzLmxlc2lvbiwKICAgICAgICAgICAgICAgICBwZXJtdXRhdGlvbnMgPSA5OTksIG1ldGhvZD0iYnJheSIpCgp0YXJnZXRzLmxlc2lvbiRkaXNlYXNlCmdncGxvdChkYXRhLmZyYW1lLCBhZXMoeD1QQzEsIHk9UEMyLCBjb2xvcj1mYWN0b3IodGFyZ2V0cy5sZXNpb24kZGlzZWFzZSkpKSArCiAgZ2VvbV9wb2ludChzaXplPTUsIHNoYXBlPTIwKSArCiAgdGhlbWVfY2FsYygpICsKICB0aGVtZShwYW5lbC5ncmlkLm1ham9yID0gZWxlbWVudF9ibGFuaygpLCBwYW5lbC5ncmlkLm1pbm9yID0gZWxlbWVudF9ibGFuaygpLAogICAgICAgIGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KHNpemUgPSAxNSwgdmp1c3QgPSAwLjUpLAogICAgICAgIGF4aXMudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemUgPSAxNSksIGF4aXMudGl0bGUgPSBlbGVtZW50X3RleHQoc2l6ZSA9IDE1KSwKICAgICAgICBsZWdlbmQucG9zaXRpb249Im5vbmUiKSArCiAgc2NhbGVfY29sb3JfbWFudWFsKHZhbHVlcyA9IGMoIiMwNzNGODAiLCIjRUI1MTJDIikpICsKICBhbm5vdGF0ZSgidGV4dCIsIHg9LTUwLCB5PTgwLCBsYWJlbD1wYXN0ZSgiUGVybWFub3ZhIFByKD5GKSA9IiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICB2ZWdhblsxLDVdKSwgc2l6ZT0zLCBmb250ZmFjZT0iYm9sZCIpICsKICB4bGFiKHBhc3RlKCJQQzEgLSIscGMucGVyWzFdLCIlIikpICsKICB5bGFiKHBhc3RlKCJQQzIgLSIscGMucGVyWzJdLCIlIikpICsKICB4bGltKC0yMDAsMTEwKQpgYGAKCiMjIyBNeSBtb3N0IHNpbWlsYXIgcGNhCgpJIGp1c3QgcmVhbGl6ZWQgdGhhdCBzb21ld2hlcmUgYWxvbmcgdGhlIHdheSBpbiBjcmVhdGluZyB0aGlzCmNvbnRhaW5lciwgSSBtZXNzZWQgdXAgdGhpcyBhbmFseXNpcyBwcmV0dHkgYmFkbHk6CgoxLiAgSSBkcm9wcGVkIHRoZSA3IGNvbnRyb2wgc2FtcGxlcy4KMi4gIEkgYW0gY29tcGFyaW5nIGN1cmUvZmFpbCBidXQgdGhlc2UgYW5hbHlzZXMgYXJlIGFsbAogICAgY29udHJvbC9jdXRhbmVvdXMuCgpXaGVuIEkgb3JpZ2luYWxseSBkaWQgdGhpcyBvbiBteSB3b3Jrc3RhdGlvbiBJIGhhZCBhbiBhY3R1YWwgMToxCmNvbXBhcmlzb24gYW5kIHNhdyB0aGF0IG91ciByZXN1bHRzIHdlcmUgcXVpdGUgc2ltaWxhci4gIEkgbmVlZCB0bwpicmluZyB0aGF0IGJhY2sgaW50byB0aGlzIGluIG9yZGVyIHRvIHNob3cgdGhhdCBuZWl0aGVyIHdlIG5vciB0aGV5CmFyZSBjcmF6eSBwZW9wbGUuCgpFaXRoZXIgd2F5LCBJIHRoaW5rIHRoZSBtYWluIHRha2Vhd2F5IGlzIHRoYXQgdGhlaXIgZGF0YXNldCBkb2VzIG5vdApzcGVuZCBtdWNoIHRpbWUgbG9va2luZyBhdCBjdXJlL2ZhaWwgYnV0IGluc3RlYWQgY29udHJvbC9pbmZlY3RlZCBmb3IKYSByZWFzb24uCgpOb3RlLCB0aGUgZnVuIGFzcGVjdHMgb2YgdGhlIGV4cGVyaW1lbnQgKHRpbWUgdG8gY3VyZSwgc2l6ZSBvZiBsZXNpb24sCmV0YykgYXJlIG5vdCBhbm5vdGF0ZWQgaW4gdGhlIG1ldGFkYXRhIHByb3ZpZGVkIGJ5IFNSQSwgYnV0IGluc3RlYWQKbWF5IGJlIGZvdW5kIGluIHRoZSBjYXBzdWxlIGtpbmRseSBwcm92aWRlZCBieSB0aGUgbGFiLiAgQXMgYSByZXN1bHQsCkkgY29waWVkIHRoYXQgZmlsZSBpbnRvIHRoZSBzYW1wbGVfc2hlZXRzLyBkaXJlY3RvcnkgYW5kIGhhdmUgYWRkZWQgaXQKdG8gdGhlIGV4cHJlc3Npb25zZXQuICBUaGVyZSBpcyBhbiBpbXBvcnRhbnQgY2F2ZWF0LCB0aG91Z2g6IEkgZGlkIG5vdAppbmNsdWRlIHRoZSBub24tZGlzZWFzZWQgc2FtcGxlcyBmb3IgdGhpcyBjb21wYXJpc29uOyBhcyBhIHJlc3VsdCB0aGUKZGlzZWFzZSBtZXRhZGF0YSBmYWN0b3IgaXMgYm9yaW5nIChlLmcuIGl0IGlzIG9ubHkgY3V0YW5lb3VzKS4KCmBgYHtyfQpleHRlcm5hbF9jZltbImFjY2Vzc2lvbiJdXSA8LSBwRGF0YShleHRlcm5hbF9jZilbWyJzYW1wbGUiXV0KZGlzZWFzZV9mYWN0b3IgPC0gcERhdGEoZXh0ZXJuYWxfY2YpW1siZGlzZWFzZSJdXQp0YWJsZShkaXNlYXNlX2ZhY3RvcikKZXh0ZXJuYWxfZGlzZWFzZSA8LSBzZXRfZXhwdF9jb25kaXRpb25zKGV4dGVybmFsX2NmLCBmYWN0ID0gZGlzZWFzZV9mYWN0b3IpCgpleHRlcm5hbF9sMmNwbSA8LSBub3JtYWxpemVfZXhwdChleHRlcm5hbF9jZiwgZmlsdGVyID0gVFJVRSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb252ZXJ0ID0gImNwbSIsIHRyYW5zZm9ybSA9ICJsb2cyIikKcGxvdF9wY2EoZXh0ZXJuYWxfbDJjcG0sIHBsb3RfbGFiZWxzID0gInJlcGVsIikKYGBgCgpVc2UgdGhlIGZvbGxvd2luZyBibG9jayBpZiB5b3Ugd2lzaCB0byBicmluZyB0b2dldGhlciBTUkEtZG93bmxvYWRlZApkYXRhIHdpdGggdGhlIGV4cGVyaW1lbnRhbCBkZXNpZ24gZnJvbSB0aGUgU2NvdHQgcGFwZXIuICBJdCByZXF1aXJlcwpydW5uaW5nIHRoZSBibG9ja3MgYWJvdmUgaW4gd2hpY2ggSSBsb2FkZWQgdGhlIGNhcHN1bGUtZGVyaXZlZAptZXRhZGF0YS4KCmBgYHtyLCBldmFsPUZBTFNFfQp0ZXN0IDwtIHBEYXRhKGV4dGVybmFsX2NmKQp0ZXN0X2ltcG9ydCA8LSBhcy5kYXRhLmZyYW1lKGltcG9ydCkKdGVzdF9pbXBvcnRbWyJhY2Nlc3Npb24iXV0gPC0gcERhdGEoZXh0ZXJuYWxfY2ZbWyJhY2Nlc3Npb24iXV0pCnRlc3RfbWVyZ2VkIDwtIG1lcmdlKHRlc3QsIGltcG9ydCwgYnkgPSAiYWNjZXNzaW9uIikKYGBgCgpUaGlzIGlzIHJlYWwgY29tcGFyaXNvbiBwb2ludCB0byB0aGVpciBjdXJlL2ZhaWwgYW5hbHlzaXMuCgojIyBDdXJlL0ZhaWwgUENBIHVzaW5nIHRoZSBzYW1lIHByY29tcCByZXN1bHQKCkkgYW0ganVzdCBjb3B5L3Bhc3RpbmcgdGhlaXIgY29kZSBhZ2FpbiwgYnV0IGNoYW5naW5nIHRoZSBjb2xvciBmYWN0b3IKc28gdGhhdCBjdXJlIGlzIHB1cnBsZSwgZmFpbHVyZSBpcyByZWQsIGFuZCBuYSh1bmluZmVjdGVkKSBpcyBibGFjay4KClRoZSBmb2xsb3dpbmcgcGxvdCBzaG91bGQgYmUgdGhlIGZpcnN0IGRpcmVjdCBjb21wYXJpc29uIHBvaW50IGJldHdlZW4KdGhlIHR3byBhbmFseXNpcyBwaXBlbGluZXMuICBUaHVzLCBpZiB5b3UgbG9vayBiYWNrIGEgZmV3IGJsb2NrIGF0IG15Cmludm9jYXRpb24gb2YgcGxvdF9wY2EoZXh0ZXJuYWxfbm9ybSksIHlvdSB3aWxsIHNlZSBhIGdyZWVuL29yYW5nZQpwbG90IHdoaWNoIGlzIGZ1bmN0aW9uYWxseSBpZGVudGljYWwgaWYgeW91IG5vdGU6CgoxLiAgVGhlIHggYW5kIHkgYXhlcyBhcmUgZmxpcHBlZCwgd2hpY2ggb2sgd2hhdGV2ZXIgaXQgaXMgUENBLgoyLiAgSSBleGNsdWRlZCB0aGUgaGVhbHRoeSBzYW1wbGVzLgozLiAgSSBkcm9wcGVkIHRvIGdlbmUgbGV2ZWwgYW5kIHVzZWQgaGlzYXQuCgpXaXRoIHRob3NlIGNhdmVhdHMgaW4gbWluZCwgaXQgaXMgdHJpdmlhbCB0byBmaW5kIHRoZSBzYW1lCnJlbGF0aW9uc2hpcGVzIGluIHRoZSBzYW1wbGVzLiAgRS5nLiB0aGUgYm90dG9tIHJlZC9wdXJwbGUgaW5kaXZpZHVhbApzYW1wbGVzIGFyZSBpbiB0aGUgc2FtZSByZWxhdGl2ZSBwb3NpdGlvbiBhcyBteSB0b3Agb3JhbmdlL2dyZWVuIHBhaXIuCnRoZSBzYW1lIDQgc2FtcGxlcyBhcmUgcmVsYXRpdmUgeC1heGlzIG91dGxpZXJzIChteSByaWdodCBncmVlbiwgdGhlaXIKbGVmdCBwdXJwbGUpLiAgVGhlIGxhc3QgNiBzYW1wbGVzIChteSBvcmFuZ2UsIHRoZWlyIHJlZCkgYXJlIGFsbCBpbgp0aGUgcmVsYXRpdmUgb3JpZW50YXRpb24uCgpJIHRoaW5rIEkgY2FuIGZ1cnRoZXIgcHJvdmUgdGhlIHNpbWlsYXJpdHkgb2Ygb3VyIGlucHV0cyB2aWEgYSBkaXJlY3QKY29tcGFyaXNvbiBvZiB0aGUgZGF0YXN0cnVjdHVyZXM6ClR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuTG9nQ1BNLmZpbHRlcmVkLm5vcm0gKHVnaCB3aGF0IGEgbmFtZSkKdnMuIGV4dGVybmFsX2NmLiAgSW4gb3JkZXIgdG8gbWFrZSB0aGF0IGNvbXBhcmlzb24sIEkgbmVlZCB0byByZW5hbWUKbXkgcm93cyB0byB0aGUgZ2VuZWNhcmQgSURzIGFuZCB0aGUgY29sdW1ucy4KCmBgYHtyLCBldmFsPUZBTFNFfQp0aGVpcl9ub3JtX2V4cHJzIDwtIFR4aS5sZXNpb24uY29kaW5nLkRHRUxpc3QuTG9nQ1BNLmZpbHRlcmVkLm5vcm0KCm15X2hnbmNfaWRzIDwtIG1ha2UubmFtZXMoZkRhdGEoZXh0ZXJuYWxfY2YpW1siaGduY19zeW1ib2wiXV0sIHVuaXF1ZSA9IFRSVUUpCm15X3JlbmFtZWQgPC0gc2V0X2V4cHRfZ2VuZW5hbWVzKGV4dGVybmFsX2NmLCBpZHMgPSBteV9oZ25jX2lkcykKbXlfbm9ybSA8LSBub3JtYWxpemVfZXhwdChteV9yZW5hbWVkLCBmaWx0ZXIgPSBUUlVFLCB0cmFuc2Zvcm0gPSAibG9nMiIsIGNvbnZlcnQgPSAiY3BtIikKbXlfbm9ybV9leHBycyA8LSBhcy5kYXRhLmZyYW1lKGV4cHJzKG15X25vcm0pKQoKb3VyX2V4cHJzIDwtIG1lcmdlKHRoZWlyX25vcm1fZXhwcnMsIG15X25vcm1fZXhwcnMsIGJ5ID0gInJvdy5uYW1lcyIpCnJvd25hbWVzKG91cl9leHBycykgPC0gb3VyX2V4cHJzW1siUm93Lm5hbWVzIl1dCm91cl9leHByc1tbIlJvdy5uYW1lcyJdXSA8LSBOVUxMCmRpbShvdXJfZXhwcnMpCgojIyBJIGZ1bGx5IGV4cGVjdGVkIGEgY29ycmVsYXRpb24gaGVhdG1hcCBvZiB0aGUgY29tYmluZWQKIyMgZGF0YSB0byBzaG93IGEgc2V0IG9mIHBhaXJlZCBzYW1wbGVzIGFjcm9zcyB0aGUgYm9hcmQuCiMjIFRoYXQgaXMgYWJzb2x1dGVseSBub3QgdHJ1ZS4KY29ycmVsYXRpb25zIDwtIHBsb3RfY29yaGVhdChvdXJfZXhwcnMpCmNvcnJlbGF0aW9uc1tbInNjYXR0ZXIiXV0KY29ycmVsYXRpb25zW1sicGxvdCJdXQpgYGAKCmBgYHtyLCBldmFsPUZBTFNFfQpjb2xvcl9mYWN0IDwtIGZhY3Rvcih0YXJnZXRzLmxlc2lvbiR0cmVhdG1lbnRfb3V0Y29tZSkKbGV2ZWxzKGNvbG9yX2ZhY3QpCiMjIEFkZGVkIGJ5IGF0YiB0byBzZWUgY3VyZS9mYWlsIG9uIHRoZSBzYW1lIGRhdGFzZXQKZ2dwbG90KGRhdGEuZnJhbWUsIGFlcyh4PVBDMSwgeT1QQzIsIGNvbG9yPWNvbG9yX2ZhY3QpKSArCiAgZ2VvbV9wb2ludChzaXplPTUsIHNoYXBlPTIwKSArCiAgdGhlbWVfY2FsYygpICsKICB0aGVtZShwYW5lbC5ncmlkLm1ham9yID0gZWxlbWVudF9ibGFuaygpLCBwYW5lbC5ncmlkLm1pbm9yID0gZWxlbWVudF9ibGFuaygpLAogICAgICAgIGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KHNpemUgPSAxNSwgdmp1c3QgPSAwLjUpLAogICAgICAgIGF4aXMudGV4dC55ID0gZWxlbWVudF90ZXh0KHNpemUgPSAxNSksIGF4aXMudGl0bGUgPSBlbGVtZW50X3RleHQoc2l6ZSA9IDE1KSwKICAgICAgICBsZWdlbmQucG9zaXRpb249Im5vbmUiKSArCiAgc2NhbGVfY29sb3JfbWFudWFsKHZhbHVlcyA9IGMoInB1cnBsZSIsICJyZWQiLCJibGFjayIpKSArCiAgYW5ub3RhdGUoInRleHQiLCB4PS01MCwgeT04MCwgbGFiZWw9cGFzdGUoIlBlcm1hbm92YSBQcig+RikgPSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgdmVnYW5bMSw1XSksIHNpemU9MywgZm9udGZhY2U9ImJvbGQiKSArCiAgeGxhYihwYXN0ZSgiUEMxIC0iLHBjLnBlclsxXSwiJSIpKSArCiAgeWxhYihwYXN0ZSgiUEMyIC0iLHBjLnBlclsyXSwiJSIpKSArCiAgeGxpbSgtMjAwLDExMCkKYGBgCgojIERFIGNvbXBhcmlzb25zCgpUaGUgZm9sbG93aW5nIGlzIHRoZWlyIGNvbXBhcmlzb24gb2YgaGVhbHRoeSB0aXNzdWUgdnMuICBDTCBsZXNpb24gYW5kCkZhaWx1cmUgdnMuIEN1cmUuICBJIGFtIGdvaW5nIHRvIGZvbGxvdyBpdCB3aXRoIG15IGFuYWxhZ291cwpleGFtaW5hdGlvbiB1c2luZyBsaW1tYS4gIE5vdGUsIGVhY2ggb2YgdGhlIHBhaXJzIG9mIHZhcmlhYmxlcyBjcmVhdGVkCmluIHRoZSBmb2xsb3dpbmcgYmxvY2sgaXMgeHh4IGZvbGxvd2VkIGJ5IHh4eC50cmVhdDsgdGhlIGZvcm1lciBpcwpoZWFsdGh5IHZzIGxlc2lvbiBhbmQgdGhlIGxhdHRlciBpcyB0aGUgZmFpbCB2cyBjdXJlIHNldC4KCmBgYHtyLCBldmFsPUZBTFNFfQojIE1vZGVsIG1hdHJpY2VzOgojIENMIGxlc2lvbnMgdnMuIEhTOgpkZXNpZ24ubGVzaW9uIDwtIG1vZGVsLm1hdHJpeCh+MCArIGRpc2Vhc2UubGVzaW9uKQpjb2xuYW1lcyhkZXNpZ24ubGVzaW9uKSA8LSBsZXZlbHMoZGlzZWFzZS5sZXNpb24pCgojIEZhaWx1cmUgdnMuIEN1cmU6CmRlc2lnbi5sZXNpb24udHJlYXRtZW50IDwtIG1vZGVsLm1hdHJpeCh+MCArIHRyZWF0bWVudC5sZXNpb24pCmNvbG5hbWVzKGRlc2lnbi5sZXNpb24udHJlYXRtZW50KSA8LSBsZXZlbHModHJlYXRtZW50Lmxlc2lvbikKCm15REdFTGlzdC5sZXNpb24uY29kaW5nIDwtIERHRUxpc3QoY2FsY05vcm0xJGNvdW50cykKbXlER0VMaXN0Lk9QLk5vdEZpbCA8LSBER0VMaXN0KENQTV9ub3JtRGF0YV9ub3RmaWx0ZXJlZF9PUCkKCiMgTW9kZWwgbWVhbi12YXJpYW5jZSB0cmVuZCBhbmQgZml0IGxpbmVhciBtb2RlbCB0byBkYXRhLgojIFVzZSBWT09NIGZ1bmN0aW9uIGZyb20gTGltbWEgcGFja2FnZSB0byBtb2RlbCB0aGUgbWVhbi12YXJpYW5jZSByZWxhdGlvbnNoaXAKbm9ybURhdGEubGVzaW9uLmNvZGluZyA8LSB2b29tKG15REdFTGlzdC5sZXNpb24uY29kaW5nLCBkZXNpZ24ubGVzaW9uKQpub3JtRGF0YS5PUC5Ob3RGaWwgPC0gdm9vbShteURHRUxpc3QuT1AuTm90RmlsLCBkZXNpZ24ubGVzaW9uLnRyZWF0bWVudCkKCmNvbG5hbWVzKG5vcm1EYXRhLmxlc2lvbi5jb2RpbmcpIDwtIHRhcmdldHMubGVzaW9uJHNhbXBsZQpjb2xuYW1lcyhub3JtRGF0YS5PUC5Ob3RGaWwpIDwtIHRhcmdldHMub25seXBhdGllbnRzJHNhbXBsZQoKIyBmaXQgYSBsaW5lYXIgbW9kZWwgdG8geW91ciBkYXRhCmZpdC5sZXNpb24uY29kaW5nIDwtIGxtRml0KG5vcm1EYXRhLmxlc2lvbi5jb2RpbmcsIGRlc2lnbi5sZXNpb24pCmZpdC5sZXNpb24uY29kaW5nLnRyZWF0bWVudCA8LSBsbUZpdChub3JtRGF0YS5PUC5Ob3RGaWwsIGRlc2lnbi5sZXNpb24udHJlYXRtZW50KQoKIyBjb250cmFzdCBtYXRyaXgKY29udHJhc3QubWF0cml4Lmxlc2lvbiA8LSBtYWtlQ29udHJhc3RzKENMLnZzLkNPTiA9IGN1dGFuZW91cyAtIGNvbnRyb2wsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBsZXZlbHM9ZGVzaWduLmxlc2lvbikKY29udHJhc3QubWF0cml4Lmxlc2lvbi50cmVhdCA8LSBtYWtlQ29udHJhc3RzKGZhaWx1cmUudnMuY3VyZSA9IGZhaWx1cmUgLSBjdXJlLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGV2ZWxzPWRlc2lnbi5sZXNpb24udHJlYXRtZW50KQoKIyBleHRyYWN0IHRoZSBsaW5lYXIgbW9kZWwgZml0CmZpdHMubGVzaW9uLmNvZGluZyA8LSBjb250cmFzdHMuZml0KGZpdC5sZXNpb24uY29kaW5nLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjb250cmFzdC5tYXRyaXgubGVzaW9uKQpmaXRzLmxlc2lvbi5jb2RpbmcudHJlYXQgPC0gY29udHJhc3RzLmZpdChmaXQubGVzaW9uLmNvZGluZy50cmVhdG1lbnQsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNvbnRyYXN0Lm1hdHJpeC5sZXNpb24udHJlYXQpCgojIGdldCBiYXllc2lhbiBzdGF0cyBmb3IgeW91ciBsaW5lYXIgbW9kZWwgZml0CmViRml0Lmxlc2lvbi5jb2RpbmcgPC0gZUJheWVzKGZpdHMubGVzaW9uLmNvZGluZykKZWJGaXQubGVzaW9uLmNvZGluZy50cmVhdCA8LSBlQmF5ZXMoZml0cy5sZXNpb24uY29kaW5nLnRyZWF0KQoKIyBUb3BUYWJsZSAtLS0tCmFsbEhpdHMubGVzaW9uLmNvZGluZyA8LSB0b3BUYWJsZShlYkZpdC5sZXNpb24uY29kaW5nLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgYWRqdXN0ID0iQkgiLCBjb2VmPTEsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBudW1iZXI9MzQ5MzUsIHNvcnQuYnk9ImxvZ0ZDIikKYWxsSGl0cy5sZXNpb24uY29kaW5nLnRyZWF0IDwtIHRvcFRhYmxlKGViRml0Lmxlc2lvbi5jb2RpbmcudHJlYXQsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBhZGp1c3QgPSJCSCIsIGNvZWY9MSwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG51bWJlcj0zNDc3Niwgc29ydC5ieT0ibG9nRkMiKQpteVRvcEhpdHMgPC0gcm93bmFtZXNfdG9fY29sdW1uKGFsbEhpdHMubGVzaW9uLmNvZGluZywgImdlbmVJRCIpCm15VG9wSGl0cy50cmVhdCA8LSByb3duYW1lc190b19jb2x1bW4oYWxsSGl0cy5sZXNpb24uY29kaW5nLnRyZWF0LCAiZ2VuZUlEIikKCiMgbXV0YXRlIHRoZSBmb3JtYXQgb2YgbnVtZXJpYyB2YWx1ZXM6Cm15VG9wSGl0cyA8LSBtdXRhdGUobXlUb3BIaXRzLCBsb2cxMFB2YWwgPSByb3VuZCgtbG9nMTAoYWRqLlAuVmFsKSwyKSwKICAgICAgICAgICAgICAgICAgICBhZGouUC5WYWwgPSByb3VuZChhZGouUC5WYWwsIDIpLAogICAgICAgICAgICAgICAgICAgIEIgPSByb3VuZChCLCAyKSwKICAgICAgICAgICAgICAgICAgICBBdmVFeHByID0gcm91bmQoQXZlRXhwciwgMiksCiAgICAgICAgICAgICAgICAgICAgdCA9IHJvdW5kKHQsIDIpLAogICAgICAgICAgICAgICAgICAgIGxvZ0ZDID0gcm91bmQobG9nRkMsIDIpLAogICAgICAgICAgICAgICAgICAgIGdlbmVJRCA9IGdlbmVJRCkKCm15VG9wSGl0cy50cmVhdCA8LSBtdXRhdGUobXlUb3BIaXRzLnRyZWF0LCBsb2cxMFB2YWwgPSByb3VuZCgtbG9nMTAoYWRqLlAuVmFsKSwyKSwKICAgICAgICAgICAgICAgICAgICAgICAgICBhZGouUC5WYWwgPSByb3VuZChhZGouUC5WYWwsIDIpLAogICAgICAgICAgICAgICAgICAgICAgICAgIEIgPSByb3VuZChCLCAyKSwKICAgICAgICAgICAgICAgICAgICAgICAgICBBdmVFeHByID0gcm91bmQoQXZlRXhwciwgMiksCiAgICAgICAgICAgICAgICAgICAgICAgICAgdCA9IHJvdW5kKHQsIDIpLAogICAgICAgICAgICAgICAgICAgICAgICAgIGxvZ0ZDID0gcm91bmQobG9nRkMsIDIpLAogICAgICAgICAgICAgICAgICAgICAgICAgIGdlbmVJRCA9IGdlbmVJRCkKI3NhdmUobXlUb3BIaXRzLCBmaWxlID0gIm15VG9wSGl0cyIpCiNzYXZlKG15VG9wSGl0cy50cmVhdCwgZmlsZSA9ICJteVRvcEhpdHMudHJlYXQiKQpgYGAKCiMgUGVyZm9ybSBteSBhbmFsYWdvdXMgbGltbWEgYW5hbHlzaXMKCmBgYHtyIGNvbXBhcmVfcmVzdWx0LCBldmFsPUZBTFNFfQpteV9maWx0IDwtIG5vcm1hbGl6ZV9leHB0KG15X3JlbmFtZWQsIGZpbHRlciA9ICJzaW1wbGUiKQpsaW1tYV9jZiA8LSBsaW1tYV9wYWlyd2lzZShteV9maWx0LCBtb2RlbF9iYXRjaCA9IEZBTFNFKQoKbXlfdGFibGUgPC0gbGltbWFfY2ZbWyJhbGxfdGFibGVzIl1dW1siZmFpbHVyZV92c19jdXJlIl1dCnRoZWlyX3RhYmxlIDwtIG15VG9wSGl0cy50cmVhdAoKZGltKG15X3RhYmxlKQpkaW0obXlUb3BIaXRzLnRyZWF0KQpvdXJfdGFibGUgPC0gbWVyZ2UobXlfdGFibGUsIG15VG9wSGl0cy50cmVhdCwgYnkueCA9ICJyb3cubmFtZXMiLCBieS55ID0gImdlbmVJRCIpCmRpbShvdXJfdGFibGUpCmNvbXBhcmlzb24gPC0gcGxvdF9saW5lYXJfc2NhdHRlcihvdXJfdGFibGVbLCBjKCJsb2dGQy54IiwgImxvZ0ZDLnkiKV0pCmNvbXBhcmlzb24kc2NhdHRlcgpjb21wYXJpc29uJGNvcnJlbGF0aW9uCmNvbXBhcmlzb24kbG1fbW9kZWwKYGBgCgpPaywgc28gdGhlcmUgaXMgYSBjb25zdGl0dWl0aXZlIGRpZmZlcmVuY2UgaW4gb3VyIHJlc3VsdHMsIGFuZCBpdCBpcwpzaWduaWZpY2FudC4gIFdoYXQgZG9lcyB0aGF0IG1lYW4gZm9yIHRoZSBzZXQgb2YgZ2VuZXMgb2JzZXJ2ZWQ/CgpXaXRoIHRoYXQgc2FpZCwgaW4gbXkgbW9zdCByZWNlbnQgbWFudWFsIHJ1biBvZiB0aGlzLCB0aGUgcmVzdWx0cyBhcmUKcXVpdGUgZ29vZCwgSSBnb3QgYSAwLjc1IGNvcnJlbGF0aW9uOyBJIGJldCB0aGUgcHJpbWFyeSBvdXRsaWVycyAob24KdGhlIGF4ZXMpIGFyZSBqdXN0IGdlbmVzIGZvciB3aGljaCB3ZSBnb3QgZGlmZmVyZW50IGdlbmU8LT50eCBtYXBwaW5ncwpkdWUgdG8gbWUgdXNpbmcgaGlzYXQgYW5kIHRoZWlyIHVzYWdlIG9mIGthbGxpc3RvLgoKSSBndWVzcyBJIGNhbiB0ZXN0IHRoaXMgaHlwb3RoZXNpcyBieSBqdXN0IHN3YXBwaW5nIGluIHRoZWlyIGNvdW50cwppbnRvIG15IGRhdGEgc3RydWN0dXJlLgoKYGBge3IsIGV2YWw9RkFMU0V9CnRlc3RfY291bnRzIDwtIGFzLmRhdGEuZnJhbWUobXlER0VMaXN0Lmxlc2lvbi5jb2RpbmdbWyJjb3VudHMiXV0pCnRlc3RfY291bnRzW1siaG9zdF9IUzAxIl1dIDwtIE5VTEwKdGVzdF9jb3VudHNbWyJob3N0X0hTMDIiXV0gPC0gTlVMTAp0ZXN0X2NvdW50c1tbImhvc3RfSFMwMyJdXSA8LSBOVUxMCnRlc3RfY291bnRzW1siaG9zdF9IUzA0Il1dIDwtIE5VTEwKdGVzdF9jb3VudHNbWyJob3N0X0hTMDUiXV0gPC0gTlVMTAp0ZXN0X2NvdW50c1tbImhvc3RfSFMwNiJdXSA8LSBOVUxMCnRlc3RfY291bnRzW1siaG9zdF9IUzA3Il1dIDwtIE5VTEwKCmRpbSh0ZXN0X2NvdW50cykKZGltKGV4cHJzKG15X3Rlc3QpKQojIyBPaCwgdGhhdCBzdXJwcmlzZXMgbWUsIHRoZSBrYWxsaXN0byBkYXRhIGhhcyB+IDZrIGZld2VyIGdlbmVzPwpgYGAKCiMgU2VlIGlmIHRoZXJlIGFyZSBzaGFyZWQgREUgZ2VuZXMKCiEhTk9URSEhICBJIGFtIHVzaW5nIGEgbm9uLWFkanVzdGVkIHAtdmFsdWUgZmlsdGVyIGhlcmUgYmVjYXVzZSBJIHdhbnQKdG8gdXNlIHRoZSBzYW1lIGZpbHRlciB0aGV5IHVzZWQgZm9yIHRoZSB2b2xjYW5vIHBsb3QuCgpgYGB7ciBzaGFyZWRfZ2VuZXMsIGV2YWw9RkFMU0V9Cm15X2ZpbHRlciA8LSBhYnMobXlfdGFibGVbWyJsb2dGQyJdXSkgPiAxLjAgJiBteV90YWJsZVtbIlAuVmFsdWUiXV0gPD0gMC4wNQpzdW0obXlfZmlsdGVyKQp0aGVpcl9maWx0ZXIgPC0gYWJzKHRoZWlyX3RhYmxlW1sibG9nRkMiXV0pID4gMS4wICYgdGhlaXJfdGFibGVbWyJQLlZhbHVlIl1dIDw9IDAuMDUKc3VtKHRoZWlyX2ZpbHRlcikKCm15X3NoYXJlZCA8LSByb3duYW1lcyhteV90YWJsZSlbbXlfZmlsdGVyXSAlaW4lIHRoZWlyX3RhYmxlW3RoZWlyX2ZpbHRlciwgImdlbmVJRCJdCnN1bShteV9zaGFyZWQpCgpzaGFyZWQgPC0gcm93bmFtZXMobXlfdGFibGUpW215X2ZpbHRlcl0Kc2hhcmVkW215X3NoYXJlZF0KCmJvdGggPC0gbGlzdCgKICAidXMiID0gcm93bmFtZXMobXlfdGFibGUpW215X2ZpbHRlcl0sCiAgInRoZW0iID0gdGhlaXJfdGFibGVbdGhlaXJfZmlsdGVyLCAiZ2VuZUlEIl0pCnR0IDwtIFVwU2V0Ujo6ZnJvbUxpc3QoYm90aCkKVXBTZXRSOjp1cHNldCh0dCkKYGBgCgojIyBDb21wYXJlIHRoZSB0d28gZGF0YXNldHMgZGlyZWN0bHkKCmBgYHtyIHNjb3R0X2V4dGVybmFsfQpvbmx5X3RtcmMzIDwtIHN1YnNldF9leHB0KHRtcmMzX2V4dGVybmFsLCBzdWJzZXQgPSAiY29uZGl0aW9uPT0nQ29sb21iaWEnIikgJT4lCiAgc2V0X2V4cHRfY29uZGl0aW9ucyhmYWN0ID0gImZpbmFsb3V0Y29tZSIpCm9ubHlfdG1yYzNfZGUgPC0gYWxsX3BhaXJ3aXNlKG9ubHlfdG1yYzMsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHBhcmFsbGVsID0gcGFyYWxsZWwsIGZpbHRlciA9IFRSVUUsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQpvbmx5X3RtcmMzX2RlCm9ubHlfdG1yYzNfdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMob25seV90bXJjM19kZSkKb25seV90bXJjM190YWJsZQpvbmx5X3RtcmMzX3RvcDEwMCA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKG9ubHlfdG1yYzNfdGFibGUsIG4gPSAxMDApCm9ubHlfdG1yYzNfdXAgPC0gb25seV90bXJjM190b3AxMDBbWyJkZXNlcSJdXVtbInVwcyJdXVtbImZhaWx1cmVfdnNfY3VyZSJdXQpvbmx5X3RtcmMzX2Rvd24gPC0gb25seV90bXJjM190b3AxMDBbWyJkZXNlcSJdXVtbImRvd25zIl1dW1siZmFpbHVyZV92c19jdXJlIl1dCgp0bXJjM19leHRlcm5hbF9kZSA8LSBhbGxfcGFpcndpc2UodG1yYzNfZXh0ZXJuYWwsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSAic2ltcGxlIiwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0bXJjM19leHRlcm5hbF90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcyh0bXJjM19leHRlcm5hbF9kZSwgZXhjZWwgPSAiZXhjZWwvdG1yYzNfc2NvdHRfYmlvcHNpZXMueGxzeCIpCnRtcmMzX2V4dGVybmFsX3NpZyA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKHRtcmMzX2V4dGVybmFsX3RhYmxlLCBleGNlbCA9ICJleGNlbC90bXJjM19zY290dF9iaW9wc2llc19zaWcueGxzeCIpCgp0bXJjM19leHRlcm5hbF9jZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRtcmMzX2V4dGVybmFsLCBmYWN0ID0gImZpbmFsb3V0Y29tZSIpICU+JQogIHNldF9leHB0X2JhdGNoZXMoZmFjdCA9ICJsYWIiKQp0bXJjM19leHRlcm5hbF9jZl9ub3JtIDwtIG5vcm1hbGl6ZV9leHB0KHRtcmMzX2V4dGVybmFsX2NmLCBmaWx0ZXIgPSBUUlVFLCBub3JtID0gInF1YW50IiwgY29udmVydCA9ICJjcG0iLCB0cmFuc2Zvcm0gPSAibG9nMiIpCnBsb3RfcGNhKHRtcmMzX2V4dGVybmFsX2NmX25vcm0pCnRtcmMzX2V4dGVybmFsX2NmX25iIDwtIG5vcm1hbGl6ZV9leHB0KHRtcmMzX2V4dGVybmFsX2NmLCBmaWx0ZXIgPSBUUlVFLCBiYXRjaCA9ICJzdmFzZXEiLCBjb252ZXJ0ID0gImNwbSIsIHRyYW5zZm9ybSA9ICJsb2cyIikKcGxvdF9wY2EodG1yYzNfZXh0ZXJuYWxfY2ZfbmIpCgp0bXJjM19leHRlcm5hbF9jZl9kZSA8LSBhbGxfcGFpcndpc2UodG1yYzNfZXh0ZXJuYWxfY2YsIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBwYXJhbGxlbCA9IHBhcmFsbGVsLCBmaWx0ZXIgPSBUUlVFLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbWV0aG9kcyA9IG1ldGhvZHMpCnRtcmMzX2V4dGVybmFsX2NmX2RlCnRtcmMzX2V4dGVybmFsX2NmX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKHRtcmMzX2V4dGVybmFsX2NmX2RlLCBleGNlbCA9ICJleGNlbC90bXJjM19zY290dF9jZl90YWJsZS54bHN4IikKdG1yYzNfZXh0ZXJuYWxfY2ZfdGFibGUKdG1yYzNfZXh0ZXJuYWxfY2Zfc2lnIDwtIGV4dHJhY3Rfc2lnbmlmaWNhbnRfZ2VuZXModG1yYzNfZXh0ZXJuYWxfY2ZfdGFibGUsIGV4Y2VsID0gImV4Y2VsL3RtcmMzX3Njb3R0X2NmX3NpZy54bHN4IikKdG1yYzNfZXh0ZXJuYWxfY2Zfc2lnCgp0bXJjM19leHRlcm5hbF9zcGVjaWVzIDwtIHNldF9leHB0X2NvbmRpdGlvbnModG1yYzNfZXh0ZXJuYWwsIGZhY3QgPSAiUGFyYXNpdGVTcGVjaWVzIikgJT4lCiAgc2V0X2V4cHRfY29sb3JzKGNvbG9yX2Nob2ljZXNbWyJwYXJhc2l0ZSJdXSkKYGBgCgojIENvbXBhcmUgdGhlIGwyRkMgdmFsdWVzCgpMZXQgdXMgbG9vayBhdCB0aGUgdG9wL2JvdHRvbSAxMDAgZ2VuZXMgb2YgdGhlc2UgdHdvIGRhdGFzZXRzIGFuZCBzZWUgaWYgdGhleQpoYXZlIGFueSBzaW1pbGFyaXRpZXMuCgpOb3RlIHRvIHNlbGYsIHNldCB1cCBzNCBkaXNwYXRjaCBvbiBjb21wYXJlX2RlX3RhYmxlcyEKCmBgYHtyfQpjb21wYXJlZCA8LSBjb21wYXJlX2RlX3RhYmxlcyhvbmx5X3RtcmMzX3RhYmxlLCBleHRlcm5hbF90YWJsZSwgZmlyc3RfdGFibGUgPSAxLCBzZWNvbmRfdGFibGUgPSAxKQpjb21wYXJlZCRzY2F0dGVyCmNvbXBhcmVkJGNvcnJlbGF0aW9uCmBgYAoKIyBDb21wYXJlIHZpc2l0cyBieSBjZWxsdHlwZSBhbmQgQy9GCgpJIGFzc3VtZSB0aGlzIHJlcXVlc3QgY2FtZSBvdXQgb2YgdGhlIHJldmlldyBwcm9jZXNzLCBidXQgSSBhbSBub3QKcXVpdGUgc3VyZSB3aGVyZSB0byBwdXQgaXQuICBJZiBJIHVuZGVyc3RhbmQgaXQgY29ycmVjdGx5LCB0aGUgZ29hbCBpcwp0byBsb29rIGFjcm9zcyB2aXNpdHMgZm9yIGNvbWJpbmF0aW9ucyBvZiBjdXJlIGFuZCBmYWlsIChub3QKZmFpbC9jdXJlLCBidXQgdjIvdjEpIGFuZCBhY3Jvc3MgY2VsbCB0eXBlcy4KClRodXMsIGluIG9yZGVyIHRvIGRvIHRoaXMsIEkgd2lsbCBuZWVkIHRvIGNvbWJpbmUgdGhvc2UgdGhyZWUKcGFyYW1ldGVycyBvciBzZXQgdXAgYSBtb3JlIGNvbXBsZXggbW9kZWwgdG8gaGFuZGxlIHRoaXMuCgpgYGB7cn0KdF9jZWxsdmlzaXRjZiA8LSBzZXRfZXhwdF9jb25kaXRpb25zKHRfY2xpbmljYWxfbm9iaW9wLCBmYWN0ID0gImNlbGxfdmlzaXRfY2YiKQoKdF9jZWxsdmlzaXRjZl9kZSA8LSBhbGxfcGFpcndpc2UodF9jZWxsdmlzaXRjZiwga2VlcGVycyA9IHZpc2l0dHlwZV9jb250cmFzdHMsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1vZGVsX2JhdGNoID0gInN2YXNlcSIsIGZpbHRlciA9IFRSVUUsIHBhcmFsbGVsID0gcGFyYWxsZWwsCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIG1ldGhvZHMgPSBtZXRob2RzKQp0X2NlbGx2aXNpdGNmX2RlCgp0X2NlbGx2aXNpdGNmX21vbm9fdGFibGUgPC0gY29tYmluZV9kZV90YWJsZXMoCiAgdF9jZWxsdmlzaXRjZl9kZSwga2VlcGVycyA9IHZpc2l0dHlwZV9jb250cmFzdHNfbW9ubywKICBleGNlbCA9IGdsdWUoInt4bHN4X3ByZWZpeH0vREVfVmlzaXRzL0N1cmVfRmFpbC9tb25vY3l0ZV92aXNpdF9jZl9jb21iaW5lZF90YWJsZV9zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZWxsdmlzaXRjZl9tb25vX3RhYmxlCnRfY2VsbHZpc2l0Y2ZfbW9ub19zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NlbGx2aXNpdGNmX21vbm9fdGFibGUsCiAgZXhjZWwgPSBnbHVlKCJ7eGxzeF9wcmVmaXh9L0RFX1Zpc2l0cy9DdXJlX0ZhaWwvbW9ub2N5dGVfdmlzaXRfY2ZfY29tYmluZWRfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NlbGx2aXNpdGNmX21vbm9fc2lnCnRfY2VsbHZpc2l0Y2ZfbmV1dF90YWJsZSA8LSBjb21iaW5lX2RlX3RhYmxlcygKICB0X2NlbGx2aXNpdGNmX2RlLCBrZWVwZXJzID0gdmlzaXR0eXBlX2NvbnRyYXN0c19uZSwKICBleGNlbCA9IGdsdWUoInt4bHN4X3ByZWZpeH0vREVfVmlzaXRzL0N1cmVfRmFpbC9uZXV0cm9waGlsX3Zpc2l0X2NmX2NvbWJpbmVkX3RhYmxlX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NlbGx2aXNpdGNmX25ldXRfdGFibGUKdF9jZWxsdmlzaXRjZl9uZXV0X3NpZyA8LSBleHRyYWN0X3NpZ25pZmljYW50X2dlbmVzKAogIHRfY2VsbHZpc2l0Y2ZfbmV1dF90YWJsZSwKICBleGNlbCA9IGdsdWUoInt4bHN4X3ByZWZpeH0vREVfVmlzaXRzL0N1cmVfRmFpbC9uZXV0cm9waGlsX3Zpc2l0X2NmX2NvbWJpbmVkX3NpZ19zdmEtdnt2ZXJ9Lnhsc3giKSkKdF9jZWxsdmlzaXRjZl9uZXV0X3NpZwp0X2NlbGx2aXNpdGNmX2VvX3RhYmxlIDwtIGNvbWJpbmVfZGVfdGFibGVzKAogIHRfY2VsbHZpc2l0Y2ZfZGUsIGtlZXBlcnMgPSB2aXNpdHR5cGVfY29udHJhc3RzX2VvLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMvQ3VyZV9GYWlsL2Vvc2lub3BoaWxfdmlzaXRfY2ZfY29tYmluZWRfdGFibGVfc3ZhLXZ7dmVyfS54bHN4IikpCnRfY2VsbHZpc2l0Y2ZfZW9fdGFibGUKdF9jZWxsdmlzaXRjZl9lb19zaWcgPC0gZXh0cmFjdF9zaWduaWZpY2FudF9nZW5lcygKICB0X2NlbGx2aXNpdGNmX2VvX3RhYmxlLAogIGV4Y2VsID0gZ2x1ZSgie3hsc3hfcHJlZml4fS9ERV9WaXNpdHMvQ3VyZV9GYWlsL2Vvc2lub3BoaWxfdmlzaXRfY2ZfY29tYmluZWRfc2lnX3N2YS12e3Zlcn0ueGxzeCIpKQp0X2NlbGx2aXNpdGNmX2VvX3NpZwpgYGAKCmBgYHtyIGxvYWRtZV9hZnRlciwgZXZhbD1GQUxTRX0KdG1wIDwtIGxvYWRtZShmaWxlbmFtZSA9IHNhdmVmaWxlKQpgYGAKCiMgQmlibGlvZ3JhcGh5Cg==