TMRC2 202405: Promastigote (mostly) Differential Expression Analyses.

1 Changelog

202405: Changed excel output directory to match organization scheme in box. Generally this means files go to analyses/transcriptome/{type_of_contrast}/{date}/something_{suffix}.xlsx Where suffix is _table for the full tables and _sig for the significant genes and will include information about whether sva etc was used. 202405: Adding some goseq results.

2 Contrasts

** Note! ** The new definitions of susceptible/resistant are tighter than ever before, as a result there are no longer any ambiguous samples. Thus I removed the ambiguous contrasts in the following block.

zymodeme_keeper <- list(
    "zymodeme" = c("z23", "z22"))
susceptibility_keepers <- list(
  "resistant_sensitive" = c("resistant", "sensitive"))
##    "resistant_ambiguous" = c("resistant", "ambiguous"),
##    "sensitive_ambiguous" = c("sensitive", "ambiguous"))

3 Parasite Ontology data

Just a reminder that in data_structures.Rmd I created lp_go and lp_lengths

3.1 Zymodeme enzyme gene IDs

Najib read me an email listing off the gene names associated with the zymodeme classification. I took those names and cross referenced them against the Leishmania panamensis gene annotations and found the following:

They are:

1. ALAT: LPAL13_120010900 – alanine aminotransferase
2. ASAT: LPAL13_340013000 – aspartate aminotransferase
3. G6PD: LPAL13_000054100 – glucase-6-phosphate 1-dehydrogenase
4. NH: LPAL13_14006100, LPAL13_180018500 – inosine-guanine nucleoside hydrolase
5. MPI: LPAL13_320022300 (maybe) – mannose phosphate isomerase (I chose phosphomannose isomerase)

Given these 6 gene IDs (NH has two gene IDs associated with it), I can do some looking for specific differences among the various samples.

3.1.1 Expression levels of zymodeme genes

The following creates a colorspace (red to green) heatmap showing the observed expression of these genes in every sample.

my_genes <- c("LPAL13_120010900", "LPAL13_340013000", "LPAL13_000054100",
              "LPAL13_140006100", "LPAL13_180018500", "LPAL13_320022300",
              "other")
my_names <- c("ALAT", "ASAT", "G6PD", "NHv1", "NHv2", "MPI", "other")

zymo_six_genes <- exclude_genes_expt(lp_two_strains, ids = my_genes, method = "keep")

## Note, I renamed this to subset_genes().

## remove_genes_expt(), before removal, there were 8710 genes, now there are 6.

## There are 93 samples which kept less than 90 percent counts.

## TMRC20001 TMRC20002 TMRC20065 TMRC20004 TMRC20005 TMRC20066 TMRC20039 TMRC20037 
##   0.12101   0.08915   0.12835   0.11970   0.13438   0.10804   0.13756   0.11451 
## TMRC20038 TMRC20067 TMRC20068 TMRC20041 TMRC20015 TMRC20009 TMRC20010 TMRC20016 
##   0.11446   0.10858   0.11269   0.12840   0.11072   0.11376   0.10292   0.10451 
## TMRC20011 TMRC20012 TMRC20013 TMRC20017 TMRC20014 TMRC20018 TMRC20019 TMRC20070 
##   0.10967   0.11676   0.11865   0.10594   0.10591   0.11517   0.12027   0.11179 
## TMRC20020 TMRC20021 TMRC20022 TMRC20024 TMRC20036 TMRC20069 TMRC20033 TMRC20026 
##   0.11100   0.10764   0.12952   0.11481   0.12100   0.11631   0.11188   0.13633 
## TMRC20031 TMRC20076 TMRC20073 TMRC20055 TMRC20079 TMRC20071 TMRC20078 TMRC20094 
##   0.10013   0.12403   0.12398   0.13783   0.12639   0.12003   0.13420   0.12021 
## TMRC20042 TMRC20058 TMRC20072 TMRC20059 TMRC20048 TMRC20057 TMRC20088 TMRC20056 
##   0.13766   0.11900   0.14675   0.10984   0.10679   0.13443   0.12936   0.13510 
## TMRC20060 TMRC20077 TMRC20074 TMRC20063 TMRC20053 TMRC20052 TMRC20064 TMRC20075 
##   0.10882   0.12810   0.12494   0.12239   0.12145   0.11690   0.12051   0.11261 
## TMRC20051 TMRC20050 TMRC20049 TMRC20062 TMRC20110 TMRC20080 TMRC20043 TMRC20083 
##   0.13149   0.11526   0.14480   0.13429   0.13812   0.12120   0.11306   0.12235 
## TMRC20054 TMRC20085 TMRC20046 TMRC20093 TMRC20089 TMRC20047 TMRC20090 TMRC20044 
##   0.12723   0.12316   0.13182   0.13588   0.11884   0.12391   0.11566   0.13691 
## TMRC20045 TMRC20105 TMRC20108 TMRC20109 TMRC20098 TMRC20096 TMRC20101 TMRC20092 
##   0.12812   0.12219   0.11601   0.11684   0.11771   0.11364   0.11784   0.11465 
## TMRC20082 TMRC20102 TMRC20099 TMRC20100 TMRC20091 TMRC20084 TMRC20087 TMRC20103 
##   0.10358   0.11399   0.11888   0.10820   0.12935   0.11273   0.12564   0.13704 
## TMRC20104 TMRC20086 TMRC20107 TMRC20081 TMRC20095 
##   0.11723   0.10752   0.09364   0.10335   0.06566

strain_norm <- normalize_expt(zymo_six_genes, convert = "rpkm", filter = TRUE, transform = "log2")

## Removing 0 low-count genes (6 remaining).

zymo_heatmap <- plot_sample_heatmap(strain_norm, row_label = my_names)
zymo_heatmap

lp_norm <- normalize_expt(lp_two_strains, filter = TRUE, convert = "rpkm",
                          norm = "quant", transform = "log2")

## Removing 140 low-count genes (8570 remaining).

## transform_counts: Found 88 values equal to 0, adding 1 to the matrix.

zymo_heatmap_all <- plot_sample_heatmap(lp_norm)
zymo_heatmap_all

3.2 Compare to highly expressed, variant genes

I want to compare the above heatmap with one which is comprised of all genes with some ‘significantly high’ expression value and also a not-negligible coefficient of variance.

zymo_high_genes <- normalize_expt(lp_two_strains, filter = "cv", cv_min = 0.9)

## Removing 4712 low-count genes (3998 remaining).

high_strain_norm <- normalize_expt(zymo_high_genes, convert = "rpkm",
                                   norm = "quant", transform = "log2")

## transform_counts: Found 476 values equal to 0, adding 1 to the matrix.

zymo_heatmap <- plot_sample_heatmap(high_strain_norm, row_label = my_names)
zymo_heatmap

I think this plot suggests that the difference between the two primary strains is not really one of a few specific genes, but instead a global pattern.

4 Zymodeme differential expression

4.1 No attempt at batch estimation

zymo_de_nobatch <- all_pairwise(lp_zymo, filter = TRUE, model_batch = FALSE)

## 
## z2.2 z2.3 
##   41   41

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

zymo_de_nobatch

## Error in eval(expr, envir, enclos): object 'zymo_de_nobatch' not found

## Including the plots causes the rda file to balloon to 3.4Gb in the following invocation.
## Removing them results in... holy crap 2.1Mb
zymo_table_nobatch <- combine_de_tables(
    zymo_de_nobatch, keepers = zymodeme_keeper,
    rda = glue("rda/zymo_tables_nobatch-v{ver}.rda"),
    excel = glue("{excel_out}/DE_Strain/{ver}/zymo_tables_nobatch-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'zymo_de_nobatch' not found

zymo_table_nobatch

## Error in eval(expr, envir, enclos): object 'zymo_table_nobatch' not found

zymo_sig_nobatch <- extract_significant_genes(
    zymo_table_nobatch,
    according_to = "deseq", current_id = "GID", required_id = "GID",
    gmt = glue("excel/zymodeme_nobatch-v{ver}.gmt"),
    excel = glue("{excel_out}/DE_Strain/{ver}/zymo_sig_nobatch_deseq-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'zymo_table_nobatch' not found

zymo_sig_nobatch

## Error in eval(expr, envir, enclos): object 'zymo_sig_nobatch' not found

4.1.0.1 Gene ontology comparing the strains

There are too few genes at our current stringencies for a meaningful result.

increased_z22 <- zymo_sig_nobatch[["deseq"]][["downs"]][["zymodeme"]]

## Error in eval(expr, envir, enclos): object 'zymo_sig_nobatch' not found

increased_z23 <- zymo_sig_nobatch[["deseq"]][["ups"]][["zymodeme"]]

## Error in eval(expr, envir, enclos): object 'zymo_sig_nobatch' not found

z22_goseq <- simple_goseq(increased_z22, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_z22' not found

z23_goseq <- simple_goseq(increased_z23, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_z23' not found

4.1.1 Plot DE genes without batch estimation/adjustment

zymo_table_nobatch[["plots"]][["zymodeme"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'zymo_table_nobatch' not found

zymo_table_nobatch[["plots"]][["zymodeme"]][["deseq_vol_plots"]]

## Error in eval(expr, envir, enclos): object 'zymo_table_nobatch' not found

Log ratio, mean average plot and volcano plot of the comparison of the two primary zymodeme transcriptomes. When the transcriptomes of the two main strains (43 and 41 samples of z2.3 and z2.1) were compared without any attempt at batch/surrogate estimation with DESeq2, 45 and 85 genes were observed as significantly higher in strain z2.3 and z2.2 respectively using a cutoff of 1.0 logFC and 0.05 FDR adjusted p-value. There remain a large number of genes which are likely significantly different between the two strains, but fall below the 2-fold difference required for ‘significance.’ This follows prior observations that the parasite transcriptomes are constituitively expressed.

When the same data was plotted via a volcano plot, the relatively small range of fold changes compared to the large range of adjusted p-values is visible.

4.2 Attempt SVA estimate

zymo_de_sva <- all_pairwise(lp_zymo, filter = TRUE, model_batch = "svaseq")

## 
## z2.2 z2.3 
##   41   41

## Removing 0 low-count genes (8557 remaining).

## Setting 443 low elements to zero.

## transform_counts: Found 443 values equal to 0, adding 1 to the matrix.

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

zymo_de_sva

## Error in eval(expr, envir, enclos): object 'zymo_de_sva' not found

zymo_table_sva <- combine_de_tables(
    zymo_de_sva, keepers = zymodeme_keeper,
    rda = glue("rda/zymo_tables_sva-v{ver}.rda"),
    excel = glue("{excel_out}/DE_Strain/{ver}/zymo_tables_sva-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'zymo_de_sva' not found

zymo_table_sva

## Error in eval(expr, envir, enclos): object 'zymo_table_sva' not found

zymo_sig_sva <- extract_significant_genes(
    zymo_table_sva,
    according_to = "deseq",
    current_id = "GID", required_id = "GID",
    gmt = glue("excel/zymodeme_sva-v{ver}.gmt"),
    excel = glue("{excel_out}/DE_Strain/{ver}/zymo_sig_sva-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'zymo_table_sva' not found

zymo_sig_sva

## Error in eval(expr, envir, enclos): object 'zymo_sig_sva' not found

4.2.0.1 Gene ontology comparing the strains

There are too few genes at our current stringencies for a meaningful result.

increased_z22 <- zymo_sig_sva[["deseq"]][["downs"]][["zymodeme"]]

## Error in eval(expr, envir, enclos): object 'zymo_sig_sva' not found

increased_z23 <- zymo_sig_sva[["deseq"]][["ups"]][["zymodeme"]]

## Error in eval(expr, envir, enclos): object 'zymo_sig_sva' not found

z22_goseq <- simple_goseq(increased_z22, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_z22' not found

z23_goseq <- simple_goseq(increased_z23, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_z23' not found

4.2.1 Plot zymodeme DE genes with sva batch estimation/adjustment

When estimates from SVA were included in the statistical model used by EdgeR, DESeq2, and limma; a nearly identical view of the data emerged. I think this shows with a high degree of confidence, that sva is not having a significant effect on this dataset.

zymo_table_sva[["plots"]][["zymodeme"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'zymo_table_sva' not found

zymo_table_sva[["plots"]][["zymodeme"]][["deseq_vol_plots"]]

## Error in eval(expr, envir, enclos): object 'zymo_table_sva' not found

5 Parasite Susceptibility to Drug (Current)

This susceptibility comparison is using the ‘current’ dataset.

Note again: we no longer have any ambiguous samples, so I commented out a portion of the following block.

sus_de_nobatch <- all_pairwise(lp_susceptibility, filter = TRUE, model_batch = FALSE)

## 
## resistant sensitive 
##        45        46

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

sus_de_nobatch

## Error in eval(expr, envir, enclos): object 'sus_de_nobatch' not found

sus_table_nobatch <- combine_de_tables(
  sus_de_nobatch, keepers = susceptibility_keepers,
  rda = glue("rda/sus_tables_nobatch-v{ver}.rda"),
  excel = glue("{excel_out}/DE_Susceptibility/{ver}/sus_tables_nobatch-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sus_de_nobatch' not found

sus_table_nobatch

## Error in eval(expr, envir, enclos): object 'sus_table_nobatch' not found

sus_sig_nobatch <- extract_significant_genes(
  sus_table_nobatch,
  excel = glue("{excel_out}/DE_Susceptibility/{ver}/sus_sig_nobatch-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sus_table_nobatch' not found

sus_de_sva <- all_pairwise(lp_susceptibility, filter = TRUE, model_batch = "svaseq")

## 
## resistant sensitive 
##        45        46

## Removing 0 low-count genes (8558 remaining).

## Setting 439 low elements to zero.

## transform_counts: Found 439 values equal to 0, adding 1 to the matrix.

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

sus_de_sva

## Error in eval(expr, envir, enclos): object 'sus_de_sva' not found

sus_table_sva <- combine_de_tables(
    sus_de_sva, keepers = susceptibility_keepers,
    rda = glue("rda/sus_tables_sva-v{ver}.rda"),
    excel = glue("{excel_out}/DE_Susceptibility/{ver}/sus_tables_sva-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sus_de_sva' not found

sus_table_sva

## Error in eval(expr, envir, enclos): object 'sus_table_sva' not found

sus_sig_sva <- extract_significant_genes(
  sus_table_sva, according_to = "deseq",
    excel = glue("{excel_out}/DE_Susceptibility/{ver}/sus_sig_sva-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sus_table_sva' not found

sus_sig_sva

## Error in eval(expr, envir, enclos): object 'sus_sig_sva' not found

## To get a more true sense of sensitive vs resistant with sva, we kind of need to get rid of the
## unknown samples and perhaps the ambiguous.
## no_ambiguous <- subset_expt(lp_susceptibility, subset = "condition!='ambiguous'") %>%
##   subset_expt(subset = "condition!='unknown'")
## no_ambiguous_de_sva <- all_pairwise(no_ambiguous, filter = TRUE, model_batch = "svaseq")
## no_ambiguous_de_sva
## Let us see if my keeper code will fail hard or soft with extra contrasts...
## no_ambiguous_table_sva <- combine_de_tables(
##     no_ambiguous_de_sva, keepers = susceptibility_keepers,
##     excel = glue("excel/no_ambiguous_tables_sva-v{ver}.xlsx"))
## no_ambiguous_table_sva
## no_ambiguous_sig_sva <- extract_significant_genes(
##     no_ambiguous_table_sva, according_to = "deseq",
##     excel = glue("excel/no_ambiguous_sig_sva-v{ver}.xlsx"))
## no_ambiguous_sig_sva

5.0.0.1 Gene ontology comparing the susceptibility

sus_sig_sva

## Error in eval(expr, envir, enclos): object 'sus_sig_sva' not found

increased_resistant <- sus_sig_sva[["deseq"]][["ups"]][["resistant_sensitive"]]

## Error in eval(expr, envir, enclos): object 'sus_sig_sva' not found

increased_sensitive <- sus_sig_sva[["deseq"]][["downs"]][["resistant_sensitive"]]

## Error in eval(expr, envir, enclos): object 'sus_sig_sva' not found

resistant_goseq <- simple_goseq(increased_resistant, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_resistant' not found

sensitive_goseq <- simple_goseq(increased_sensitive, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_sensitive' not found

5.0.1 Plot Susceptibility DE genes with sva batch estimation/adjustment

sus_table_nobatch[["plots"]][["resistant_sensitive"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'sus_table_nobatch' not found

sus_table_nobatch[["plots"]][["resistant_sensitive"]][["deseq_vol_plots"]]

## Error in eval(expr, envir, enclos): object 'sus_table_nobatch' not found

sus_table_sva[["plots"]][["resistant_sensitive"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'sus_table_sva' not found

sus_table_sva[["plots"]][["resistant_sensitive"]][["deseq_vol_plots"]]

## Error in eval(expr, envir, enclos): object 'sus_table_sva' not found

Given that resistance/sensitivity tends to be correlated with strain, one might expect similar results. One caveat in this context though: there are fewer strains with resistance/sensitivity definitions. This when the analysis was repeated without the ambiguous/unknown samples, a few more genes were observed as significant.

6 Comparing DE results from strain/sensitivity

## zymo_table_sva[["plots"]][["zymodeme"]][["deseq_ma_plots"]][["plot"]]
zy_df <- zymo_table_sva[["data"]][["zymodeme"]]

## Error in eval(expr, envir, enclos): object 'zymo_table_sva' not found

sus_df <- sus_table_sva[["data"]][["resistant_sensitive"]]

## Error in eval(expr, envir, enclos): object 'sus_table_sva' not found

both_df <- merge(zy_df, sus_df, by = "row.names")

## Error in h(simpleError(msg, call)): error in evaluating the argument 'x' in selecting a method for function 'merge': object 'zy_df' not found

plot_df <- both_df[, c("deseq_logfc.x", "deseq_logfc.y")]

## Error in eval(expr, envir, enclos): object 'both_df' not found

rownames(plot_df) <- both_df[["Row.names"]]

## Error in eval(expr, envir, enclos): object 'both_df' not found

colnames(plot_df) <- c("z23_vs_z22", "sensitive_vs_resistant")

## Error: object 'plot_df' not found

compare <- plot_linear_scatter(plot_df)

## Error in eval(expr, envir, enclos): object 'plot_df' not found

pp(file = "images/compare_sus_zy.png")
compare$scatter

## Error in eval(expr, envir, enclos): object 'compare' not found

dev.off()

## png 
##   2

compare$scatter

## Error in eval(expr, envir, enclos): object 'compare' not found

compare$cor

## Error in eval(expr, envir, enclos): object 'compare' not found

7 Parasite Susceptibility to Drug (Historical)

This susceptibility comparison is using the historical dataset.

sushist_de_nobatch <- all_pairwise(lp_susceptibility_historical, filter = TRUE,
                                   model_batch = FALSE)

## 
## ambiguous resistant sensitive   unknown 
##         5        12        29        45

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

sushist_de_nobatch

## Error in eval(expr, envir, enclos): object 'sushist_de_nobatch' not found

sushist_table_nobatch <- combine_de_tables(
  sushist_de_nobatch, keepers = susceptibility_keepers,
  excel = glue("{excel_out}/DE_Susceptibility/sushist_tables_nobatch-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sushist_de_nobatch' not found

sushist_table_nobatch

## Error in eval(expr, envir, enclos): object 'sushist_table_nobatch' not found

sushist_sig_nobatch <- extract_significant_genes(
  sushist_table_nobatch,
  excel = glue("{excel_out}/DE_Susceptibility/sushist_sig_nobatch-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sushist_table_nobatch' not found

sushist_sig_nobatch

## Error in eval(expr, envir, enclos): object 'sushist_sig_nobatch' not found

sushist_de_sva <- all_pairwise(lp_susceptibility_historical, filter = TRUE,
                               model_batch = "svaseq")

## 
## ambiguous resistant sensitive   unknown 
##         5        12        29        45

## Removing 0 low-count genes (8558 remaining).

## Setting 348 low elements to zero.

## transform_counts: Found 348 values equal to 0, adding 1 to the matrix.

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

sushist_de_sva

## Error in eval(expr, envir, enclos): object 'sushist_de_sva' not found

sushist_table_sva <- combine_de_tables(
  sushist_de_sva, keepers = susceptibility_keepers,
  excel = glue("{excel_out}/DE_Susceptibility/sushist_tables_sva-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sushist_de_sva' not found

sushist_table_sva

## Error in eval(expr, envir, enclos): object 'sushist_table_sva' not found

sushist_sig_sva <- extract_significant_genes(
  sushist_table_sva, according_to = "deseq",
  excel = glue("{excel_out}/DE_Susceptibility/sushist_sig_sva-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'sushist_table_sva' not found

sushist_sig_sva

## Error in eval(expr, envir, enclos): object 'sushist_sig_sva' not found

8 Cure/Fail association

##cf_nb_input <- subset_expt(cf_expt, subset="condition!='unknown'")
cf_de_nobatch <- all_pairwise(lp_cf_known, filter = TRUE, model_batch = FALSE)

## 
## cure fail 
##   39   34

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

cf_de_nobatch

## Error in eval(expr, envir, enclos): object 'cf_de_nobatch' not found

cf_table_nobatch <- combine_de_tables(
  cf_de_nobatch,
  excel = glue("{excel_out}/DE_Cure_vs_Fail/{ver}/cf_tables_nobatch-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'cf_de_nobatch' not found

cf_table_nobatch

## Error in eval(expr, envir, enclos): object 'cf_table_nobatch' not found

cf_sig_nobatch <- extract_significant_genes(
  cf_table_nobatch,
  excel = glue("{excel_out}/DE_Cure_vs_Fail/{ver}/cf_sig_nobatch-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'cf_table_nobatch' not found

cf_sig_nobatch

## Error in eval(expr, envir, enclos): object 'cf_sig_nobatch' not found

cf_de <- all_pairwise(lp_cf_known, filter = TRUE, model_batch = "svaseq")

## 
## cure fail 
##   39   34

## Removing 0 low-count genes (8546 remaining).

## Setting 110 low elements to zero.

## transform_counts: Found 110 values equal to 0, adding 1 to the matrix.

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

cf_de

## Error in eval(expr, envir, enclos): object 'cf_de' not found

cf_table <- combine_de_tables(
  cf_de,
  excel = glue("{excel_out}/DE_Cure_vs_Fail/{ver}/cf_tables-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'cf_de' not found

cf_table

## Error in eval(expr, envir, enclos): object 'cf_table' not found

cf_sig <- extract_significant_genes(
  cf_table,
  excel = glue("{excel_out}/DE_Cure_vs_Fail/{ver}/cf_sig-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'cf_table' not found

cf_sig

## Error in eval(expr, envir, enclos): object 'cf_sig' not found

I am not going to mess with GO searches for this.

8.1 Cure/Fail DE plots

It is not surprising that few or no genes are deemed significantly differentially expressed across samples which were taken from cure or fail patients.

cf_table_nobatch[["plots"]][["fail_vs_cure"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'cf_table_nobatch' not found

dev <- pp(file = "images/cf_ma.png")
cft_able[["plots"]][["fail_vs_cure"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'cft_able' not found

closed <- dev.off()
cf_table[["plots"]][["fail_vs_cure"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'cf_table' not found

9 Combining the macrophage infected amastigotes with in-vitro promastigotes

One query we have not yet addressed: what are the similarities and differences among the strains used to infect the macrophage samples and the promastigote samples used in the TMRC2 parasite data?

In my container image, this dataset is not currently loaded, so turning this off.

## I just fixed this in the datasets Rmd, but until that propagates just set it manually
annotation(lp_expt) <- annotation(lp_macrophage)
tmrc2_macrophage_norm <- normalize_expt(lp_macrophage, transform="log2", convert="cpm",
                                        norm="quant", filter=TRUE)

## Removing 0 low-count genes (8710 remaining).

## transform_counts: Found 3735 values equal to 0, adding 1 to the matrix.

all_tmrc2 <- combine_expts(lp_expt, lp_macrophage)

## The numbers of samples by condition are:

## 
## z2.1 z2.2 z2.3 z2.4 
##    7   62   70    2

all_nosb <- all_tmrc2
pData(all_nosb)[["stage"]] <- "promastigote"
na_idx <- is.na(pData(all_nosb)[["macrophagetreatment"]])
pData(all_nosb)[na_idx, "macrophagetreatment"] <- "undefined"
all_nosb <- subset_expt(all_nosb, subset = "macrophagetreatment!='inf_sb'")

## The samples excluded are: TMRC30051, TMRC30062, TMRC30065, TMRC30069, TMRC30248, TMRC30249, TMRC30251, TMRC30252, TMRC30317, TMRC30321, TMRC30298, TMRC30300, TMRC30296, TMRC30302, TMRC30315, TMRC30294, TMRC30292, TMRC30308, TMRC30331, TMRC30332, TMRC30306.

## subset_expt(): There were 141, now there are 120 samples.

ama_idx <- pData(all_nosb)[["macrophagetreatment"]] == "inf"
pData(all_nosb)[ama_idx, "stage" ] <- "amastigote"
pData(all_nosb)[["batch"]] <- pData(all_nosb)[["stage"]]

I think the above picture is sort of the opposite of what we want to compare in a DE analysis for this set of data, e.g. we want to compare promastigotes from amastigotes?

all_nosb <- set_expt_batches(all_nosb, fact = "condition") %>%
  set_expt_conditions(fact = "stage")

## The number of samples by batch are:

## 
## z2.1 z2.2 z2.3 z2.4 
##    7   55   56    2

## The numbers of samples by condition are:

## 
##   amastigote promastigote 
##           29           91

two_zymo <- subset_expt(
  all_nosb,
  subset = "zymodemecategorical=='z22'|zymodemecategorical=='z23'|zymodemecategorical=='unknown'")

## The samples excluded are: TMRC20057, TMRC20056, TMRC20093, TMRC20047, TMRC20045, TMRC20108, TMRC20091, TMRC20084, TMRC20103, TMRC30057, TMRC30061, TMRC30063, TMRC30064, TMRC30067, TMRC30162, TMRC30245, TMRC30247, TMRC30250, TMRC30267, TMRC30286, TMRC30316, TMRC30322, TMRC30328, TMRC30318, TMRC30324, TMRC30320, TMRC30297, TMRC30299, TMRC30295, TMRC30303, TMRC30301, TMRC30314, TMRC30293, TMRC30291, TMRC30307, TMRC30310, TMRC30311, TMRC30305.

## subset_expt(): There were 120, now there are 82 samples.

pro_ama <- all_pairwise(all_nosb, filter = TRUE, model_batch = "svaseq")

## 
##   amastigote promastigote 
##           29           91

## Removing 0 low-count genes (8613 remaining).

## Setting 1443 low elements to zero.

## transform_counts: Found 1443 values equal to 0, adding 1 to the matrix.

## Error in checkForRemoteErrors(val): 3 nodes produced errors; first error: c("Error in loadNamespace(x) : there is no package called 'DESeq2'\n", "deseq")

pro_ama_table <- combine_de_tables(
  pro_ama,
  excel = glue("{excel_out}/DE_promastigote_amastigote/{ver}/pro_vs_ama_table-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'pro_ama' not found

pro_ama_sig <- extract_significant_genes(
    pro_ama_table,
    excel = glue("{excel_out}/DE_promastigote_amastigote/{ver}/pro_vs_ama_sig-v{ver}.xlsx"))

## Error in eval(expr, envir, enclos): object 'pro_ama_table' not found

9.0.0.1 Gene ontology comparing the life stages

increased_promastigote <- pro_ama_sig[["deseq"]][["ups"]][["promastigote_vs_amastigote"]]

## Error in eval(expr, envir, enclos): object 'pro_ama_sig' not found

increased_amastigote <- pro_ama_sig[["deseq"]][["downs"]][["promastigote_vs_amastigote"]]

## Error in eval(expr, envir, enclos): object 'pro_ama_sig' not found

promastigote_goseq <- simple_goseq(increased_promastigote, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_promastigote' not found

promastigote_goseq

## Error in eval(expr, envir, enclos): object 'promastigote_goseq' not found

amastigote_goseq <- simple_goseq(increased_amastigote, go_db = lp_go, length_db = lp_lengths)

## Error in eval(expr, envir, enclos): object 'increased_amastigote' not found

amastigote_goseq

## Error in eval(expr, envir, enclos): object 'amastigote_goseq' not found

## silly, topgo wants the gene id column to be 'ID', I should fix this.
colnames(lp_go) <- c("ID", "GO")
promastigote_topgo <- simple_topgo(increased_promastigote, go_db = lp_go)

## Error in h(simpleError(msg, call)): error in evaluating the argument 'sig_genes' in selecting a method for function 'simple_topgo': object 'increased_promastigote' not found

enrichplot::dotplot(promastigote_topgo$enrich_results$bp)

## Error in loadNamespace(x): there is no package called 'enrichplot'

amastigote_topgo <- simple_topgo(increased_amastigote, go_db = lp_go)

## Error in h(simpleError(msg, call)): error in evaluating the argument 'sig_genes' in selecting a method for function 'simple_topgo': object 'increased_amastigote' not found

enrichplot::dotplot(amastigote_topgo$enrich_results$bp)

## Error in loadNamespace(x): there is no package called 'enrichplot'

9.0.1 Plot promastigote/amastigote DE genes

pro_ama_table[["plots"]][["promastigote_vs_amastigote"]][["deseq_ma_plots"]]

## Error in eval(expr, envir, enclos): object 'pro_ama_table' not found

I am a little surprised by this plot, I somewhat expected there to be few genes which passed the 2-fold difference demarcation line.

pander::pander(sessionInfo())

R version 4.3.3 (2024-02-29)

Platform: x86_64-conda-linux-gnu (64-bit)

locale: C

attached base packages: stats4, stats, graphics, grDevices, utils, datasets, methods and base

other attached packages: ruv(v.0.9.7.1), hpgltools(v.1.0), Matrix(v.1.6-5), glue(v.1.7.0), SummarizedExperiment(v.1.32.0), GenomicRanges(v.1.54.1), GenomeInfoDb(v.1.38.8), IRanges(v.2.36.0), S4Vectors(v.0.40.2), MatrixGenerics(v.1.14.0), matrixStats(v.1.3.0), Biobase(v.2.62.0), BiocGenerics(v.0.48.1) and Heatplus(v.3.10.0)

loaded via a namespace (and not attached): RColorBrewer(v.1.1-3), jsonlite(v.1.8.8), magrittr(v.2.0.3), rmarkdown(v.2.26), fs(v.1.6.4), BiocIO(v.1.12.0), zlibbioc(v.1.48.2), vctrs(v.0.6.5), memoise(v.2.0.1), Rsamtools(v.2.18.0), RCurl(v.1.98-1.14), htmltools(v.0.5.8.1), S4Arrays(v.1.2.1), curl(v.5.2.1), SparseArray(v.1.2.4), sass(v.0.4.9), KernSmooth(v.2.23-22), bslib(v.0.7.0), desc(v.1.4.3), htmlwidgets(v.1.6.4), testthat(v.3.2.1.1), plyr(v.1.8.9), plotly(v.4.10.4), cachem(v.1.0.8), GenomicAlignments(v.1.38.2), mime(v.0.12), lifecycle(v.1.0.4), iterators(v.1.0.14), pkgconfig(v.2.0.3), R6(v.2.5.1), fastmap(v.1.1.1), GenomeInfoDbData(v.1.2.11), shiny(v.1.8.1.1), digest(v.0.6.35), colorspace(v.2.1-0), AnnotationDbi(v.1.64.1), rprojroot(v.2.0.4), pkgload(v.1.3.4), RSQLite(v.2.3.6), filelock(v.1.0.3), fansi(v.1.0.6), mgcv(v.1.9-1), httr(v.1.4.7), abind(v.1.4-5), compiler(v.4.3.3), pander(v.0.6.5), doParallel(v.1.0.17), bit64(v.4.0.5), BiocParallel(v.1.36.0), DBI(v.1.2.2), highr(v.0.10), gplots(v.3.1.3.1), DelayedArray(v.0.28.0), corpcor(v.1.6.10), rjson(v.0.2.21), HDO.db(v.0.99.1), caTools(v.1.18.2), gtools(v.3.9.5), tools(v.4.3.3), zip(v.2.3.1), httpuv(v.1.6.15), restfulr(v.0.0.15), nlme(v.3.1-164), GOSemSim(v.2.28.1), promises(v.1.3.0), grid(v.4.3.3), reshape2(v.1.4.4), sva(v.3.50.0), fgsea(v.1.28.0), generics(v.0.1.3), gtable(v.0.3.5), preprocessCore(v.1.64.0), tidyr(v.1.3.1), data.table(v.1.15.4), utf8(v.1.2.4), XVector(v.0.42.0), foreach(v.1.5.2), pillar(v.1.9.0), stringr(v.1.5.1), yulab.utils(v.0.1.4), limma(v.3.58.1), genefilter(v.1.84.0), later(v.1.3.2), splines(v.4.3.3), dplyr(v.1.1.4), BiocFileCache(v.2.10.2), lattice(v.0.22-6), survival(v.3.6-4), rtracklayer(v.1.62.0), bit(v.4.0.5), annotate(v.1.80.0), tidyselect(v.1.2.1), GO.db(v.3.18.0), locfit(v.1.5-9.9), Biostrings(v.2.70.3), knitr(v.1.46), gridExtra(v.2.3), edgeR(v.4.0.16), xfun(v.0.43), statmod(v.1.5.0), brio(v.1.1.5), stringi(v.1.8.4), lazyeval(v.0.2.2), yaml(v.2.3.8), evaluate(v.0.23), codetools(v.0.2-20), tibble(v.3.2.1), qvalue(v.2.34.0), BiocManager(v.1.30.23), graph(v.1.80.0), cli(v.3.6.2), xtable(v.1.8-4), munsell(v.0.5.1), jquerylib(v.0.1.4), Rcpp(v.1.0.12), dbplyr(v.2.5.0), png(v.0.1-8), fastcluster(v.1.2.6), XML(v.3.99-0.16.1), parallel(v.4.3.3), ggplot2(v.3.5.1), blob(v.1.2.4), DOSE(v.3.28.2), bitops(v.1.0-7), viridisLite(v.0.4.2), GSEABase(v.1.64.0), scales(v.1.3.0), openxlsx(v.4.2.5.2), purrr(v.1.0.2), crayon(v.1.5.2), rlang(v.1.1.3), cowplot(v.1.1.3), fastmatch(v.1.1-4) and KEGGREST(v.1.42.0)

message(paste0("This is hpgltools commit: ", get_git_commit()))

## If you wish to reproduce this exact build of hpgltools, invoke the following:

## > git clone http://github.com/abelew/hpgltools.git

## > git reset

## This is hpgltools commit:

message(paste0("Saving to ", savefile))

## Saving to 03differential_expression.rda.xz

tmp <- sm(saveme(filename = savefile))

## Error in save(list = ls(all.names = TRUE, envir = globalenv()), envir = globalenv(), : ignoring SIGPIPE signal

tmp <- loadme(filename = savefile)