Skip to content

Not enough memory at reduce_dimentionality step #33

Description

@alicekao1118

Before the reduce_dimentioality step, I've done several steps to change my input dataset:

  1. Using gather() to transform my dataset to the correct format ( 39,543,942 entries, 3 total columns)
  2. Before proceeding to reduce dimentionality sfunction, I transformed my expression data to "matrix" type
  3. Then my program stops here, telling that it needs 294.6GB to process the vectors.

Anyone has any suggestions for this?

Thank you so much!!

Activity

  1. rcannood commented on Aug 2, 2021

    @rcannood
    Owner

    Can you show me the head of your dataset? You may want to run Matrix::sparseMatrix(...) to create a sparse matrix from your input data.

  2. alicekao1118 commented on Aug 2, 2021

    @alicekao1118
    Author

    Do you mean instead of using matrix, I can substitute for sparseMatrix?

    Attach the screenshot for my head of the dataset, also the code below.
    Screen Shot 2021-08-02 at 4 11 38 PM

    `
    data2 <- read.table("~/Downloads/Exp_BM_cluster_EC.txt", row.names = NULL)

    library (tidyr)
    data_long <- gather(data2, key = "sample_info", value = "expression", 2:1290)
    (coerce1 <- as.matrix(data_long$expression))

    space <- reduce_dimensionality(coerce1, ndim = 2)
    traj <- infer_trajectory(space)
    `

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions