# Terra warp-pipelines out of memory issue

**URL:** <https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321>\
**Category:** Help\
**Tags:** terra\
**Created:** [July 23, 2025, 7:32pm UTC](https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321 "2025-07-23T19:32:20Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![yxhan](https://avatars.discourse-cdn.com/v4/letter/y/ee59a6/32.png) [@yxhan](https://help.anvilproject.org/u/yxhan)\
**Post date:** [July 23, 2025, 7:32pm UTC](https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321/1 "2025-07-23T19:32:20Z")

</div>

Hello~  
I am using the Terra workflow [warp-pipelines/1-WholeGenomeGermlineSingleSample] to try the variants calling. The input files are the uBAMs, which size ranges from 4GB - 40GB for each. As we did high depth WGS, there are about 10 uBAM for each sample, which might be the reason that lead to the “out of memory” error.  
_|[UnmappedBamToAlignedBam](https://job-manager.dsde-prod.broadinstitute.org/jobs/ccd9a6fd-bcda-4c95-b3cf-1abbc3877cd6)||stderr for job `UnmappedBamToAlignedBam.MarkDuplicates:NA:1` contained one of the `memory-retry-error-keys: [OutOfMemory,Killed]` specified in the Cromwell config. Job might have run out of memory._

I submit jobs with data table and the latest try was using:  
MarkDuplicates - additional\_disk - 500; memory\_multiplier - 10  
GatherBamFiles - additional\_disk - 200; memory\_multiplier - 2

I would very grateful if anyone could help me to optimize the parameters for this workflow run through.

---

<div class="post-metadata">

**Author:** ![Javier-CP](https://yyz1.discourse-cdn.com/flex027/user_avatar/help.anvilproject.org/javier-cp/32/168_2.png) [@Javier-CP](https://help.anvilproject.org/u/Javier-CP)\
**Post date:** [July 24, 2025, 7:06pm UTC](https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321/2 "2025-07-24T19:06:02Z")

</div>

Hi @yxhan

I am opening a ticket with Terra support and will get back to you as soon as we get an answer.

Javier

---

<div class="post-metadata">

**Author:** ![yxhan](https://avatars.discourse-cdn.com/v4/letter/y/ee59a6/32.png) [@yxhan](https://help.anvilproject.org/u/yxhan)\
**Post date:** [July 24, 2025, 7:29pm UTC](https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321/3 "2025-07-24T19:29:34Z")

</div>

You are very much appreciated, @Javier-CP

---

<div class="post-metadata">

**Author:** ![Javier-CP](https://yyz1.discourse-cdn.com/flex027/user_avatar/help.anvilproject.org/javier-cp/32/168_2.png) [@Javier-CP](https://help.anvilproject.org/u/Javier-CP)\
**Post date:** [July 24, 2025, 8:54pm UTC](https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321/4 "2025-07-24T20:54:13Z")

</div>

@yxhan From Terra support:

> It sounds like the user believes their workflow is failing due to insufficient memory, which is common. If that’s the case, they can try increasing the `memory_multiplier` value they’re setting for the individual tasks. Unfortunately, we can’t provide any recommendations around optimization and exactly _how much_ to increase memory by so that’ll be up to the user to test out and determine for themselves based on their inputs.  
> If the user is willing to share their workspace with Terra Support, we can certainly take a look at the failed submission and see if there could be anything else causing the workflow to fail.

---

<div class="post-metadata">

**Author:** ![yxhan](https://avatars.discourse-cdn.com/v4/letter/y/ee59a6/32.png) [@yxhan](https://help.anvilproject.org/u/yxhan)\
**Post date:** [July 24, 2025, 9:09pm UTC](https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321/5 "2025-07-24T21:09:00Z")

</div>

Thanks, @Javier-CP  
I tried once again with increased memory\_multiplier as well as additional\_disk but failed with similar out of memory error.  
I am happy to share my workspace with the Terra team if you could suggest which account I should share with.

---

<div class="post-metadata">

**Author:** ![Javier-CP](https://yyz1.discourse-cdn.com/flex027/user_avatar/help.anvilproject.org/javier-cp/32/168_2.png) [@Javier-CP](https://help.anvilproject.org/u/Javier-CP)\
**Post date:** [July 25, 2025, 1:40pm UTC](https://help.anvilproject.org/t/terra-warp-pipelines-out-of-memory-issue/321/6 "2025-07-25T13:40:25Z")

</div>

@yxhan

From Terra support:

> The Share option is in the three-dots menu at the top-right.
> 
> 1. Toggle the “Share with support” button to “Yes”
> 2. Click **Save**  
> ![share-with-support](https://canada1.discourse-cdn.com/flex027/uploads/anvil/original/1X/88c1167e87ea3a229ea9042eb9a2971a68616aaa.png)
> 
> Please provide us with
> 
> 1. A link to your workspace
> 2. The relevant submission ID
> 3. The relevant workflow ID

If you’d prefer to share the info privately, you can email it to [help@lists.anvilproject.org](mailto:help@lists.anvilproject.org).

Javier
