镜像站点 · 本页由第三方 GitHub 只读镜像提供,非 GitHub 官方站点,不接受任何登录或凭据输入。前往 github.com
Skip to content

Suspect memory leak in v6.10.1 #12033

Description

@stefanosala
  • Version: v6.10.1
  • Platform: Linux f227befc-7ce9-41a4-9b09-363eac11b499 3.13.0-112-generic Added DS_Store to gitignore #159-Ubuntu SMP Fri Mar 3 15:26:07 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
  • Subsystem:

Hi there, we noticed a weird behaviour after upgrading to v6.10.1 from v6.10.0. Basically we see memory accumulating until Heroku restarts the process.

You can better notice the behaviour in this graph:

v1314 is the upgrade to v6.10.1, v1315 is the rollback to v6.10.0.

We start the process with this command: NODE_ICU_DATA=node_modules/full-icu node --max-old-space-size=900 lib/processes/oneInstance.js.

Help? :) Please let me know if and how we can provide more useful info.

Thanks a lot.
Stefano

Activity

  1. stefanosala commented on Mar 25, 2017

    @stefanosala
    Author

    We had a similar behaviour when we tried node v7, I'm not sure if that helps :)

  2. added
    memoryIssues and PRs related to Node.js memory management or memory footprint.
    on Mar 25, 2017
  3. cjihrig commented on Mar 25, 2017

    @cjihrig
    Contributor

    @stefanosala do you have any code you can share?

  4. stefanosala commented on Mar 25, 2017

    @stefanosala
    Author

    @cjihrig we haven't isolated the issue yet, I'm sorry :(

  5. joyeecheung commented on Mar 25, 2017

    @joyeecheung
    Member

    You mentioned this behavior also presents in v7, can you provide the specific version of that release? Cross comparing it with #11759 we might be able to find the related commit.

  6. lpinca commented on Mar 25, 2017

    @lpinca
    Member

    Possibly related: #12019.

  7. stefanosala commented on Mar 25, 2017

    @stefanosala
    Author

    Yep, we had the same issue with v7.6.0.

  8. SuperTux88 commented on Mar 26, 2017

    @SuperTux88

    I have the same behaviour after upgrading to 6.10.1 with camo, started with this command: /usr/bin/node /srv/camo/node_modules/.bin/coffee server.coffee.

  9. dvfeinblum commented on Mar 27, 2017

    @dvfeinblum

    I also see similar issues. My child processes are utilizing more ram than they are provisioned (using the --max_old_space_size flag) and I'm seeing a linear increase in memory usage.

    Edit: Bit more information. I am using child_process.exec() to fire off my workers and switching to 6.9 has fixed the problem. Memory is no longer increasing linearly and I'm only using 15gb as opposed to maxing out the 30 I have at my disposal. Scripts also seem to be respecting the 1.5 gb I'm giving each of them now.

  10. kmikiy commented on Mar 28, 2017

    @kmikiy

    I've also had the same issue
    6.10.0 works fine
    6100 - lassitva -no date

    6.10.1 starts leaking
    6101 - lassitva - no date

    7.5.0 also works fine
    7050 - lassitva - no date

    7.6.0 and up starts leaking
    7060 - lassitva - no date

    Same code was running all 4 times, only changed the node version.

  11. joyeecheung commented on Mar 28, 2017

    @joyeecheung
    Member

    Excluding benchmark, doc, meta, test, tools and build, these are the PRs both added in v6.10.1 and v7.6.0 (obtained by scripting the OP of #11185 and #11759, I might be missing something though..)

  12. MylesBorins commented on Mar 28, 2017

    @MylesBorins
    Contributor

    @joyeecheung thank you so much for compiling that list

    @nodejs/lts @nodejs/collaborators do any of the above prs stand out to you?

  13. addaleax commented on Mar 28, 2017

    @addaleax
    Member

    src: unconsume stream fix in internal http impl #11015

    Seems like the most likely candidate from the list by far … /cc @Kasher @jasnell @indutny

  14. 4 remaining items

  15. MylesBorins commented on Mar 28, 2017

    @MylesBorins
    Contributor

    As it would appear that the memory leak is also appear on v4.x I've gone ahead and made a list of commits that appears in v4.8.1, v6.10.1, and v7.6.0. It is much smaller

    edit: @nodejs/streams do you think #11015 could have caused a leak?

  16. shigeki commented on Mar 28, 2017

    @shigeki
    Contributor

    TLS and HTTP client memory leaks were fixed in a6f9494.
    I'm sure it fixes this. Please test it.

    I apology my bug in my commit and thanks for everyone helping and identifying the issues.

  17. stefanosala commented on Mar 28, 2017

    @stefanosala
    Author

    @shigeki thanks a lot and thanks to everybody else involved, we appreciate a lot! :)

    I'll test the new release asap.

  18. dvfeinblum commented on Mar 28, 2017

    @dvfeinblum

    Yeah, thanks a bunch for fixing this! We'll give this patch a go next time we run our job.

  19. stefanosala commented on Mar 29, 2017

    @stefanosala
    Author

    Stats are looking good with v7.8.0, thanks again!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    memoryIssues and PRs related to Node.js memory management or memory footprint.

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions