Repository navigation
MemoryPressureNotification got executed on the wrong platform #17859
Description
I'm using the new MultiIsolatePlatform feature added in v9.3.0.
I have following code running in a new node isolate which has its own thread loop. But it have a check failure error when trying to find isolate on the platform.
static node::MultiIsolatePlatform* platform = node::CreatePlatform(4, nullptr);
node::IsolateData* isolateData = node::CreateIsolateData(thread_isolate, thread_loop, platform);
thread_isolate->MemoryPressureNotification(v8::MemoryPressureLevel::kCritical);
The thread isolate is registered to the newly create platform when creating isolate data in line 2.
However, line 3 leads to a CHECK failure when trying to find this thread isolate because the platform instance here is returned from V8::GetCurrentPlatform() and it's not the one I created. Here's the callstack:
1: node::Abort
2: node::Assert
3: node::NodePlatform::ForIsolate
4: node::NodePlatform::CallDelayedOnForegroundThread
5: v8::internal::Heap::CheckMemoryPressure
6: v8::internal::Heap::MemoryPressureNotification
7: v8::Isolate::MemoryPressureNotification
I'm not sure if I'm using this feature correctly. Could somebody advise?
Activity
bnoordhuis commentedon Dec 25, 2017
The stack trace suggests you haven't actually called
CreateIsolateData()yet. Check in a debugger whatplatform->per_isolate_contains at the time of the crash.levimm commentedon Dec 25, 2017
@bnoordhuis platform->per_isolate_ contains the node main isolate.
As I mentioned, I run the previous code in a newly created separate isolate. And the thread isolate is added to the platform I created. But V8::GetCurrentPlatform gives me another platform, which I think is the main platform.
bnoordhuis commentedon Dec 25, 2017
Right, that's not going to work. The Platform is a singleton, there can only be one instance per process.
levimm commentedon Dec 25, 2017
@bnoordhuis Thank you for the explanation.
Is there any API to get the platform instance so I can register isolate into that?
bnoordhuis commentedon Dec 25, 2017
static_cast<node::NodePlatform*>(v8::V8::GetCurrentPlatform())should do it.levimm commentedon Dec 26, 2017
But this one is declared as V8_EXPORT_PRIVATE and it's not in the v8.h for external usage.
bnoordhuis commentedon Dec 27, 2017
No, but you mentioned that you were already using it. There's no public API at the moment.
You shouldn't really need one either because as an embedder you control the platform instance. If you are trying to create a second node instance in another thread - don't, node is not thread-safe.
levimm commentedon Dec 27, 2017
Actually I'm not directly using
v8::V8::GetCurrentPlatform()since I can't.I'm calling
MemoryPressureNotificationand then node internal code invokesV8::GetCurrentPlatform(). Is it possible to add something likenode::GetCurrentPlatformto return this instance?Btw, what's the point of recently exported
node::CreatePlatformto create another platform if this is singleton?bnoordhuis commentedon Dec 27, 2017
Can you go in more detail about what you are trying to do?
As I mentioned, if you are the embedder, then you already control the platform; and if you are not the embedder, then there should be no need to touch the platform.
It does things V8's basic platform doesn't. (Not that I personally think it's useful to export, or at least for the reasons it was made public for, but that's a separate discussion.)
levimm commentedon Dec 29, 2017
Thanks for the explanation.
I'm trying to build a multi-thread addin by creating new isolates in new thread (I'll handle the thread sync issue). I need a way to register those new isolates in the default platform with only node dependency.
bnoordhuis commentedon Dec 29, 2017
You could open a PR that adds that API and see how it's received. Grep src/node.cc for
v8_platform, it's itsplatform_member.I'm curious how. IIUC, that's only safe when you suspend the main thread until your thread is done but that kind of heavy-weight serialization defeats the purpose of using threads.
devsnek commentedon Dec 29, 2017
@bnoordhuis I'm actually doing mostly the same thing, atm if you use them correctly it's totally worth it. while serdes is definitely a pain if you aren't moving obscenely large objects around it's fine.
bnoordhuis commentedon Dec 29, 2017
Are we talking about the same thing? I mean serialization as in synchronization, the opposite of parallelization, not data marshaling.
levimm commentedon Jan 2, 2018
I'll try to follow the guideline and create a pr.
Actually my addon doesn't need to communicate between threads. Each thread communicates to another component through tcp socket.
levimm commentedon Jan 2, 2018
I tried to register this new isolate in the default platform. MemoryPressureNotification works fine.
But I got another error when the js script is about to finish:
The cause is this line when trying to get Environment of this new isolate.
I tried two ways in order to fix this:
node::CreateEnvironment(isolate_data, isolate_context, 0, nullptr, 0, nullptr);but got more HandleScope error.node::FreeIsolateData(isolate_data);as soon as I can to avoid running foreground tasks. Didn't work either.Could you advise?
levimm commentedon Apr 11, 2018
I made it work by shutdown the original platform and then initialize it again with multiIsolatePlatform.
Does it sounds reasonable? @bnoordhuis
bnoordhuis commentedon Apr 11, 2018
If it works, it works. The shutdown takes place while there is no active isolate? I think you should be good in that case.
levimm commentedon Apr 12, 2018
Thanks