Thanks! @cori, it might be helpful to update your post here to reflect what @etamponi said.
I’m now seeing a sudden “jump” from ~190mb to 500mb just before the “exceeded” message:
And watching htop
at the same time shows that it jumps from this:
To this (just before the “exceeded” message):
Could very well be something wrong with the module, but it seems very strange and I’m pretty sure I had the same problem with the lzma-native
module. I’ll keep investigating.
Update: Looks like it is a problem with the node-zstd
module. The lzma-native
module processes a similar file well past the 10k lines mark (it’s at 30k as of writing with no sign of stopping):
https://glitch.com/edit/#!/exceeded-memory-limit-lzma-native