Clarification Needed : Docker Containers are Not Releasing Memory
Hey Team,
Our Migration Application is built in java for migrating data into hyperledger fabric 2.2 using Java SDk to connect to HLF Network.
We are processing data in batches of 4000 Records in a Scheduler and Scheduler runs after every 1 min interval.
We migrated 40,000 Records in 10 minutes in after which, 993.689 Mb was occupied by Docker Containers(Peers , Orderers, CouchDB , CA , Chaincode).
we stopped the java process and kept the system Idle and After 1 Hour it released around 200 Mb only.
We are Trying to migrate 25 Lakhs data . After running the scheduler multiple times, system is getting Stopped (no memory available) .
JVM is not leaking any memory , we have confirmed That.
I want to understand Why Docker Containers are Not Releasing Memory ? Where is The Memory Leak Happening ?
Please assist!
Thanks,
Saundarya Saurabh
Sr. Associate Consultant (Blockchain)
Infosys Limited
Are you sure there is a memory leak? Perhaps 1GB is the steady state usage for this combination of containers. It is typical to remain at the steady state level rather than free up much memory. Does the memory continue to grow beyond the 1GB steady state when additional transactions are sent? Which container(s) continue to grow?
From:
fabric@... <fabric@...> on behalf of Saundarya Saurabh via lists.hyperledger.org <saundarya.saurabh=infosys.com@...>
Date: Friday, October 7, 2022 at 11:11 AM
To: hyperledger-fabric@... <hyperledger-fabric@...>
Cc: Sayan Ghosal <sayan.ghosal@...>, Viraj Shelar <viraj.shelar@...>
Subject: [EXTERNAL] [Hyperledger Fabric] Clarification Needed : Docker Containers are Not Releasing Memory
Hey Team, Our Migration Application is built in java for migrating data into hyperledger fabric 2. 2 using Java SDk to connect to HLF Network. We are processing data in batches of 4000 Records in a Scheduler and Scheduler runs after every 1
ZjQcmQRYFpfptBannerStart
|
ZjQcmQRYFpfptBannerEnd
Hey Team,
Our Migration Application is built in java for migrating data into hyperledger fabric 2.2 using Java SDk to connect to HLF Network.
We are processing data in batches of 4000 Records in a Scheduler and Scheduler runs after every 1 min interval.
We migrated 40,000 Records in 10 minutes in after which, 993.689 Mb was occupied by Docker Containers(Peers , Orderers, CouchDB , CA , Chaincode).
we stopped the java process and kept the system Idle and After 1 Hour it released around 200 Mb only.
We are Trying to migrate 25 Lakhs data . After running the scheduler multiple times, system is getting Stopped (no memory available) .
JVM is not leaking any memory , we have confirmed That.
I want to understand Why Docker Containers are Not Releasing Memory ? Where is The Memory Leak Happening ?
Please assist!
Thanks,
Saundarya Saurabh
Sr. Associate Consultant (Blockchain)
Infosys Limited