qortal

Commit Graph

Author	SHA1	Message	Date
CalDescent	30347900d9	Tidied up one last place that was accessing immutableConnectedPeers directly. This makes no difference, but helps with code consistency.	3 years ago
CalDescent	e5f88fe2f4	Synchronize arbitrary data list removals, as it seems that SynchronizedList and SynchronizedMap aren't overriding removeIf() with a thread-safe version.	3 years ago
CalDescent	0d0ccfd0ac	Small refactor for code simplicity.	3 years ago
CalDescent	9013d11d24	Report as 100% synced if the latest block is within the last 30 mins This should hopefully reduce confusion due to APIs reporting 99% synced even though up to date. The systray should never show this since it already treats blocks in the last 30 mins as synced.	3 years ago
CalDescent	fc5672a161	Use a more tolerant latest block timestamp in the isUpToDate() calls below to reduce misleading systray statuses. Any block in the last 30 minutes is considered "up to date" for the purposes of displaying statuses.	3 years ago
CalDescent	221c3629e4	Don't refetch the file list if the fileListCache is empty, since an empty list now means that there are likely to be no files available on disk.	3 years ago
CalDescent	76fc56f1c9	Fetch the file list in getFilenameForHeight() if needed.	3 years ago
CalDescent	8e59aa2885	Peer getter methods renamed to include "immutable", for consistency with underlying lists and also to make it clearer to the callers.	3 years ago
CalDescent	0738dbd613	Avoid direct access to this.connectedPeers, as we need to use the immutable copy.	3 years ago
CalDescent	196ecffaf3	Skip calls to this.logger.trace() in ExecuteProduceConsume.run() if trace logging isn't enabled. This could very slightly reduce load due to skipping the internal filtering inside log4j. Given that this method is causing major problems with CPU at times, I'm trying to make it as optimized as possible.	3 years ago
CalDescent	a0fedbd4b0	Implemented suggestions from catbref to avoid potential thread safety issue in peer arrays.	3 years ago
CalDescent	7c47e22000	Set fileListCache to null when invalidating.	3 years ago
CalDescent	6aad6a1618	fileListCache is now an immutable Map, which is thread safe. Thanks to catbref for this idea.	3 years ago
CalDescent	b764172500	Revert "Hopeful fix for ConcurrentModificationException in BlockArchiveReader.getFilenameForHeight()" This reverts commit `a12ae8ad24`.	3 years ago
CalDescent	c185d79672	Loop through all available direct peer connections and try each one in turn. Also added some extra conditionals to avoid repeated attempts with the same port.	3 years ago
CalDescent	76b8ba91dd	Only add an entry to directConnectionInfo if one with this peer-signature combination doesn't already exist.	3 years ago
CalDescent	0418c831e6	Direct connections with peers now prefer those with the highest number of chunks for a resource. Once a connection has been attempted with a peer, remove it from the list so that it isn't attempted again in the same round.	3 years ago
CalDescent	4078f94caa	Modified GetArbitraryDataFileListMessage to allow requesting peer's address to be optionally included. This can ultimately be used to notify the serving peer to expect a direct connection from the requesting peer (to allow it to temporarily bypass maxConnections for long enough for the files to be retrieved). Or it could even possibly be used to trigger a reverse connection (from the serving peer to the requesting peer).	3 years ago
CalDescent	a12ae8ad24	Hopeful fix for ConcurrentModificationException in BlockArchiveReader.getFilenameForHeight()	3 years ago
CalDescent	498ca29aab	Wait until a successful connection with a peer before tracking the direct request.	3 years ago
CalDescent	ba70e457b6	Default chunk size reduced from 1MB to 0.5MB	3 years ago
CalDescent	d62808fe1d	Don't attempt to create the data directory every time an ArbitraryDataFile instance is instantiated. This was using excessive amounts of CPU and disk I/O.	3 years ago
CalDescent	6c14b79dfb	Removed bootstrap host that is no longer functional.	3 years ago
CalDescent	631a253bcc	Added support for dark theme in loading screen.	3 years ago
CalDescent	4cb63100d3	Drop the ArbitraryPeers table as it's no longer needed	3 years ago
CalDescent	42fcee0cfd	Removed all code that interfaced with the ArbitraryPeers table	3 years ago
CalDescent	829a2e937b	Removed all arbitrary signature broadcasts	3 years ago
CalDescent	5d7e5e8e59	Dropped support of ARBITRARY_SIGNATURES message handling, as this feature has been superseded by the peerAddress in file list requests.	3 years ago
CalDescent	6f0a0ef324	Small refactor	3 years ago
CalDescent	f7fe91abeb	sendOurOnlineAccountsInfo() moved to its own thread, in preparation for mempow	3 years ago
CalDescent	7252e8d160	Deleted presence tests, as they are no longer relevant, and aren't easily adaptable to the new approach.	3 years ago
CalDescent	2630c35f8c	Chunk validation now uses MAX_CHUNK_SIZE rather than CHUNK_SIZE, to allow for a smaller CHUNK_SIZE value to be optionally used, without failing the validation of existing resources.	3 years ago
CalDescent	49f466c073	Added missing break;	3 years ago
CalDescent	c198f785e6	Added significant CPU optimizations to ArbitraryDataManager - Slow down loops that query the db - Check for new metadata every 5 minutes instead of constantly - Check for new data every 1 minute instead of constantly This could be further improved in the future by having block.process() notify the ArbitraryDataManager that there is new data to process. This would avoid the need for the frequent checks/loops, and only a single complete sweep would be needed on node startup (as long as failures are then retried). But I will avoid this additional complexity for now.	3 years ago
CalDescent	5be093dafc	Fix for "Synchronizing null%" systray bug introduced in 3.2.0	3 years ago
CalDescent	2c33d5256c	Added code accidentally missed out of commit `1b036b7`	3 years ago
CalDescent	4448e2b5df	Handle case when metadata isn't returned.	3 years ago
CalDescent	146d234dec	Additional defensiveness in ArbitraryDataFile.fromHash() to avoid similar future bugs.	3 years ago
CalDescent	18d5c924e6	Fixed bug cased by fetchAllMetadata()	3 years ago
CalDescent	b520838195	Increased default maxNetworkThreadPoolSize from 20 to 32 This will hopefully offset some of the additional network demands from arbitrary data requests.	3 years ago
CalDescent	1b036b763c	Major CPU optimization to block minter Load sorted list of reward share public keys into memory, so that the indexes can be obtained. This is around 100x faster than querying each index separately (and the savings will increase as more keys are added). For 4150 reward share keys, it was taking around 5000ms to query individually, vs 50ms using this approach. The main trade off is that these 4150 keys require around 130kB of additional memory when minting (and this will increase proportionally with more minters). However, this one query was often accounting for 50% of the entire core's CPU usage, so the additional memory usage seems insignificant by comparison. To gain confidence, I ran both old and new approaches side by side, and confirmed that the indexes matched exactly.	3 years ago
CalDescent	8545a8bf0d	Automatically fetch metadata for all resources that have it.	3 years ago
CalDescent	f0136a5018	Include the external port when responding ArbitraryDataFileListRequests	3 years ago
CalDescent	6697b3376b	Direct peer connections now use the on-demand data retrieved from file list requests, rather than the stale and incomplete ArbitraryPeerData.	3 years ago
CalDescent	ea785f79b8	Removed unnecessary synchronization	3 years ago
CalDescent	0352a09de7	New online accounts are now verified on the OnlineAccountsManager thread rather than on network threads. This is an attempt to reduce the amount of blocked network threads due to signature verification, and is necessary for the upcoming mempow addition.	3 years ago
CalDescent	5b4f15ab2e	Transaction importing code moved to TransactionImporter controller class As with online accounts, no logic changes other than moving transaction queue processing from the controller thread to its own dedicated thread.	3 years ago
CalDescent	fd37c2b76b	Moved all online accounts code to a new OnlineAccountsManager controller class There are no logic changes here other than moving performOnlineAccountsTasks() onto its own thread, so that it's not subject to anything that might be slowing down the main controller thread.	3 years ago
CalDescent	924aa05681	Optimized peer lists - Removed synchronization from connectedPeers, and replaced it with an unmodifiableList. - Added additional immuatable caches: handshakedPeers and outboundHandshakedPeers This should greatly reduce the amount of time spent waiting around for access to the connectedPeers array, since it is now immediately accessible without needing to obtain a lock. It also removes calls to stream() which were consuming large amounts of CPU to constantly filter the connected peers down to a list of handshaked peers. Thanks to @catbref for these great suggestions.	3 years ago
CalDescent	84b42210f1	Use ArbitraryDataFileRequestThreads only - instead of reusing file list response threads.	3 years ago

1 2 3 4 5 ...

2431 Commits (30347900d9aa7253ed7ed2e39f06f4edc45f06dd) All Branches Search

2431 Commits (30347900d9aa7253ed7ed2e39f06f4edc45f06dd)

All Branches