CalDescent
1613375cc0
Added more validation of files received in GET /data/file/frompeer
3 years ago
CalDescent
787ef957d2
Added support for uploading an entire directory via POST /data/upload/path
...
If a directory is specified instead of a file, the directory is automatically zipped before being split into chunks.
3 years ago
CalDescent
b915d0aed5
Only create the output file directories when we are actually writing a file there. This should prevent empty directories being created when initializing a nonexistent DataFile using a hash.
3 years ago
CalDescent
16dc5b5327
Include the data length in DataFileMessage, which is more similar to the approach used by ArbitraryDataMessage. These two message types are very similar, except arbitrary code currently has a requirement of one piece of data per signature, whereas DataFile code is independent and can support multiple files per transaction. Maybe the two can be combined at some point, but for now I'll keep them separate.
3 years ago
CalDescent
c2d0c63db0
Improved error logging.
3 years ago
CalDescent
f5c9807a48
Use contains() rather than equals() when matching a peer in /data/file/frompeer, so that the port can be optionally left out.
3 years ago
CalDescent
7e9b1d5e16
Rework of DataFile.base58Digest()
...
This fixes an NPE when trying to send a file that doesn't exist. It also removes the caching, which we can add again later if it turns out to be needed.
3 years ago
CalDescent
5070c4eea9
Better handling of data file responses in the /data/file/frompeer API endpoint.
3 years ago
CalDescent
33d9c51b6f
Validate supplied base58 string in /data/file/frompeer API endpoint
3 years ago
CalDescent
d0f9d478c2
Fixed bug which prevented the DATA_FILE message ID from making it through to the reply queue.
3 years ago
CalDescent
f296ec46c8
Removed unused headers.
3 years ago
CalDescent
64d19e480b
Chunk size set to 1MB for now, as it seems that our networking code has problems when transferring 2MB chunks. We can increase this later once that problem has been fixed.
3 years ago
CalDescent
8e35f131d5
Removed debugging log that wasn't intended to be committed.
3 years ago
CalDescent
aafb9d7e4f
Include running total in "Sent X bytes" log entry.
3 years ago
CalDescent
652f30bdbd
Added DATA_FILE and GET_DATA_FILE message types.
3 years ago
CalDescent
f4ba7b2a0c
Added onNetworkGetDataFileMessage() handler
3 years ago
CalDescent
592490d709
Added GET /data/file/frompeer API endpoint
...
This requests a file from the supplied peer address, and stores a copy locally if successful. Still a work in progress.
3 years ago
CalDescent
5ac676d201
Added DataFileMessage and GetDataFileMessage, used for requesting and sending files between peers.
3 years ago
CalDescent
abfe0a925a
More DataFile methods and improvements
3 years ago
CalDescent
fa11f4f45b
Moved DataFileChunk(byte[] fileContent) constructor to the superclass so it can be used by regular data files too.
3 years ago
CalDescent
1e8dbfe4b7
Delete chunk if it fails the hash validation in the constructor.
3 years ago
CalDescent
f82f2bd287
Added DELETE /data/file API endpoint
...
This deletes a file referenced by a user supplied SHA256 digest string (which we will use as the file's "ID" in the Qortal data system). In the future this could be extended to delete all associated chunks, but first we need to build out the data chain so we have a way to look up chunks associated with a file hash.
3 years ago
CalDescent
76742c3869
Removed .dat extension, and use an extra level in the directory structure (data/aB/cD/aBcDeF... etc)
3 years ago
CalDescent
9407e7e418
Data storage location moved to settings ("dataPath")
3 years ago
CalDescent
120552b36e
Added resource file missing from last commit.
3 years ago
CalDescent
9fb58c7ae3
Added the beginnings of an upload API, with some basic data file management.
3 years ago
CalDescent
b917da765c
Removed block 212937
3 years ago
CalDescent
cc59510cd0
Removed all cross-chain code. It's not needed for data nodes.
3 years ago
CalDescent
86aab7023c
Initial settings for data node development. Most to be decided later.
3 years ago
CalDescent
e3b0a41ba9
Merge branch 'sync-multiple-blocks'
3 years ago
CalDescent
802c55dfc8
Merge branch 'networking'
3 years ago
CalDescent
280f7814aa
Merge branch 'master' of github.com:Qortal/qortal
3 years ago
CalDescent
3174681bd8
Removed /src/main/resources/log*.properties from .gitignore
...
We must be careful not to add files to the resources folder accidentally, given that a bundled log4j2.properties file is used in preference to the user's copy. By keeping this out of gitignore, it becomes more obvious if a file is added, and it can then be caught and removed before a release.
3 years ago
CalDescent
853f80b928
Updates to build-zip.sh and build-release.sh
...
There were necessary for these scripts to function in my build environment (Mac OSX). This may give errors when running in other environments, but we can deal with that in future, when others need to use these scripts.
3 years ago
CalDescent
8bdad377d7
Removed outdated qortal.jar from "WindowsInstaller/Install Files" directory.
...
Including an older JAR in the source code only leads to confusion, because a zip of the source code is automatically included with each github release. From what I can see, there is no need for it to be here. Added to .gitignore so we have the option of keeping a local copy.
3 years ago
CalDescent
9e1c2a5bd1
Updated AdvancedInstaller project for v1.5.4
3 years ago
CalDescent
b1777b6011
Bump version to 1.5.4
3 years ago
CalDescent
904be3005f
Enable fast sync by default.
3 years ago
CalDescent
95eaf4c887
Merge branch 'master' into sync-multiple-blocks
3 years ago
CalDescent
e3923b7b22
Fixed issue causing frequent disconnects (found by szisti)
...
When sending or requesting more than 1000 online accounts, peers would be disconnected with an EOF or connection reset error due to an intentional null response. This response has been removed and it will instead now only send the first 1000 accounts, which prevents the disconnections from occurring.
In theory, these accounts should be in a different order on each node, so the 1000 limit should still result in a fairly even propagation of accounts. However, we may want to consider increasing this limit, to maximise the propagation speed.
Thanks to szisti for tracking this one down.
3 years ago
CalDescent
a43993e3ec
Use placeholder build timestamp and build version when building without mvn package (e.g. from within an IDE)
...
This fixes an exception thrown when running directly in IntelliJ, as previously we relied on mvn package to parse the commit hash and timestamp.
3 years ago
CalDescent
bc6b3fb5f4
Include timestamps in block-timings.sh
3 years ago
CalDescent
df47f5d47b
Merge branch 'master' into sync-multiple-blocks
3 years ago
CalDescent
319e64bacc
Defend against an edge case NPE in the chat messages websocket.
3 years ago
CalDescent
ecf044bed1
Removed qortal-backup folder from git
3 years ago
CalDescent
76e1de38e8
Workaround for issue where sometimes an AT stays in "TRADING" mode even after it is marked as finished. This caused Bob's tradebot to enter BOB_REFUNDED mode instead of redeeming the LTC. This workaround treats "TRADING" as "REDEEMED" as long as the AT is finished. It will still enter the BOB_REFUNDED state if the AT's trade state is "REFUNDED" or "CANCELLED", to prevent it trying to redeem LTC without the secret. Longer term we need to prevent the AT itself from getting in this state to begin with, but this should at least solve the LTC redemption problem that occurs as a result.
3 years ago
CalDescent
1648a74ed7
Removed code which auto deletes trade bot data if it can't locate the AT after 24 hours. It's not a good idea to ever delete trade bot data, since it can contain private keys necessary to redeem or refund LTC. We have seen at least one instance of this where the trade bot data was deleted for an active trade. We still have the auto backup in these cases, so the keys are recoverable, but it's safest to avoid any auto deletions.
3 years ago
CalDescent
c63a7884cb
Limit to 10 untrimmed blocks per response, as they are larger than the trimmed ones.
3 years ago
CalDescent
cffbd41f26
Reduce memory allocations in onNetworkGetBlocksMessage
3 years ago
CalDescent
c443187d0b
Reduce log spam by logging the total number of expired unconfirmed transactions that are deleted, rather than each one individually. The individual deletion logs have been moved from INFO to DEBUG.
3 years ago